You might really benefit from counseling to help you deal with this incident. You obviously are still dealing with it, and you idea to just move seems like a way to run away instead of really tackling it. A counselor can really help with that.

It's turning into marital stife. Time to get some help. You may end up moving anyways, but you will more likely to make that decision after considering all the issues.

Best to you.