You limit yourself to those two options because you want to ease your own conscience and convince yourself that what you are doing is in some way the right thing to do. How about a third option? Ever consider talking to your wife perhaps and perhaps fixing the damage you've mentioned??
I don't think a wife would see it that way. Total cop out and another another lie that married men tell themselves to ease their conscience. Laughable really when you think about it.