Well, yes, there reaches a point where that can be the case, but the original scumbag in question did not seem to be anywhere near that point with his wife, but was routinely cheating on her anyway.
Also, once you've been with a person for long enough, in most cases you can make choices that determine whether or not you can stand to be in the same room with each other.