I agree with that.
But if a wife is unable to cope she can seek husband's permission and Insha'Allah ask for someone to speak to him. I have spoken to random husbands several times in that manner and they have known that their wives have provided me with the details.
Most men know very well that what they are doing is HARAM and do have Fear of Allah (SWT) in their hearts.