I hate memory plots

I think it was made so that he could see her under a new light. He probably saw her as a child all this time due to the time/way that they married and their big mental age gap at the time. So without the memory he can actually see her as a woman

Or he might thought that if he touched her he be like the other man who brought try to buy her with a debt