His “not with men” doesn’t sound like he’s straight… It sounds/looks like he’s dated a man before and it didn’t go well. Those implications are MUCH different