What is there to be mad about. If he heard everything, he heard his bf defend their relationship at every turn. If this becomes an issue that drags on I'll be pissed.
