My interpretation is:
The guy has always been timid, quiet and to himself ( maybe even a little girlish. ). So women tend to pick on him because of those qualities? Thus leading to the fight with his guy friend. Maybe he told everyone around him they wasnāt friends because he didnāt want them to start bullying his friend like that did him. The girl was okay because I think the girls naturally feared her ( maybe from childhood ) for the years leading up to when they currently was in high school.
Honestly if someoneās scared of an entire gender because of a few bullies from their childhood, then they need therapy. I feel like the author couldāve given his character a more specific fear rather than just being scared of all women, or at least a more reasonable trauma to excuse his fear. And Iām not just saying this out of a place of ignorance, this is coming from someone who was bullied their entire life for being autistic and queer.
this manga is so cute but i still dont understand why was he scared of women???? is it bc he was bullied/attacked when he was young?? but wasn't the fight with his guy friend?? they didn't go to much into that part of the story, i was expecting a better explanation ngl