It's because we mostly read trash bl manga (manwha, etc.) and have this very specific stereo type of feminine bottoms stuck in our head.
Tiny, feminine, infantilized, naive with no will of his own who needs constant rescue - with minimal alterations between BLs.
I think most readers don't even hate twinks. I find them hot, ngl I'm one of those fujo......
