Uhm so...his brother raped him? Or i got it wrong?

As far as I remember, he tries to force Heun. It was said in the earlier chapters where the brother blames him for "having a body that attracts men" or something like that ¯_ಠ_ಠ_/¯

Yep, he does