Isekai Truck's feed

Why did Hariya think that he needed to leave Suga to not hurt him or whatever? Like was he saying that he would ruin his image as an actor if they found out he was in a gay relationship?