I think that maybe he must've found out from the evil step brother that the ML approached him with an ulterior motive, they must've said something to spook him I think
If you look at the 3 times that same kiss scene shows up, it doesn’t look like it was even seoin. (Chapters 1, 2, and 20 if I remember correctly). Seeing has a mole on his left side and two of those reoccurring kiss scenes don’t have the mole on his left side.
I am still waiting for the explanation why he kissed him then, that was the end line that drove yeonwoon (sorry for the spelling lol)away