Woh woh woh okay guys calm down. I know where you're all coming from but they're both in shock.
Not saying taeju's reaction isn't shitty but he was already drowning in guilt (as he should) so it's not surprising he feels what happened to euihyun and his child is his fault (it kinda is) and that he's a danger to them so he need to distance himself. Not the right move, but he's trying to hold accountable for once.
And anyway I trust our great MC to slap some sense into him u.u