Why did he say he can't go to the hospital?

That's what I want to know

just a guess, but he probably also has some trauma with hospitals

True. Probably from the orphanage massacre incident which caused the trauma and memory loss