It's my interpretation of course but I feel like "the ghost" is a parent member of Jaekyung that told him all of this when he was young. I also think this is because of theses traumas he is always angry and didn't stop his matchs besides the risk. Like he thinks he is useless if he doesn't win and prove his worth to others. While this doesn't excuse his behavior at all, it could make the character more deep and make us readers connect a bit more with him even through he is, and will stay forever, a bastard of course...