my guess: ML and FL got kidnapped or something when they were young. he's older so he remembers her. Kidnapping probs resulted in the scar and POSSIBLY could explain his absentee father. I think he blames himself for it and that's why he rejected her. Also explains the father's overprotectiveness.
Ahhhhhhh missing reading this type of manga.