There are three possible reasons I could think of. The first thing that came to mind while reading your post is to check your attachment style. You could be avoidant(??) based on you wanting to be with him but also wanting to leave. I recommend to look it up, youll learn more about yourself in terms of relationships.
The second thing is probably a......