The most important thing is to prioritize yourself first, if you’re uncomfortable then you need to communicate abt this to him. Maybe for starter you can ask, ‘Why are you calling me babe?’. After that you can see what’s going on and you can tell & explain to him how uncomfortable you are with his behavior.
I would say immediately ghost him......