I think it makes sense. From what we know about nobles in this world, they seem to value power and money above all. Even our ML is the same way--I wouldn't be surprised if he's more used to using his power to intimidate than to actually TALK to someone.
Does his brain also shrinks every time he turns into a child? He kinda dumb..