Not his daughter and wife being spoiled brats, that poor man

Yeah, we can see it pains him to do this but it is absolutely necessary because he is smart enough to see reason as well as this will cause only trouble for his family is his daughter keeps up her arrogant act just because she is the Empress' niece.