i think for a long time he had it ingrained into his brain that he had to be the perfect duke, thus he also needed an heir for that. however, after coming to love Chloe, he realized she is much more important than trying to be perfect and emotionless.
Maybe Alphones can't or don't want to a Child because of his abusive and mad father...