Can't think of another explanation unless he hates the kid, or maybe the kid's not biologically his due to him being castrated for kiddy fiddling?