Dragon may be an absent father, but he does care for Luffy, and that shows in his behavior. Dragon is simply torn between duty and family.