Inside your home, the chimney sweep should check the refractory brick in the firebox itself and make sure that the flue damper is working properly.