Remove the cover plate. If the gap between the electrical box and the drywall is less than 1/4 in., fill it with acrylic latex caulk. If the gap is bigger and lopsided, use foam sealant that’s ...