Andover Township is a township in Sussex County, in the U.S. state of New Jersey. As of the 2020 United States census, the township's population was 5,996, a decrease of 323 from the 2010 census count of 6,319, which in turn reflected an increase of 286 from the 6,033 counted in the 2000 census.