When he left The White House in 1817, Madison and his wife Dolley returned to his Virginia plantation, named Montpelier. There he supervised plantation operations, which included slavery. Madison was ...