He married Sarah Hart Shumway on October 15, 1855, and the following year saw the birth of their first child, Edgar. A second son, William, was born in 1859.