The man being referred to is likely Philip Larkin, a real poet who it's implied the Doctor has met in person at some point. The quote, "What survives of us is love," is a fitting encapsulation of ...