Young Jimmy's connection to a woman who worked and lived on his family farm helped shape his advocacy for decades to come, Jason Carter writes in a letter shared with PEOPLE Matt Winkelmeyer/Getty ...