A man accused of trying to sexually assault a woman on a New York City subway Thursday was arrested years ago for allegedly attacking a toddler, a Westchester County father says.