Police have charged an Ayer man who allegedly threw rocks and shouted a racial slur at a Black man and his daughter while they were fishing on Lake Shirley over Memorial Day weekend.