A priest at a church in West Memphis, Arkansas has been arrested in connection with a case involving two cats who police say appeared to have been drowned, city officials said Tuesday.