3. Battery Point Lighthouse and Beach Battery Point Lighthouse may not seem like your classic lighthouse, but that doesn’t mean it should be missing from your list of things to do in Crescent City.