You can find caves scattered all throughout the map throughout your travels. They look like large rocky structures with a hole in one side in the overworld, and like a small mountain on your map.