Side effects of horny goat weed may include upset stomach, dry mouth, nosebleeds, dizziness, and rapid heartbeat. Horny goat weed can also have adverse effects when taken with other medications ...