Potential Side Effects. Suppositories are generally safe to use, but certain issues can arise. For example, you may experience leakage while the suppository dissolves in your body.