PSGD (Preconditioned SGD) is a general purpose (mathematical and stochastic, convex and nonconvex ... product approximation with finite difference method when the 2nd order derivative is unavailable.