A comprehensive reference sheet for graduate students summarizing key optimization algorithms, including Vanilla Gradient Descent, Momentum, Nesterov Accelerated Gradient, and AdaGrad. Includes a troubleshooting table for common convergence issues.

Similar Materials