Arshad Siddiqui

Artificial Intelligence
Technology
Arabic
Recipe
Journeys & Jottings
- Post-Salah Duas
- Hello World!
About Me
Resume

Momentum-Based Learning

Momentum-Based Learning #

Momentum smooths updates and helps traverse valleys efficiently.

Home | Nonlinear Optimisation

Stochastic Gradient Descent (SGD) Adaptive Methods: AdaGrad, RMSProp, Adam