Training & Optimization
Nesterov Momentum
A momentum variant that looks ahead before computing gradients, often converging faster.
This concept is essential for understanding training & optimization and forms a key part of modern AI systems.
Related Concepts
- Momentum
- SGD
- Optimization
Tags
training-optimization momentum sgd optimization