AdaGrad

An optimizer that adapts learning rates for each parameter based on historical gradients, useful for sparse data.

This concept is essential for understanding training & optimization and forms a key part of modern AI systems.