Training & Optimization

Cosine Annealing

A learning rate schedule following a cosine curve, smoothly decreasing the rate over training.

This concept is essential for understanding training & optimization and forms a key part of modern AI systems.

  • Learning Rate Schedule
  • Training
  • Optimization

Tags

training-optimization learning-rate-schedule training optimization

Related Terms

Learning Rate Schedule

A strategy for adjusting the learning rate during training (decay, warm-up, cosine annealing) to improve convergence.

Training

The process of teaching a machine learning model by adjusting its parameters based on data to minimize prediction errors.

Added: November 18, 2025

← Back to All Terms