Training & Optimization

Gradient Checkpointing

Trading computation for memory by recomputing activations during backprop instead of storing them.

This concept is essential for understanding training & optimization and forms a key part of modern AI systems.

  • Memory Efficiency
  • Training
  • Backpropagation

Tags

training-optimization memory-efficiency training backpropagation

Related Terms

Backpropagation

The algorithm for computing gradients of the loss with respect to network weights, enabling training through gradient descent.

Training

The process of teaching a machine learning model by adjusting its parameters based on data to minimize prediction errors.

Added: November 18, 2025

← Back to All Terms