KL Divergence

Kullback-Leibler divergence - a measure of how one probability distribution differs from another.

This concept is essential for understanding machine learning fundamentals and forms a key part of modern AI systems.