Mutual Information

A measure of dependence between variables, quantifying how much knowing one reduces uncertainty about the other.

This concept is essential for understanding machine learning fundamentals and forms a key part of modern AI systems.