Entropy

A measure of uncertainty or randomness in a random variable from information theory.

This concept is essential for understanding machine learning fundamentals and forms a key part of modern AI systems.