- Dataset ✓ understood
A collection of data examples used for training, validating, or testing machine learning models.
- Training Data ✓ understood
The examples a model learns its weights from, kept separate from the validation and test data used to check how well it generalizes.
- Overfitting ✓ understood
When a model fits its training data too closely, noise included, so it scores well on examples it has seen and poorly on new ones.
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Supervised Learning ✓ understood
Learning from examples paired with the correct answer, so a model can predict answers for new inputs it hasn't seen.
- Training ✓ understood
The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.
- Loss Function ✓ understood
A function that scores how wrong a model's prediction is as a single number, which training then works to make as small as possible.
- Empirical Risk Minimization ✓ understood
The principle of choosing a model that minimizes error on training data, fundamental to supervised learning.
- PAC Learning ✓ understood
Probably Approximately Correct - a theoretical framework for analyzing learning algorithm guarantees.
- Rademacher Complexity · you are here ✓ understood