Neural Networks & Deep Learning
Weight Normalization
Reparameterizing weight vectors to improve optimization by decoupling magnitude from direction.
This concept is essential for understanding neural networks & deep learning and forms a key part of modern AI systems.
Related Concepts
- Normalization
- Optimization
- Training
Tags
neural-networks-deep-learning normalization optimization training
Related Terms
Normalization
Scaling features to a standard range (typically 0-1 using min-max scaling) to improve model training and convergence. Often used interchangeably with standardization (mean=0, std=1), though technically distinct.
Training
The process of teaching a machine learning model by adjusting its parameters based on data to minimize prediction errors.