Standard 2 stops to get here · leads to 4
Weight
Learnable parameters connecting neurons in neural networks, determining the strength of connections.
Your route here
2 stops · basics first
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Neural Network ✓ understood
A computational model inspired by biological neural networks, consisting of interconnected nodes (neurons) organized in layers that process information through weighted connections.
- Weight · you are here ✓ understood
Where it sits
Before this
Neural Network Weight
Explore nearby
Neural Networks Parameter Learnable values (weights and biases) in a neural network that are adjusted during training to minimize loss. Neural Networks Bias A learnable offset added to neuron inputs, allowing the model to fit data that doesn't pass through the origin. Neural Networks Xavier Initialization A weight initialization strategy maintaining variance across layers, improving training of deep networks. Training Weight Decay A regularization technique that shrinks weights toward zero during optimization. Equivalent to L2 regularization in standard SGD, but differs when using adaptive optimizers like Adam. Neural Networks He Initialization Weight initialization designed for ReLU activations, preventing vanishing/exploding gradients in deep networks.