Zubnet AILearnWiki › Gradient Descent
Training

Gradient Descent

SGD, Stochastic Gradient Descent, Backpropagation
The algorithm that trains neural networks by iteratively adjusting parameters to reduce the loss function. It works by computing the gradient (the direction of steepest increase) of the loss with respect to each parameter, then moving each parameter a small step in the opposite direction (downhill). Backpropagation is the technique used to efficiently compute these gradients through the network's layers.

Why it matters

Gradient descent is the engine under the hood of all deep learning. Every model you use — every LLM, every image generator, every embedding model — was trained by gradient descent. Understanding it helps you understand training dynamics: why learning rate matters, why training can diverge or get stuck, and why modern optimizers like Adam work better than naive gradient descent.

Deep Dive

The full algorithm: (1) take a batch of training examples, (2) run them through the model to get predictions, (3) compute the loss, (4) use backpropagation to compute the gradient of the loss with respect to every parameter, (5) update each parameter by subtracting the gradient times a learning rate, (6) repeat. In practice, "stochastic" gradient descent (SGD) uses random mini-batches rather than the full dataset, which is both computationally necessary (the full dataset doesn't fit in memory) and beneficial (the noise from random batches helps escape local minima).

Adam and Modern Optimizers

Plain SGD is rarely used today. Adam (Adaptive Moment Estimation) maintains a running average of both the gradient and its squared magnitude for each parameter, effectively giving each parameter its own adaptive learning rate. Parameters with consistently large gradients get smaller updates (they're already well-calibrated), while parameters with small, noisy gradients get larger updates (they need more aggressive movement). AdamW adds weight decay for regularization. Most LLM training uses AdamW or variants.

The Learning Rate

The learning rate is arguably the single most important hyperparameter in training. Too high and the model overshoots the minimum, loss diverges, and training fails. Too low and training takes forever or gets stuck. Modern training uses learning rate schedules: start with a warmup phase (gradually increasing from near-zero), reach a peak, then decay (cosine annealing is common). The peak learning rate, warmup duration, and decay schedule all interact with batch size and model architecture. Getting this right is a significant part of training large models.

Related Concepts

← All Terms
← Gradient Checkpointing Groq →