Zubnet AILearnWiki › Catastrophic Forgetting
Training

Catastrophic Forgetting

Catastrophic Interference
When a neural network trained on a new task loses its ability to perform previously learned tasks. Fine-tuning a model on customer support data might make it great at support but terrible at coding. The new learning overwrites the weights that encoded the old capabilities, "forgetting" them.

Why it matters

Catastrophic forgetting is the central challenge of fine-tuning and continual learning. It's why you can't just keep fine-tuning a model on task after task and expect it to do everything well. It's also why techniques like LoRA (which only modify a small subset of parameters) and careful learning rate selection are critical for preserving base model capabilities.

Deep Dive

The root cause is weight sharing: the same parameters encode multiple capabilities, and updating them for a new task disrupts the existing encodings. In a large neural network, knowledge isn't stored in dedicated neurons — it's distributed across the weights in complex, overlapping patterns (superposition). Modifying those weights for new knowledge inevitably disturbs old knowledge.

Mitigation Strategies

Several techniques reduce forgetting. Low learning rates during fine-tuning minimize weight changes. LoRA adds new trainable parameters while keeping the original weights frozen. Elastic Weight Consolidation (EWC) identifies which weights are important for old tasks and penalizes changes to them. Replay methods mix old task data into new task training. None fully solve the problem — there's always a trade-off between plasticity (learning new things) and stability (retaining old things).

The Continual Learning Dream

Continual learning (also called lifelong learning) is the research goal of building models that can keep learning from new data without forgetting old capabilities — the way humans do. Current LLMs sidestep this by training once on a massive dataset and then fine-tuning carefully. True continual learning remains an open problem and would be transformative: imagine a model that keeps learning from every conversation without degrading.

Related Concepts

← All Terms
← Cartesia Cerebras →