Zubnet AILearnWiki › Positional Encoding
Fundamentals

Positional Encoding

Positional Embedding, RoPE, ALiBi
A mechanism that tells a Transformer model the order of tokens in a sequence. Unlike RNNs which process tokens sequentially (so position is implicit), Transformers process all tokens in parallel and have no inherent sense of order. Positional encodings inject position information so the model knows that "dog bites man" and "man bites dog" are different.

Why it matters

Without positional information, a Transformer treats a sentence as a bag of words — word order is lost. The choice of positional encoding also determines how well a model handles sequences longer than those seen during training, which is why techniques like RoPE and ALiBi are critical for long-context models.

Deep Dive

The original Transformer (2017) used fixed sinusoidal functions at different frequencies for each position and dimension. These had a nice theoretical property: the model could learn to attend to relative positions because the sinusoidal patterns create consistent offsets. But learned positional embeddings (a trainable vector for each position) quickly became the default because they performed slightly better, despite being limited to the maximum training length.

RoPE: The Modern Standard

Rotary Position Embeddings (RoPE, Su et al., 2021) encode position by rotating the query and key vectors in the attention mechanism. The angle of rotation depends on position, so the dot product between two tokens naturally encodes their relative distance. RoPE is used by LLaMA, Mistral, Qwen, and most modern LLMs. Its key advantage: it enables length extrapolation — models can handle sequences somewhat longer than those seen during training, especially when combined with techniques like YaRN or NTK-aware scaling.

ALiBi and Beyond

ALiBi (Attention with Linear Biases) takes a simpler approach: instead of modifying embeddings, it adds a linear penalty to attention scores based on distance between tokens. Farther tokens get penalized more. This requires no learned parameters and extrapolates well to longer sequences. Some architectures combine approaches or use relative position biases. The trend is toward methods that generalize beyond the training length, since context windows keep growing.

Related Concepts

← All Terms
← Pooling Pre-training →