Zubnet AILearnWiki › Word Embedding
Fundamentals

Word Embedding

Word2Vec, GloVe, Word Vectors
Dense vector representations of words where words with similar meanings have similar vectors. Word2Vec (2013) and GloVe (2014) pioneered this: they train on word co-occurrence patterns to produce vectors where "king − man + woman ≈ queen." Word embeddings were the precursor to modern contextual embeddings (BERT, sentence-transformers) and remain foundational to understanding how neural networks represent language.

Why it matters

Word embeddings were the breakthrough that made neural NLP practical. Before them, words were represented as one-hot vectors (no notion of similarity). Word embeddings proved that distributed representations could capture meaning, analogy, and semantic relationships. This insight — represent discrete symbols as learned continuous vectors — is the foundation of all modern language models.

Deep Dive

Word2Vec (Mikolov et al., 2013, Google) trains by either predicting a word from its context (CBOW) or predicting context from a word (Skip-gram). GloVe (Pennington et al., 2014, Stanford) factorizes the word co-occurrence matrix. Both produce similar results: 100–300 dimensional vectors where cosine similarity correlates with semantic similarity. These vectors capture remarkable relationships: countries map to capitals, verbs map to tenses, and analogies are solvable through vector arithmetic.

Static vs. Contextual

Word2Vec and GloVe produce one vector per word, regardless of context. "Bank" gets the same embedding whether it means "river bank" or "financial bank." Contextual embeddings (ELMo, then BERT) solved this by producing different representations depending on context. Modern sentence embeddings (from models like BGE, E5) go further, embedding entire sentences into vectors. Each generation improved on the last, but the core idea — meaning as a vector — started with Word2Vec.

The Legacy

Word2Vec's biggest contribution wasn't the algorithm but the demonstration that neural networks can learn useful representations of language from raw text. This proof of concept inspired the progression from word vectors to sentence vectors to contextual embeddings to full language models. The embedding layer of every LLM is a direct descendant of word embeddings: a lookup table mapping discrete tokens to learned continuous vectors, just at a much larger scale.

Related Concepts

← All Terms
← Weights & Biases World Model →