The skip-gram objective maximizes the probability of observed context words given a center word, over the whole corpus:
Layer 4 · Foundations
Embeddings
The formal skip-gram objective, negative sampling, and why embedding geometry captures linear semantic relationships.
15 min read180 XP