engineering.fm
Episode 02How it's builtOct 2Published

How an LLM generates one token

The math behind the single next word a language model picks.

Signature animationProbability bars collapsing into a single token