The Runtime Theory

topic / lexing-and-parsing

Lexing and Parsing

Turn source characters into a structured program representation.

Explore tokenization, grammars, operator precedence, syntax trees, error recovery, source locations, and the boundary between syntax and meaning.

1 article · 1 video · 1 trace · 1 request flow · 1 interview · 5 total

Articles

lexing and parsingSep 25, 2026

How a Parser Turns Tokens Into Structure

A lexer groups characters into tokens such as identifiers, numbers, and punctuation.

Request Flows

request flow · 5 stagesHow How a Parser Turns Tokens Into Structure worksAn interactive concept flow for how a parser turns tokens into structure, from its assumptions through the main operation and boundary checks.

Videos

lexing and parsingSep 25, 2026

Video lesson: How a Parser Turns Tokens Into Structure

Recording brief and narration plan for a visual lesson on how a parser turns tokens into structure.

Traces

trace 01 · runtimeTrace: How a Parser Turns Tokens Into StructureFollow the key state changes and boundary checks involved in how a parser turns tokens into structure.

Interviews

medium · t2Explain How a Parser Turns Tokens Into StructureExplain the model, execution steps, complexity, and limits of how a parser turns tokens into structure.

Explore adjacent

programming language internals

New lessons by email

Get new explanations about lexing and parsing and related systems in your inbox.

One technical dispatch per week. No noise.