The book’s vocabulary

Token

The unit models read and write: about three-quarters of an English word.

From The World That Agrees With You1 section of the book

The unit a model reads and writes: a whole word, a part of a word, or punctuation. OpenAI’s rough estimate for English is about three-quarters of a word per token.

A million-token window is therefore roughly 750,000 words — about ten books — before instructions, tool results, and conversation history take their share. Tokens are accounting units, not measures of meaning.

Definition from The World That Agrees With You: Understanding and Managing Sycophancy in the Age of AI, by Timothy O’Brien. © 2026 Timothy O’Brien. All rights reserved.

In the book

See also

  • Context window