The book’s vocabulary

Agent memory benchmarks

Tests for what a saved claim does after the conversation ends.

From The World That Agrees With You1 section of the book1 related post

Controlled tests of what a saved claim does afterward. “Agents Don’t Just Agree, They Remember” separates a conversation that can write durable state from a later query and asks whether the claim returns with greater authority or wider scope; its named failure patterns are lost attribution and upgraded claims.

LongMemEval asks whether the assistant uses a correction — or declines to answer when the record is insufficient. MemSyco-Bench asks when memory should influence a decision at all. Run them as questions against your own setup: add an incorrect test memory, supply a correction, start another session, and inspect what comes back.

Definition from The World That Agrees With You: Understanding and Managing Sycophancy in the Age of AI, by Timothy O’Brien. © 2026 Timothy O’Brien. All rights reserved.

In the book

See also

  • Memory stores
  • Checked versus reported
  • Correction