agentic-memory-spans-three-temporal-levels

IN derived (depth 1)

Created 2026-06-21T11:28:04+00:00 · Reviewed 2026-06-21T14:41:08+00:00

Several techniques address memory coherence at different temporal scales in agentic LLM systems: Ghost Attention supports intra-turn consistency by concatenating system instructions to each user message (with loss zeroed on prompt tokens), Reflexion accumulates episodic 'lessons learned' across multiple attempts, and Dreaming (a May 2026 research preview) consolidates persistent memory between sessions by merging duplicates and removing stale entries — suggesting a pattern where different temporal horizons of agent continuity may benefit from distinct mechanisms.

Summary

Agent memory is not a single problem to solve but at least three separate ones: staying consistent within a single exchange, learning from repeated attempts at a task, and keeping long-term records tidy across sessions. Recognizing these as distinct temporal scales means a well-designed agent system needs purpose-built mechanisms for each horizon rather than one generic memory store handling all of them.

Justifications

SL — Three temporal memory levels with distinct mechanisms for agent continuity

Antecedents (all must be IN):

IN ghost-attention-multi-turn-consistency — Ghost Attention is a technique for multi-turn consistency that concatenates system instructions to each user message but zeros out loss on prompt tokens
IN reflexion-agent-episodic-memory — The Reflexion agent method uses episodic 'lessons learned' as long-term memory across multiple episodes
IN claude-dreaming-may-2026 — Dreaming is a May 2026 research preview feature for the Managed Agents API that consolidates persistent memory between sessions by merging duplicates and removing stale entries.

Dependents

These beliefs depend on this one:

IN complete-memory-hierarchy-bridges-capacity-and-persistence — LLM memory architecture appears to be developing along two orthogonal axes — horizontal capacity expansion (10,000x context window growth enabling richer intra-session memory) and vertical persistence (cross-session state consolidation enabling inter-session memory) — with at least three temporal levels (intra-turn ghost attention, inter-episode reflexion, cross-session dreaming) that may serve as bridging abstractions between the two, though whether these form a complete or unified hierarchy remains an open question.
IN memory-security-surfaces-expand-across-temporal-levels — The agentic memory architecture's three temporal levels — intra-turn consistency (ghost attention), inter-episode learning (reflexion), and cross-session persistence (dreaming) — likely introduce architecturally distinct security considerations that interact with the already-compounding security challenges from persistent state, suggesting a multi-dimensional attack surface where different temporal levels may require different defensive approaches.
OUT three-level-memory-enables-expertise-codification — Agentic memory spanning three temporal levels — combined with the field's craft knowledge being fundamentally experiential — could enable systematic codification of deployment expertise across sessions, potentially addressing the expertise scalability paradox by distributing experiential knowledge through persistent agent memory rather than requiring each practitioner to acquire it independently.