context-as-infinite-dimension-complement
OUT derived (depth 7)
Created 2026-08-25T03:11:44+00:00 · Reviewed 2026-08-25T03:24:16+00:00
The context window is the operational realization of the "infinite" or "unbounded" dimension in the superposition framework: while the d-dimensional residual stream is over-compressed to store N≫d features (necessitating covariance whitening for well-defined read/write operations), the context window provides an unbounded, interference-free channel where knowledge is injected without superposition, without the need for C⁻¹k* addressability, and without the rank-one constraint—making it the architectural complement to the finite, superposed parametric memory.
Justifications
SL — The "infinite dimension" interpretation requires both the unbounded complement (establishing the context window as the unbounded channel) AND the superposition triangle (establishing why the parametric channel is finite and constrained); together they show the context window is not an ad-hoc addition but the necessary completion of the finite superposed memory system.
Antecedents (all must be IN):
- OUT context-write-unbounded-complement — The context window functions as the unbounded write channel that complements the rank-one parametric write: where parametric editing is confined to a single MLP's addressable subspace, the context channel injects arbitrary quantities of verified knowledge, making the two write channels capacity-complementary rather than redundant.
- OUT superposition-covariance-editability-triangle — Superposition, covariance whitening, and rank-one editability form a closed logical triangle in which each property necessitates the others: over-complete superposition requires covariance separation for feature addressability, covariance separation defines the geometric space in which rank-one updates are well-defined, and the boundedness of rank-one editing confirms the addressable space is finite.
Dependents
These beliefs depend on this one:
- OUT context-trend-as-geometric-convergence-in-practice — The industry trajectory of expanding context windows (200K tokens), agentic tooling, and multi-hour autonomous runs is the operational convergence toward the theoretically-predicted "complete" semantic space: as the unbounded write channel grows, the parametric/contextual duality becomes a matter of degree rather than kind, empirically confirming the geometric prediction that the full d-dimensional space is the union of both channels.
- OUT three-tier-architecture-completeness — The three-tier memory architecture (broad superposition read, narrow parametric write, unbounded context write) constitutes a complete and faithful model of LLM knowledge management