context-write-unbounded-complement
OUT derived (depth 6)
Created 2026-08-25T03:10:25+00:00 · Reviewed 2026-08-25T04:02:18+00:00
The context window functions as the unbounded write channel that complements the rank-one parametric write: where parametric editing is confined to a single MLP's addressable subspace, the context channel injects arbitrary quantities of verified knowledge, making the two write channels capacity-complementary rather than redundant.
Justifications
SL — The boundary defines what parametric write cannot do; the ephemeral edit shows what context write achieves; faithfulness validation confirms context is genuinely read (not re-ranked). All three are load-bearing for the complementarity claim.
Antecedents (all must be IN):
- OUT context-window-ephemeral-edit — The long-context window with near-perfect in-context key-value retrieval functions as an ephemeral, weight-free knowledge editing mechanism: injecting a fact into the 200K-token context is functionally equivalent to a rank-one edit that bypasses the parametric write subspace, providing a complementary write channel with zero persistence cost.
- OUT parametric-write-subspace-boundary — The operational boundary between parametric recall and contextual retrieval is precisely the geometric boundary of the rank-one addressable subspace: facts whose subject-key projection aligns with the locally-stored key covariance are parametrically editable, while facts outside this subspace must be externally supplied.
- OUT knowledge-routing-faithfulness-validated — The parametric/contextual two-channel knowledge architecture is a genuine computational duality rather than a surface-level re-ranking bias, because retrieval context demonstrably inverts the parametric accuracy trend (accuracy increases with document relevance for rare facts) and BM25 recall remains robust independently of parametric scaling.
Dependents
These beliefs depend on this one:
- OUT context-as-infinite-dimension-complement — The context window is the operational realization of the "infinite" or "unbounded" dimension in the superposition framework: while the d-dimensional residual stream is over-compressed to store N≫d features (necessitating covariance whitening for well-defined read/write operations), the context window provides an unbounded, interference-free channel where knowledge is injected without superposition, without the need for C⁻¹k* addressability, and without the rank-one constraint—making it the architectural complement to the finite, superposed parametric memory.
- OUT context-extends-semantic-currency-to-infinite-dimension — The context window extends the "universal semantic currency" (covariance geometry) into an effectively unbounded-dimensional space, making the full LLM read/write system a finite-dimensional-plus-infinite-dimensional geometric object rather than a purely finite one.
- OUT knowledge-routing-as-geometric-gate — The parametric/contextual knowledge routing is a geometric gate based on subspace membership rather than a statistical frequency heuristic: the model routes to parametric recall when the fact direction lies within the rank-one addressable subspace, and to contextual retrieval when it does not, with the faithfulness validation (accuracy scaling with document relevance) as the empirical confirmation that the gate responds to geometry, not statistics.
- OUT three-tier-memory-architecture — The LLM implements a three-tier memory architecture: broad superposition-based read, narrow rank-one parametric write confined to the covariance-whitened addressable subspace, and unbounded contextual write via the context window—with the geometric boundary of C⁻¹k* defining the precise demarcation between parametric and contextual regimes.