parametric-contextual-knowledge-duality

OUT derived (depth 1)

Created 2026-08-25T03:00:40+00:00 · Reviewed 2026-08-25T04:28:09+00:00

LLMs maintain two functionally independent knowledge channels: parametric (editable via ROME's rank-one weight update) and contextual (supplied via retrieved passages that invert accuracy trends), which operate on separate mechanisms and can be independently manipulated.

Justifications

This belief has 2 justifications — it is IN if any one holds.

SL — ROME achieves 99–100% single-fact efficacy through weight modification; Kandpal shows providing the same fact in context flips accuracy from below to above human level. These are orthogonal knowledge-access axes that can be independently targeted.

Antecedents (all must be IN):

  • IN rome-quantitative-benchmark-results — On COUNTERFACT, ROME achieves ~99–100% efficacy and ~75–79% neighborhood specificity, while fine-tuning achieves 100% efficacy but only ~10–40% specificity.

Unless (any of these IN defeats this justification):

  • IN parametric-contextual-knowledge-duality-v2 — Evidence suggests LLMs exhibit at least two distinguishable knowledge pathways: a parametric channel amenable to targeted editing via ROME's rank-one weight update (achieving ~99–100% efficacy with ~75–79% neighborhood specificity, in contrast to fine-tuning's 100% efficacy but only ~10–40% specificity), and a contextual channel in which retrieved passages alter the accuracy–rarity relationship (accuracy increases with relevant document count, inverting the closed-book trend). These pathways display distinct behavioral profiles and appear to be amenable to different manipulation strategies, though the available evidence does not establish full functional independence or confirm that they rely on entirely separate internal mechanisms.
SL — ROME achieves 99–100% single-fact efficacy through weight modification; Kandpal shows providing the same fact in context flips accuracy from below to above human level. These are orthogonal knowledge-access axes that can be independently targeted.

Antecedents (all must be IN):

  • IN kandpal-2023-retrieval-inverts-accuracy-trend — When retrieval-augmented context is provided, LM accuracy increases as relevant document count grows (matching human behavior), whereas closed-book accuracy decreases as rarity increases.

Unless (any of these IN defeats this justification):

  • IN parametric-contextual-knowledge-duality-v2 — Evidence suggests LLMs exhibit at least two distinguishable knowledge pathways: a parametric channel amenable to targeted editing via ROME's rank-one weight update (achieving ~99–100% efficacy with ~75–79% neighborhood specificity, in contrast to fine-tuning's 100% efficacy but only ~10–40% specificity), and a contextual channel in which retrieved passages alter the accuracy–rarity relationship (accuracy increases with relevant document count, inverting the closed-book trend). These pathways display distinct behavioral profiles and appear to be amenable to different manipulation strategies, though the available evidence does not establish full functional independence or confirm that they rely on entirely separate internal mechanisms.

Dependents

These beliefs depend on this one: