Knowledge Editing

121 beliefs (121 IN, 0 OUT)

Knowledge editing addresses the problem of modifying specific factual associations stored in large language models without retraining or degrading unrelated knowledge. This matters because LLMs encode vast amounts of world knowledge parametrically, and errors or outdated facts persist in their outputs unless targeted interventions are applied. The belief set under this topic spans the core editing methods (ROME, MEMIT, MEND, ICE, MeLLo, fine-tuning), the benchmarks designed to evaluate them (RIPPLE EDITS, MQuAKE, COUNTERFACT), the mathematical machinery behind parametric edits, and the fundamental limitations that constrain what can be edited and how reliably knowledge propagates beyond the edited fact.

The central finding across the beliefs is a tension between editing efficacy at the target fact and the model's ability to preserve or propagate logically related knowledge. ROME performs a rank-one weight update to a single mid-layer MLP (rome-rank-one-update-formula, rome-rank-one-weight-update-layer-9), achieving roughly 99 to 100 percent efficacy on the edited fact while maintaining 75 to 79 percent neighborhood specificity (rome-quantitative-benchmark-results). MEMIT extends this to multi-layer batch edits across a range of feedforward layers (memit-multi-layer-batch, memit-targets-mlp-layers-not-attention) and scales to 10,000 simultaneous edits (memit-10k-edit-scores-cOUNTERFACT). Yet both methods show dramatic multi-hop degradation: ROME-edited GPT-J drops from 40.5 percent to 7.4 percent on MQuAKE-CF (rome-gptj-mquake-cf-multi-hop-drop), MEMIT-edited Vicuna-7B drops from 30.2 percent to 4.9 percent (vicuna7b-memit-multi-hop-drop), and fine-tuning is even more catastrophic at just 1.4 percent versus 39.5 percent for the unedited model (ft-catastrophic-mquake-cf-multipath). Paradoxically, a simple prompt-based in-context editing method (ICE) outperforms all dedicated parametric methods on the RIPPLE EDITS benchmark (c2023-in-context-editing-best-ripple-edits, in-context-editing-outperforms-ke), and ICE outperforms ROME by more than 29 points on LLaMA (ripple-edits-ice-outperforms-rome). This suggests the parametric editing machinery introduces more collateral damage than it repairs, consistent with the finding that in at least 68 percent of failure cases the model produces noise or abstention rather than simply retaining the original answer (c2023-ripple-edits-erroneous-change-rate, ripple-edits-error-taxonomy-noise-dominant).

All beliefs in this topic are IN (affirmed); none have been retracted. A key structural distinction separates premises from derived conclusions: the mathematical definitions of ROME's closed-form solution (rome-lambda-closed-form-solution), MEMIT's core update equation (memit-core-update-equation), and the benchmark construction rules (mquake-chain-construction-rule, mquake-cf-conflict-free-subject-relation) serve as axiomatic foundations, while the multi-hop failure results and the 68-percent-noise finding are empirical conclusions derived from applying those methods to those benchmarks. The belief set also draws an important boundary: the linear-subspace assumption underlying ROME and MEMIT limits them to directional entity-relation-object factual triples (memit-limited-directional-relations, rome-scope-limitation), and this same assumption is identified as the shared root cause of why neither can encode non-linear constraints like part-whole relations (linearity-boundary-of-geometric-framework). Additionally, the benchmarks themselves have different scopes: RIPPLE EDITS covers only the 1-to-2-hop close neighbourhood of an edit (c2023-ripple-edits-scope-1-to-2-hop, ripple-edits-2hop-scope), while MQuAKE evaluates multi-hop chains of 2 to 4 triples (mquake-dataset-3000-instances-2-4-hop, c2023-mquake-multi-hop-ke), and white-box gradient-based methods are distinguished from black-box prompting approaches like MeLLo (mquake-whitebox-blackbox-distinction).

The broader implications captured in these beliefs point to a structural problem. Evidence suggests LLMs maintain at least two distinguishable knowledge pathways—a parametric channel amenable to targeted weight editing and a contextual channel in which retrieved passages alter accuracy patterns in ways that invert closed-book trends (parametric-contextual-knowledge-duality-v2)—but the available evidence does not establish full functional independence between them. Knowledge editing side effects are now recognized as one of three causes of intra-memory conflict, alongside training corpus bias and decoding strategy effects (im-three-causes-pipeline-stages), and editing methods like ROME and MEMIT have been shown to create new intra-memory conflicts and increase hallucination as a side effect (ke-creates-im-and-increases-hallucination). The practical consequence is that current parametric editing methods, while effective at the target fact, systematically degrade the model's ability to reason over interconnected knowledge, raising serious questions about whether weight-level modification is the right mechanism for maintaining coherent world knowledge in large language models.