rome-rank-one-weight-update-layer-9
IN premise — summaries/2026/08/24/zhong-2023-mquake-sR-references.md
Created 2026-08-25T02:59:08+00:00
ROME performs a rank-one weight update at layer 9 of the language model.
Summary
ROME fixes a single wrong fact in a language model by making a tiny, targeted tweak to the weights at one specific depth (layer 9), rather than retraining or broadly modifying the model. This matters because the edit is cheap and surgical, meaning the model can correct one piece of knowledge without risking damage to everything else it already "knows."