rome-lambda-closed-form-solution

IN premise — summaries/2026/08/24/meng-2022-rome-sR-references.md

Created 2026-08-25T02:58:17+00:00

The ROME edit vector Λ is given by the closed-form solution Λ = (v* − Wk*) / ((C⁻¹k*)ᵀk*), obtained by solving the 2×2 block system from the Lagrangian.

Summary

The ROME knowledge-edit is computed with a single direct formula rather than an iterative optimization loop, so the system applies the correction in one deterministic step. This means the edit is exact and reproducible given the model's current weights and the target fact, with no convergence risk or hyperparameter sensitivity to worry about.