rome-edit-time-2s-a6000

IN premise — summaries/2026/08/24/meng-2022-rome-sR-references-chunk-2.md

Created 2026-08-25T02:58:17+00:00

ROME's total edit time is approximately 2 seconds on an NVIDIA A6000 GPU for GPT-2 XL, compared to ~100ms inference for hypernetwork methods that require hours-to-days of training.

Summary

ROME can fix a model's behavior in roughly two seconds on a high-end GPU, so a single edit is essentially instantaneous from a user's perspective. The practical upshot is that this one-shot cost is far cheaper to deploy than alternative methods that are quicker per query but require hours or days of dedicated training before they can even be used.