memit-iclr-2023-gptj-gptneox

Summary

MEMIT is a peer-reviewed method for editing the knowledge stored inside a language model, validated at a top-tier machine learning conference in 2023. It was tested on two mid-sized open-source models (6B and 20B parameters), showing the technique works beyond tiny toy models but within a practical range of model sizes.