memit-hardware-gpu-requirements

IN premise — summaries/2026/08/24/meng-2022-memit-sR-references.md

Created 2026-08-25T02:58:14+00:00

GPT-J (6B) runs MEMIT on a single NVIDIA A6000 (48 GB) GPU, while GPT-NeoX-20B requires at least two GPUs (one 48 GB for the model in fp16, one smaller for editing computation).

Summary

Running the MEMIT editing procedure is a single-GPU job for the smaller 6B model but becomes a multi-GPU job for the 20B model, meaning the system's hardware planning needs to treat those two model sizes as different tiers of cost and complexity rather than just a difference in scale.