liu-2023-uuid-key-value-task
IN premise — summaries/2026/08/24/liu-2023-lost-in-middle-s2-multi-document-question-answering.md
Created 2026-08-25T02:58:08+00:00
The synthetic key-value retrieval task uses random 128-bit UUIDs as keys and values in a serialized JSON object to eliminate natural-language semantics as a confounder.
Summary
This is a deliberately meaningless memory benchmark: the system is asked to store and recall random strings that carry no linguistic or conceptual content at all, so that any success or failure reveals purely the raw retrieval mechanism and is never contaminated by the model's ability to "understand" the words. It isolates one narrow skill from everything else the model can do.