mquake-tf-dataset-split-purpose
IN premise — summaries/2026/08/24/zhong-2023-mquake-s3-mq-uake-multi-hop-question.md
Created 2026-08-25T02:59:05+00:00
MQuAKE-CF tests propagation of artificial counterfactual edits (up to 4 per instance) while MQuAKE-T tests real temporal updates (exactly 1 per instance)
Summary
These two benchmark suites stress-test the system in fundamentally different ways: one checks whether it can untangle up to four hypothetical "what if" changes per question, while the other checks whether it correctly absorbs a single real-world fact that shifted over time. Together they tell you whether the system handles cascading hypothetical edits versus straightforward temporal corrections, which are separate failure modes.