mquake-evaluation-edit-sizes

IN premise — summaries/2026/08/24/zhong-2023-mquake-s3-mq-uake-multi-hop-question.md

Created 2026-08-25T02:59:06+00:00

MQuAKE grouped-edit evaluation uses k ∈ {1, 100, 1000, 3000} for MQuAKE-CF and k ∈ {1, 100, 500, 1868} for MQuAKE-T

Summary

MQuAKE evaluates edits in fixed-size groups, testing four specific group sizes per variant (up to 3000 for the CF variant and 1868 for the T variant). This locks in the resolution at which edit performance is measured, so any comparison or trend analysis is limited to those discrete batch sizes rather than a continuous range.