mquake-7-heuristic-constraints
IN premise — summaries/2026/08/24/zhong-2023-mquake-sR-references-chunk-1.md
Created 2026-08-25T02:59:07+00:00
Wikidata fact-chain sampling in MQuAKE uses 7 heuristic constraints including no circular chains, no repeated relations, country objects only in last two hops, ≤3 object types, and specific subject requirements for headquarters/capital relations.
Summary
When MQuAKE builds multi-hop fact chains from Wikidata for evaluation, it applies a small set of practical rules — like forbidding loops, capping the number of distinct entity types, and restricting where country entities can appear — to keep the chains structurally sensible and diverse. This matters because without those guardrails, the generated test cases would collapse into repetitive or circular patterns that don't meaningfully stress-test a system's reasoning ability.