popqa-diversity-cap-2000-per-relation

IN premise — summaries/2026/08/24/mallen-2023-when-not-to-trust-sA-appendix.md

Created 2026-08-25T02:58:12+00:00

POPQA enforces a diversity cap of 2000 triples per relation type

Summary

The POPQA dataset is deliberately limited so that no single kind of relationship (like "is a type of" or "is located in") can account for more than 2,000 entries. This keeps the test spread across many different ways knowledge connects, so a system can't pass by just nailing a few common patterns.