kandpal-causal-relationship-documents-accuracy
IN premise — summaries/2026/08/24/kandpal-2023-long-tail-knowledge-s0-abstract.md
Created 2026-08-25T02:58:05+00:00
The relationship between pre-training relevant-document count and QA accuracy in Kandpal et al. is both correlational and causal, verified by manipulating pre-training data.
Summary
Kandpal et al. didn't just notice that more relevant pre-training documents tend to go alongside better question-answering scores; they actually changed the pre-training data and confirmed the accuracy moved as a result. This matters because it means the system can treat "more relevant documents leads to better answers" as a reliable cause-and-effect rule, not a coincidence that might break under different conditions.