llm-fragmentation-inconsistency-strategyqa
IN premise — summaries/2026/08/24/xie-2024-chameleon-sloth-sA-appendix-chunk-1.md
Created 2026-08-25T02:58:59+00:00
When one side's evidence is split into fragments, LLMs shift their preference to the other intact side in 38.2% of cases on StrategyQA.
Summary
Breaking a source's evidence into smaller fragments can tip an LLM toward the competitor's intact presentation roughly two-fifths of the time, meaning the format in which information is delivered can sway the model's judgment independent of the content itself. This matters because it exposes a manipulation surface: someone could game an LLM's reasoning simply by reformatting one side's evidence into pieces, without changing a single word.