convergence-inversion-persists-at-70b-open-question-at-400b
IN premise — summaries/2026/08/24/convergence-without-understanding-2026-s6-limitations.md
Created 2026-08-24T17:10:52+00:00
The difficulty inversion effect is measured at +0.062 at 70B parameters; behavior at 400B+ models (e.g., Nemotron-4 340B) is flagged as an open question.
Summary
A small performance inversion effect (harder problems getting relatively worse) was measured in 70-billion-parameter models, but we do not yet know whether that effect holds, shrinks, or flips in much larger 340B-plus models. This matters because any reasoning that assumes the trend continues past 70B is resting on an unverified assumption, so conclusions drawn at larger scales should be treated as provisional rather than settled.