compute-scaling-self-undermining-on-two-fronts

IN derived (depth 12)

Created 2026-06-21T14:15:26+00:00 · Reviewed 2026-06-21T15:37:01+00:00

ML's compute-driven capability scaling is self-undermining on two independent fronts — it displaces structured mechanisms with raw capacity (300,000x scaling systematically replacing search, theory, and domain expertise) while simultaneously contaminating the data ecosystem required for further scaling (capable models flood the internet with synthetic content, triggering model collapse) — meaning the compute revolution destroys both the intellectual and material substrates on which its own continuation depends.

Justifications

SL — Compute scaling destroys intellectual substrates (displacing structure) and material substrates (contaminating data) independently — two self-undermining feedback loops within the same scaling trajectory.

Antecedents (all must be IN):

IN compute-scaling-quantifies-structure-displacement-rate — The 300,000x compute increase from AlexNet to AlphaZero (doubling every 3.4 months) provides a quantitative measure for the rate at which capacity growth has accompanied the displacement of structured mechanisms. The observed pattern — where increases in compute coincide with replacement of components like tree search, handcrafted features, and symbolic rules by neural capacity — suggests that structure displacement operates as an exponential process, though the precise relationship between each order of magnitude of compute and specific structural replacements is an observed correlation rather than a confirmed causal law.
IN compute-revolution-contaminates-own-data-supply — The 300,000x compute increase that drove ML's capability revolution simultaneously creates the conditions for model collapse — massive compute enables training on internet-scale data that produces capable models, but those capable models flood the internet with synthetic content, contaminating the very data ecosystem that enabled the scaling in the first place.