ml-compute-300000x-alexnet-alphazero

IN premise — entries/2026/06/21/wiki-Machine_learning-chunk-6.md

Created 2026-06-21T09:55:51+00:00

OpenAI found a 300,000x increase in compute from AlexNet (2012) to AlphaZero (2017), with a doubling time of 3.4 months

Dependents

These beliefs depend on this one:

• IN compute-scaling-drove-dl-revolution — Compute scaling was a major factor in the deep learning revolution: OpenAI measured a 300,000x increase in compute from AlexNet (2012) to AlphaZero (2017), GPUs displaced CPUs as the dominant training hardware by 2019, and AlexNet's GPU-based ImageNet win helped catalyze the modern AI boom. Whether compute scaling was more important than algorithmic innovation is not established by these data points alone.
• IN compute-scaling-quantifies-structure-displacement-rate — The 300,000x compute increase from AlexNet to AlphaZero (doubling every 3.4 months) provides a quantitative measure for the rate at which capacity growth has accompanied the displacement of structured mechanisms. The observed pattern — where increases in compute coincide with replacement of components like tree search, handcrafted features, and symbolic rules by neural capacity — suggests that structure displacement operates as an exponential process, though the precise relationship between each order of magnitude of compute and specific structural replacements is an observed correlation rather than a confirmed causal law.