hardware-economics-primary-selection-pressure
IN derived (depth 5)
Created 2026-06-21T10:16:38+00:00 · Reviewed 2026-06-21T15:37:01+00:00
Hardware economics is a primary selection pressure in ML's evolution — co-evolution with theory shapes choices from macro architecture decisions to micro implementation tradeoffs, and paradigm survival correlates more strongly with scalability than with theoretical completeness, suggesting that compute availability significantly shapes what ML becomes, alongside but often outweighing mathematical insight.
Justifications
SL — Both depth-4 chains converge on hardware as the governing force — one from architecture co-evolution, the other from paradigm survival — unifying them reveals hardware economics as THE selection pressure
Antecedents (all must be IN):
- IN hardware-theory-coevolution-governs-all-scales — ML's trajectory has been significantly shaped by hardware-theory co-evolution at multiple scales — the macro deep learning revolution required convergence of bio-inspired architectures, mathematical foundations, and GPU compute (all three becoming available around 2012), while the micro-level sequence modeling arc (RNN→LSTM→Transformer) tracked a CPU→GPU hardware shift that favored parallelizable architectures, suggesting hardware availability is a major factor in selecting among theoretically viable approaches.
- IN paradigm-survival-determined-by-scalability-not-theory — Mathematical completeness and theoretical elegance are neither necessary nor sufficient for paradigm survival in ML — GANs had the most complete analytical characterization yet were eclipsed by diffusion models, SVMs had convex guarantees yet were outscaled by neural networks, while theoretically less grounded approaches that scaled with hardware thrived.
Dependents
These beliefs depend on this one:
- IN game-playing-validates-search-replaceability-by-capacity — Game-playing empirically demonstrates that explicit search (tree search, Monte Carlo methods) can be complemented or replaced by sufficient model capacity — AlphaGo combined deep neural networks with tree search, while a later transformer achieved grandmaster chess through pure static evaluation — suggesting that the search-vs-capacity tradeoff may be influenced by hardware-driven architecture selection, where increasing compute can reduce the need for explicit search, though both hybrid and pure neural paradigms remain viable depending on the game's computational structure.
- IN ml-evolution-economic-not-intellectual — ML's evolution follows an economic rather than intellectual trajectory — biology seeds the architectural design space with initial intuitions (receptive fields, gating, reward signals) but hardware economics determines which survive, meaning Moore's law and GPU economics shape the field more than neuroscience or mathematical insight.
- OUT svm-revival-possible-with-modern-hardware — SVMs could experience a paradigm revival if modern specialized hardware eliminated their scaling bottleneck — their mathematical completeness (convex optimization, kernel theory, global optimality guarantees) would transform from a liability into an asset if hardware economics no longer selected against them.
- IN theory-practice-misalignment-economically-sustained — ML's comprehensive theory-practice misalignment is economically self-perpetuating — hardware economics selects for scalable architectures regardless of theoretical soundness, removing the commercial incentive to resolve fundamental gaps and creating a stable equilibrium where ML advances commercially despite deepening theoretical deficits.