search-replaceability-validates-capacity-over-structure

IN derived (depth 8)

Created 2026-06-21T13:54:31+00:00 · Reviewed 2026-06-21T15:37:01+00:00

Game-playing's demonstration that explicit search can be complemented or replaced by sufficient model capacity suggests a pattern that may parallel the generative paradigm succession (Hopfield→Boltzmann→RBM→VAE→GAN→Diffusion) — in both domains, pragmatic selection appears to favor approaches that leverage increasing hardware capacity, though the game-playing evidence shows hybrid and pure neural paradigms remain viable depending on computational structure, and the generative succession is driven by a capability-adoption/displacement-before-resolution dynamic rather than a simple capacity-replaces-structure trajectory.

Justifications

SL — Game-playing (search→capacity) and generative modeling (structured→pragmatic) independently confirm capacity displacement of structure under hardware scaling.

Antecedents (all must be IN):

IN game-playing-validates-search-replaceability-by-capacity — Game-playing empirically demonstrates that explicit search (tree search, Monte Carlo methods) can be complemented or replaced by sufficient model capacity — AlphaGo combined deep neural networks with tree search, while a later transformer achieved grandmaster chess through pure static evaluation — suggesting that the search-vs-capacity tradeoff may be influenced by hardware-driven architecture selection, where increasing compute can reduce the need for explicit search, though both hybrid and pure neural paradigms remain viable depending on the game's computational structure.
IN generative-paradigm-churn-exemplifies-pragmatism-dynamic — The succession of generative paradigms (Hopfield → Boltzmann → RBM → VAE → GAN → Diffusion) is consistent with pragmatism's linked capability-and-crisis dynamic — each generation appears to have been adopted primarily for capability gains and displaced before its reliability limitations were fully resolved, suggesting that pragmatic selection contributes to both the rapid progress (each generation unlocking new applications) and persistent fragility (each generation carrying forward unresolved failure modes) characteristic of ML's evolution.

Dependents

These beliefs depend on this one:

IN capacity-systematically-displaces-structure-across-all-domains — Evidence from multiple ML domains — game-playing replacing explicit search with neural capacity, generative modeling's succession from structured to capacity-intensive architectures, and GPU-scalable neural networks displacing analytically elegant but non-parallelizable frameworks like SVMs — suggests a recurring pattern where hardware-driven capacity scaling favors architectures that trade structural understanding for raw capacity. This pattern appears across enough domains to indicate a broad tendency in ML evolution, though characterizing it as a universal law goes beyond what these specific cases establish.