nlp-validates-scalability-over-theory-selection

IN derived (depth 5)

Created 2026-06-21T10:30:35+00:00 · Reviewed 2026-06-21T15:37:01+00:00

NLP's paradigm trajectory provides partial independent support for hardware scalability as a primary factor in paradigm survival — the symbolic-to-statistical-to-neural succession and the RNN-to-LSTM-to-Transformer architectural evolution both correlate with hardware capability, though hardware-driven selection was one of several primary factors (alongside attention mechanisms and memory-parallelism tradeoffs) rather than the sole determinant, offering a domain-specific case consistent with the general pattern that scalability outweighs theoretical elegance.

Justifications

SL — NLP's independent paradigm trajectory provides domain-specific evidence confirming hardware-driven paradigm selection

Antecedents (all must be IN):

  • IN nlp-architecture-parallel-hardware-convergence — NLP's paradigm succession (symbolic → statistical → neural) and sequence modeling's architectural evolution (RNN → LSTM → Transformer) are parallel instances of broader ML paradigm succession patterns, and both converged on transformer-based deep learning in part because GPU-enabled parallelism selected for architectures with hardware-friendly parallel computation — though this hardware-driven selection was one of several primary factors alongside attention as a bridging mechanism and fundamental tradeoffs between memory range and parallelism, rather than the sole explanatory cause.
  • IN paradigm-survival-determined-by-scalability-not-theory — Mathematical completeness and theoretical elegance are neither necessary nor sufficient for paradigm survival in ML — GANs had the most complete analytical characterization yet were eclipsed by diffusion models, SVMs had convex guarantees yet were outscaled by neural networks, while theoretically less grounded approaches that scaled with hardware thrived.

Dependents

These beliefs depend on this one: