chomsky-resisted-data-driven-nlp
IN premise — entries/2026/06/21/wiki-Natural_language_processing-chunk-3.md
Created 2026-06-21T09:50:10+00:00
Chomsky's theoretical focus on corner cases and the 'poverty of the stimulus' argument actively discouraged the data-driven/statistical approaches that later proved successful in NLP
Summary
Chomsky's emphasis on rare edge cases and his argument that humans must have innate grammar rules created a cultural bias in the field against learning language patterns from large corpora of text. This matters because it suggests a decades-long delay in NLP progress, where a promising practical approach was held back not by technical limitations but by a philosophical position that the field eventually outgrew.
Dependents
These beliefs depend on this one:
- IN neural-nlp-revolution-overcame-institutional-resistance — The neural NLP revolution progressed from early evidence (Bengio 2003 neural LM beating n-grams) through institutional skepticism (2012 ACL tutorial) to dominance (2015), overcoming both Chomsky's theoretical opposition and established statistical methods.
- IN nlp-evolution-driven-by-three-resisted-paradigm-shifts — NLP's evolution toward modern LLMs involved three major paradigm shifts — from symbolic/rule-based to statistical methods (1990s), from statistical to neural/deep learning (achieving dominance by roughly 2015), and the emergence of attention/transformer architectures. The deep learning paradigm shift faced initial skepticism, as seen at Socher's ACL 2012 tutorial, before becoming dominant by 2015. Chomsky's theoretical focus on corner cases and the 'poverty of the stimulus' argument actively discouraged the data-driven approaches that later proved successful.