bengio-2003-first-modern-neural-language-model

OUT premise — summaries/2026/08/24/wiki-Natural_language_processing-chunk-3.md

Created 2026-08-24T17:11:19+00:00

Bengio et al. (2003) introduced the neural probabilistic language model, and Mikolov et al. (2010) extended it to RNN-based language models, forming the direct lineage preceding the Transformer era.