gpt2-1-5b-parameters-restricted-release-nov-2019
IN premise — summaries/2026/08/24/wiki-Generative_pre-trained_transformer-chunk-2.md
Created 2026-08-24T17:11:11+00:00
GPT-2 (Radford et al., 2019) has 1.5 billion parameters; it was initially released under restricted terms and fully released in November 2019.
Summary
GPT-2 is a 1.5-billion-parameter language model that OpenAI initially kept under tight access controls out of concern people would use it to generate harmful content, but it was opened to the public in November 2019. This matters because it established a precedent for a very large model transitioning from a gated research artifact to a broadly available resource, reshaping how the community builds on top of frontier-scale architectures.