generative-modeling-paradigm-succession
IN derived (depth 1)
Created 2026-06-21T10:06:02+00:00 · Reviewed 2026-06-21T15:37:01+00:00
Generative modeling has seen a significant shift: GANs, introduced in 2014, were largely supplanted by diffusion models (such as DALL-E 2 and Stable Diffusion) from approximately 2022 onward, particularly for text-to-image generation, suggesting that even widely adopted adversarial training frameworks can be overtaken by alternative approaches.
Justifications
SL — Historical succession from GANs to diffusion models as dominant generative paradigm
Antecedents (all must be IN):
- IN gan-introduced-goodfellow-2014 — Generative Adversarial Networks were introduced by Ian Goodfellow et al. in 2014
- IN diffusion-models-eclipsed-gans-2022 — Diffusion models (DALL-E 2, Stable Diffusion) eclipsed GANs for generative modeling from approximately 2022 onward
- IN diffusion-models-supplanted-gans-text-to-image — Latent diffusion models (Stable Diffusion, DALL-E) have largely supplanted GANs as the dominant approach for text-to-image generation tasks
Dependents
These beliefs depend on this one:
- IN dominant-paradigms-empirically-fragile-and-transient — The most successful ML paradigms are simultaneously dominant and fragile — pretrain-then-finetune is standard practice yet empirically hurtful in some transfer settings, GANs dominated generative modeling for years yet were displaced by diffusion — suggesting that current best practices are locally optimal recipes liable to succession rather than fundamental principles.
- IN theoretical-completeness-no-guarantee-of-paradigm-durability — Theoretical completeness does not guarantee paradigm durability — GANs had a notably complete analytical characterization (closed-form optimal discriminator, JSD minimization proof, unique equilibrium) yet were largely supplanted by diffusion models from approximately 2022 onward, suggesting that factors beyond theoretical elegance — possibly including training reliability — may play a significant role in determining which paradigms persist.
- IN unsupervised-generative-evolution-validates-paradigm-succession — The evolution of unsupervised neural network architectures (Hopfield → Boltzmann → RBM → VAE) and the succession of generative model families (GANs → diffusion models) illustrate a recurring pattern in which dominant ML paradigms can be displaced by successors that may draw on predecessor ideas but achieve prominence through different approaches. This is consistent with the observation that even widely adopted paradigms appear to be locally optimal practices liable to succession rather than permanent foundations.