three-transformer-variants-encoder-decoder

OUT premise — entries/2026/06/21/wiki-Transformer_deep_learning_architecture-chunk-1.md

Created 2026-06-21T09:50:11+00:00

Three main transformer architectural variants exist: encoder-only (BERT) for understanding, decoder-only (GPT) for autoregressive generation, and encoder-decoder (T5, original transformer) for sequence-to-sequence tasks.