bert-encoder-only-gpt-decoder-only-t5-enc-dec

IN premise — entries/2026/06/21/wiki-Transformer_deep_learning_architecture-chunk-2.md

Created 2026-06-21T09:55:55+00:00

BERT is encoder-only (masked LM task), GPT is decoder-only (autoregressive task), and T5 is encoder-decoder (prefixLM task).