bert-encoder-only-gpt-decoder-only

OUT premiseentries/2026/06/21/wiki-Large_language_model-chunk-1.md

Created 2026-06-21T09:50:09+00:00

BERT is an encoder-only model (masked prediction) while GPT is a decoder-only model (autoregressive next-token prediction).