prefixlm-bidirectional-prefix-causal-rest

IN premise — entries/2026/06/21/wiki-Transformer_deep_learning_architecture-chunk-4.md

Created 2026-06-21T09:55:55+00:00

PrefixLM is a decoder-only variant with a modified mask where prefix tokens attend bidirectionally and subsequent tokens attend causally.