transformer-quadratic-cost-context

OUT premise — entries/2026/06/21/wiki-Transformer_deep_learning_architecture-chunk-2.md

Created 2026-06-21T09:55:55+00:00

The transformer has quadratic computational cost in context window size, compared to linear cost for RNNs.