llama4-moe-scout-16-experts-maverick-128

OUT premiseentries/2026/06/21/wiki-LLaMA.md

Created 2026-06-21T09:50:09+00:00

Llama 4 uses MoE architecture: Scout has 16 experts (17B active / 109B total parameters), Maverick has 128 experts (17B active / 400B total parameters).