kandpal-bloom-model-range
IN premise — summaries/2026/08/24/kandpal-2023-long-tail-knowledge-s0-abstract.md
Created 2026-08-25T02:58:05+00:00
Kandpal et al. (ICML 2023) use the BLOOM model family ranging from 560M to 176B parameters as the experimental subject.
Summary
The Kandpal et al. study uses the BLOOM model family, testing models that span more than two hundred times in size, from 560 million up to 176 billion parameters. This wide scale range matters because it means their findings are intended to apply broadly across model sizes rather than being specific to one particular architecture, giving the results more general weight.