hendel-pythia-2.8b-architecture

Summary

This pins down the fixed "shape" of the Pythia 2.8B model: how wide its internal text representations are at each step, how many sequential processing stages it applies, and how many parallel channels it uses to track relationships between words. These numbers set the baseline for any comparison with other models, memory-budget calculations, or claims about what the model can and cannot do.