hendel-llama-7b-architecture

Summary

This is the structural blueprint of the LLaMA 7B model: how wide its internal representations are, how many sequential stages of processing it runs, and how many parallel "spotlight" mechanisms it uses to track relationships between words. These three numbers set the baseline for everything else — they determine the model's capacity, its memory and compute footprint, and how it compares to other architectures in the system.