llama3-8b-trained-15t-tokens-75x-chinchilla

OUT premise — entries/2026/06/21/wiki-LLaMA.md

Created 2026-06-21T09:50:09+00:00

Llama 3 8B was trained on 15 trillion tokens, approximately 75x the Chinchilla-optimal 200 billion tokens, and performance continued to scale log-linearly.