A year ago @DeepMind released the Chinchilla paper, forever changing the direction of LLM training. Without Chinchilla, there would be no LLaMa, Alpaca, or Cerebras-GPT. Happy birthday Chinchilla! https://
deepmind.com/publications/a
n-empirical-analysis-of-compute-optimal-large-language-model-training
…
Chinchilla Paper Anniversary: One Year Transforming LLM Training
By
–