> Are scaling laws over? A report from the Information announced that @OpenAI is seeing diminishing returns from scaling up the next GPT models. What are scaling laws? These are empiric laws that say "Every time you increase compute spent in training 10-fold, your LLM's
Scaling laws diminishing returns for OpenAI GPT models
By
–
