Make sure to check out the inverse scaling prize, which is a great community effort! Looking forward to evaluating on the Round 2 winners 🙂
AI
-
U-shaped Scaling and the Limitations of Inverse Scaling Tasks
By
–
Implications: 1. U-shaped scaling means that inverse scaling may not hold when extrapolated to larger models. 2. The term “inverse scaling task” is underspecified. A task can be inverse scaling for one type of prompting and positive or U-shaped for another type of prompting.
-
CoT Prompting Defends Against Inverse Scaling in Math Tasks
By
–
Second, we show that CoT prompting can defend against inverse scaling. For instance, CoT prompting achieves 100% on 7 out of 8 subtasks for Redefine Math.
-
U-shaped Scaling Behavior Emerges at Higher Computational Budgets
By
–
Our results first confirm inverse scaling behavior seen on prior models trained up to 500 zettaFLOPs. But at 2K zettaFLOPs, it becomes U-shaped. U-scaling has also been shown in prior work, such as BIG-Bench.
-
Inverse Scaling Becomes U-Shaped with Larger Language Models
By
–
New preprint!
— Jason Wei (@_jasonwei) 4 novembre 2022
By evaluating 5x larger language models, inverse scaling can become “U-shaped scaling”, which means that performance increases sharply after decreasing.
https://t.co/bZQndKqlB6
These two tasks here are Third Prize winners from the Inverse Scaling Prize. pic.twitter.com/8d3pu8DDrkNew preprint! By evaluating 5x larger language models, inverse scaling can become “U-shaped scaling”, which means that performance increases sharply after decreasing. https://
arxiv.org/abs/2211.02011 These two tasks here are Third Prize winners from the Inverse Scaling Prize. -
Meta AI Creates Largest Protein Language Model with 15B Parameters
By
–
Meta AI researchers trained a language model to fill in protein sequence gaps across millions of diverse proteins & scaled up to 15B parameters, creating the largest language model of proteins to date. More on our latest breakthrough in protein folding https://
bit.ly/3WoWcK2 -
Replicate Increases Default Rate Limits for API Predictions
By
–
We've also increased our default rate limits. You can create 10 predictions a second, bursting up to 600 predictions a second. https://
replicate.com/docs/reference
/http#rate-limits
… We can support higher rates too – just email us: team@replicate.com -
Infrastructure improvements deliver faster response times for users
By
–
Over the past few weeks, we've made some major improvements to our infrastructure to make it more reliable and perform better. Nothing's changed from your point of view, but you'll be seeing faster response times!
-
Machine Learning GPT3 Website Free for Content Creators
By
–
Machine learning for deep thought: a GPT3-based website that every content creator should jump on while it’s free… https://
qburst.co -
Groq Highlights Compiler Engineer Zachary Cetinic at SC22
By
–
@GroqInc has been exceptional at hiring the best talent in the technology industry. Zachary Cetinic, Compiler Engineer, is a perfect fit to our team. You can hear Zachary present at #SC22 and meet him at our booth, #3047. Learn more at https://t.co/nD3jMJOsyE#WhyGroq pic.twitter.com/1BMwOkyVqk
— Groq Inc (@GroqInc) 4 novembre 2022@GroqInc has been exceptional at hiring the best talent in the technology industry. Zachary Cetinic, Compiler Engineer, is a perfect fit to our team. You can hear Zachary present at #SC22 and meet him at our booth, #3047. Learn more at https://
groq.com/sc22/
#WhyGroq