Joint work with the usual suspects @YiTayML @quocleix
AI
-
Few-shot Prompt Setup Notes for Scaling Law Experiments
By
–
Some setup notes (cc @EthanJPerez
) – We used the exact 2-shot prompt for Quote Repetition, which is already U-shaped for Gopher/Chinchilla – We used fewer shots for Hindsight – We did few-shot instead of 0-shot for Negation QA – We also showed inverse scaling up to PaLM 62B -
Inverse Scaling Prize Round 2 Evaluation Announcement
By
–
Make sure to check out the inverse scaling prize, which is a great community effort! Looking forward to evaluating on the Round 2 winners 🙂
-
U-shaped Scaling and the Limitations of Inverse Scaling Tasks
By
–
Implications: 1. U-shaped scaling means that inverse scaling may not hold when extrapolated to larger models. 2. The term “inverse scaling task” is underspecified. A task can be inverse scaling for one type of prompting and positive or U-shaped for another type of prompting.
-
CoT Prompting Defends Against Inverse Scaling in Math Tasks
By
–
Second, we show that CoT prompting can defend against inverse scaling. For instance, CoT prompting achieves 100% on 7 out of 8 subtasks for Redefine Math.
-
U-shaped Scaling Behavior Emerges at Higher Computational Budgets
By
–
Our results first confirm inverse scaling behavior seen on prior models trained up to 500 zettaFLOPs. But at 2K zettaFLOPs, it becomes U-shaped. U-scaling has also been shown in prior work, such as BIG-Bench.
-
Inverse Scaling Becomes U-Shaped with Larger Language Models
By
–
New preprint!
— Jason Wei (@_jasonwei) 4 novembre 2022
By evaluating 5x larger language models, inverse scaling can become “U-shaped scaling”, which means that performance increases sharply after decreasing.
https://t.co/bZQndKqlB6
These two tasks here are Third Prize winners from the Inverse Scaling Prize. pic.twitter.com/8d3pu8DDrkNew preprint! By evaluating 5x larger language models, inverse scaling can become “U-shaped scaling”, which means that performance increases sharply after decreasing. https://
arxiv.org/abs/2211.02011 These two tasks here are Third Prize winners from the Inverse Scaling Prize. -
JMLR Review Delays: How TMLR Improves Academic Publishing
By
–
I had the same experience with JMLR back in 2015. After 6 months, they hadn't found reviewers. Withdrew the paper and submitted to a different journal. I like that @TmlrOrg doesn't run into this type of friction, since reviewers are expected to review it after being assigned.
-
Improve People Skills for Engineering and Industry 4.0 Leaders
By
–
10 Simple Ways to Improve Your People Skills https://
entrepreneur.com/growing-a-busi
ness/10-simple-ways-to-improve-your-people-skills/343141
… @ASMEdotorg @3DSNorthAmerica @Dassault3DS @cyngn @MargaretSiegien @Cindybolt61 @fogoros @DrFerdowsi @CRudinschi @PawlowskiMario @IIoT_World @MEngineeringMag #Engineering #Industry40 #Robots #AI #Manufacturing -
Democracy increases moral universalism globally survey finds
By
–
Giant worldwide survey looks at universalism (a willingness to treat strangers the same way you treat friends/community members) & finds 26% of people are strongly universalist & 18% are the opposite. Exposure to democracy causally increases universalism. https://
cepr.org/voxeu/columns/
moral-universalism-global-evidence
…