do you really think? im pretty sure we will outspend on compute by a _huge_ margin, and at least for companies like openai data spend will go down as models get smarter. curious if i am missing something!
INNOVATION
-
Large Language Models as Reasoning Teachers
By
–
(7/12) Large Language Models Are Reasoning Teachers
Authors: @itsnamgyu
, Laura Schmid, Se-Young Yun -
Teaching Small Language Models to Reason
By
–
(6/12) Teaching Small Language Models to Reason
Authors: Lucie Charlotte Magister, Jonathan Mallinson, Jakub Adamek, @ericmalmi
, Aliaksei Severyn -
CiT: Data Curation Methods for Vision-Language Model Training
By
–
(5/12) CiT: Curation in Training for Effective Vision-Language Data
Authors: Hu Xu, @sainingxie
, Po-Yao Huang, @Licheng_Yu
, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, @cfeichtenhofer -
Hungry Hungry Hippos: Language Modeling with State Space Models
By
–
(3/12) Hungry Hungry Hippos: Towards Language Modeling with State Space Models
Authors: @tri_dao
, @realDanFu
, Khaled K. Saab, @ai_with_brains, Atri Rudra, Christopher Ré @HazyResearch @SnorkelAI -
Quebec AI: Ambitious Project to Lead Global AI by 2030
By
–
http://
QUEBEC.AI "The Most Ambitious Project in Quebec History" QUÉBEC ♡ AI : https://
quebec.ai http://
QUEBEC.AI aims for unicorn status and to make Québec the world leader in AI by 2030. #IABleue #MontrealAI #QuebecAI -
Piggy Twitter Bot: Free Mobile Content Creation with AI
By
–
Create beautiful mobile content for free with Piggy and their twitter bot – https://
futurepedia.io/tool/piggy-to #Marketing #artificial #ChatGPT -
Scale AI Discusses RLHF Strategy with OpenAI
By
–
btw if you want to chat about your RLHF strategy with us @scale_AI — reach out! DMs are open source on OpenAI:
-
OpenAI Team Excellence and Deep Commitment to AI
By
–
everyone on the openai team is exceptional and cares deeply. i am very grateful for all of their contributions.