This is my bet too. And one I’ve talked about a lot. Next 3 years of ML startups and AI/ML VC will be focused on the application layer of LLMs (even the compute-optimal mini-LLMs like chinchilla). Buckle up.
LLMS
-
Google’s Mu2SLAM: Unified Model For Speech And Text Understanding
By
–
Google’s Mu2SLAM: Toward a Single Model For All Speech and Text Understanding Tasks https://
syncedreview.com/2022/12/22/goo
gles-mu2slam-toward-a-single-model-for-all-speech-and-text-understanding-tasks/
… -
text2SQL Challenges: Demo Status Requires Production Readiness Work
By
–
Getting it to work reliably is a challenge too. text2SQL is still much a demo and needs more work to be production ready.
-
Ask to continue from start of last code block using Markdown
By
–
Ask it to start from an earlier point, like "Continue from the start of the last code block." Under the hood everything is Markdown so you can refer to stuff in Markdown terms.
-
AI Powers Human Creation Across All Industries
By
–
AI can now power anything that humans create. 2023 will be wild. pic.twitter.com/5cklXMk9uL
— Nina Schick (@NinaDSchick) 22 décembre 2022AI can now power anything that humans create. 2023 will be wild.
-
Completion Models vs Instruction Fine-Tuning Approaches
By
–
It’s a completion model, not (yet) an instruct fine tuned model so you should formulate your task as a completion task. For instance by writing your prompt as a code comment or docstring.
-
2023 Tech Predictions: AI Models, Tesla Optimus, and Warehouse Robots
By
–
Thanks @BHeater
! FWIW, my predictions for 2023: Transformers / Large Language / Diffusion Models; @Tesla
’s Optimus; and Warehouse Robots. @AmbiRobotics -
Cerebras Makes Large-Model Training Affordable Universities
By
–
Sally Ward-Foxton of EETimes writes, "One of Cerebras’ goals is to make large-model training accessible to universities and large enterprises at a cost they can afford" Article: https://
hubs.li/Q01wjwd_0 Learn more about our affordable training solution: -
OPT-IML: Instruction-Tuned Models for Diverse Language Tasks
By
–
For OPT-IML, we boosted performance of our OPT-175B work using instruction tuning, allowing us to adapt it for more diverse language applications (Ex. Answering Q’s, summarizing text & translation). A 30B parameter model is available today with a 175B model available soon.
-
Meta AI Announces OPT-IML: 175B Parameter Language Model
By
–
Announcing OPT-IML: a new language model from Meta AI with 175B parameters, fine-tuned on 2,000 language tasks — openly available soon under a noncommercial license for research use cases. Research paper & more details on GitHub