Thanks @BHeater
! FWIW, my predictions for 2023: Transformers / Large Language / Diffusion Models; @Tesla
’s Optimus; and Warehouse Robots. @AmbiRobotics
LLMS
-
2023 Tech Predictions: AI Models, Tesla Optimus, and Warehouse Robots
By
–
-
Cerebras Makes Large-Model Training Affordable Universities
By
–
Sally Ward-Foxton of EETimes writes, "One of Cerebras’ goals is to make large-model training accessible to universities and large enterprises at a cost they can afford" Article: https://
hubs.li/Q01wjwd_0 Learn more about our affordable training solution: -
OPT-IML: Instruction-Tuned Models for Diverse Language Tasks
By
–
For OPT-IML, we boosted performance of our OPT-175B work using instruction tuning, allowing us to adapt it for more diverse language applications (Ex. Answering Q’s, summarizing text & translation). A 30B parameter model is available today with a 175B model available soon.
-
Meta AI Announces OPT-IML: 175B Parameter Language Model
By
–
Announcing OPT-IML: a new language model from Meta AI with 175B parameters, fine-tuned on 2,000 language tasks — openly available soon under a noncommercial license for research use cases. Research paper & more details on GitHub
-
MoleculeSTM: ChatGPT Technology Applied to Molecular Analysis
By
–
MoleculeSTM paving the way for #chatGPT for molecules https://t.co/EtPho1oj0b
— Prof. Anima Anandkumar (@AnimaAnandkumar) 22 décembre 2022MoleculeSTM paving the way for #chatGPT for molecules
-
Largest Text-Molecule Model Enables ChatGPT-like Molecule Retrieval and Editing
By
–
We build the largest Text-molecule model that does not rely only on aligned training pairs. Now you can retrieve and edit molecules based on text prompts. This will pave the way for #ChatGPT for #molecules https://
chao1224.github.io/MoleculeSTM @nvidia @Mila_Quebec @Caltech -
OODA Loop 2022: ChatGPT GPT-3 OpenAI Future Analysis
By
–
OODA Loop 2022: The Past, Present, and Future of ChatGPT, GPT-3, OpenAI, NLMs, and NLP https://
oodaloop.com/ooda-original/
disruptive-technology/2022/12/22/ooda-loop-2022-the-past-present-and-future-of-chatgpt-gpt-3-openai-nlms-and-nlp/
… via @ooda -
SantaCoder: First LLM with Opted-Out Training Dataset
By
–
So cool to see @BigCodeProject release SantaCoder, afaik the very first LLM trained on an "opted-out" dataset, aka allowing people to opt-out from the training dataset. 1.1B parameters that outperforms larger models on both generation and infilling! https://
huggingface.co/bigcode/santac
oder
… -
LangChain v0.0.44: OpenAI Timeout, Azure Integration, HyDE
By
–
v0.0.44 Timeout argument for OpenAI LLM – Sam Bean, @YouSearchEngine Azure OpenAI LLM integration – @gojira Hypothetical Document Embeddings, based on https://
arxiv.org/abs/2212.10496 – h/t @luyu_gao For docs on Azure OpenAI, see https://
langchain.readthedocs.io/en/latest/exam
ples/prompts/azure_openai_example.html
…
