two years ago the entry point to participate in AI research was to have a couple of GPUs for training or finetuning now the entry level is to be able to regularly train a 50-70B params model on a couple hundred billion tokens
LLMS
-
From 7 likes to viral: GPT-3 tweet thread evolution
By
–
How it started: In April 2022, I tweet my first GPT-3 screenshot thread to my ~200 followers. I receive 7 likes across all posts, including 4 from my wife. How it’s going:
-
Copyrighted Data Training for Generative AI Models Falls Under Fair Use
By
–
Using copyrighted data as training data for generative AI model training falls under "Fair Use" clause:
-
Linear AI Model Adoption Strategy Safety Infrastructure
By
–
Maybe the idea here is to promote linear adoption for n number of reasons – tech infrastructure required to run such a big model, safety and prevention of misuse, etc.
-
AI Game pauses LLM Engineer hiring, focuses on SoTA models
By
–
Hi Muhammad, we paused hiring for the LLM Engineer position for now, because we are focusing on validating the game mechanics of AI Game, and at this stage, it's better to use SoTA LLMs, than to train our own. I expect we will resume this in 3-6 months.
-
DeepMind Launches Sparrow Chatbot to Rival ChatGPT
By
–
While ChatGPT has taken everyone by storm, hitting a million users in just 5 days of the launch, DeepMind is also planning to launch its own chatbot, named Sparrow, for a closed beta in 2023. Read the blog here https://
unwindai.substack.com/p/deepminds-sp
arrow-googles-answer
… -
Choosing between text-davinci-003 and code-davinci-002 based on task
By
–
text-davinci-003 or code-davinci-002 depending on the task.
-
Scaling issues during ChatGPT’s surge, but fine lately.
By
–
It’s been fine lately, but they had some scaling issues when ChatGPT was blowing up.
-
ChatGPT Pro and GPT-4 Could Reach $100B Valuation
By
–
So true, with the same growth trajectory it can easily reach to $100B valuation before the year ends. Big bets on ChatGPT pro and GPT-4!!
-
LangChain 0.0.66 Release: Bing Search and Qdrant Support
By
–
Big end of week release! `pip install lanchain==0.0.66` New Features Bing Search Wrapper – @EnricoShippole
: https://
langchain.readthedocs.io/en/latest/modu
les/utils/examples/bing_search.html
… Support for @qdrant_engine – @LukawskiKacper
: https://
langchain.readthedocs.io/en/latest/modu
les/utils/combine_docs_examples/vectorstores.html#qdrant
… And lots of misc improvements and bug fixes…