I don’t know, but it’s open source so you can take a look!
OPEN SOURCE
-
DBRX: Building a $10M LLM with Mosaic AI’s Chief Scientist
By
–
Explore the secret sauce behind @DbrxMosaicAI with our Chief AI Scientist @jefrankle
! He chatted with the #NextGenLakehouse crew about how we built DBRX for $10M (and why we built our own LLM), ways to evaluate models after training, and more. -
Hugging Face Datasets Viewer Now Embeddable on Any Webpage
By
–
Cool weekend update from the @huggingface datasets team, You can now embed our viewer on any webpage (Look for the "Embed" button.) Let us know what you think!
-
GPT-2: Perfect Introduction to LLMs and Distributed Training
By
–
Exactly as intended! GPT-2 is a beautiful "hello world" to LLMs but also distributed training etc.
-
Open-source advocacy influences FTC competition policy
By
–
Thanks to @garrytan
, who was quite instrumental in making this happen, educating the FTC on the importance of open-source and how it promotes competition. -
Google’s Gemma 2 9B Now Available on GroqChat at 599 T/s
By
–
Google’s Gemma 2 9B is live on GroqChat and available via GroqCloud, running at 599 T/s! Try it now and follow along as @ArtificialAnlys builds out the model’s public benchmark (
https://
hubs.la/Q02Gkq6R0). -
Reduce OpenAI Costs 50% with SLMs and Fine-tuning
By
–
Want to learn how to cut your #OpenAI spend by 50% or more with #SLMs, open-source and the latest techniques in LLM #finetuning? Great! Save your spot: https://
pbase.ai/4eZFw54 -
Complete Guide to Datalab Workflows and Use Cases
By
–
Here's a complete guide with examples that demonstrates various useful things you can do with Datalab! Check this out https://
docs.cleanlab.ai/stable/tutoria
ls/datalab/workflows.html
… 6/n -
Hugging Face achieves profitability with 220 team members
By
–
This isn’t a goal of ours because we have plenty of money in the bank but quite excited to see that @huggingface is profitable these days, with 220 team members and most of our platform being free (like model hosting) and open-source for the community! Especially noteworthy at
-
GPT-2 Training Now Affordable: $672 on Single GPU Node
By
–
In 2019, OpenAI announced GPT-2 with this post: https://
openai.com/index/better-l
anguage-models/
… Today (~5 years later) you can train your own for ~$672, running on one 8XH100 GPU node for 24 hours. Our latest llm.c post gives the walkthrough in some detail: https://
github.com/karpathy/llm.c
/discussions/677
… Incredibly, the