Llama 3.1 405B launches • Comparable to GPT-4o and Claude 3.5 Sonnet, according to the benchmarks
• The weights are publicly available
• 128k context even on the smaller models Discussion on r/ML
OPEN SOURCE
-
Llama 3.1 405B Launch: Open Weights, GPT-4o Comparable Performance
By
–
-
Meta Releases Llama 3.1 Models to Community
By
–
We're thrilled to make these models available to the community and can't wait to see what they do with Llama 3.1!
-
Karpathy Plans Multiple Llama 3.1 Fine-tuning Projects
By
–
Yep I’d like to do many Llama 3.1 finetunes, coming up.
-
QLoRA Bug Consumes 4888GB VRAM in Llama 3 405B
By
–
One bug in bitsandbytes caused QLoRA to consume an extra *read notes* 4888 GB of VRAM. Even with QLoRA, fine-tuning Llama 3 405B on long sequence lengths ain't cheap.
-
Best Open-Source Model Now Available on ChatLLM Teams
By
–
The best open-source model in the world is now available on ChatLLM Teams http://
chatllm.abacus.ai -
Decaf: First Open Source AlexNet for Feature Reuse
By
–
Thanks so much for this award (makes me feel old )! I am honored to be sharing this award with amazing coauthors Decaf was the first open source version of AlexNet, and tested whether features learned by this amazing ImageNet classifier could be reused broadly in other
-
Meta’s Llama 3.1 405B: First Open Frontier LLM Available to All
By
–
Huge congrats to @AIatMeta on the Llama 3.1 release!
Few notes: Today, with the 405B model release, is the first time that a frontier-capability LLM is available to everyone to work with and build on. The model appears to be GPT-4 / Claude 3.5 Sonnet grade and the weights are -
Llama 3.1 405b Instruct Now Available Free on Hugging Chat
By
–
Llama 3.1 405b Instruct can be tried for FREE on Hugging Chat
-
Meta Llama 3.1 Now Available for Fine-tuning on Predibase
By
–
Meta's new hotness #Llama3.1 is out and ready for #finetuning and #serving on Predibase 🔥
— Predibase by Rubrik (@predibase) 23 juillet 2024
Try it for free! Here's $25 in credits to #customize Llama-3.1 or any of your favorite #opensource models for your use case: https://t.co/Rq8fsQwaZl 🎉 pic.twitter.com/tHCSLtx8LEMeta's new hotness #Llama3.1 is out and ready for #finetuning and #serving on Predibase Try it for free! Here's $25 in credits to #customize Llama-3.1 or any of your favorite #opensource models for your use case: https://
predibase.com/free-trial