As Mark Zuckerberg shared in an open letter this morning: we believe that open source will ensure that more people around the world have access to the benefits and opportunities of AI, that power isn't concentrated in the hands of a small few, and that the technology can be
@aiatmeta
-
Llama License Update: Developers Can Now Use Model Outputs for Improvement
By
–
We’ve also updated our license to allow developers to use the outputs from Llama models — including 405B — to improve other models for the first time. We’re excited about how this will enable new advancements in the field through synthetic data generation and model distillation
-
Llama 3.1 405B Competes with GPT-4 and Claude
By
–
With Llama 3.1, we evaluated performance on >150 benchmark datasets spanning a wide range of languages — in addition to extensive human evaluations in real-world scenarios. These results show that the 405B competes with leading closed source models like GPT-4, Claude 2 and Gemini
-
Meta Releases Llama 3.1: New Open Source AI Models Including 405B
By
–
Starting today, open source is leading the way. Introducing Llama 3.1: Our most capable models yet. Today we’re releasing a collection of new Llama 3.1 models including our long awaited 405B. These models deliver improved reasoning capabilities, a larger 128K token context
-
Llama 3.1 405B: Training the Largest Model at Scale
By
–
Training a model as large and capable as Llama 3.1 405B was no simple task. The model was trained on over 15 trillion tokens over the course of several months requiring over 16K @NVIDIA H100 GPUs — making it the first Llama model ever trained at this scale. We also used the 405B
-
JASCO: Music Generation Model with Improved Controllability
By
–
We recently announced JASCO, a music-generation model with improved controllability using conditioning inputs like chords or beat. We've shared more details on this work in the research paper https://
go.fb.me/sou2ox -
Happy Birthday Ollama: Celebrating Community Contributions
By
–
What a year! Happy birthday Ollama, and thank you for everything you do for the Llama community!
-
Llama 3 Model Size Increase: 7B to 8B Explanation
By
–
Some context on why our smallest Llama 3 model went from 7B → 8B. More details on the changes to the tokenizer in the full conversation with @astongzhangAZ ➡️ https://t.co/cKuUfwmuZ4 pic.twitter.com/OfqCJtfSJW
— AI at Meta (@AIatMeta) 16 juillet 2024Some context on why our smallest Llama 3 model went from 7B → 8B. More details on the changes to the tokenizer in the full conversation with @astongzhangAZ https://
youtu.be/Tmdk_H2WDj4 -
Llama 2 Project Building: CoLab Notebook from MetaConnect2023
By
–
P.S. Want to start building your own project with Llama 2? Here's the full CoLab notebook from our workshop at #MetaConnect2023 today https://
bit.ly/3RDEX7K