Looking forward to see what we can do with this, especially the increaseed context length! Thanks a lot to @Meta for open-sourcing this
OPEN SOURCE
-
Meta Releases Llama-3.1 with 405B Model and Expanded Context
By
–
Mark Zuckerberg just announced the GPT-4 killer: Llama-3.1 Two breakthroughs:
New 405B, possibly the strongest LLM ever, slightly above GPT-4o in many domains
Improved 8B & 70B models, with a much larger context size of 128k vs 8k ⇒ game-changer for RAG and Agents. -
Llama License Update: Developers Can Now Use Model Outputs for Improvement
By
–
We’ve also updated our license to allow developers to use the outputs from Llama models — including 405B — to improve other models for the first time. We’re excited about how this will enable new advancements in the field through synthetic data generation and model distillation
-
Meta Commits to Open Source AI for Broader Global Access
By
–
As Mark Zuckerberg shared in an open letter this morning: we believe that open source will ensure that more people around the world have access to the benefits and opportunities of AI, that power isn't concentrated in the hands of a small few, and that the technology can be
-
Llama 3.1 405B Competes with GPT-4 and Claude
By
–
With Llama 3.1, we evaluated performance on >150 benchmark datasets spanning a wide range of languages — in addition to extensive human evaluations in real-world scenarios. These results show that the 405B competes with leading closed source models like GPT-4, Claude 2 and Gemini
-
Meta Releases Llama 3.1: New Open Source AI Models Including 405B
By
–
Starting today, open source is leading the way. Introducing Llama 3.1: Our most capable models yet. Today we’re releasing a collection of new Llama 3.1 models including our long awaited 405B. These models deliver improved reasoning capabilities, a larger 128K token context
-
Fine-tuning Llama-3.1-8B with High-Quality Reasoning Datasets
By
–
What I'm excited about: Use Llama-3.1-405B to generate a high quality reasoning dataset, then fine-tune Llama-3.1-8B models.
— Jiquan Ngiam (@JiquanNgiam) 23 juillet 2024
Imagine having 4o-mini performance models, but open sourced, and tuned for your use cases. pic.twitter.com/mf9tMZ8vWMWhat I'm excited about: Use Llama-3.1-405B to generate a high quality reasoning dataset, then fine-tune Llama-3.1-8B models. Imagine having 4o-mini performance models, but open sourced, and tuned for your use cases.
-
Meta Releases New Llama Model Update Blog Post
By
–
Os dejo el link con el blog post de Meta. Yo voy a repasar la info y más que hacer un hilo, luego abrimos directo y comentamos la importancia de esta noticia 🙂 https://
llama.meta.com -
Llama 3.1 Now Available in Three Sizes: 8B, 70B, 405B
By
–
¡LLAMA 3.1 YA ESTÁ AQUÍ! En sus tres tamaños… 8B, 70B y 405B
-
Technical differences between closed and open-source AI models
By
–
Les modèles fermés ont des verrous post et pré traitement pour empêcher d’emmener le modèle n’importe où. Les modèle ouvert non c’est brut.