Excited to see what developers build with these new models — and the 11B & 90B when they roll out on Cortex AI!
@aiatmeta
-
Models Ready for NVIDIA NIM Integration
By
–
Exciting to see these models ready to go with NVIDIA NIM!
-
Llama 1B & 3B Models Released, Quantized Variants Coming Soon
By
–
It’s still early days for these models and we’re excited for the innovations ahead. The Llama 1B & 3B weights being released today are based on BFloat16 numerics. Our teams are actively exploring quantized variants that will run even faster and we hope to share more on that soon.
-
Meta trains lightweight Llama models with net zero emissions
By
–
Combined, training these lightweight Llama models required 916K GPU hours on NVIDIA H100-80GB. As part of Meta’s commitment starting in 2020, we’ve maintained net zero greenhouse gas emissions in our global operations and matched 100% of the electricity use from the training
-
New Models Outperform Gemma 2 and Phi 3.5 at Smaller Sizes
By
–
We’re seeing exciting performance from these new models, with results that outperform Gemma 2 2.6B and Phi 3.5-mini models on a range of tasks even at smaller sizes!
-
Llama 3.2 Lightweight Models Launch with Mobile Platform Support
By
–
The lightweight Llama 3.2 models shipping today include support for @Arm
, @MediaTek & @Qualcomm to enable the developer community to start building impactful mobile applications from day one. -
Llama Lightweight Models: Pruning and Distillation Techniques
By
–
These lightweight Llama models were pretrained on up to 9 trillion tokens. One of the keys for Llama 1B & 3B however was using pruning & distillation to build smaller and more performant models informed by powerful teacher models. Pruning enabled us to reduce the size of extant
-
Llama 1B & 3B: Lightweight Models for Mobile Edge Deployments
By
–
Even With their lightweight size, Llama 1B & 3B have a range of capabilities and were built to run on mobile devices & lightweight edge deployments. They empower developers to build personalized & private, on-device agentic applications.
-
Technical insights on lightweight Llama 3.2 1B and 3B models
By
–
A few technical insights on our lightweight Llama 3.2 1B & 3B models.
-
Llama 3.2 Now Available on Ollama Platform
By
–
The community is going to love this, excited to see Llama 3.2 up and running on Ollama!