More details on all of the new models, datasets and code released by Meta FAIR last week
@aiatmeta
-
Meta Open Materials 2024: New Open Source Model for Materials Discovery
By
–
New open source release — Meta Open Materials 2024: a new open source model and dataset from Meta FAIR to facilitate inorganic materials discovery. The Open Materials 2024 models deliver results putting them at the top of the MatBench-Discovery leaderboard. They use the
-
Meta AI Models Deployed on Mobile CPUs with Partner Collaboration
By
–
Thanks to close work with @arm
, @mediatek and @qualcomm
, these new models are ready to deploy on even more mobile CPUs.
We are also currently collaborating with partners to utilize NPUs for these quantized models for even greater performance. -
Two Quantization Techniques for Model Optimization Released
By
–
We used two different techniques for quantizing these models.
Quantization-Aware Training with LoRA adaptorsprioritizing accuracy.
SpinQuant, a post-training quantization method which prioritizes portability.
Both versions are available for download as part of this release. -
Llama 3.2 Quantized Versions Speed Up Inference 2-4x
By
–
We want to make it easier for more people to build with Llama — so today we’re releasing new quantized versions of Llama 3.2 1B & 3B that deliver up to 2-4x increases in inference speed and, on average, 56% reduction in model size, and 41% reduction in memory footprint.
Details -
Meta Movie Gen Research Paper and Media Foundation Models Breakdown
By
–
That’s all for now, but we’re excited to share more. You can see even more breakdowns and examples of what Meta Movie Gen can do in the full research paper https://
ai.meta.com/research/publi
cations/movie-gen-a-cast-of-media-foundation-models/?utm_source=twitter&utm_medium=organic_social&utm_content=thread&utm_campaign=moviegen
… -
Movie Gen Audio Output Demo Walk Through
By
–
Walk with us (and turn up your volume to hear the output from Movie Gen Audio in the last clip!) pic.twitter.com/w1rmLlDP6E
— AI at Meta (@AIatMeta) 23 octobre 2024Walk with us (and turn up your volume to hear the output from Movie Gen Audio in the last clip!)
-
Meta Movie Gen Models Deliver Impressive Results in Latest Examples
By
–
We’re continuing to see exciting results as we work with our Meta Movie Gen models, here are some more examples of what they can do 🧵 pic.twitter.com/Prswvvcc6v
— AI at Meta (@AIatMeta) 23 octobre 2024We’re continuing to see exciting results as we work with our Meta Movie Gen models, here are some more examples of what they can do
-
Meta Lingua: Lightweight Framework for Language Model Training
By
–
We recently released Meta Lingua, a lightweight and self-contained codebase designed to train language models at scale. Lingua is designed for research and uses easy-to-modify @PyTorch components in order to try new architectures, losses, data and more.
-
Knowledge Distillation with Llama 3.1 405B: Fine-tuning and Synthetic Data
By
–
New video – Knowledge Distillation with Llama 3.1 405B. In this extended discussion, @nazeri2010 & @subramen delve into the importance of fine-tuning — and how Llama 405B can be used to generate synthetic data. Full video on YouTube https://
youtu.be/kxx6TfpAkEU