It’s still early days for these models and we’re excited for the innovations ahead. The Llama 1B & 3B weights being released today are based on BFloat16 numerics. Our teams are actively exploring quantized variants that will run even faster and we hope to share more on that soon.

→ View original post on X — @aiatmeta