Breaking news: we're still the fastest. 😎
— SambaNova (@SambaNovaAI) 3 octobre 2024
Running at full-precision, SambaNova Cloud delivers top speeds of 2470 tokens per sec on Llama 3.2 1B and 1566 tokens per sec on 3B, independently verified by @ArtificialAnlys 🏎️💨
Start developing ⤵️
Breaking news: we're still the fastest. Running at full-precision, SambaNova Cloud delivers top speeds of 2470 tokens per sec on Llama 3.2 1B and 1566 tokens per sec on 3B, independently verified by @ArtificialAnlys Start developing
