Breaking news: we're still the fastest. ๐
— SambaNova (@SambaNovaAI) 3 octobre 2024
Running at full-precision, SambaNova Cloud delivers top speeds of 2470 tokens per sec on Llama 3.2 1B and 1566 tokens per sec on 3B, independently verified by @ArtificialAnlys ๐๏ธ๐จ
Start developing โคต๏ธ
Breaking news: we're still the fastest. Running at full-precision, SambaNova Cloud delivers top speeds of 2470 tokens per sec on Llama 3.2 1B and 1566 tokens per sec on 3B, independently verified by @ArtificialAnlys Start developing
Leave a Reply