My mind is blown.@GroqInc is serving LLaMA 3 at over 800 tokens per second!

800. Tokens. Per. Second.

This unlocks so many incredible use-cases.

It's one thing to see my demo — it's another thing entirely to experience it for yourself.

Do yourself a favor and try it asap. pic.twitter.com/Rd5NW5SDlW

— Matt Shumer (@mattshumer_) 19 avril 2024

My mind is blown. @GroqInc is serving LLaMA 3 at over 800 tokens per second! 800. Tokens. Per. Second. This unlocks so many incredible use-cases. It's one thing to see my demo — it's another thing entirely to experience it for yourself. Do yourself a favor and try it asap.

→ View original post on X — @mattshumer_,