“If you have one Nvidia A100 server versus one of ours, they’re going to win, but if you take the 65-billion–parameter LLM & take 40 of our servers against 40 of theirs, it’s not even close [Groq’s latency is much faster],” Ross said. @eetimes by @sallywf
Groq Claims Superior Latency Performance Over Nvidia A100 Servers
By
–