Depends on the use-case… for many simple consumer use-cases, sure, but for anything that requires thinking, iteration, etc. t/s is insanely important. Extremely fast inference from @GroqInc or similar cuts down a 10 minute thinking workflow into just a few seconds. Or allows
Fast Inference Speed Critical for Complex AI Thinking Workflows
By
–