Shout-out to @ArtificialAnlys for independently verifying our speeds! 225 tokens/sec on Qwen 2.5 72B
566 tokens/sec on Qwen 2.5 Coder 32B @Alibaba_Qwen @_micah_h #AI #GenAI #LLM
Qwen 2.5 Models Achieve Impressive Token Generation Speeds
By
–
By
–
Shout-out to @ArtificialAnlys for independently verifying our speeds! 225 tokens/sec on Qwen 2.5 72B
566 tokens/sec on Qwen 2.5 Coder 32B @Alibaba_Qwen @_micah_h #AI #GenAI #LLM