Admittedly the CPU here is a ~$10,000 96 core AMD Ryzen Threadripper PRO 7995WX, but still, it looks like GPUs don't necessarily have the total monopoly on LLM inference performance that I thought they did
CPU Threadripper Challenges GPU Dominance in LLM Inference
By
–
