Making AMD GPUs competitive for LLM inference Worried about NVIDIA GPU shortage? This project aims to makes it possible to compile LLMs and deploy them on AMD GPUs using ROCm and get competitive performance. Article: https://
blog.mlc.ai/2023/08/09/Mak
ing-AMD-GPUs-competitive-for-LLM-inference
… Discussion: https://
reddit.com/r/MachineLearn
ing/comments/15ml8n0/project_making_amd_gpus_competitive_for_llm/
…

→ View original post on X — @hardmaru,