high-performance CPU programming IMO is harder than GPU programming.
GPU performance model is a lot more uniform and easy to understand than CPU performance which has so many edges and discontinuities and so many layers of caches and a much more complex instruction pipeline.

→ View original post on X — @soumithchintala,