
how do you know whether your GPU is compute-bound or memory-bound? here's a simple explanation: your model weights sit in HBM (high bandwidth memory), the large pool of memory on the GPU board. no arithmetic happens there. before any multiplication can run, those weights have
