It actually does matter here — number of GPUs in a system is almost always a power of two, and to maximize your utilization you will want that to evenly divide into the number of tasks.

→ View original post on X — @id_aa_carmack,