It actually does matter here — number of GPUs in a system is almost always a power of two, and to maximize your utilization you will want that to evenly divide into the number of tasks.
GPU Count Power of Two for Task Distribution Optimization
By
–
By
–
It actually does matter here — number of GPUs in a system is almost always a power of two, and to maximize your utilization you will want that to evenly divide into the number of tasks.