Amdahl’s law gets you there — you can linearly scale throughput on independent tasks, or scale up problems to utilize more parallel resources, but scaling a fixed task across parallel resources always has sublinear speed up. Also significantly more work.
Amdahl’s Law: Limits of Parallel Computing and Sublinear Speedup
By
–
Leave a Reply