I know what you mean. For me there was nothing between 1x and 70x, it either worked or it didn't — had to redesign it each time. Now running out of shared memory for the GPU kernel, just a tad too small to be useful!
GPU Kernel Memory Optimization Challenges in AI Development
By
–