GPU architecture, clearly explained. The usual assumption is that a faster GPU means more compute, so a chip rated for more operations per second should generate more tokens per second. That rarely holds. You can rent a top-end chip, load a model, watch utilization sit high,