Last note here though: batch gives you a flexible timeframe which means you can grab idle GPUs outside of peak hours. All the endpoints are mostly in service to maxing out utilization to return the value of those GPUs. So now OpenAI has a way to do that.

→ View original post on X — @mattlynley,