Here's a wild idea for you: keep just one server running Claude 3 Sonnet online, hook up a job queue with a limited length and have an auction mechanism people can use to buy their place in the queue such that price varies with demand

→ View original post on X — @simonw