Message Batches API is now:
– Generally available on the Anthropic API (and you can send up to 100k messages in a batch now)
– Batch predictions is in preview on Google Cloud’s Vertex AI
– Batch inference is generally available in Amazon Bedrock

→ View original post on X — @alexalbert__