yep we do this for Bedrock, Vertex, and Azure, since they don’t have a token-counting API available yet. When using Anthropic API we use the token-counting endpoint directly
Token Counting API Support Across Bedrock Vertex Azure Anthropic
By
–
By
–
yep we do this for Bedrock, Vertex, and Azure, since they don’t have a token-counting API available yet. When using Anthropic API we use the token-counting endpoint directly