Are those prices for input or output tokens? I think they're for output tokens, but usually I find the input tokens price is more relevant – especially since most models with long context have a much lower cap on output tokens (eg Claude 3 allows 200k input but only 4k output)
Input vs Output Token Pricing for LLMs
By
–
Leave a Reply