Anthropic don't release any form of their tokenizer at all – not even an API endpoint that lets you count tokens before prompting with them (Google Gemini has that) It's a small thing but it's the feature I most want from them at the moment
Anthropic Needs Public Tokenizer API Like Google Gemini
By
–
Leave a Reply