AI Dynamics

Global AI News Aggregator

About

Anthropic Needs Public Tokenizer API Like Google Gemini

Anthropic don't release any form of their tokenizer at all – not even an API endpoint that lets you count tokens before prompting with them (Google Gemini has that) It's a small thing but it's the feature I most want from them at the moment

→ View original post on X — @simonw