For example, with OpenAI bots, a chat history of 24 cached messages could cost the same as 12 uncached ones. With Anthropic bots, up to 120 cached messages could cost the same as 12 uncached ones. This means more context with fewer points used. (4/5)
Anthropic Prompt Caching Cost Efficiency vs OpenAI
By
–