Prompt caching didn't even exist until <2 years ago Google: June 2024
Anthropic: August 2024
OpenAI: October 2024 Now for agentic workflows, 95% of tokens gets cached, without it the costs would be completely insane
The Impact of Prompt Caching on LLM Agentic Workflows and Costs
By
–
