Anthropic's prompt caching is such a game changer. We had a few ideas which needed huge system prompts in a chat-like interaction to work — but it was always too expensive/slow to reasonably run. With prompt caching, all those ideas are suddenly much more feasible! More to
Anthropic’s Prompt Caching Enables New Cost-Effective AI Applications
By
–
Leave a Reply