AI Dynamics

Global AI News Aggregator

About

Improving Prompt Cache Efficiency for API Users

I put up a few PRs to improve prompt cache efficiency actually, to benefit folks using it through API/overages

→ View original post on X — @bcherny