AI Dynamics

Global AI News Aggregator

Gemini API Caching Infrastructure Major Updates Shipped

We just shipped major updates to the Gemini API caching infrastructure – Video's that hit the cache are 3x faster TTFT
– PDF's that hit the cache are 4x faster TTFT
– Closed the speed gap on implicit vs explicit cache
– Ongoing work for large Audio files

→ View original post on X — @officiallogank,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *