AI Dynamics

Global AI News Aggregator

About

OrcaRouter-Lite Open Source for LLM Model Selection and Prompt Caching

OrcaRouter-Lite just launched open source. MIT. BYOK. Self-hosted. Zero markup. The real unlock: model="auto" picks the cheapest capable model, with deterministic prompt caching across providers. Every LLM team has been hand-rolling some messy version of this for the last two

→ View original post on X — @kimmonismus