Fallbacks Importantly, not just at the LLM level, but at the chain level Why does this matter? Different LLMs need different prompts. If you hit a rate-limit error on OAI and want to switch to Anthropic, you don't just want to retry with the same prompt – you want to switch
LLM Fallbacks: Chain-Level Prompt Switching Strategy
By
–
Leave a Reply