Design a multi-model fallback system for production reliability. ## Primary Model {{primary_model}} ## Fallback Models {{fallback_models}} ## Fallback Triggers {{fallback_triggers}} ## Quality Requirements {{quality_requirements}} Think through the implementation: **Step 1**: Define health check mechanisms for each model **Step 2**: Design circuit breaker logic **Step 3**: Plan prompt adaptation between models **Step 4**: Implement quality monitoring across fallbacks **Step 5**: Create rollback triggers Provide: - System architecture diagram - Configuration schema - Implementation code - Monitoring dashboards - Runbook for manual overrides
Multi-Model Fallback Orchestrator
U
@
Design a multi-model fallback orchestration system with circuit breakers, prompt adaptation, and quality monitoring for high-availability LLM applications.
34 copies0 forks
Details
Category
CodingUse Cases
Fallback designHigh availabilityModel orchestration
Works Best With
claude-sonnet-4-20250514gpt-4o
Created Shared