As a Lead AI Engineer, analyze RAG failure modes from production logs. ## Sample Failures {{failure_examples}} ## System Configuration {{system_config}} ## Success Rate {{current_success_rate}} Categorize and analyze failures: **Retrieval Failures** - No relevant documents found - Relevant docs ranked too low - Missing information in corpus **Generation Failures** - Hallucination despite context - Incomplete answers - Format errors **System Failures** - Timeout errors - Rate limiting - Parsing errors For each category: 1. Quantify occurrence rate 2. Identify root causes 3. Propose mitigation strategies 4. Estimate improvement potential Provide actionable remediation plan.
RAG Failure Mode Analyzer
U
@
Systematically analyze RAG failure modes from production data, categorize issues, identify root causes, and propose quantified mitigation strategies.
8 copies0 forks
Details
Category
AnalysisUse Cases
Failure analysisQuality improvementRoot cause analysis
Works Best With
claude-sonnet-4-20250514gpt-4o
Created Shared