As a Lead AI Engineer, analyze RAG failure modes from production logs. ## Sample Failures {{failure_examples}} ## System Configuration {{system_config}} ## Success Rate {{current_success_rate}} Categorize and analyze failures: **Retrieval Failures** - No relevant documents found - Relevant docs ranked too low - Missing information in corpus **Generation Failures** - Hallucination despite context - Incomplete answers - Format errors **System Failures** - Timeout errors - Rate limiting - Parsing errors For each category: 1. Quantify occurrence rate 2. Identify root causes 3. Propose mitigation strategies 4. Estimate improvement potential Provide actionable remediation plan.
RAG Failure Mode Analyzer
Systematically analyze RAG failure modes from production data, categorize issues, identify root causes, and propose quantified mitigation strategies.
8 copies0 forks
Share this prompt:
Details
Category
AnalysisUse Cases
Failure analysisQuality improvementRoot cause analysis
Works Best With
claude-sonnet-4-20250514gpt-4o
Created Updated Shared