RAG Failure Mode Analyzer

U

@

·

Systematically analyze RAG failure modes from production data, categorize issues, identify root causes, and propose quantified mitigation strategies.

8 copies0 forks
As a Lead AI Engineer, analyze RAG failure modes from production logs.

## Sample Failures
{{failure_examples}}

## System Configuration
{{system_config}}

## Success Rate
{{current_success_rate}}

Categorize and analyze failures:

**Retrieval Failures**
- No relevant documents found
- Relevant docs ranked too low
- Missing information in corpus

**Generation Failures**
- Hallucination despite context
- Incomplete answers
- Format errors

**System Failures**
- Timeout errors
- Rate limiting
- Parsing errors

For each category:
1. Quantify occurrence rate
2. Identify root causes
3. Propose mitigation strategies
4. Estimate improvement potential

Provide actionable remediation plan.

Details

Category

Analysis

Use Cases

Failure analysisQuality improvementRoot cause analysis

Works Best With

claude-sonnet-4-20250514gpt-4o
Created Shared

Create your own prompt vault and start sharing