Analyze the retrieval quality of our RAG system and suggest improvements. ## Sample Queries and Results {{query_result_pairs}} ## Current Retrieval Configuration - Embedding model: {{embedding_model}} - Top-K: {{top_k}} - Similarity threshold: {{similarity_threshold}} ## User Feedback {{user_feedback_summary}} Perform a structured analysis: 1. **Relevance Assessment**: Rate each result set (1-5) 2. **Failure Pattern Analysis**: Identify common retrieval failures 3. **Root Cause Diagnosis**: Why are failures occurring? 4. **Improvement Hypotheses**: Ranked by expected impact 5. **A/B Test Proposals**: Experiments to validate improvements Provide specific, actionable recommendations with expected lift.
RAG Retrieval Quality Analyzer
U
@
Systematically analyze RAG retrieval quality through structured evaluation of results, failure patterns, and improvement hypotheses with A/B test proposals.
37 copies0 forks
Details
Category
AnalysisUse Cases
Quality analysisRetrieval optimizationRAG improvement
Works Best With
claude-sonnet-4-20250514gpt-4o
Created Shared