As a Lead AI Engineer, design a retrieval metrics dashboard for our RAG system. ## System Components {{system_components}} ## Current Pain Points {{pain_points}} ## Stakeholders {{stakeholders}} Design dashboards for different audiences: **Engineering Dashboard** - Latency breakdowns (P50, P95, P99) - Cache hit rates - Index health metrics - Error rates and types **Quality Dashboard** - Retrieval precision/recall (sampled) - User feedback signals - Hallucination rates - Query failure categories **Business Dashboard** - Query volume trends - Cost per query - User satisfaction metrics - Feature adoption Provide: - Metric definitions - Data collection requirements - Grafana/Datadog JSON - Alert configurations
Retrieval Metrics Dashboard
U
@
Design multi-stakeholder retrieval metrics dashboards for engineering, quality, and business audiences with specific metrics and alert configurations.
44 copies0 forks
Details
Category
AnalysisUse Cases
Dashboard designMetrics planningObservability setup
Works Best With
claude-sonnet-4-20250514gpt-4o
Created Shared