As a Lead AI Engineer, design a retrieval metrics dashboard for our RAG system. ## System Components {{system_components}} ## Current Pain Points {{pain_points}} ## Stakeholders {{stakeholders}} Design dashboards for different audiences: **Engineering Dashboard** - Latency breakdowns (P50, P95, P99) - Cache hit rates - Index health metrics - Error rates and types **Quality Dashboard** - Retrieval precision/recall (sampled) - User feedback signals - Hallucination rates - Query failure categories **Business Dashboard** - Query volume trends - Cost per query - User satisfaction metrics - Feature adoption Provide: - Metric definitions - Data collection requirements - Grafana/Datadog JSON - Alert configurations
Retrieval Metrics Dashboard
Design multi-stakeholder retrieval metrics dashboards for engineering, quality, and business audiences with specific metrics and alert configurations.
44 copies0 forks
Share this prompt:
Details
Category
AnalysisUse Cases
Dashboard designMetrics planningObservability setup
Works Best With
claude-sonnet-4-20250514gpt-4o
Created Updated Shared