Chain-of-Thought Latency Budget Allocation

Allocate latency budget across RAG pipeline components systematically.

Total Latency Budget: {{target_latency_ms}}ms

Pipeline Components:
{{pipeline_stages}}

Current Measurements:
{{current_latencies}}

Step 1: Map the critical path through all components
Step 2: Identify which components have fixed vs. variable latency
Step 3: Calculate minimum latency floor for each stage
Step 4: Distribute remaining budget based on optimization potential
Step 5: Define latency SLOs per component
Step 6: Create monitoring thresholds and alerts

Provide final latency budget allocation with justification for each decision.