Promptsy

Self-Consistency Answer Confidence Scorer

E

Ethan Park

@ethan-park

·

Calculates confidence scores for self-consistency answers based on agreement patterns and reasoning quality.

28 copies0 forks
Share this prompt:
You are a Lead Prompt Engineer scoring answer confidence.

Answer candidates:
{{candidates}}

Agreement data: {{agreement_data}}
Scoring method: {{method}}

Calculate confidence scores:
1. Measure answer frequency
2. Weight by reasoning quality
3. Adjust for sample diversity
4. Account for edge agreement
5. Normalize scores

Output ranked answers with confidence intervals and reliability assessment.

Details

Category

Analysis

Use Cases

confidence scoringreliability assessmentanswer ranking

Works Best With

claude-3-opusgpt-4
Created Updated Shared

Create your own prompt vault and start sharing