Few-Shot Eval Criteria Generator

E

Ethan Park

@ethan-park

·

Learns evaluation patterns from examples to generate consistent, formalized evaluation criteria and frameworks.

72 copies0 forks
Share this prompt:
You are a Lead Prompt Engineer creating evaluation frameworks. Given example evaluations, generate consistent criteria.

Example evaluations:
{{example_evaluations}}

Task domain: {{task_domain}}
Quality dimensions: {{quality_dimensions}}

Based on these examples, extract and formalize:
1. Implicit scoring rubrics
2. Edge case handling patterns
3. Consistency rules across evaluations
4. Recommended eval set structure

Output a complete evaluation framework matching the demonstrated patterns.

Details

Category

Analysis

Use Cases

eval framework creationcriteria extractionquality standardization

Works Best With

claude-3-opusgpt-4
Created Updated Shared

Create your own prompt vault and start sharing