Annotation Guideline Creator

U

@

·

Create annotation guidelines for human evaluation.

79 copies0 forks
Create annotation guidelines for evaluating {{model}} on {{evaluation_task}}.

Generate guidelines including:
1. Task description and goals
2. Annotation schema with examples
3. Quality criteria definitions
4. Common disagreement scenarios
5. Calibration exercises

Format for {{annotator_expertise}} annotators with {{annotation_tool}} integration notes.

Details

Category

Analysis

Use Cases

Guideline creationAnnotation designEvaluator training

Works Best With

claude-opus-4.5gpt-5.2gemini-2.0-flash
Created Shared

Create your own prompt vault and start sharing