Benchmark Designer Test Creation

Priya Ramanathan

@priya-ramanathan

·December 31, 2025

Design benchmarks from test designer perspective.

33 copies0 forks

Share this prompt:

As a Benchmark Designer, create evaluation suite for {{model}} on {{capability}}.

Benchmark design:
- Test case diversity across {{difficulty_levels}}
- Ground truth generation methodology
- Scoring rubric development
- Statistical validity requirements
- Administration protocol

Provide benchmark specification with validation criteria.

Details

Category

Analysis

Use Cases

Benchmark designTest creationEvaluation development

Works Best With

claude-opus-4.5gpt-5.2gemini-2.0-flash

Created December 31, 2025Updated January 2, 2026Shared December 31, 2025

Related Prompts

Meta-Prompt Benchmark Suite Creator

by @ethan-park

Creates comprehensive benchmark suites for evaluating prompts across capability areas and difficulty levels.

Reflection Comparative Benchmark Creator

by @ethan-park

Creates benchmarks to compare different reflection methods across standardized evaluation tasks.

Meta-Prompt: Benchmark Suite Generator

by @samira-el-masri

Generate prompts for creating RAG system benchmark suites

Customer Benchmark Report

by @aisha-bello

Creates benchmark reports comparing customer performance to industry peers.

A/B Test Design Framework

by @jordan-reyes

Create rigorous A/B test designs with clear success criteria

Meta-Prompt A/B Test Designer

by @ethan-park

Designs A/B test specifications for prompt variants with proper hypothesis, metrics, and analysis plans.

More from @priya-ramanathan

Mitigation Strategy Branching

Instruction Complexity Scoring

Deployment Scenario Analysis

Capability Probe Designer

Create your own prompt vault and start sharing