Promptsy

Token-Limited Model Evaluation

U

@

·

Evaluate model with strict token budget constraints.

29 copies0 forks
Evaluate {{model}} on {{evaluation_set}} within {{token_budget}} tokens.

Constraints:
- Maximum {{input_tokens}} input tokens per query
- Maximum {{output_tokens}} output tokens per response
- No multi-turn conversations

Report accuracy achieved within constraints. Compare to unconstrained baseline. Recommend optimal token allocation strategy.

Details

Category

Analysis

Use Cases

Budget evaluationToken optimizationConstrained testing

Works Best With

claude-opus-4.5gpt-5.2gemini-2.0-flash
Created Shared

Create your own prompt vault and start sharing