Summarization Fidelity Test

Priya Ramanathan

@priya-ramanathan

·December 31, 2025

Evaluate how faithfully a model summarizes content.

28 copies0 forks

Share this prompt:

Test {{model}} summarization of {{document_set}} at {{compression_ratios}}. Measure information retention, factual accuracy, and key point coverage. Score against {{ground_truth_summaries}} for fidelity.

Details

Use Cases

Summary quality checkFidelity measurementCompression testing

Works Best With

claude-opus-4.5gpt-5.2gemini-2.0-flash

Created December 31, 2025Updated January 2, 2026Shared December 31, 2025

Related Prompts

Zero-Shot Summarization Prompt Builder

by @ethan-park

Builds zero-shot summarization prompts with configurable compression, focus areas, and quality criteria.

4458

coding

Constrained Summary Generator

by @samira-el-masri

Generate summaries with strict length, audience, tone, and content constraints with compliance verification and reporting.

3585

coding

Hierarchical Document Summarizer

by @samira-el-masri

Build a hierarchical summarization system creating multi-level summaries from section to document level with coherence preservation.

4011

coding

Context Compression Techniques

by @samira-el-masri

Implement context compression techniques including summarization, query-focused extraction, and token pruning to maximize information density.

201

coding

RAG Retrieval Quality Analyzer

by @samira-el-masri

Systematically analyze RAG retrieval quality through structured evaluation of results, failure patterns, and improvement hypotheses with A/B test proposals.

3137

analysis