# Benchmark Card

## What This Pack Is
- A local synthetic benchmark kit for invoice extraction evaluation
- A packaged benchmark artifact with labels, evaluator assets, and benchmark documentation

## Who It Is For
- Teams evaluating fit, schema shape, evaluator behavior, and packaging before a paid benchmark purchase.

## Who It Is Not For
- Teams looking for real invoice archives, hosted benchmarking infrastructure, or accounting/compliance validation.

## Included In This Pack
- Synthetic invoice PDFs and JSON labels
- Pack manifest and coverage summary
- Standalone evaluator with JSON, Markdown, and HTML reports
- Preview doc, protocol doc, and model comparison guide

## What It Measures
- Invoice header field extraction against shipped ground-truth labels
- Positional line-item extraction against shipped ground-truth labels
- Coverage, invoice-level success, and optional latency/cost summaries when provided

## What It Does Not Measure
- Real-world accounting correctness beyond the shipped labels
- Bounding boxes, OCR token alignment, or confidence scoring
- Multi-page workflows, public leaderboard performance, or hosted benchmark orchestration

## Coverage Snapshot
- Product: Invoice Extraction Benchmark Kit — US English / Free Sample
- Version: `1.21`
- Document count: 12
- License tier: `free`
- Layout coverage: classic_windowed=4, dense_table=4, minimal_modern=4
- Difficulty coverage: easy=4, hard=4, medium=4
- Noise coverage: clean=8, light_noisy=4

## Known Limitations
- Synthetic invoices only
- English and USD only
- Single-page documents only
- Exact-match evaluator with bounded normalization
