# Model Comparison Guide

Use this guide when comparing two model outputs on the same benchmark pack.

## Practical Rules
- Use the same pack version and the same release artifact for both runs.
- Keep upstream normalization assumptions consistent across runs.
- Compare overall metrics and slice summaries together, not just topline accuracy.
- Include latency or cost only when both runs provide them on the same basis.
- Inspect mismatch examples and document breakdowns before drawing conclusions.
- Do not draw strong conclusions from tiny preview subsets alone.
- Do not treat this benchmark as a proxy for accounting, tax, or compliance correctness.
