# Evaluation Report

## Overall Metrics
- Overall field accuracy: 0.9904
- Invoice count: 8
- Invoice-level success: 7 / 8 (0.875)
- Missing field count: 0
- Extra field count: 0
- Line-item accuracy: 1.0

## Coverage
- Field coverage: 102 / 104 (0.9808)
- Line-item field coverage: 128 / 128 (1.0)
- Overall coverage: 230 / 232 (0.9914)

## Invoice-Level Success
- Definition: all expected header fields must match, no extra header fields may appear, predicted line-item count must match expected count, and line-item accuracy for that invoice must be `1.0`.

## Slice Summaries

## Clean vs Noisy Summary
- `clean`: invoice_count=6, overall_field_accuracy=0.9872, line_item_accuracy=1.0, invoice_level_success_rate=0.8333
- `light_noisy`: invoice_count=2, overall_field_accuracy=1.0, line_item_accuracy=1.0, invoice_level_success_rate=1.0

## Layout Summary
- `classic_windowed`: invoice_count=4, overall_field_accuracy=0.9808, line_item_accuracy=1.0, invoice_level_success_rate=0.75
- `dense_table`: invoice_count=2, overall_field_accuracy=1.0, line_item_accuracy=1.0, invoice_level_success_rate=1.0
- `minimal_modern`: invoice_count=2, overall_field_accuracy=1.0, line_item_accuracy=1.0, invoice_level_success_rate=1.0

## Difficulty Summary
- `easy`: invoice_count=3, overall_field_accuracy=1.0, line_item_accuracy=1.0, invoice_level_success_rate=1.0
- `hard`: invoice_count=3, overall_field_accuracy=0.9744, line_item_accuracy=1.0, invoice_level_success_rate=0.6667
- `medium`: invoice_count=2, overall_field_accuracy=1.0, line_item_accuracy=1.0, invoice_level_success_rate=1.0

## Latency Summary
- Count: 8
- Mean runtime (ms): 165.25
- Median runtime (ms): 165.25
- Min runtime (ms): 118.0
- Max runtime (ms): 212.5

## Cost Summary
- Count: 8
- Total cost (USD): 0.158
- Mean cost per invoice (USD): 0.0198
- Min cost (USD): 0.011
- Max cost (USD): 0.0285

## Per-Field Accuracy
- `bill_to_address`: 1.0
- `bill_to_name`: 1.0
- `currency`: 1.0
- `due_date`: 1.0
- `invoice_date`: 1.0
- `invoice_number`: 1.0
- `payment_terms`: 0.875
- `purchase_order_number`: 1.0
- `subtotal`: 1.0
- `supplier_address`: 1.0
- `supplier_name`: 1.0
- `tax_amount`: 1.0
- `total_amount`: 1.0

## Document Breakdown
- `inv_0001`: field_accuracy=0.9231, field_coverage=1.0, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=False, runtime_ms=118.0, cost_usd=0.011
- `inv_0002`: field_accuracy=1.0, field_coverage=0.9231, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=131.5, cost_usd=0.0135
- `inv_0003`: field_accuracy=1.0, field_coverage=1.0, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=145.0, cost_usd=0.016
- `inv_0004`: field_accuracy=1.0, field_coverage=1.0, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=158.5, cost_usd=0.0185
- `inv_0005`: field_accuracy=1.0, field_coverage=1.0, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=172.0, cost_usd=0.021
- `inv_0006`: field_accuracy=1.0, field_coverage=0.9231, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=185.5, cost_usd=0.0235
- `inv_0007`: field_accuracy=1.0, field_coverage=1.0, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=199.0, cost_usd=0.026
- `inv_0008`: field_accuracy=1.0, field_coverage=1.0, missing=0, extra=0, line_item_accuracy=1.0, line_item_coverage=1.0, invoice_success=True, runtime_ms=212.5, cost_usd=0.0285

## Mismatch Examples
- `inv_0001` `field_mismatch` `payment_terms`: expected=Due on receipt predicted=Net 45
