Hermanos Peral S.L. · F2025-0581

Verdict
Cheapest with no errors: Mistral Small 4 at $0.52 per 1,000 documents.
- Mistral Large 4 is also error-free, but 38.5× more expensive.
- Gemma 4 31B is 2.8× cheaper, but: wrong value (Supplier ID (EIN, IČO…)).
Prompt given to every model
Extraiga del documento adjunto los siguientes datos y devuelva exclusivamente un JSON con estas claves:
supplier_name Nombre o razón social del emisor de la factura (exactamente como figura en el documento, incluidos acentos y forma jurídica)
supplier_id NIF del emisor (en empresas también llamado CIF, p. ej. B12345674; en autónomos, DNI con letra), sin el prefijo de país «ES»
vat_id NIF-IVA (número de IVA intracomunitario, «ES» + NIF) del emisor, solo si figura como tal en el documento
invoice_number Número de factura (o del documento)
payment_reference Concepto o referencia que debe indicarse al realizar el pago
issue_date Fecha de expedición de la factura (YYYY-MM-DD)
tax_point_date Fecha de operación (fecha de devengo del IVA) (YYYY-MM-DD)
due_date Fecha de vencimiento (YYYY-MM-DD)
net_by_rate Base imponible por tipo de IVA, p. ej. {"21": 18450.00, "10": 1200.00}
vat_by_rate Cuota de IVA por tipo, p. ej. {"21": 3874.50}
total Importe total de la factura / importe a pagar (número, negativo en facturas rectificativas que abonan un importe)
currency Moneda según ISO 4217 (EUR, USD, …)
bank_account IBAN del emisor
Reglas:
- No devuelva datos del cliente (destinatario), solo los del emisor.
- Si un dato no figura en el documento, devuelva null. No invente nada.
- Si el documento no contiene desglose del IVA (operación exenta, factura proforma), devuelva net_by_rate y vat_by_rate como null.
- Importes como números con punto decimal, sin separadores de miles y sin moneda.
How we score
Exact match per field after normalizing dates, amounts, and whitespace. Missing diacritics count as an error. Cost is the actual token spend of this run, converted at the rate shown in the footer.
What each model extracted
| Field | Correct value | Gemma 4 31B10 / 13 fields | Mistral Small 413 / 13 fields | DeepSeek V4.1 Flash13 / 13 fields | GPT-6 Luna13 / 13 fields | Claude Haiku 5.513 / 13 fields | Gemini 3.5 Flash Lite13 / 13 fields | Qwen3.8 Flash13 / 13 fields | GLM-5.3 Flash13 / 13 fields | Gemini 3.8 Flash13 / 13 fields | Mistral Medium 3.512 / 13 fields | GPT-6 Sol13 / 13 fields | Claude Sonnet 5.513 / 13 fields | Mistral Large 413 / 13 fields | Claude Sonnet 511 / 13 fields |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Supplier | Hermanos Peral S.L. | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | HERMANOS Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | Hermanos Peral S.L. (correct) | — (correct) |
| Supplier ID (EIN, IČO…)The company registration number (Czech IČO, German Handelsregister, US EIN…). Not the VAT ID (DIČ, USt-IdNr.). If the document has none, the field should stay empty. | B03707783 | B03770783wrong value | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | B03707783 (correct) | — (correct) |
| VAT IDThe supplier's VAT ID (DIČ, USt-IdNr., VAT number). Not the registration number. | ESB03707783 | ES B03770783wrong value | ES B03707783 (correct) | ESB03707783 (correct) | ESB03707783 (correct) | ESB03707783 (correct) | ES B03707783 (correct) | ES B03707783 (correct) | ESB03707783 (correct) | ES B03707783 (correct) | ES B03707783 (correct) | ESB03707783 (correct) | ESB03707783 (correct) | ESB03707783 (correct) | — (correct) |
| Invoice number | F2025-0581 | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | F2025-0581 (correct) | — (correct) |
| Payment reference | CLI-50031 | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | CLI-50031 (correct) | — (correct) |
| Invoice date | 2025-04-08 | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | — (correct) |
| Tax pointThe tax point (date of supply). It can differ from the issue date. | 2025-04-08 | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | 2025-04-08 (correct) | — (correct) |
| Due date | 2025-04-22 | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | 2025-04-22 (correct) | — (correct) |
| Net amount by tax rate | 0 %: 1330.12 | nullmissing field | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | nullmissing field | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | 0 %: 1330.12 (correct) | nullmissing field |
| Tax amount by tax rate | 0 %: 0.00 | — (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | — (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | 0 %: 0.00 (correct) | — (correct) |
| Total | 1330.12 | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | 1330.12 (correct) | — (correct) |
| Currency | USD | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | — (correct) |
| Bank account | ES8200493268345964187393 | ES82 0049 3268 3459 6418 7393 (correct) | ES82 0049 3268 3459 6418 7393 (correct) | ES8200493268345964187393 (correct) | ES8200493268345964187393 (correct) | ES8200493268345964187393 (correct) | ES82 0049 3268 3459 6418 7393 (correct) | ES8200493268345964187393 (correct) | ES8200493268345964187393 (correct) | ES82 0049 3268 3459 6418 7393 (correct) | ES8200493268345964187393 (correct) | ES82 0049 3268 3459 6418 7393 (correct) | ES8200493268345964187393 (correct) | ES8200493268345964187393 (correct) | nullwrong value |
| Tokens | input / output | 743 / 203 | 2,649 / 206 | 1,795 / 552 | 5,193 / 267 | 5,422 / 788 | 1,555 / 258 | 3,326 / 2,985 | 5,486 / 942 | 1,555 / 1,112 | 2,649 / 187 | 5,193 / 265 | 5,422 / 659 | 2,906 / 3,697 | 5,420 / 932 |
| including hidden reasoning | billed as output | 0 | 0 | 396 | 134 | 560 | 0 | 2,782 | 724 | 855 | 0 | 124 | 431 | 2,603 | 0 |
| including cached input | input billed at a discount | 3 | 0 | 664 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Cost of this document | this run | $0.0002 | $0.0005 | $0.0006 | $0.0008 | $0.0009 | $0.0011 | $0.0019 | $0.0019 | $0.0053 | $0.0054 | $0.0156 | $0.0174 | $0.0200 | $0.0360 |
| Per 1,000 documents | for documents of this type | $0.19 | $0.52 | $0.62 | $0.78 | $0.94 | $1.11 | $1.90 | $1.94 | $5.34 | $5.38 | $15.63 | $17.43 | $20.04 | $35.99 |
| Latency | this run | 4.1 s | 2.3 s | 8.8 s | 3.9 s | 5.3 s | 2.5 s | 36.9 s | 7.2 s | 4.8 s | 2.6 s | 5.8 s | 7.4 s | 59.5 s | 10.7 s |