ModelVerdict

Talleres Ibérica, S.A. · PF25/1188

SpanishClean image13 fields

Document es-p0002 · layout es-L04 · 13 fields · public part of the dataset · Same invoice in English (US) → · Report an error in this example

Talleres Ibérica, S.A. · PF25/1188

Verdict

Cheapest with no errors: Gemma 4 31B at $0.18 per 1,000 documents.

  • GPT-6 Sol is also error-free, but 83.3× more expensive.

Prompt given to every model

Extraiga del documento adjunto los siguientes datos y devuelva exclusivamente un JSON con estas claves:

supplier_name      Nombre o razón social del emisor de la factura (exactamente como figura en el documento, incluidos acentos y forma jurídica)
supplier_id        NIF del emisor (en empresas también llamado CIF, p. ej. B12345674; en autónomos, DNI con letra), sin el prefijo de país «ES»
vat_id             NIF-IVA (número de IVA intracomunitario, «ES» + NIF) del emisor, solo si figura como tal en el documento
invoice_number     Número de factura (o del documento)
payment_reference  Concepto o referencia que debe indicarse al realizar el pago
issue_date         Fecha de expedición de la factura (YYYY-MM-DD)
tax_point_date     Fecha de operación (fecha de devengo del IVA) (YYYY-MM-DD)
due_date           Fecha de vencimiento (YYYY-MM-DD)
net_by_rate        Base imponible por tipo de IVA, p. ej. {"21": 18450.00, "10": 1200.00}
vat_by_rate        Cuota de IVA por tipo, p. ej. {"21": 3874.50}
total              Importe total de la factura / importe a pagar (número, negativo en facturas rectificativas que abonan un importe)
currency           Moneda según ISO 4217 (EUR, USD, …)
bank_account       IBAN del emisor

Reglas:
- No devuelva datos del cliente (destinatario), solo los del emisor.
- Si un dato no figura en el documento, devuelva null. No invente nada.
- Si el documento no contiene desglose del IVA (operación exenta, factura proforma), devuelva net_by_rate y vat_by_rate como null.
- Importes como números con punto decimal, sin separadores de miles y sin moneda.

How we score

Exact match per field after normalizing dates, amounts, and whitespace. Missing diacritics count as an error. Cost is the actual token spend of this run, converted at the rate shown in the footer.

What each model extracted

FieldCorrect valueGemma 4 31B13 / 13 fieldsMistral Small 412 / 13 fieldsDeepSeek V4.1 Flash13 / 13 fieldsGPT-6 Luna13 / 13 fieldsClaude Haiku 5.513 / 13 fieldsGemini 3.5 Flash Lite13 / 13 fieldsQwen3.8 Flash3 / 13 fieldsGLM-5.3 Flash13 / 13 fieldsGemini 3.8 Flash13 / 13 fieldsMistral Medium 3.513 / 13 fieldsMistral Large 413 / 13 fieldsClaude Sonnet 5.513 / 13 fieldsGPT-6 Sol13 / 13 fieldsClaude Sonnet 512 / 13 fields
SupplierTalleres Ibérica, S.A.Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct) nullmissing fieldTalleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)Talleres Ibérica, S.A. (correct)— (correct)
Supplier ID (EIN, IČO…)The company registration number (Czech IČO, German Handelsregister, US EIN…). Not the VAT ID (DIČ, USt-IdNr.). If the document has none, the field should stay empty.A38261673A38261673 (correct)A38261673 (correct)A38261673 (correct)A38261673 (correct)A38261673 (correct)A38261673 (correct) nullmissing fieldA38261673 (correct)A38261673 (correct)A38261673 (correct)A38261673 (correct)A38261673 (correct)A38261673 (correct)— (correct)
VAT IDThe supplier's VAT ID (DIČ, USt-IdNr., VAT number). Not the registration number.ESA38261673ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct) nullmissing fieldESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)ESA38261673 (correct)— (correct)
Invoice numberPF25/1188PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct) nullmissing fieldPF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)— (correct)
Payment referencePF25/1188PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct) nullmissing fieldPF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)PF25/1188 (correct)— (correct)
Invoice date2025-04-022025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct) nullmissing field2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)2025-04-02 (correct)— (correct)
Tax pointThe tax point (date of supply). It can differ from the issue date.—— (correct) 2025-04-02extra value— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)
Due date2025-04-092025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct) nullmissing field2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)2025-04-09 (correct)— (correct)
Net amount by tax rate—— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)
Tax amount by tax rate—— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)
Total10300.0010300.00 (correct)10300.00 (correct)10300.00 (correct)10300.00 (correct)10300.00 (correct)10300.00 (correct) nullmissing field10300.00 (correct)10300.00 (correct)10300 (correct)10300.00 (correct)10300.00 (correct)10300.00 (correct)— (correct)
CurrencyEUREUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct) nullmissing fieldEUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)— (correct)
Bank accountES6621032698621916622684ES66 2103 2698 6219 1662 2684 (correct)ES6621032698621916622684 (correct)ES66 2103 2698 6219 1662 2684 (correct)ES6621032698621916622684 (correct)ES6621032698621916622684 (correct)ES66 2103 2698 6219 1662 2684 (correct) nullmissing fieldES6621032698621916622684 (correct)ES6621032698621916622684 (correct)ES6621032698621916622684 (correct)ES6621032698621916622684 (correct)ES6621032698621916622684 (correct)ES6621032698621916622684 (correct) nullwrong value
Tokensinput / output743 / 1932,649 / 1871,795 / 3385,193 / 2075,422 / 7071,555 / 2213,326 / 1,2555,486 / 3601,555 / 7922,649 / 1752,906 / 2,5015,422 / 2105,193 / 2125,420 / 688
including hidden reasoningbilled as output001958849701,06621657702,1290930
including cached inputinput billed at a discount46602180003,2000000000
Cost of this documentthis run$0.0002$0.0005$0.0006$0.0008$0.0009$0.0010$0.0014$0.0015$0.0041$0.0053$0.0072$0.0129$0.0151$0.0331
Per 1,000 documentsfor documents of this type$0.18$0.51$0.57$0.75$0.90$1.02$1.40$1.50$4.14$5.29$7.20$12.94$15.10$33.10
Latencythis run3.7 s1.8 s6.2 s4.2 s4.7 s1.7 s19.8 s3.7 s4.2 s2.3 s27.8 s3.1 s6.9 s6.8 s

Log in with email

We use your email only to log you in (and for the digest if you tick it). No spam.