Établissements Bertrand SASU · F2025-0066

Verdict
Cheapest without an error: Gemma 4 31B at $0.21 per 1,000 documents.
- GPT-6 Sol is also error-free but 74.8× more expensive.
Prompt given to every model
Extrayez du document joint les informations suivantes et renvoyez uniquement du JSON avec ces clés :
supplier_name Nom de l'émetteur de la facture (exactement comme sur le document, accents et forme juridique compris)
supplier_id Numéro SIRET de l'émetteur (14 chiffres ; ni le numéro de TVA intracommunautaire ni le seul numéro RCS)
vat_id Numéro de TVA intracommunautaire de l'émetteur
invoice_number Numéro du document
payment_reference Référence à rappeler lors du paiement
issue_date Date d'émission (YYYY-MM-DD)
tax_point_date Date de la livraison ou de la prestation de services (YYYY-MM-DD)
due_date Date d'échéance / « à payer avant le » (YYYY-MM-DD)
net_by_rate Montant HT par taux de TVA, p. ex. {"20": 18450.00, "5.5": 1200.00}
vat_by_rate Montant de la TVA par taux, p. ex. {"20": 3690.00}
total Montant total TTC / net à payer (nombre, négatif pour un avoir)
currency Devise selon ISO 4217 (EUR, GBP, …)
bank_account IBAN de l'émetteur
Règles :
- Ne renvoyez aucune information concernant le client, uniquement celles de l'émetteur.
- Si une information ne figure pas sur le document, renvoyez null. N'inventez rien.
- Si le document ne comporte pas de ventilation de la TVA (micro-entreprise, demande d'acompte), renvoyez net_by_rate et vat_by_rate à null.
- Montants sous forme de nombres avec un point décimal, sans séparateur de milliers et sans devise.
How we score
Exact match per field after normalising dates, amounts and whitespace. Missing diacritics count as an error. Cost is the real token spend of this run, converted at the rate shown in the footer.
What each model extracted
| Field | Correct value | Gemma 4 31B13 / 13 fields | Mistral Small 412 / 13 fields | GPT-6 Luna13 / 13 fields | DeepSeek V4.1 Flash12 / 13 fields | Gemini 3.5 Flash Lite12 / 13 fields | Qwen3.8 Flash12 / 13 fields | Mistral Medium 3.512 / 13 fields | Gemini 3.8 Flash13 / 13 fields | Claude Sonnet 511 / 13 fields | GPT-6 Sol13 / 13 fields |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Supplier | Établissements Bertrand SASU | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) | Établissements Bertrand SASU (correct) |
| Supplier ID (EIN, IČO…) | 92418455900053 | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) | 92418455900053 (correct) |
| VAT ID | FR70924184559 | FR 70 924 184 559 (correct) | FR70924184559 (correct) | FR 70 924 184 559 (correct) | FR70924184559 (correct) | FR 70 924 184 559 (correct) | FR70924184559 (correct) | FR70924184559 (correct) | FR 70 924 184 559 (correct) | FR 70 924 184 559 (correct) | FR70924184559 (correct) |
| Invoice number | F2025-0066 | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) | F2025-0066 (correct) |
| Payment reference | — | — (correct) | BC-2025-7576invented value | — (correct) | BC-2025-7576invented value | BC-2025-7576invented value | BC-2025-7576invented value | BC-2025-7576invented value | — (correct) | BC-2025-7576invented value | — (correct) |
| Invoice date | 2025-08-04 | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) |
| Tax point | 2025-08-04 | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) | 2025-08-04 (correct) |
| Due date | 2025-08-11 | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) | 2025-08-11 (correct) |
| Net by tax rate | 20 %: 2272.86 | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) | 20 %: 2272.86 (correct) |
| Tax by rate | 20 %: 454.57 | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) | 20 %: 454.57 (correct) |
| Total | 2727.43 | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) | 2727.43 (correct) |
| Currency | EUR | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) |
| Bank account | FR7617515023090006341164459 | FR76 1751 5023 0900 0634 1164 459 (correct) | FR7617515023090006341164459 (correct) | FR7617515023090006341164459 (correct) | FR76 1751 5023 0900 0634 1164 459 (correct) | FR7617515023090006341164459 (correct) | FR7617515023090006341164459 (correct) | FR7617515023090006341164459 (correct) | FR7617515023090006341164459 (correct) | FR7617515023090063411644 59wrong value | FR7617515023090006341164459 (correct) |
| Tokens | input / output | 717 / 271 | 2,610 / 221 | 5,170 / 240 | 1,771 / 1,010 | 1,529 / 275 | 3,291 / 2,686 | 2,610 / 221 | 1,529 / 1,390 | 5,387 / 238 | 5,170 / 270 |
| of which hidden reasoning | billed as output | 0 | 0 | 105 | 814 | 0 | 2,465 | 0 | 1,126 | 0 | 139 |
| of which from cache | input billed at a discount | 440 | 0 | 0 | 640 | 0 | 640 | 0 | 0 | 0 | 0 |
| Cost of this document | this run | $0.0002 | $0.0005 | $0.0008 | $0.0009 | $0.0011 | $0.0017 | $0.0056 | $0.0064 | $0.0132 | $0.0156 |
| Per 1,000 documents | for the same kind of document | $0.21 | $0.52 | $0.77 | $0.92 | $1.15 | $1.67 | $5.57 | $6.36 | $13.15 | $15.62 |
| Latency | this run | 4.8 s | 3 s | 3.3 s | 11 s | 1.9 s | 30.5 s | 2.8 s | 6.4 s | 4.3 s | 7.5 s |