ModelVerdict

Établissements Blanc SAS · F-11122

FrenchScan13 fields

Document fr-p0001 · layout fr-L05 · 13 fields · public part of the dataset · Same invoice in English (US) → · Report an error in this example

Établissements Blanc SAS · F-11122

Verdict

Cheapest with no errors: GPT-6 Luna at $0.52 per 1,000 documents.

  • Claude Sonnet 5 is also error-free, but 23.7× more expensive.
  • Gemma 4 31B is 2.5× cheaper, but: wrong value (Currency).
  • Mistral Small 4 is 1× cheaper, but: wrong value (Currency).

Prompt given to every model

Extrayez du document joint les informations suivantes et renvoyez uniquement du JSON avec ces clés :

supplier_name      Nom de l'émetteur de la facture (exactement comme sur le document, accents et forme juridique compris)
supplier_id        Numéro SIRET de l'émetteur (14 chiffres ; ni le numéro de TVA intracommunautaire ni le seul numéro RCS)
vat_id             Numéro de TVA intracommunautaire de l'émetteur
invoice_number     Numéro du document
payment_reference  Référence à rappeler lors du paiement
issue_date         Date d'émission (YYYY-MM-DD)
tax_point_date     Date de la livraison ou de la prestation de services (YYYY-MM-DD)
due_date           Date d'échéance / « à payer avant le » (YYYY-MM-DD)
net_by_rate        Montant HT par taux de TVA, p. ex. {"20": 18450.00, "5.5": 1200.00}
vat_by_rate        Montant de la TVA par taux, p. ex. {"20": 3690.00}
total              Montant total TTC / net à payer (nombre, négatif pour un avoir)
currency           Devise selon ISO 4217 (EUR, GBP, …)
bank_account       IBAN de l'émetteur

Règles :
- Ne renvoyez aucune information concernant le client, uniquement celles de l'émetteur.
- Si une information ne figure pas sur le document, renvoyez null. N'inventez rien.
- Si le document ne comporte pas de ventilation de la TVA (micro-entreprise, demande d'acompte), renvoyez net_by_rate et vat_by_rate à null.
- Montants sous forme de nombres avec un point décimal, sans séparateur de milliers et sans devise.

How we score

Exact match per field after normalizing dates, amounts, and whitespace. Missing diacritics count as an error. Cost is the actual token spend of this run, converted at the rate shown in the footer.

What each model extracted

FieldCorrect valueGemma 4 31B12 / 13 fieldsMistral Small 411 / 13 fieldsGPT-6 Luna13 / 13 fieldsGLM-5.3 Flash13 / 13 fieldsClaude Haiku 5.513 / 13 fieldsDeepSeek V4.1 Flash13 / 13 fieldsGemini 3.5 Flash Lite13 / 13 fieldsQwen3.8 Flash0 / 13 fieldsGemini 3.8 Flash13 / 13 fieldsMistral Medium 3.511 / 13 fieldsMistral Large 412 / 13 fieldsGPT-6 Sol13 / 13 fieldsClaude Sonnet 5.513 / 13 fieldsClaude Sonnet 513 / 13 fields
SupplierÉtablissements Blanc SASÉtablissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct) nullinvalid JSONÉtablissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)Établissements Blanc SAS (correct)
Supplier ID (EIN, IČO…)The company registration number (Czech IČO, German Handelsregister, US EIN…). Not the VAT ID (DIČ, USt-IdNr.). If the document has none, the field should stay empty.8663070850001386630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct) nullinvalid JSON86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)86630708500013 (correct)
VAT IDThe supplier's VAT ID (DIČ, USt-IdNr., VAT number). Not the registration number.FR73866307085FR73866307085 (correct)FR73866307085 (correct)FR73866307085 (correct)FR73866307085 (correct)FR73866307085 (correct)FR73866307085 (correct)FR73866307085 (correct) nullinvalid JSONFR73866307085 (correct)FR73866307085 (correct) FR7386307085wrong valueFR73866307085 (correct)FR73866307085 (correct)FR73866307085 (correct)
Invoice numberF-11122F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct) nullinvalid JSONF-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)
Payment referenceF-11122F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct) nullinvalid JSONF-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)F-11122 (correct)
Invoice date2025-04-082025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct) nullinvalid JSON2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)
Tax pointThe tax point (date of supply). It can differ from the issue date.2025-04-082025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct) nullinvalid JSON2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)2025-04-08 (correct)
Due date2025-04-222025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct) nullinvalid JSON2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)
Net amount by tax rate0 %: 1059.920 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct) nullinvalid JSON0 %: 1059.92 (correct) nullmissing field0 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct)0 %: 1059.92 (correct)
Tax amount by tax rate0 %: 0.000 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct) nullinvalid JSON0 %: 0.00 (correct)— (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)0 %: 0.00 (correct)
Total1059.921059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct) nullinvalid JSON1059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct)1059.92 (correct)
CurrencyGBP EURwrong value EURwrong valueGBP (correct)GBP (correct)GBP (correct)GBP (correct)GBP (correct) nullinvalid JSONGBP (correct) EURwrong valueGBP (correct)GBP (correct)GBP (correct)GBP (correct)
Bank accountFR7630003035500003114132087FR76 3000 3035 5000 0311 4132 087 (correct) FR763000303550003114132087wrong valueFR7630003035500003114132087 (correct)FR7630003035500003114132087 (correct)FR7630003035500003114132087 (correct)FR7630003035500003114132087 (correct)FR76 3000 3035 5000 0311 4132 087 (correct) nullinvalid JSONFR7630003035500003114132087 (correct)FR76 3000 3035 5000 0311 4132 087 (correct)FR7630003035500003114132087 (correct)FR7630003035500003114132087 (correct)FR7630003035500003114132087 (correct)FR7630003035500003114132087 (correct)
Tokensinput / output717 / 2662,610 / 2053,127 / 2523,246 / 5403,468 / 9271,771 / 1,0411,529 / 2652,916 / 8251,529 / 9142,610 / 1982,868 / 3,8403,127 / 2973,468 / 4533,466 / 532
including hidden reasoningbilled as output00121360701817082065602,695166227305
including cached inputinput billed at a discount439000021802,688000000
Cost of this documentthis run$0.0002$0.0005$0.0005$0.0008$0.0008$0.0010$0.0011$0.0020$0.0046$0.0054$0.0100$0.0108$0.0115$0.0123
Per 1,000 documentsfor documents of this type$0.21$0.51$0.52$0.76$0.81$1.03$1.12$2.05$4.57$5.40$9.98$10.79$11.47$12.25
Latencythis run7.9 s2.1 s4.8 s6.4 s4.9 s11.8 s1.5 s12.1 s4.7 s2.7 s60.6 s6.1 s9.1 s11.9 s

Log in with email

We use your email only to log you in (and for the digest if you tick it). No spam.