Clément & Fils SASU · 2025-04-431

Verdict
Cheapest with no errors: Mistral Small 4 at $0.50 per 1,000 documents.
- Claude Sonnet 5.5 is also error-free, but 32.6× more expensive.
- Gemma 4 31B is 2.6× cheaper, but: wrong value (Supplier ID (EIN, IČO…)).
Prompt given to every model
Extrayez du document joint les informations suivantes et renvoyez uniquement du JSON avec ces clés :
supplier_name Nom de l'émetteur de la facture (exactement comme sur le document, accents et forme juridique compris)
supplier_id Numéro SIRET de l'émetteur (14 chiffres ; ni le numéro de TVA intracommunautaire ni le seul numéro RCS)
vat_id Numéro de TVA intracommunautaire de l'émetteur
invoice_number Numéro du document
payment_reference Référence à rappeler lors du paiement
issue_date Date d'émission (YYYY-MM-DD)
tax_point_date Date de la livraison ou de la prestation de services (YYYY-MM-DD)
due_date Date d'échéance / « à payer avant le » (YYYY-MM-DD)
net_by_rate Montant HT par taux de TVA, p. ex. {"20": 18450.00, "5.5": 1200.00}
vat_by_rate Montant de la TVA par taux, p. ex. {"20": 3690.00}
total Montant total TTC / net à payer (nombre, négatif pour un avoir)
currency Devise selon ISO 4217 (EUR, GBP, …)
bank_account IBAN de l'émetteur
Règles :
- Ne renvoyez aucune information concernant le client, uniquement celles de l'émetteur.
- Si une information ne figure pas sur le document, renvoyez null. N'inventez rien.
- Si le document ne comporte pas de ventilation de la TVA (micro-entreprise, demande d'acompte), renvoyez net_by_rate et vat_by_rate à null.
- Montants sous forme de nombres avec un point décimal, sans séparateur de milliers et sans devise.
How we score
Exact match per field after normalizing dates, amounts, and whitespace. Missing diacritics count as an error. Cost is the actual token spend of this run, converted at the rate shown in the footer.
What each model extracted
| Field | Correct value | Gemma 4 31B12 / 13 fields | Mistral Small 413 / 13 fields | DeepSeek V4.1 Flash13 / 13 fields | GPT-6 Luna13 / 13 fields | Claude Haiku 5.513 / 13 fields | Gemini 3.5 Flash Lite12 / 13 fields | Qwen3.8 Flash13 / 13 fields | GLM-5.3 Flash12 / 13 fields | Mistral Large 413 / 13 fields | Mistral Medium 3.513 / 13 fields | Gemini 3.8 Flash13 / 13 fields | Claude Sonnet 513 / 13 fields | GPT-6 Sol13 / 13 fields | Claude Sonnet 5.513 / 13 fields |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Supplier | Clément & Fils SASU | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) | Clément & Fils SASU (correct) |
| Supplier ID (EIN, IČO…)The company registration number (Czech IČO, German Handelsregister, US EIN…). Not the VAT ID (DIČ, USt-IdNr.). If the document has none, the field should stay empty. | 51770490400013 | 517704900013wrong value | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) | 51770490400013 (correct) |
| VAT IDThe supplier's VAT ID (DIČ, USt-IdNr., VAT number). Not the registration number. | FR00517704904 | FR 00 517 704 904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) | FR 00 517 704 904 (correct) | FR 00 517 704 904 (correct) | FR00517704904 (correct) | FR00517704904 (correct) |
| Invoice number | 2025-04-431 | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-43Iwrong value | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) | 2025-04-431 (correct) |
| Payment reference | CL10932 | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CLI0932wrong value | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) | CL10932 (correct) |
| Invoice date | 2025-04-02 | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) | 2025-04-02 (correct) |
| Tax pointThe tax point (date of supply). It can differ from the issue date. | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Due date | 2025-04-09 | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) | 2025-04-09 (correct) |
| Net amount by tax rate | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Tax amount by tax rate | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Total | 10300.00 | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) | 10300.00 (correct) |
| Currency | EUR | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) | EUR (correct) |
| Bank account | FR7630002002946540747392911 | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) | FR7630002002946540747392911 (correct) |
| Tokens | input / output | 717 / 229 | 2,610 / 186 | 1,771 / 450 | 5,170 / 232 | 5,389 / 756 | 1,529 / 226 | 3,291 / 2,133 | 5,451 / 369 | 2,868 / 1,583 | 2,610 / 184 | 1,529 / 1,165 | 5,387 / 210 | 5,170 / 309 | 5,389 / 561 |
| including hidden reasoning | billed as output | 0 | 0 | 291 | 112 | 550 | 0 | 1,945 | 221 | 1,288 | 0 | 936 | 0 | 189 | 355 |
| including cached input | input billed at a discount | 440 | 0 | 640 | 0 | 0 | 0 | 640 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Cost of this document | this run | $0.0002 | $0.0005 | $0.0006 | $0.0008 | $0.0009 | $0.0010 | $0.0014 | $0.0015 | $0.0053 | $0.0053 | $0.0055 | $0.0129 | $0.0160 | $0.0164 |
| Per 1,000 documents | for documents of this type | $0.19 | $0.50 | $0.55 | $0.76 | $0.92 | $1.02 | $1.41 | $1.50 | $5.26 | $5.30 | $5.52 | $12.87 | $16.01 | $16.39 |
| Latency | this run | 6.5 s | 1.9 s | 5.6 s | 5.4 s | 4.4 s | 1.4 s | 26.8 s | 5.3 s | 18.2 s | 3 s | 5.7 s | 3.8 s | 7.3 s | 8.7 s |