Claude Sonnet 5 vs Mistral Small 4
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 99.8% / 95.6% | 100.0% / 93.6% | 99.0% / 94.6% | 93.6% / 91.9% | 98.7% / 94.2% |
| Email triage | 98.2% / 89.7% | 98.2% / 87.7% | 97.9% / 87.1% | — | — |
| Personal data detection | 99.7% / 99.4% | 98.9% / 98.8% | 99.7% / 99.1% | — | — |
| Contract clauses | 100.0% / 91.5% | 100.0% / 99.0% | 98.2% / 94.0% | — | — |
Correct fields: Claude Sonnet 5 / Mistral Small 4; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 4.2 pp. Mistral Small 4 is 21.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.8% | 95.6% |
| Error-free documents | 99% | 58% |
| Per 1,000 documents | $8.84 | $0.41 |
| To fix / 1,000 | 13 | 420 |
| Speed (median) | 3.2 sec | 1.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Supplier | 100.0% | 100.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 99.3% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 87.3% |
| Invoice date | 100.0% | 97.3% |
| Due date | 100.0% | 98.7% |
| Net by tax rate | 98.7% | 72.0% |
| Tax by rate | 99.3% | 99.3% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 99.3% |
| Bank account | 100.0% | 98.0% |
Documents where they differ
- Cochran-Graham Group LLC · A-007505 · Clean image · Claude Sonnet 5 11/11, Mistral Small 4 9/11
- Raleigh Engineering Inc. · INV253511 · Scan · Claude Sonnet 5 11/11, Mistral Small 4 9/11
- Atlanta Office Products LLC · A-001328 · PDF text · Claude Sonnet 5 11/11, Mistral Small 4 9/11
- Reid Office Products LLC · A-003849 · Scan · Claude Sonnet 5 11/11, Mistral Small 4 10/11
- Miranda-Vega Group LLC · 4959 · PDF text · Claude Sonnet 5 11/11, Mistral Small 4 10/11
- Summit Services Inc. · INV-15230 · Scan · Claude Sonnet 5 11/11, Mistral Small 4 10/11
- Hughes Janitorial Services Corp. · A-001911 · Scan · Claude Sonnet 5 11/11, Mistral Small 4 10/11
- Lutz & Sons, Inc. · A-008230 · Clean image · Claude Sonnet 5 11/11, Mistral Small 4 10/11
Invoice extraction · Czech (150 documents)
Claude Sonnet 5 is more accurate by 6.4 pp. Mistral Small 4 is 21.5× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.0% | 93.6% |
| Error-free documents | 100% | 56% |
| Per 1,000 documents | $9.41 | $0.44 |
| To fix / 1,000 | 0 | 440 |
| Speed (median) | 3.6 sec | 2.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Supplier | 100.0% | 91.3% |
| Supplier ID (EIN, IČO…) | 100.0% | 92.7% |
| VAT ID | 100.0% | 94.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 97.3% |
| Invoice date | 100.0% | 98.0% |
| Tax point | 100.0% | 76.0% |
| Due date | 100.0% | 97.3% |
| Net by tax rate | 100.0% | 90.0% |
| Tax by rate | 100.0% | 94.7% |
| Total | 100.0% | 98.7% |
| Currency | 100.0% | 97.3% |
| Bank account | 100.0% | 90.0% |
Documents where they differ
- Sedláček s.r.o. · 2025/0774 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Pavlík a Zeman s.r.o. · 25500457 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Hruška a Šťastný s.r.o. · 2025/0324 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Tesař s.r.o. · 20250237 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Vilma Marešová · 2026/1216 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Slavěna Pospíšilová · 26200409 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Erik Vítek · FV-2025-01059 · PDF text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Agrotrade s.r.o. · DB-2025-00296 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
Invoice extraction · German (150 documents)
Claude Sonnet 5 is more accurate by 4.3 pp. Mistral Small 4 is 23.9× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.0% | 94.6% |
| Error-free documents | 87% | 50% |
| Per 1,000 documents | $10.42 | $0.44 |
| To fix / 1,000 | 133 | 500 |
| Speed (median) | 3.8 sec | 2.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Supplier | 100.0% | 98.6% |
| Supplier ID (EIN, IČO…) | 100.0% | 80.0% |
| VAT ID | 100.0% | 92.9% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 87.1% |
| Invoice date | 99.3% | 100.0% |
| Tax point | 100.0% | 87.9% |
| Due date | 100.0% | 98.6% |
| Net by tax rate | 89.3% | 94.3% |
| Tax by rate | 100.0% | 99.3% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 98.0% | 91.4% |
Documents where they differ
- Maurizio Schröder · RE10338 · PDF text · Claude Sonnet 5 13/13, Mistral Small 4 10/13
- Braun IT-Service GmbH · RE2500825 · Photo · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Gebäudereinigung Klara Weiß · 2025-1126 · PDF text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Schreinerei Ferdi Schuster · 2025/0939 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Druckerei Baumann GmbH · 2025-0324 · Scan · Claude Sonnet 5 12/13, Mistral Small 4 11/13
- Isarplan e.K. · 2025/0849 · PDF text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Hoffmann UG (haftungsbeschränkt) · 2025/1479 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Zimmermann & Schulz GmbH · RE11274 · Scan · Claude Sonnet 5 12/13, Mistral Small 4 13/13
Invoice extraction · Spanish (100 documents)
Claude Sonnet 5 is more accurate by 1.7 pp. Mistral Small 4 is 26.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 93.6% | 91.9% |
| Error-free documents | 77% | 31% |
| Per 1,000 documents | $11.89 | $0.44 |
| To fix / 1,000 | 230 | 691 |
| Speed (median) | 4.0 sec | 2.2 sec |
| Valid answers | 95.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Supplier | 94.0% | 97.6% |
| Supplier ID (EIN, IČO…) | 95.0% | 98.8% |
| VAT ID | 95.0% | 53.6% |
| Invoice number | 95.0% | 100.0% |
| Payment reference | 94.0% | 88.1% |
| Invoice date | 95.0% | 100.0% |
| Tax point | 95.0% | 69.1% |
| Due date | 95.0% | 100.0% |
| Net by tax rate | 79.0% | 96.4% |
| Tax by rate | 95.0% | 97.6% |
| Total | 95.0% | 98.8% |
| Currency | 95.0% | 100.0% |
| Bank account | 95.0% | 95.2% |
Documents where they differ
- Hermanos Peral S.L. · F2025-0581 · Scan · Claude Sonnet 5 0/13, Mistral Small 4 13/13
- Losa Comunicación S.L. · A-2026-0862 · PDF text · Claude Sonnet 5 0/13, Mistral Small 4 13/13
- Talleres Ibérica, S.A. · PF25/1188 · Clean image · Claude Sonnet 5 0/13, Mistral Small 4 12/13
- Centro de Formación del Sur S.L. · F2026-0167 · PDF text · Claude Sonnet 5 0/13, Mistral Small 4 12/13
- Academia Checa S.L. · F2025-0208 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 10/13
- Leyre Lladó Vall · F2025-1476 · Photo · Claude Sonnet 5 13/13, Mistral Small 4 10/13
- Construcciones del Norte S.L.U. · PF25/0020 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Centro de Formación del Sur S.L.U. · F2025-1424 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
Invoice extraction · French (97 documents)
Claude Sonnet 5 is more accurate by 4.4 pp. Mistral Small 4 is 24.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.7% | 94.2% |
| Error-free documents | 96% | 50% |
| Per 1,000 documents | $11.02 | $0.45 |
| To fix / 1,000 | 41 | 500 |
| Speed (median) | 4.4 sec | 2.1 sec |
| Valid answers | 99.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Supplier | 99.0% | 96.1% |
| Supplier ID (EIN, IČO…) | 99.0% | 93.4% |
| VAT ID | 99.0% | 93.4% |
| Invoice number | 99.0% | 100.0% |
| Payment reference | 97.9% | 85.5% |
| Invoice date | 99.0% | 100.0% |
| Tax point | 99.0% | 92.1% |
| Due date | 99.0% | 100.0% |
| Net by tax rate | 96.9% | 94.7% |
| Tax by rate | 99.0% | 100.0% |
| Total | 99.0% | 100.0% |
| Currency | 99.0% | 94.7% |
| Bank account | 97.9% | 75.0% |
Documents where they differ
- Carrosserie Alain Meunier EI · FAC-2026-00869 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 10/13
- Occiservices SASU · AVO-2025-01209 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 10/13
- Établissements Blanc SAS · F-11122 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Maçonnerie Arnaude Dumont EI · FAC26021277 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Catherine Dubois EI · FAC-2025-00139 · PDF text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- SAS Marie et Associés · FAC25070013 · Scan · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Gilbert Marie – Multiservices (EI) · FAC-2025-00924 · Clean image · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Établissements Legrand SA · F2025-1073 · PDF text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
Email triage · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 8.5 pp. Mistral Small 4 is 42.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.2% | 89.7% |
| Error-free documents | 84% | 37% |
| Per 1,000 documents | $4.01 | $0.09 |
| To fix / 1,000 | 160 | 627 |
| Speed (median) | 3.8 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 97.3% | 61.3% |
| Sentiment | 86.7% | 71.3% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 99.3% |
| Currency | 100.0% | 99.3% |
| Deadline | 100.0% | 76.0% |
Documents where they differ
- Robert Lewis · Email · Claude Sonnet 5 9/9, Mistral Small 4 6/9
- Omar Cabrera · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Russell Bates · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Kyle Schwartz · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Jennifer Chapman · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Cody Baldwin · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Dale Sanchez · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Leah Douglas · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
Email triage · Czech (150 documents)
Claude Sonnet 5 is more accurate by 10.5 pp. Mistral Small 4 is 41.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.2% | 87.7% |
| Error-free documents | 83% | 32% |
| Per 1,000 documents | $4.91 | $0.12 |
| To fix / 1,000 | 167 | 685 |
| Speed (median) | 4.7 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 96.0% | 52.4% |
| Sentiment | 87.3% | 72.5% |
| Customer name | 100.0% | 98.7% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 98.0% |
| Currency | 100.0% | 98.0% |
| Deadline | 100.0% | 69.8% |
Documents where they differ
- Rostislav Novák · Email · Claude Sonnet 5 9/9, Mistral Small 4 6/9
- Milan Matějka · Email · Claude Sonnet 5 9/9, Mistral Small 4 6/9
- Milan Kašpar · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Eduard Stejskal · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Alexandr Kubíček · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Simona Kolářová · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Adam Vaněk · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Štěpánka Vítková · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
Email triage · German (150 documents)
Claude Sonnet 5 is more accurate by 10.8 pp. Mistral Small 4 is 47.9× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 97.9% | 87.1% |
| Error-free documents | 81% | 29% |
| Per 1,000 documents | $5.11 | $0.11 |
| To fix / 1,000 | 187 | 706 |
| Speed (median) | 4.3 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 96.0% | 55.2% |
| Sentiment | 84.7% | 65.0% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 96.5% |
| Currency | 100.0% | 96.5% |
| Deadline | 100.0% | 70.6% |
Documents where they differ
- Berthold Anders · Email · Claude Sonnet 5 9/9, Mistral Small 4 5/9
- Swantje Noack · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Luzia Drewes · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Cynthia Hahn · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Sibille Lehmann · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Antonietta Wende · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Marta Kambs · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
- Margret Löchel · Email · Claude Sonnet 5 9/9, Mistral Small 4 7/9
Personal data detection · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 0.3 pp. Mistral Small 4 is 45.3× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.7% | 99.4% |
| Error-free documents | 98% | 96% |
| Per 1,000 documents | $3.50 | $0.08 |
| To fix / 1,000 | 20 | 40 |
| Speed (median) | 2.5 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Names | 100.0% | 97.3% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.0% | 98.7% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Christopher Scott · Text · Claude Sonnet 5 7/7, Mistral Small 4 6/7
- Denise Jones · Text · Claude Sonnet 5 7/7, Mistral Small 4 6/7
- Margaret Mills · Text · Claude Sonnet 5 7/7, Mistral Small 4 6/7
- David Fitzpatrick · Text · Claude Sonnet 5 7/7, Mistral Small 4 6/7
Personal data detection · Czech (150 documents)
Claude Sonnet 5 is more accurate by 0.1 pp. Mistral Small 4 is 43.8× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.9% | 98.8% |
| Error-free documents | 92% | 92% |
| Per 1,000 documents | $4.06 | $0.09 |
| To fix / 1,000 | 80 | 81 |
| Speed (median) | 3.2 sec | 0.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Names | 96.7% | 94.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 97.3% | 98.7% |
| Dates of birth | 98.0% | 98.7% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Růžena Tichá · Text · Claude Sonnet 5 6/7, Mistral Small 4 7/7
- Jonáš Toman · Text · Claude Sonnet 5 6/7, Mistral Small 4 7/7
- Rudolf Konečný · Text · Claude Sonnet 5 6/7, Mistral Small 4 5/7
- Zikmund Sedláček · Text · Claude Sonnet 5 6/7, Mistral Small 4 7/7
Personal data detection · German (150 documents)
Claude Sonnet 5 is more accurate by 0.6 pp. Mistral Small 4 is 49× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.7% | 99.1% |
| Error-free documents | 98% | 94% |
| Per 1,000 documents | $4.40 | $0.09 |
| To fix / 1,000 | 20 | 65 |
| Speed (median) | 3.7 sec | 0.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Names | 98.7% | 95.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 100.0% | 99.3% |
| Dates of birth | 99.3% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 99.3% |
Documents where they differ
- Rosi Karz · Text · Claude Sonnet 5 7/7, Mistral Small 4 6/7
Contract clauses · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 8.5 pp. Mistral Small 4 is 29.6× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.0% | 91.5% |
| Error-free documents | 100% | 43% |
| Per 1,000 documents | $5.04 | $0.17 |
| To fix / 1,000 | 0 | 567 |
| Speed (median) | 3.4 sec | 1.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Provider | 100.0% | 43.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 46.7% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Chambers & Sons, Corp. · Reed & Sons, LLC · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Santiago-Harris Group Co. · Columbus Printing Inc. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Pittsburgh Construction Co. · Evans Electric LLC · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Murray Plumbing Inc. · Gray & Sons, Co. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Frye & Sons, Co. · Nunez-Smith Group Inc. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Kim Electric Co. · Ramos & Sons, Co. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Seattle Printing Inc. · Gutierrez Landscaping LLC · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Blue Ridge Services Corp. · Bishop-Kim Group LLC · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
Contract clauses · Czech (150 documents)
Claude Sonnet 5 is more accurate by 1 pp. Mistral Small 4 is 26.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.0% | 99.0% |
| Error-free documents | 100% | 92% |
| Per 1,000 documents | $6.05 | $0.23 |
| To fix / 1,000 | 0 | 80 |
| Speed (median) | 3.6 sec | 1.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Provider | 100.0% | 95.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 95.3% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 96.7% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Blažek s.r.o. · Moravec s.r.o. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Elektrotrade s.r.o. · Konečný a Dostál spol. s r.o. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Bureš a Kadlec s.r.o. · Kříž s.r.o. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
Contract clauses · German (150 documents)
Claude Sonnet 5 is more accurate by 4.2 pp. Mistral Small 4 is 34.5× cheaper.
| Metric | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.2% | 94.0% |
| Error-free documents | 87% | 45% |
| Per 1,000 documents | $7.11 | $0.21 |
| To fix / 1,000 | 133 | 553 |
| Speed (median) | 4.3 sec | 1.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Mistral Small 4 |
|---|---|---|
| Provider | 100.0% | 98.6% |
| Provider ID | 87.3% | 62.4% |
| Client | 100.0% | 98.6% |
| Client ID | 89.3% | 63.1% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Hansawerk GmbH · Schreinerei Weber AG · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Richter & Scholz e.K. · Köhler AG · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 11/13
- Hahn & Schulz GmbH & Co. KG · Alpentec GmbH · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Maintec GmbH · Schreinerei Wagner GmbH · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Winkler & Beck e.K. · Meyer & Weber e.K. · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Hansametall GmbH & Co. KG · Roth & Schröder UG (haftungsbeschränkt) · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13
- Neumann Consulting UG (haftungsbeschränkt) · Huber AG · Contract text · Claude Sonnet 5 13/13, Mistral Small 4 12/13