Claude Sonnet 5 vs Gemini 3.8 Flash
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 99.8% / 99.8% | 100.0% / 100.0% | 99.0% / 97.2% | 93.6% / 95.9% | 98.7% / 99.9% |
| Email triage | 98.2% / 98.7% | 98.2% / 99.2% | 97.9% / 98.4% | — | — |
| Personal data detection | 99.7% / 99.7% | 98.9% / 99.5% | 99.7% / 99.7% | — | — |
| Contract clauses | 100.0% / 99.9% | 100.0% / 100.0% | 98.2% / 99.9% | — | — |
Correct fields: Claude Sonnet 5 / Gemini 3.8 Flash; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.3× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.8% | 99.8% |
| Error-free documents | 99% | 98% |
| Per 1,000 documents | $8.84 | $3.84 |
| To fix / 1,000 | 13 | 20 |
| Speed (median) | 3.2 sec | 3.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Supplier | 100.0% | 100.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 100.0% |
| Invoice date | 100.0% | 100.0% |
| Due date | 100.0% | 100.0% |
| Net by tax rate | 98.7% | 100.0% |
| Tax by rate | 99.3% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 100.0% | 98.0% |
Documents where they differ
- Rose Lowery · INV-14797 · Clean image · Claude Sonnet 5 11/11, Gemini 3.8 Flash 10/11
Invoice extraction · Czech (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.0% | 100.0% |
| Error-free documents | 100% | 99% |
| Per 1,000 documents | $9.41 | $4.26 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 3.6 sec | 3.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Supplier | 100.0% | 99.3% |
| Supplier ID (EIN, IČO…) | 100.0% | 100.0% |
| VAT ID | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 100.0% |
| Invoice date | 100.0% | 100.0% |
| Tax point | 100.0% | 100.0% |
| Due date | 100.0% | 100.0% |
| Net by tax rate | 100.0% | 100.0% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Invoice extraction · German (150 documents)
Claude Sonnet 5 is more accurate by 1.7 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.0% | 97.2% |
| Error-free documents | 87% | 96% |
| Per 1,000 documents | $10.42 | $7.15 |
| To fix / 1,000 | 133 | 40 |
| Speed (median) | 3.8 sec | 4.7 sec |
| Valid answers | 100.0% | 97.3% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Supplier | 100.0% | 97.3% |
| Supplier ID (EIN, IČO…) | 100.0% | 97.3% |
| VAT ID | 100.0% | 96.7% |
| Invoice number | 100.0% | 97.3% |
| Payment reference | 100.0% | 97.3% |
| Invoice date | 99.3% | 97.3% |
| Tax point | 100.0% | 97.3% |
| Due date | 100.0% | 97.3% |
| Net by tax rate | 89.3% | 96.7% |
| Tax by rate | 100.0% | 97.3% |
| Total | 100.0% | 97.3% |
| Currency | 100.0% | 97.3% |
| Bank account | 98.0% | 97.3% |
Documents where they differ
- Gebäudereinigung Klara Weiß · 2025-1126 · PDF text · Claude Sonnet 5 13/13, Gemini 3.8 Flash 0/13
- Druckerei Baumann GmbH · 2025-0324 · Scan · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13
- Zimmermann & Schulz GmbH · RE11274 · Scan · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13
- Südform AG · 2025-0307 · PDF text · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13
- Zimmermann UG (haftungsbeschränkt) · GS10958 · Clean image · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13
Invoice extraction · Spanish (100 documents)
Gemini 3.8 Flash is more accurate by 2.3 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 93.6% | 95.9% |
| Error-free documents | 77% | 95% |
| Per 1,000 documents | $11.89 | $7.86 |
| To fix / 1,000 | 230 | 50 |
| Speed (median) | 4.0 sec | 5.3 sec |
| Valid answers | 95.0% | 96.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Supplier | 94.0% | 95.0% |
| Supplier ID (EIN, IČO…) | 95.0% | 96.0% |
| VAT ID | 95.0% | 96.0% |
| Invoice number | 95.0% | 96.0% |
| Payment reference | 94.0% | 96.0% |
| Invoice date | 95.0% | 96.0% |
| Tax point | 95.0% | 96.0% |
| Due date | 95.0% | 96.0% |
| Net by tax rate | 79.0% | 96.0% |
| Tax by rate | 95.0% | 96.0% |
| Total | 95.0% | 96.0% |
| Currency | 95.0% | 96.0% |
| Bank account | 95.0% | 96.0% |
Documents where they differ
- Hermanos Peral S.L. · F2025-0581 · Scan · Claude Sonnet 5 0/13, Gemini 3.8 Flash 13/13
- Talleres Ibérica, S.A. · PF25/1188 · Clean image · Claude Sonnet 5 0/13, Gemini 3.8 Flash 13/13
- Losa Comunicación S.L. · A-2026-0862 · PDF text · Claude Sonnet 5 0/13, Gemini 3.8 Flash 13/13
- Centro de Formación del Sur S.L. · F2026-0167 · PDF text · Claude Sonnet 5 0/13, Gemini 3.8 Flash 13/13
- Climatización Levante S.L. · F2025-1305 · Scan · Claude Sonnet 5 12/13, Gemini 3.8 Flash 0/13
- Escobar Comunicación S.L. · RECT-2025-0924 · Clean image · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13
- Distribuciones Levante S.L.U. · A-2026-0526 · PDF text · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13
Invoice extraction · French (97 documents)
Gemini 3.8 Flash is more accurate by 1.3 pp. Gemini 3.8 Flash is 1.8× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.7% | 99.9% |
| Error-free documents | 96% | 99% |
| Per 1,000 documents | $11.02 | $6.18 |
| To fix / 1,000 | 41 | 10 |
| Speed (median) | 4.4 sec | 5.2 sec |
| Valid answers | 99.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Supplier | 99.0% | 100.0% |
| Supplier ID (EIN, IČO…) | 99.0% | 100.0% |
| VAT ID | 99.0% | 100.0% |
| Invoice number | 99.0% | 100.0% |
| Payment reference | 97.9% | 99.0% |
| Invoice date | 99.0% | 100.0% |
| Tax point | 99.0% | 100.0% |
| Due date | 99.0% | 100.0% |
| Net by tax rate | 96.9% | 100.0% |
| Tax by rate | 99.0% | 100.0% |
| Total | 99.0% | 100.0% |
| Currency | 99.0% | 100.0% |
| Bank account | 97.9% | 100.0% |
Documents where they differ
- Établissements Bertrand SASU · F2025-0066 · Scan · Claude Sonnet 5 11/13, Gemini 3.8 Flash 13/13
Email triage · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 0.5 pp. Gemini 3.8 Flash is 1.7× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.2% | 98.7% |
| Error-free documents | 84% | 89% |
| Per 1,000 documents | $4.01 | $2.39 |
| To fix / 1,000 | 160 | 113 |
| Speed (median) | 3.8 sec | 2.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 97.3% | 100.0% |
| Sentiment | 86.7% | 88.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Laurie Knight · Email · Claude Sonnet 5 9/9, Gemini 3.8 Flash 8/9
- Daniel Stewart · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Allison Floyd · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
Email triage · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Gemini 3.8 Flash is 1.6× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.2% | 99.2% |
| Error-free documents | 83% | 93% |
| Per 1,000 documents | $4.91 | $3.06 |
| To fix / 1,000 | 167 | 73 |
| Speed (median) | 4.7 sec | 2.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 96.0% | 99.3% |
| Sentiment | 87.3% | 93.3% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Lucie Kašparová · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Petra Šťastná · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Václav Vítek · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Vanda Vacková · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
Email triage · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.5 pp. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 97.9% | 98.4% |
| Error-free documents | 81% | 85% |
| Per 1,000 documents | $5.11 | $2.74 |
| To fix / 1,000 | 187 | 147 |
| Speed (median) | 4.3 sec | 2.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 96.0% | 100.0% |
| Sentiment | 84.7% | 85.3% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Rolf-Peter Metz · Email · Claude Sonnet 5 7/9, Gemini 3.8 Flash 8/9
- Friedbert Hoffmann · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Alexej Sauer · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Nadja Wiek · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Ibrahim Walter · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
- Augusta Lange · Email · Claude Sonnet 5 8/9, Gemini 3.8 Flash 9/9
Personal data detection · English (US) (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.7% | 99.7% |
| Error-free documents | 98% | 98% |
| Per 1,000 documents | $3.50 | $1.86 |
| To fix / 1,000 | 20 | 20 |
| Speed (median) | 2.5 sec | 1.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Names | 100.0% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.0% | 98.0% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Personal data detection · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 0.7 pp. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.9% | 99.5% |
| Error-free documents | 92% | 97% |
| Per 1,000 documents | $4.06 | $2.19 |
| To fix / 1,000 | 80 | 33 |
| Speed (median) | 3.2 sec | 2.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Names | 96.7% | 98.7% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 97.3% | 98.0% |
| Dates of birth | 98.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Růžena Tichá · Text · Claude Sonnet 5 6/7, Gemini 3.8 Flash 7/7
- Jonáš Toman · Text · Claude Sonnet 5 6/7, Gemini 3.8 Flash 7/7
- Rudolf Konečný · Text · Claude Sonnet 5 6/7, Gemini 3.8 Flash 7/7
- Zikmund Sedláček · Text · Claude Sonnet 5 6/7, Gemini 3.8 Flash 7/7
Personal data detection · German (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.1× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.7% | 99.7% |
| Error-free documents | 98% | 98% |
| Per 1,000 documents | $4.40 | $2.12 |
| To fix / 1,000 | 20 | 20 |
| Speed (median) | 3.7 sec | 2.3 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Names | 98.7% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 100.0% | 98.0% |
| Dates of birth | 99.3% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 0.1 pp. Gemini 3.8 Flash is 2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.0% | 99.9% |
| Error-free documents | 100% | 99% |
| Per 1,000 documents | $5.04 | $2.47 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 3.4 sec | 2.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Provider | 100.0% | 99.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 99.3% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Kim Electric Co. · Ramos & Sons, Co. · Contract text · Claude Sonnet 5 13/13, Gemini 3.8 Flash 11/13
Contract clauses · Czech (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.0% | 100.0% |
| Error-free documents | 100% | 100% |
| Per 1,000 documents | $6.05 | $3.09 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 2.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · German (150 documents)
Gemini 3.8 Flash is more accurate by 1.7 pp. Gemini 3.8 Flash is 2.1× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.2% | 99.9% |
| Error-free documents | 87% | 99% |
| Per 1,000 documents | $7.11 | $3.42 |
| To fix / 1,000 | 133 | 7 |
| Speed (median) | 4.3 sec | 2.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 87.3% | 99.3% |
| Client | 100.0% | 100.0% |
| Client ID | 89.3% | 99.3% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Wesermetall e.K. · Weserform GmbH · Contract text · Claude Sonnet 5 11/13, Gemini 3.8 Flash 13/13
- Schulz Systemtechnik GmbH · Elbdata GmbH · Contract text · Claude Sonnet 5 11/13, Gemini 3.8 Flash 13/13
- Richter & Albrecht e.K. · Elbmetall UG (haftungsbeschränkt) · Contract text · Claude Sonnet 5 11/13, Gemini 3.8 Flash 13/13
- Meyer AG · Hartmann GmbH · Contract text · Claude Sonnet 5 11/13, Gemini 3.8 Flash 13/13
- Schuster Medien e.K. · Bäckerei Böhm GmbH · Contract text · Claude Sonnet 5 12/13, Gemini 3.8 Flash 13/13