DeepSeek V4.1 Flash vs Gemma 4 31B
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 99.4% / 97.6% | 99.9% / 96.1% | 99.5% / 94.9% | 98.3% / 95.4% | 99.4% / 93.6% |
| Email triage | 97.6% / 96.5% | 97.4% / 97.1% | 96.3% / 95.1% | — | — |
| Personal data detection | 99.6% / 99.9% | 99.7% / 99.8% | 99.8% / 99.9% | — | — |
| Contract clauses | 100.0% / 99.6% | 100.0% / 100.0% | 97.2% / 94.4% | — | — |
Correct fields: DeepSeek V4.1 Flash / Gemma 4 31B; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.7 pp. Gemma 4 31B is 3.1× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.4% | 97.6% |
| Error-free documents | 93% | 81% |
| Per 1,000 documents | $0.52 | $0.17 |
| To fix / 1,000 | 67 | 187 |
| Speed (median) | 5.7 sec | 8.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Supplier | 100.0% | 99.3% |
| Supplier ID (EIN, IČO…) | 100.0% | 98.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 96.7% | 99.3% |
| Invoice date | 100.0% | 98.7% |
| Due date | 100.0% | 98.7% |
| Net by tax rate | 100.0% | 95.3% |
| Tax by rate | 100.0% | 98.7% |
| Total | 100.0% | 100.0% |
| Currency | 99.3% | 100.0% |
| Bank account | 97.3% | 86.0% |
Documents where they differ
- Harmon Logistics LLC · INV256017 · Scan · DeepSeek V4.1 Flash 11/11, Gemma 4 31B 8/11
- Gomez & Sons, LLC · 7855 · Scan · DeepSeek V4.1 Flash 11/11, Gemma 4 31B 9/11
- Reid Office Products LLC · A-003849 · Scan · DeepSeek V4.1 Flash 10/11, Gemma 4 31B 11/11
- Summit Services Inc. · INV-15230 · Scan · DeepSeek V4.1 Flash 11/11, Gemma 4 31B 10/11
- Jennifer Moore · 5113 · Scan · DeepSeek V4.1 Flash 11/11, Gemma 4 31B 10/11
- Mason-Nelson Group LLC · 2025-3952 · Photo · DeepSeek V4.1 Flash 11/11, Gemma 4 31B 10/11
- Sarah Villanueva · 2025-7876 · Clean image · DeepSeek V4.1 Flash 11/11, Gemma 4 31B 10/11
- Austin Landscaping Inc. · INV-17836 · Scan · DeepSeek V4.1 Flash 10/11, Gemma 4 31B 9/11
Invoice extraction · Czech (150 documents)
DeepSeek V4.1 Flash is more accurate by 3.8 pp. Gemma 4 31B is 2.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.9% | 96.1% |
| Error-free documents | 99% | 67% |
| Per 1,000 documents | $0.50 | $0.21 |
| To fix / 1,000 | 13 | 333 |
| Speed (median) | 5.0 sec | 10.4 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Supplier | 99.3% | 96.7% |
| Supplier ID (EIN, IČO…) | 100.0% | 93.3% |
| VAT ID | 100.0% | 96.7% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 96.0% |
| Invoice date | 100.0% | 96.0% |
| Tax point | 100.0% | 95.3% |
| Due date | 100.0% | 94.0% |
| Net by tax rate | 100.0% | 98.0% |
| Tax by rate | 100.0% | 97.3% |
| Total | 100.0% | 99.3% |
| Currency | 100.0% | 100.0% |
| Bank account | 99.3% | 86.7% |
Documents where they differ
- Jiřina Švecová · 25401227 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Bednář spol. s r.o. · 20250610 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Stejskal, v.o.s. · FV2600175 · Photo · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Ekolog s.r.o. · FV2600132 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Hruška a Šťastný s.r.o. · 2025/0324 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Moravská energetická spol. s r.o. · 25101373 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Sedlák s.r.o. · 20250158 · Photo · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Holub s.r.o. · FV2500655 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
Invoice extraction · German (150 documents)
DeepSeek V4.1 Flash is more accurate by 4.7 pp. Gemma 4 31B is 2.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.5% | 94.9% |
| Error-free documents | 94% | 64% |
| Per 1,000 documents | $0.57 | $0.20 |
| To fix / 1,000 | 60 | 360 |
| Speed (median) | 6.4 sec | 7.7 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Supplier | 99.3% | 98.7% |
| Supplier ID (EIN, IČO…) | 98.7% | 99.3% |
| VAT ID | 99.3% | 94.0% |
| Invoice number | 100.0% | 99.3% |
| Payment reference | 100.0% | 98.7% |
| Invoice date | 100.0% | 87.3% |
| Tax point | 99.3% | 92.0% |
| Due date | 99.3% | 90.7% |
| Net by tax rate | 100.0% | 94.7% |
| Tax by rate | 100.0% | 97.3% |
| Total | 100.0% | 99.3% |
| Currency | 100.0% | 99.3% |
| Bank account | 98.0% | 82.7% |
Documents where they differ
- Spedition Müller GmbH · 2026-1446 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 8/13
- Zimmermann & Schulz GmbH · RE11274 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 10/13
- Dachdeckerei Fischer GmbH · 2025/0014 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 10/13
- Wesermetall GmbH · RE2501375 · Scan · DeepSeek V4.1 Flash 12/13, Gemma 4 31B 9/13
- Schmidt & Bauer GmbH & Co. KG · RE-2025-01397 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 10/13
- Richter GmbH & Co. KG · 2025-0509 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Nordtec GmbH & Co. KG · RE-2025-00909 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Berger UG (haftungsbeschränkt) · GS10609 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
Invoice extraction · Spanish (79 documents)
DeepSeek V4.1 Flash is more accurate by 2.9 pp. Gemma 4 31B is 3.5× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 98.3% | 95.4% |
| Error-free documents | 77% | 54% |
| Per 1,000 documents | $0.71 | $0.20 |
| To fix / 1,000 | 228 | 460 |
| Speed (median) | 5.8 sec | 8.7 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Supplier | 93.7% | 95.4% |
| Supplier ID (EIN, IČO…) | 100.0% | 93.1% |
| VAT ID | 100.0% | 98.9% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 97.5% | 95.4% |
| Invoice date | 100.0% | 98.9% |
| Tax point | 98.7% | 100.0% |
| Due date | 100.0% | 97.7% |
| Net by tax rate | 88.6% | 81.6% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 98.7% | 79.3% |
Documents where they differ
- Distribuciones Mayo Santana, S.L.U. · A-2025-0563 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Talleres Rozas Zapata S.L. · FV25-01486 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Construcciones del Norte S.L.U. · PF25/0020 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Arranz e Hijos S.L. · F2026-0940 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · DeepSeek V4.1 Flash 12/13, Gemma 4 31B 13/13
- Onofre Diez Guitart · R-2025/1100 · Clean image · DeepSeek V4.1 Flash 12/13, Gemma 4 31B 13/13
- Centro de Formación Centro S.L.U. · A-2025-1405 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
Invoice extraction · French (74 documents)
DeepSeek V4.1 Flash is more accurate by 5.8 pp. Gemma 4 31B is 2.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.4% | 93.6% |
| Error-free documents | 92% | 51% |
| Per 1,000 documents | $0.65 | $0.22 |
| To fix / 1,000 | 81 | 494 |
| Speed (median) | 5.7 sec | 7.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Supplier | 100.0% | 96.6% |
| Supplier ID (EIN, IČO…) | 100.0% | 77.0% |
| VAT ID | 98.7% | 95.4% |
| Invoice number | 100.0% | 97.7% |
| Payment reference | 98.7% | 96.6% |
| Invoice date | 100.0% | 96.6% |
| Tax point | 100.0% | 94.3% |
| Due date | 100.0% | 96.6% |
| Net by tax rate | 100.0% | 93.1% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 98.9% |
| Bank account | 94.6% | 73.6% |
Documents where they differ
- Guérin & Fils EURL · 2026-05-688 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 10/13
- Établissements Bonnet EURL · AV-10599 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- SARL Garcia Informatique · F2025-0111 · Clean image · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Bernard et Associés SASU · FAC-2025-01115 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 11/13
- Carrosserie Gauthier SASU · F-11079 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Établissements Bertrand SASU · F2025-0066 · Scan · DeepSeek V4.1 Flash 12/13, Gemma 4 31B 13/13
- Couverture Simon SAS · FAC-2025-00553 · Photo · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Constance Martin – Rédactrice (EI) · FAC25080663 · Scan · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
Email triage · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.1 pp. Gemma 4 31B is 1.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 97.6% | 96.5% |
| Error-free documents | 79% | 72% |
| Per 1,000 documents | $0.23 | $0.12 |
| To fix / 1,000 | 213 | 280 |
| Speed (median) | 3.8 sec | 2.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 96.7% | 85.3% |
| Sentiment | 82.0% | 83.3% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Allison Floyd · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 7/9
- Russell Bates · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Sheila Evans · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Gene Everett · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Laurie Knight · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Jason Davis · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Daniel Stewart · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 7/9
- Christine Copeland · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
Email triage · Czech (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.3 pp. Gemma 4 31B is 1.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 97.4% | 97.1% |
| Error-free documents | 77% | 75% |
| Per 1,000 documents | $0.30 | $0.16 |
| To fix / 1,000 | 227 | 253 |
| Speed (median) | 4.2 sec | 2.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 98.7% | 85.3% |
| Sentiment | 78.0% | 88.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Alois Sedlák · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Lucie Kašparová · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Ignác Bartoš · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Simona Kolářová · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Václav Vítek · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Magdalena Sedláčková · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Ctibor Dušek · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Vanda Vacková · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
Email triage · German (145 documents)
DeepSeek V4.1 Flash is more accurate by 1.2 pp. Gemma 4 31B is 2× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 96.3% | 95.1% |
| Error-free documents | 68% | 62% |
| Per 1,000 documents | $0.30 | $0.15 |
| To fix / 1,000 | 324 | 380 |
| Speed (median) | 4.2 sec | 3.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 97.2% | 78.0% |
| Sentiment | 69.7% | 78.0% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Irmela Warmer · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Cristina Krause · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Cynthia Hahn · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Linda Bähr · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Sibille Lehmann · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Nadja Wiek · Email · DeepSeek V4.1 Flash 8/9, Gemma 4 31B 9/9
- Marta Kambs · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
- Samira Hermann · Email · DeepSeek V4.1 Flash 9/9, Gemma 4 31B 8/9
Personal data detection · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.3 pp. Gemma 4 31B is 3.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.6% | 99.9% |
| Error-free documents | 97% | 99% |
| Per 1,000 documents | $0.29 | $0.08 |
| To fix / 1,000 | 27 | 7 |
| Speed (median) | 3.8 sec | 2.4 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Names | 98.7% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.7% | 99.3% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Margaret Mills · Text · DeepSeek V4.1 Flash 6/7, Gemma 4 31B 7/7
Personal data detection · Czech (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 2.6× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.7% | 99.8% |
| Error-free documents | 98% | 99% |
| Per 1,000 documents | $0.31 | $0.12 |
| To fix / 1,000 | 20 | 13 |
| Speed (median) | 4.2 sec | 2.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Names | 100.0% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.0% | 98.7% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Personal data detection · German (148 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.8% | 99.9% |
| Error-free documents | 99% | 99% |
| Per 1,000 documents | $0.31 | $0.10 |
| To fix / 1,000 | 13 | 7 |
| Speed (median) | 3.7 sec | 1.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Names | 100.0% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.7% | 99.3% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.4 pp. Gemma 4 31B is 1.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.0% | 99.6% |
| Error-free documents | 100% | 97% |
| Per 1,000 documents | $0.32 | $0.18 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 3.9 sec | 2.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Provider | 100.0% | 98.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 98.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 1.7× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.0% | 100.0% |
| Error-free documents | 100% | 99% |
| Per 1,000 documents | $0.42 | $0.25 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 4.3 sec | 6.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Elektrotrade s.r.o. · Konečný a Dostál spol. s r.o. · Contract text · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
Contract clauses · German (145 documents)
DeepSeek V4.1 Flash is more accurate by 2.8 pp. Gemma 4 31B is 2.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 97.2% | 94.4% |
| Error-free documents | 77% | 27% |
| Per 1,000 documents | $0.51 | $0.22 |
| To fix / 1,000 | 228 | 727 |
| Speed (median) | 4.6 sec | 2.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 81.4% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 82.8% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 27.3% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Richter & Scholz e.K. · Köhler AG · Contract text · DeepSeek V4.1 Flash 11/13, Gemma 4 31B 13/13
- Hahn GmbH · Bauer & Klein GmbH · Contract text · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Wesermetall e.K. · Weserform GmbH · Contract text · DeepSeek V4.1 Flash 11/13, Gemma 4 31B 12/13
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Hansawerk GmbH · Schreinerei Weber AG · Contract text · DeepSeek V4.1 Flash 11/13, Gemma 4 31B 12/13
- Maintec GmbH · Schreinerei Wagner GmbH · Contract text · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Winkler & Beck e.K. · Meyer & Weber e.K. · Contract text · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13
- Kraus Consulting GmbH · Lange Consulting GmbH & Co. KG · Contract text · DeepSeek V4.1 Flash 13/13, Gemma 4 31B 12/13