DeepSeek V4.1 Flash vs Gemma 4 31B
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
DeepSeek V4.1 Flash is more accurate; Gemma 4 31B is cheaper in 30 of 30 combinations.
More accurate
DeepSeek V4.1 Flash
wins 15 of 30
Cheaper
Gemma 4 31B
cheaper in 30 of 30
Faster
Gemma 4 31B
2.9 sec vs 5.0 sec
Fewer fixes
DeepSeek V4.1 Flash
13 vs 27 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | DeepSeek V4.1 Flash | Gemma 4 31B | Difference | DeepSeek V4.1 Flash | Gemma 4 31B | Difference |
| Invoice extraction | 99.39% | 97.64% | ▼ 1.75 | $0.52 | $0.17 | −68 % |
| Email triage | 97.63% | 96.52% | ▼ 1.11 | $0.23 | $0.12 | −48 % |
| Personal data detection | 99.62% | 99.90% | ▲ 0.28 | $0.29 | $0.08 | −70 % |
| Contract clauses | 100.00% | 99.64% | ▼ 0.36 | $0.32 | $0.18 | −44 % |
| Document summaries | 100.00% | 100.00% | ±0 | $0.54 | $0.13 | −77 % |
| Questions about a document | 99.22% | 100.00% | ▲ 0.78 | $0.31 | $0.15 | −50 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | DeepSeek V4.1 Flash | Gemma 4 31B | Difference | DeepSeek V4.1 Flash | Gemma 4 31B | Difference |
| Invoice extraction | 99.90% | 96.10% | ▼ 3.8 | $0.50 | $0.21 | −57 % |
| Email triage | 97.41% | 97.11% | ▼ 0.3 | $0.30 | $0.16 | −46 % |
| Personal data detection | 99.71% | 99.81% | ▲ 0.1 | $0.31 | $0.12 | −62 % |
| Contract clauses | 100.00% | 99.95% | ▼ 0.05 | $0.42 | $0.25 | −39 % |
| Document summaries | 100.00% | 100.00% | ±0 | $0.78 | $0.19 | −76 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.38 | $0.21 | −44 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | DeepSeek V4.1 Flash | Gemma 4 31B | Difference | DeepSeek V4.1 Flash | Gemma 4 31B | Difference |
| Invoice extraction | 99.54% | 94.87% | ▼ 4.67 | $0.57 | $0.20 | −65 % |
| Email triage | 96.37% | 95.11% | ▼ 1.26 | $0.30 | $0.15 | −51 % |
| Personal data detection | 99.81% | 99.90% | ▲ 0.09 | $0.31 | $0.10 | −67 % |
| Contract clauses | 97.08% | 94.41% | ▼ 2.67 | $0.52 | $0.22 | −57 % |
| Document summaries | 100.00% | 100.00% | ±0 | $0.62 | $0.16 | −74 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.33 | $0.18 | −45 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | DeepSeek V4.1 Flash | Gemma 4 31B | Difference | DeepSeek V4.1 Flash | Gemma 4 31B | Difference |
| Invoice extraction | 98.21% | 94.62% | ▼ 3.59 | $0.65 | $0.20 | −69 % |
| Email triage | 96.52% | 97.11% | ▲ 0.59 | $0.34 | $0.15 | −58 % |
| Personal data detection | 99.90% | 99.90% | ±0 | $0.44 | $0.10 | −76 % |
| Contract clauses | 100.00% | 94.41% | ▼ 5.59 | $0.40 | $0.24 | −41 % |
| Document summaries | 100.00% | 99.67% | ▼ 0.33 | $0.88 | $0.16 | −82 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.35 | $0.18 | −48 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | DeepSeek V4.1 Flash | Gemma 4 31B | Difference | DeepSeek V4.1 Flash | Gemma 4 31B | Difference |
| Invoice extraction | 99.54% | 93.54% | ▼ 6 | $0.60 | $0.22 | −63 % |
| Email triage | 96.74% | 96.22% | ▼ 0.52 | $0.34 | $0.16 | −53 % |
| Personal data detection | 99.71% | 99.81% | ▲ 0.1 | $0.37 | $0.12 | −68 % |
| Contract clauses | 99.85% | 94.62% | ▼ 5.23 | $0.45 | $0.26 | −43 % |
| Document summaries | 100.00% | 99.11% | ▼ 0.89 | $0.78 | $0.16 | −79 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.36 | $0.19 | −47 % |
Difference: Gemma 4 31B vs. DeepSeek V4.1 Flash; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.7 pp. Gemma 4 31B is 3.1× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.39% | 97.64% |
| Error-free documents | 93.33% | 81.33% |
| Per 1,000 documents | $0.52 | $0.17 |
| To fix / 1,000 | 67 | 187 |
| Speed (median) | 5.7 sec | 8.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
DeepSeek V4.1 Flash is more accurate by 3.8 pp. Gemma 4 31B is 2.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.90% | 96.10% |
| Error-free documents | 98.67% | 66.67% |
| Per 1,000 documents | $0.50 | $0.21 |
| To fix / 1,000 | 13 | 333 |
| Speed (median) | 5.0 sec | 10.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
DeepSeek V4.1 Flash is more accurate by 4.7 pp. Gemma 4 31B is 2.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.54% | 94.87% |
| Error-free documents | 94.00% | 64.00% |
| Per 1,000 documents | $0.57 | $0.20 |
| To fix / 1,000 | 60 | 360 |
| Speed (median) | 6.4 sec | 7.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
DeepSeek V4.1 Flash is more accurate by 3.6 pp. Gemma 4 31B is 3.2× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 98.21% | 94.62% |
| Error-free documents | 77.33% | 50.67% |
| Per 1,000 documents | $0.65 | $0.20 |
| To fix / 1,000 | 227 | 493 |
| Speed (median) | 6.3 sec | 7.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
DeepSeek V4.1 Flash is more accurate by 6 pp. Gemma 4 31B is 2.7× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.54% | 93.54% |
| Error-free documents | 94.00% | 50.67% |
| Per 1,000 documents | $0.60 | $0.22 |
| To fix / 1,000 | 60 | 493 |
| Speed (median) | 6.2 sec | 6.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.1 pp. Gemma 4 31B is 1.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 97.63% | 96.52% |
| Error-free documents | 78.67% | 72.00% |
| Per 1,000 documents | $0.23 | $0.12 |
| To fix / 1,000 | 213 | 280 |
| Speed (median) | 3.8 sec | 2.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.3 pp. Gemma 4 31B is 1.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 97.41% | 97.11% |
| Error-free documents | 77.33% | 74.67% |
| Per 1,000 documents | $0.30 | $0.16 |
| To fix / 1,000 | 227 | 253 |
| Speed (median) | 4.2 sec | 2.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.3 pp. Gemma 4 31B is 2× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 96.37% | 95.11% |
| Error-free documents | 68.00% | 62.00% |
| Per 1,000 documents | $0.30 | $0.15 |
| To fix / 1,000 | 320 | 380 |
| Speed (median) | 4.2 sec | 3.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Gemma 4 31B is more accurate by 0.6 pp. Gemma 4 31B is 2.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 96.52% | 97.11% |
| Error-free documents | 72.00% | 74.00% |
| Per 1,000 documents | $0.34 | $0.15 |
| To fix / 1,000 | 280 | 260 |
| Speed (median) | 5.5 sec | 2.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.5 pp. Gemma 4 31B is 2.1× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 96.74% | 96.22% |
| Error-free documents | 72.67% | 68.67% |
| Per 1,000 documents | $0.34 | $0.16 |
| To fix / 1,000 | 273 | 313 |
| Speed (median) | 5.2 sec | 2.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.3 pp. Gemma 4 31B is 3.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.62% | 99.90% |
| Error-free documents | 97.33% | 99.33% |
| Per 1,000 documents | $0.29 | $0.08 |
| To fix / 1,000 | 27 | 7 |
| Speed (median) | 3.8 sec | 2.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 2.6× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.71% | 99.81% |
| Error-free documents | 98.00% | 98.67% |
| Per 1,000 documents | $0.31 | $0.12 |
| To fix / 1,000 | 20 | 13 |
| Speed (median) | 4.2 sec | 2.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.81% | 99.90% |
| Error-free documents | 98.67% | 99.33% |
| Per 1,000 documents | $0.31 | $0.10 |
| To fix / 1,000 | 13 | 7 |
| Speed (median) | 3.7 sec | 1.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Both are equally accurate. Gemma 4 31B is 4.2× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.90% | 99.90% |
| Error-free documents | 99.33% | 99.33% |
| Per 1,000 documents | $0.44 | $0.10 |
| To fix / 1,000 | 7 | 7 |
| Speed (median) | 5.9 sec | 3.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 3.1× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.71% | 99.81% |
| Error-free documents | 98.00% | 98.67% |
| Per 1,000 documents | $0.37 | $0.12 |
| To fix / 1,000 | 20 | 13 |
| Speed (median) | 5.3 sec | 4.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.4 pp. Gemma 4 31B is 1.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 99.64% |
| Error-free documents | 100.00% | 97.33% |
| Per 1,000 documents | $0.32 | $0.18 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 3.9 sec | 2.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 1.7× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 99.95% |
| Error-free documents | 100.00% | 99.33% |
| Per 1,000 documents | $0.42 | $0.25 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 4.3 sec | 6.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
DeepSeek V4.1 Flash is more accurate by 2.7 pp. Gemma 4 31B is 2.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 97.08% | 94.41% |
| Error-free documents | 76.00% | 27.33% |
| Per 1,000 documents | $0.52 | $0.22 |
| To fix / 1,000 | 240 | 727 |
| Speed (median) | 4.7 sec | 2.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
DeepSeek V4.1 Flash is more accurate by 5.6 pp. Gemma 4 31B is 1.7× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 94.41% |
| Error-free documents | 100.00% | 27.33% |
| Per 1,000 documents | $0.40 | $0.24 |
| To fix / 1,000 | 0 | 727 |
| Speed (median) | 4.1 sec | 5.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
DeepSeek V4.1 Flash is more accurate by 5.2 pp. Gemma 4 31B is 1.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.85% | 94.62% |
| Error-free documents | 98.00% | 30.67% |
| Per 1,000 documents | $0.45 | $0.26 |
| To fix / 1,000 | 20 | 693 |
| Speed (median) | 5.2 sec | 5.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Both are equally accurate. Gemma 4 31B is 4.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.54 | $0.13 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 8.8 sec | 2.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 4.1× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.78 | $0.19 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 13.4 sec | 3.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Both are equally accurate. Gemma 4 31B is 3.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.62 | $0.16 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 9.8 sec | 2.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.3 pp. Gemma 4 31B is 5.6× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 99.67% |
| Error-free documents | 100.00% | 98.00% |
| Per 1,000 documents | $0.88 | $0.16 |
| To fix / 1,000 | 0 | 20 |
| Speed (median) | 10.6 sec | 2.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
DeepSeek V4.1 Flash is more accurate by 0.9 pp. Gemma 4 31B is 4.7× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 99.11% |
| Error-free documents | 100.00% | 94.67% |
| Per 1,000 documents | $0.78 | $0.16 |
| To fix / 1,000 | 0 | 53 |
| Speed (median) | 10.5 sec | 3.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.8 pp. Gemma 4 31B is 2× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.22% | 100.00% |
| Error-free documents | 98.67% | 100.00% |
| Per 1,000 documents | $0.31 | $0.15 |
| To fix / 1,000 | 13 | 0 |
| Speed (median) | 4.2 sec | 2.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 1.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.38 | $0.21 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.5 sec | 1.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Both are equally accurate. Gemma 4 31B is 1.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.33 | $0.18 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.0 sec | 2.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Both are equally accurate. Gemma 4 31B is 1.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.35 | $0.18 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.3 sec | 1.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Both are equally accurate. Gemma 4 31B is 1.9× cheaper.
| Metric | DeepSeek V4.1 Flash | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.36 | $0.19 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 2.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.