Gemini 3.8 Flash vs Mistral Small 4
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Gemini 3.8 Flash is more accurate; Mistral Small 4 is cheaper in 30 of 30 combinations.
More accurate
Gemini 3.8 Flash
wins 24 of 30
Cheaper
Mistral Small 4
cheaper in 30 of 30
Faster
Mistral Small 4
1.0 sec vs 3.2 sec
Fewer fixes
Gemini 3.8 Flash
7 vs 100 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Small 4 | Difference | Gemini 3.8 Flash | Mistral Small 4 | Difference |
| Invoice extraction | 99.82% | 95.58% | ▼ 4.24 | $3.84 | $0.41 | −89 % |
| Email triage | 98.74% | 89.70% | ▼ 9.04 | $2.39 | $0.09 | −96 % |
| Personal data detection | 99.71% | 99.43% | ▼ 0.28 | $1.86 | $0.08 | −96 % |
| Contract clauses | 99.90% | 91.54% | ▼ 8.36 | $2.47 | $0.17 | −93 % |
| Document summaries | 100.00% | 99.67% | ▼ 0.33 | $5.46 | $0.14 | −97 % |
| Questions about a document | 99.89% | 100.00% | ▲ 0.11 | $3.00 | $0.15 | −95 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Small 4 | Difference | Gemini 3.8 Flash | Mistral Small 4 | Difference |
| Invoice extraction | 99.95% | 93.64% | ▼ 6.31 | $4.26 | $0.44 | −90 % |
| Email triage | 99.19% | 87.63% | ▼ 11.56 | $3.06 | $0.12 | −96 % |
| Personal data detection | 99.52% | 98.76% | ▼ 0.76 | $2.19 | $0.09 | −96 % |
| Contract clauses | 100.00% | 99.03% | ▼ 0.97 | $3.09 | $0.23 | −93 % |
| Document summaries | 100.00% | 99.00% | ▼ 1 | $6.69 | $0.22 | −97 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.36 | $0.21 | −95 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Small 4 | Difference | Gemini 3.8 Flash | Mistral Small 4 | Difference |
| Invoice extraction | 97.23% | 94.82% | ▼ 2.41 | $7.15 | $0.44 | −94 % |
| Email triage | 98.37% | 87.26% | ▼ 11.11 | $2.74 | $0.11 | −96 % |
| Personal data detection | 99.71% | 99.14% | ▼ 0.57 | $2.12 | $0.09 | −96 % |
| Contract clauses | 99.90% | 94.26% | ▼ 5.64 | $3.42 | $0.21 | −94 % |
| Document summaries | 100.00% | 99.89% | ▼ 0.11 | $6.11 | $0.19 | −97 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $3.76 | $0.18 | −95 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Small 4 | Difference | Gemini 3.8 Flash | Mistral Small 4 | Difference |
| Invoice extraction | 97.28% | 92.36% | ▼ 4.92 | $7.84 | $0.44 | −94 % |
| Email triage | 98.96% | 88.67% | ▼ 10.29 | $3.30 | $0.11 | −97 % |
| Personal data detection | 99.81% | 99.05% | ▼ 0.76 | $2.11 | $0.09 | −96 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $3.33 | $0.23 | −93 % |
| Document summaries | 100.00% | 97.78% | ▼ 2.22 | $6.78 | $0.18 | −97 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.05 | $0.18 | −95 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Small 4 | Difference | Gemini 3.8 Flash | Mistral Small 4 | Difference |
| Invoice extraction | 99.95% | 94.87% | ▼ 5.08 | $6.07 | $0.44 | −93 % |
| Email triage | 98.59% | 90.52% | ▼ 8.07 | $2.63 | $0.11 | −96 % |
| Personal data detection | 99.81% | 98.95% | ▼ 0.86 | $2.13 | $0.09 | −96 % |
| Contract clauses | 100.00% | 99.23% | ▼ 0.77 | $3.50 | $0.23 | −93 % |
| Document summaries | 100.00% | 93.22% | ▼ 6.78 | $7.06 | $0.19 | −97 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.06 | $0.18 | −96 % |
Difference: Mistral Small 4 vs. Gemini 3.8 Flash; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 4.2 pp. Mistral Small 4 is 9.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.82% | 95.58% |
| Error-free documents | 98.00% | 58.00% |
| Per 1,000 documents | $3.84 | $0.41 |
| To fix / 1,000 | 20 | 420 |
| Speed (median) | 3.2 sec | 1.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 6.3 pp. Mistral Small 4 is 9.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.95% | 93.64% |
| Error-free documents | 99.33% | 56.00% |
| Per 1,000 documents | $4.26 | $0.44 |
| To fix / 1,000 | 7 | 440 |
| Speed (median) | 3.5 sec | 2.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Gemini 3.8 Flash is more accurate by 2.4 pp. Mistral Small 4 is 16.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 97.23% | 94.82% |
| Error-free documents | 96.00% | 51.33% |
| Per 1,000 documents | $7.15 | $0.44 |
| To fix / 1,000 | 40 | 487 |
| Speed (median) | 4.7 sec | 2.0 sec |
| Valid answers | 97.33% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 4.9 pp. Mistral Small 4 is 17.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 97.28% | 92.36% |
| Error-free documents | 96.67% | 32.67% |
| Per 1,000 documents | $7.84 | $0.44 |
| To fix / 1,000 | 33 | 673 |
| Speed (median) | 5.7 sec | 2.1 sec |
| Valid answers | 97.33% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Gemini 3.8 Flash is more accurate by 5.1 pp. Mistral Small 4 is 13.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.95% | 94.87% |
| Error-free documents | 99.33% | 52.67% |
| Per 1,000 documents | $6.07 | $0.44 |
| To fix / 1,000 | 7 | 473 |
| Speed (median) | 5.3 sec | 2.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 9 pp. Mistral Small 4 is 25.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.74% | 89.70% |
| Error-free documents | 88.67% | 37.33% |
| Per 1,000 documents | $2.39 | $0.09 |
| To fix / 1,000 | 113 | 627 |
| Speed (median) | 2.2 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 11.6 pp. Mistral Small 4 is 25.9× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.19% | 87.63% |
| Error-free documents | 92.67% | 31.33% |
| Per 1,000 documents | $3.06 | $0.12 |
| To fix / 1,000 | 73 | 687 |
| Speed (median) | 2.6 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Gemini 3.8 Flash is more accurate by 11.1 pp. Mistral Small 4 is 25.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.37% | 87.26% |
| Error-free documents | 85.33% | 29.33% |
| Per 1,000 documents | $2.74 | $0.11 |
| To fix / 1,000 | 147 | 707 |
| Speed (median) | 2.9 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 10.3 pp. Mistral Small 4 is 29.9× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.96% | 88.67% |
| Error-free documents | 90.67% | 35.33% |
| Per 1,000 documents | $3.30 | $0.11 |
| To fix / 1,000 | 93 | 647 |
| Speed (median) | 3.3 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Gemini 3.8 Flash is more accurate by 8.1 pp. Mistral Small 4 is 23.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 98.59% | 90.52% |
| Error-free documents | 87.33% | 44.67% |
| Per 1,000 documents | $2.63 | $0.11 |
| To fix / 1,000 | 127 | 553 |
| Speed (median) | 2.7 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 0.3 pp. Mistral Small 4 is 24.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.71% | 99.43% |
| Error-free documents | 98.00% | 96.00% |
| Per 1,000 documents | $1.86 | $0.08 |
| To fix / 1,000 | 20 | 40 |
| Speed (median) | 1.9 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 0.8 pp. Mistral Small 4 is 23.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.52% | 98.76% |
| Error-free documents | 96.67% | 92.00% |
| Per 1,000 documents | $2.19 | $0.09 |
| To fix / 1,000 | 33 | 80 |
| Speed (median) | 2.0 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.6 pp. Mistral Small 4 is 23.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.71% | 99.14% |
| Error-free documents | 98.00% | 94.00% |
| Per 1,000 documents | $2.12 | $0.09 |
| To fix / 1,000 | 20 | 60 |
| Speed (median) | 2.3 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 0.8 pp. Mistral Small 4 is 22.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.81% | 99.05% |
| Error-free documents | 98.67% | 93.33% |
| Per 1,000 documents | $2.11 | $0.09 |
| To fix / 1,000 | 13 | 67 |
| Speed (median) | 2.3 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.9 pp. Mistral Small 4 is 22.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.81% | 98.95% |
| Error-free documents | 98.67% | 93.33% |
| Per 1,000 documents | $2.13 | $0.09 |
| To fix / 1,000 | 13 | 67 |
| Speed (median) | 2.3 sec | 1.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 8.4 pp. Mistral Small 4 is 14.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.90% | 91.54% |
| Error-free documents | 99.33% | 43.33% |
| Per 1,000 documents | $2.47 | $0.17 |
| To fix / 1,000 | 7 | 567 |
| Speed (median) | 2.0 sec | 1.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Mistral Small 4 is 13.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 99.03% |
| Error-free documents | 100.00% | 92.00% |
| Per 1,000 documents | $3.09 | $0.23 |
| To fix / 1,000 | 0 | 80 |
| Speed (median) | 2.2 sec | 1.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Gemini 3.8 Flash is more accurate by 5.6 pp. Mistral Small 4 is 16.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.90% | 94.26% |
| Error-free documents | 99.33% | 46.67% |
| Per 1,000 documents | $3.42 | $0.21 |
| To fix / 1,000 | 7 | 533 |
| Speed (median) | 2.6 sec | 1.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Mistral Small 4 is 14.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.33 | $0.23 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.0 sec | 1.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.8 pp. Mistral Small 4 is 15× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 99.23% |
| Error-free documents | 100.00% | 90.00% |
| Per 1,000 documents | $3.50 | $0.23 |
| To fix / 1,000 | 0 | 100 |
| Speed (median) | 3.0 sec | 1.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 0.3 pp. Mistral Small 4 is 38.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 99.67% |
| Error-free documents | 100.00% | 98.67% |
| Per 1,000 documents | $5.46 | $0.14 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 5.4 sec | 1.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Mistral Small 4 is 30.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 99.00% |
| Error-free documents | 100.00% | 94.00% |
| Per 1,000 documents | $6.69 | $0.22 |
| To fix / 1,000 | 0 | 60 |
| Speed (median) | 6.2 sec | 1.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.1 pp. Mistral Small 4 is 32.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 99.89% |
| Error-free documents | 100.00% | 99.33% |
| Per 1,000 documents | $6.11 | $0.19 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 5.8 sec | 1.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 2.2 pp. Mistral Small 4 is 37.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 97.78% |
| Error-free documents | 100.00% | 86.67% |
| Per 1,000 documents | $6.78 | $0.18 |
| To fix / 1,000 | 0 | 133 |
| Speed (median) | 5.9 sec | 1.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Gemini 3.8 Flash is more accurate by 6.8 pp. Mistral Small 4 is 37.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 93.22% |
| Error-free documents | 100.00% | 62.00% |
| Per 1,000 documents | $7.06 | $0.19 |
| To fix / 1,000 | 0 | 380 |
| Speed (median) | 6.7 sec | 1.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Mistral Small 4 is more accurate by 0.1 pp. Mistral Small 4 is 19.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 99.89% | 100.00% |
| Error-free documents | 99.33% | 100.00% |
| Per 1,000 documents | $3.00 | $0.15 |
| To fix / 1,000 | 7 | 0 |
| Speed (median) | 3.0 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Both are equally accurate. Mistral Small 4 is 20.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.36 | $0.21 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Both are equally accurate. Mistral Small 4 is 21.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.76 | $0.18 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.2 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Both are equally accurate. Mistral Small 4 is 22.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.05 | $0.18 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Both are equally accurate. Mistral Small 4 is 22.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Small 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.06 | $0.18 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.7 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.