Gemini 3.8 Flash vs Mistral Large 4
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Gemini 3.8 Flash is more accurate and cheaper in 27 of 30 combinations.
More accurate
Gemini 3.8 Flash
wins 24 of 30
Cheaper
Gemini 3.8 Flash
cheaper in 27 of 30
Faster
Gemini 3.8 Flash
3.2 sec vs 31.5 sec
Fewer fixes
Gemini 3.8 Flash
7 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Large 4 | Difference | Gemini 3.8 Flash | Mistral Large 4 | Difference |
| Invoice extraction | 99.82% | 95.39% | ▼ 4.43 | $3.84 | $6.65 | +73 % |
| Email triage | 98.74% | 98.74% | ±0 | $2.39 | $3.52 | +47 % |
| Personal data detection | 99.71% | 99.62% | ▼ 0.09 | $1.86 | $2.89 | +55 % |
| Contract clauses | 99.90% | 96.10% | ▼ 3.8 | $2.47 | $5.24 | +112 % |
| Document summaries | 100.00% | 100.00% | ±0 | $5.46 | $5.62 | +3 % |
| Questions about a document | 99.89% | 98.89% | ▼ 1 | $3.00 | $4.16 | +39 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Large 4 | Difference | Gemini 3.8 Flash | Mistral Large 4 | Difference |
| Invoice extraction | 99.95% | 97.08% | ▼ 2.87 | $4.26 | $5.69 | +34 % |
| Email triage | 99.19% | 98.15% | ▼ 1.04 | $3.06 | $4.41 | +44 % |
| Personal data detection | 99.52% | 99.33% | ▼ 0.19 | $2.19 | $3.15 | +44 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $3.09 | $4.58 | +48 % |
| Document summaries | 100.00% | 83.33% | ▼ 16.67 | $6.69 | $10.72 | +60 % |
| Questions about a document | 100.00% | 89.89% | ▼ 10.11 | $4.36 | $7.08 | +62 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Large 4 | Difference | Gemini 3.8 Flash | Mistral Large 4 | Difference |
| Invoice extraction | 97.23% | 97.49% | ▲ 0.26 | $7.15 | $6.72 | −6 % |
| Email triage | 98.37% | 97.85% | ▼ 0.52 | $2.74 | $3.78 | +38 % |
| Personal data detection | 99.71% | 99.52% | ▼ 0.19 | $2.12 | $2.61 | +23 % |
| Contract clauses | 99.90% | 99.44% | ▼ 0.46 | $3.42 | $5.12 | +50 % |
| Document summaries | 100.00% | 99.33% | ▼ 0.67 | $6.11 | $7.19 | +18 % |
| Questions about a document | 100.00% | 93.56% | ▼ 6.44 | $3.76 | $5.77 | +54 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Large 4 | Difference | Gemini 3.8 Flash | Mistral Large 4 | Difference |
| Invoice extraction | 97.28% | 96.51% | ▼ 0.77 | $7.84 | $7.49 | −4 % |
| Email triage | 98.96% | 97.93% | ▼ 1.03 | $3.30 | $4.03 | +22 % |
| Personal data detection | 99.81% | 99.81% | ±0 | $2.11 | $3.16 | +50 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $3.33 | $4.83 | +45 % |
| Document summaries | 100.00% | 91.33% | ▼ 8.67 | $6.78 | $7.99 | +18 % |
| Questions about a document | 100.00% | 94.22% | ▼ 5.78 | $4.05 | $5.74 | +42 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Large 4 | Difference | Gemini 3.8 Flash | Mistral Large 4 | Difference |
| Invoice extraction | 99.95% | 88.97% | ▼ 10.98 | $6.07 | $8.71 | +44 % |
| Email triage | 98.59% | 98.30% | ▼ 0.29 | $2.63 | $3.70 | +41 % |
| Personal data detection | 99.81% | 98.67% | ▼ 1.14 | $2.13 | $2.96 | +39 % |
| Contract clauses | 100.00% | 99.28% | ▼ 0.72 | $3.50 | $4.60 | +31 % |
| Document summaries | 100.00% | 72.67% | ▼ 27.33 | $7.06 | $11.26 | +59 % |
| Questions about a document | 100.00% | 92.33% | ▼ 7.67 | $4.06 | $5.74 | +41 % |
Difference: Mistral Large 4 vs. Gemini 3.8 Flash; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 4.4 pp. Gemini 3.8 Flash is 1.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.82% | 95.39% |
| Error-free documents | 98.00% | 77.33% |
| Per 1,000 documents | $3.84 | $6.65 |
| To fix / 1,000 | 20 | 227 |
| Speed (median) | 3.2 sec | 29.0 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 2.9 pp. Gemini 3.8 Flash is 1.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 97.08% |
| Error-free documents | 99.33% | 88.67% |
| Per 1,000 documents | $4.26 | $5.69 |
| To fix / 1,000 | 7 | 113 |
| Speed (median) | 3.5 sec | 26.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Mistral Large 4 is more accurate by 0.3 pp. Mistral Large 4 is 1.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.23% | 97.49% |
| Error-free documents | 96.00% | 91.33% |
| Per 1,000 documents | $7.15 | $6.72 |
| To fix / 1,000 | 40 | 87 |
| Speed (median) | 4.7 sec | 35.3 sec |
| Valid answers | 97.33% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 0.8 pp.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.28% | 96.51% |
| Error-free documents | 96.67% | 88.00% |
| Per 1,000 documents | $7.84 | $7.49 |
| To fix / 1,000 | 33 | 120 |
| Speed (median) | 5.7 sec | 41.3 sec |
| Valid answers | 97.33% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Gemini 3.8 Flash is more accurate by 11 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 88.97% |
| Error-free documents | 99.33% | 65.33% |
| Per 1,000 documents | $6.07 | $8.71 |
| To fix / 1,000 | 7 | 347 |
| Speed (median) | 5.3 sec | 43.4 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.74% | 98.74% |
| Error-free documents | 88.67% | 88.67% |
| Per 1,000 documents | $2.39 | $3.52 |
| To fix / 1,000 | 113 | 113 |
| Speed (median) | 2.2 sec | 19.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.19% | 98.15% |
| Error-free documents | 92.67% | 89.33% |
| Per 1,000 documents | $3.06 | $4.41 |
| To fix / 1,000 | 73 | 107 |
| Speed (median) | 2.6 sec | 28.4 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.5 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.37% | 97.85% |
| Error-free documents | 85.33% | 82.00% |
| Per 1,000 documents | $2.74 | $3.78 |
| To fix / 1,000 | 147 | 180 |
| Speed (median) | 2.9 sec | 21.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.96% | 97.93% |
| Error-free documents | 90.67% | 82.00% |
| Per 1,000 documents | $3.30 | $4.03 |
| To fix / 1,000 | 93 | 180 |
| Speed (median) | 3.3 sec | 25.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.3 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.59% | 98.30% |
| Error-free documents | 87.33% | 84.67% |
| Per 1,000 documents | $2.63 | $3.70 |
| To fix / 1,000 | 127 | 153 |
| Speed (median) | 2.7 sec | 24.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 0.1 pp. Gemini 3.8 Flash is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.71% | 99.62% |
| Error-free documents | 98.00% | 97.33% |
| Per 1,000 documents | $1.86 | $2.89 |
| To fix / 1,000 | 20 | 27 |
| Speed (median) | 1.9 sec | 28.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 0.2 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.52% | 99.33% |
| Error-free documents | 96.67% | 95.33% |
| Per 1,000 documents | $2.19 | $3.15 |
| To fix / 1,000 | 33 | 47 |
| Speed (median) | 2.0 sec | 18.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.2 pp. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.71% | 99.52% |
| Error-free documents | 98.00% | 96.67% |
| Per 1,000 documents | $2.12 | $2.61 |
| To fix / 1,000 | 20 | 33 |
| Speed (median) | 2.3 sec | 18.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.81% | 99.81% |
| Error-free documents | 98.67% | 98.67% |
| Per 1,000 documents | $2.11 | $3.16 |
| To fix / 1,000 | 13 | 13 |
| Speed (median) | 2.3 sec | 21.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Gemini 3.8 Flash is more accurate by 1.1 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.81% | 98.67% |
| Error-free documents | 98.67% | 94.67% |
| Per 1,000 documents | $2.13 | $2.96 |
| To fix / 1,000 | 13 | 53 |
| Speed (median) | 2.3 sec | 23.6 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 3.8 pp. Gemini 3.8 Flash is 2.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.90% | 96.10% |
| Error-free documents | 99.33% | 74.67% |
| Per 1,000 documents | $2.47 | $5.24 |
| To fix / 1,000 | 7 | 253 |
| Speed (median) | 2.0 sec | 41.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.09 | $4.58 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.2 sec | 43.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.5 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.90% | 99.44% |
| Error-free documents | 99.33% | 95.33% |
| Per 1,000 documents | $3.42 | $5.12 |
| To fix / 1,000 | 7 | 47 |
| Speed (median) | 2.6 sec | 36.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.33 | $4.83 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.0 sec | 35.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.7 pp. Gemini 3.8 Flash is 1.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.28% |
| Error-free documents | 100.00% | 90.67% |
| Per 1,000 documents | $3.50 | $4.60 |
| To fix / 1,000 | 0 | 93 |
| Speed (median) | 3.0 sec | 34.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Both are equally accurate.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $5.46 | $5.62 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 5.4 sec | 37.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 16.7 pp. Gemini 3.8 Flash is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 83.33% |
| Error-free documents | 100.00% | 83.33% |
| Per 1,000 documents | $6.69 | $10.72 |
| To fix / 1,000 | 0 | 167 |
| Speed (median) | 6.2 sec | 55.4 sec |
| Valid answers | 100.00% | 83.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.7 pp. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.33% |
| Error-free documents | 100.00% | 99.33% |
| Per 1,000 documents | $6.11 | $7.19 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 5.8 sec | 48.0 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 8.7 pp. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 91.33% |
| Error-free documents | 100.00% | 91.33% |
| Per 1,000 documents | $6.78 | $7.99 |
| To fix / 1,000 | 0 | 87 |
| Speed (median) | 5.9 sec | 38.3 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Gemini 3.8 Flash is more accurate by 27.3 pp. Gemini 3.8 Flash is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 72.67% |
| Error-free documents | 100.00% | 72.67% |
| Per 1,000 documents | $7.06 | $11.26 |
| To fix / 1,000 | 0 | 273 |
| Speed (median) | 6.7 sec | 46.4 sec |
| Valid answers | 100.00% | 72.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.89% | 98.89% |
| Error-free documents | 99.33% | 97.33% |
| Per 1,000 documents | $3.00 | $4.16 |
| To fix / 1,000 | 7 | 27 |
| Speed (median) | 3.0 sec | 17.7 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 10.1 pp. Gemini 3.8 Flash is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 89.89% |
| Error-free documents | 100.00% | 78.00% |
| Per 1,000 documents | $4.36 | $7.08 |
| To fix / 1,000 | 0 | 220 |
| Speed (median) | 3.6 sec | 33.6 sec |
| Valid answers | 100.00% | 93.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Gemini 3.8 Flash is more accurate by 6.4 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 93.56% |
| Error-free documents | 100.00% | 89.33% |
| Per 1,000 documents | $3.76 | $5.77 |
| To fix / 1,000 | 0 | 107 |
| Speed (median) | 3.2 sec | 31.5 sec |
| Valid answers | 100.00% | 94.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 5.8 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 94.22% |
| Error-free documents | 100.00% | 90.67% |
| Per 1,000 documents | $4.05 | $5.74 |
| To fix / 1,000 | 0 | 93 |
| Speed (median) | 3.6 sec | 22.8 sec |
| Valid answers | 100.00% | 95.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Gemini 3.8 Flash is more accurate by 7.7 pp. Gemini 3.8 Flash is 1.4× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 92.33% |
| Error-free documents | 100.00% | 87.33% |
| Per 1,000 documents | $4.06 | $5.74 |
| To fix / 1,000 | 0 | 127 |
| Speed (median) | 3.7 sec | 19.8 sec |
| Valid answers | 100.00% | 94.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.