Gemini 3.8 Flash vs Mistral Medium 3.5
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Gemini 3.8 Flash is more accurate; Mistral Medium 3.5 is cheaper in 26 of 30 combinations.
More accurate
Gemini 3.8 Flash
wins 13 of 30
Cheaper
Mistral Medium 3.5
cheaper in 26 of 30
Faster
Mistral Medium 3.5
1.0 sec vs 3.2 sec
Fewer fixes
Gemini 3.8 Flash
7 vs 20 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference |
| Invoice extraction | 99.82% | 97.76% | ▼ 2.06 | $3.84 | $4.37 | +14 % |
| Email triage | 98.74% | 94.89% | ▼ 3.85 | $2.39 | $1.47 | −38 % |
| Personal data detection | 99.71% | 99.71% | ±0 | $1.86 | $1.15 | −38 % |
| Contract clauses | 99.90% | 98.10% | ▼ 1.8 | $2.47 | $2.35 | −5 % |
| Document summaries | 100.00% | 100.00% | ±0 | $5.46 | $1.57 | −71 % |
| Questions about a document | 99.89% | 100.00% | ▲ 0.11 | $3.00 | $1.81 | −40 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference |
| Invoice extraction | 99.95% | 93.49% | ▼ 6.46 | $4.26 | $4.69 | +10 % |
| Email triage | 99.19% | 94.52% | ▼ 4.67 | $3.06 | $1.95 | −36 % |
| Personal data detection | 99.52% | 99.81% | ▲ 0.29 | $2.19 | $1.40 | −36 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $3.09 | $3.06 | −1 % |
| Document summaries | 100.00% | 100.00% | ±0 | $6.69 | $2.31 | −65 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.36 | $2.51 | −43 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference |
| Invoice extraction | 97.23% | 97.38% | ▲ 0.15 | $7.15 | $4.72 | −34 % |
| Email triage | 98.37% | 92.74% | ▼ 5.63 | $2.74 | $1.77 | −35 % |
| Personal data detection | 99.71% | 100.00% | ▲ 0.29 | $2.12 | $1.38 | −35 % |
| Contract clauses | 99.90% | 97.13% | ▼ 2.77 | $3.42 | $2.76 | −19 % |
| Document summaries | 100.00% | 100.00% | ±0 | $6.11 | $1.98 | −68 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $3.76 | $2.13 | −43 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference |
| Invoice extraction | 97.28% | 96.87% | ▼ 0.41 | $7.84 | $4.75 | −39 % |
| Email triage | 98.96% | 94.15% | ▼ 4.81 | $3.30 | $1.79 | −46 % |
| Personal data detection | 99.81% | 99.62% | ▼ 0.19 | $2.11 | $1.41 | −33 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $3.33 | $3.02 | −9 % |
| Document summaries | 100.00% | 100.00% | ±0 | $6.78 | $1.86 | −73 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.05 | $2.18 | −46 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference | Gemini 3.8 Flash | Mistral Medium 3.5 | Difference |
| Invoice extraction | 99.95% | 98.56% | ▼ 1.39 | $6.07 | $4.82 | −21 % |
| Email triage | 98.59% | 94.15% | ▼ 4.44 | $2.63 | $1.78 | −32 % |
| Personal data detection | 99.81% | 99.62% | ▼ 0.19 | $2.13 | $1.43 | −33 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $3.50 | $3.01 | −14 % |
| Document summaries | 100.00% | 100.00% | ±0 | $7.06 | $1.87 | −74 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.06 | $2.19 | −46 % |
Difference: Mistral Medium 3.5 vs. Gemini 3.8 Flash; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 2.1 pp. Gemini 3.8 Flash is 1.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.82% | 97.76% |
| Error-free documents | 98.00% | 79.33% |
| Per 1,000 documents | $3.84 | $4.37 |
| To fix / 1,000 | 20 | 207 |
| Speed (median) | 3.2 sec | 2.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 6.5 pp. Gemini 3.8 Flash is 1.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.95% | 93.49% |
| Error-free documents | 99.33% | 63.33% |
| Per 1,000 documents | $4.26 | $4.69 |
| To fix / 1,000 | 7 | 367 |
| Speed (median) | 3.5 sec | 2.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Mistral Medium 3.5 is more accurate by 0.1 pp. Mistral Medium 3.5 is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 97.23% | 97.38% |
| Error-free documents | 96.00% | 74.67% |
| Per 1,000 documents | $7.15 | $4.72 |
| To fix / 1,000 | 40 | 253 |
| Speed (median) | 4.7 sec | 2.5 sec |
| Valid answers | 97.33% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 0.4 pp. Mistral Medium 3.5 is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 97.28% | 96.87% |
| Error-free documents | 96.67% | 66.67% |
| Per 1,000 documents | $7.84 | $4.75 |
| To fix / 1,000 | 33 | 333 |
| Speed (median) | 5.7 sec | 2.5 sec |
| Valid answers | 97.33% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Gemini 3.8 Flash is more accurate by 1.4 pp. Mistral Medium 3.5 is 1.3× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.95% | 98.56% |
| Error-free documents | 99.33% | 84.67% |
| Per 1,000 documents | $6.07 | $4.82 |
| To fix / 1,000 | 7 | 153 |
| Speed (median) | 5.3 sec | 2.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 3.9 pp. Mistral Medium 3.5 is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 98.74% | 94.89% |
| Error-free documents | 88.67% | 57.33% |
| Per 1,000 documents | $2.39 | $1.47 |
| To fix / 1,000 | 113 | 427 |
| Speed (median) | 2.2 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 4.7 pp. Mistral Medium 3.5 is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.19% | 94.52% |
| Error-free documents | 92.67% | 55.33% |
| Per 1,000 documents | $3.06 | $1.95 |
| To fix / 1,000 | 73 | 447 |
| Speed (median) | 2.6 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Gemini 3.8 Flash is more accurate by 5.6 pp. Mistral Medium 3.5 is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 98.37% | 92.74% |
| Error-free documents | 85.33% | 48.00% |
| Per 1,000 documents | $2.74 | $1.77 |
| To fix / 1,000 | 147 | 520 |
| Speed (median) | 2.9 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 4.8 pp. Mistral Medium 3.5 is 1.8× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 98.96% | 94.15% |
| Error-free documents | 90.67% | 54.00% |
| Per 1,000 documents | $3.30 | $1.79 |
| To fix / 1,000 | 93 | 460 |
| Speed (median) | 3.3 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Gemini 3.8 Flash is more accurate by 4.4 pp. Mistral Medium 3.5 is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 98.59% | 94.15% |
| Error-free documents | 87.33% | 54.00% |
| Per 1,000 documents | $2.63 | $1.78 |
| To fix / 1,000 | 127 | 460 |
| Speed (median) | 2.7 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.71% | 99.71% |
| Error-free documents | 98.00% | 98.00% |
| Per 1,000 documents | $1.86 | $1.15 |
| To fix / 1,000 | 20 | 20 |
| Speed (median) | 1.9 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Mistral Medium 3.5 is more accurate by 0.3 pp. Mistral Medium 3.5 is 1.6× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.52% | 99.81% |
| Error-free documents | 96.67% | 98.67% |
| Per 1,000 documents | $2.19 | $1.40 |
| To fix / 1,000 | 33 | 13 |
| Speed (median) | 2.0 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Mistral Medium 3.5 is more accurate by 0.3 pp. Mistral Medium 3.5 is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.71% | 100.00% |
| Error-free documents | 98.00% | 100.00% |
| Per 1,000 documents | $2.12 | $1.38 |
| To fix / 1,000 | 20 | 0 |
| Speed (median) | 2.3 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 0.2 pp. Mistral Medium 3.5 is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.81% | 99.62% |
| Error-free documents | 98.67% | 97.33% |
| Per 1,000 documents | $2.11 | $1.41 |
| To fix / 1,000 | 13 | 27 |
| Speed (median) | 2.3 sec | 1.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.2 pp. Mistral Medium 3.5 is 1.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.81% | 99.62% |
| Error-free documents | 98.67% | 97.33% |
| Per 1,000 documents | $2.13 | $1.43 |
| To fix / 1,000 | 13 | 27 |
| Speed (median) | 2.3 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 1.8 pp.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.90% | 98.10% |
| Error-free documents | 99.33% | 87.33% |
| Per 1,000 documents | $2.47 | $2.35 |
| To fix / 1,000 | 7 | 127 |
| Speed (median) | 2.0 sec | 1.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.09 | $3.06 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.2 sec | 1.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Gemini 3.8 Flash is more accurate by 2.8 pp. Mistral Medium 3.5 is 1.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.90% | 97.13% |
| Error-free documents | 99.33% | 75.33% |
| Per 1,000 documents | $3.42 | $2.76 |
| To fix / 1,000 | 7 | 247 |
| Speed (median) | 2.6 sec | 1.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.33 | $3.02 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.0 sec | 1.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.2× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.50 | $3.01 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.0 sec | 1.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 3.5× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $5.46 | $1.57 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 5.4 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 2.9× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.69 | $2.31 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 6.2 sec | 1.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 3.1× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.11 | $1.98 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 5.8 sec | 1.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 3.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.78 | $1.86 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 5.9 sec | 1.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 3.8× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $7.06 | $1.87 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 6.7 sec | 1.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Mistral Medium 3.5 is more accurate by 0.1 pp. Mistral Medium 3.5 is 1.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.89% | 100.00% |
| Error-free documents | 99.33% | 100.00% |
| Per 1,000 documents | $3.00 | $1.81 |
| To fix / 1,000 | 7 | 0 |
| Speed (median) | 3.0 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.7× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.36 | $2.51 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.8× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.76 | $2.13 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.2 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.9× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.05 | $2.18 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 0.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Both are equally accurate. Mistral Medium 3.5 is 1.9× cheaper.
| Metric | Gemini 3.8 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.06 | $2.19 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.7 sec | 0.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.