Mistral Small 4 vs Qwen3.8 Flash
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Mistral Small 4 is more accurate and cheaper in 30 of 30 combinations.
More accurate
Mistral Small 4
wins 15 of 30
Cheaper
Mistral Small 4
cheaper in 30 of 30
Faster
Mistral Small 4
1.0 sec vs 14.1 sec
Fewer fixes
Qwen3.8 Flash
67 vs 100 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Mistral Small 4 | Qwen3.8 Flash | Difference | Mistral Small 4 | Qwen3.8 Flash | Difference |
| Invoice extraction | 95.58% | 82.36% | ▼ 13.22 | $0.41 | $1.15 | +183 % |
| Email triage | 89.70% | 97.48% | ▲ 7.78 | $0.09 | $0.30 | +221 % |
| Personal data detection | 99.43% | 99.24% | ▼ 0.19 | $0.08 | $0.28 | +262 % |
| Contract clauses | 91.54% | 95.13% | ▲ 3.59 | $0.17 | $0.62 | +264 % |
| Document summaries | 99.67% | 99.89% | ▲ 0.22 | $0.14 | $0.75 | +424 % |
| Questions about a document | 100.00% | 99.78% | ▼ 0.22 | $0.15 | $0.44 | +189 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Mistral Small 4 | Qwen3.8 Flash | Difference | Mistral Small 4 | Qwen3.8 Flash | Difference |
| Invoice extraction | 93.64% | 91.79% | ▼ 1.85 | $0.44 | $1.02 | +133 % |
| Email triage | 87.63% | 98.52% | ▲ 10.89 | $0.12 | $0.45 | +277 % |
| Personal data detection | 98.76% | 96.95% | ▼ 1.81 | $0.09 | $0.41 | +338 % |
| Contract clauses | 99.03% | 99.90% | ▲ 0.87 | $0.23 | $0.63 | +178 % |
| Document summaries | 99.00% | 95.44% | ▼ 3.56 | $0.22 | $1.48 | +570 % |
| Questions about a document | 100.00% | 94.22% | ▼ 5.78 | $0.21 | $0.71 | +232 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Mistral Small 4 | Qwen3.8 Flash | Difference | Mistral Small 4 | Qwen3.8 Flash | Difference |
| Invoice extraction | 94.82% | 93.49% | ▼ 1.33 | $0.44 | $1.12 | +156 % |
| Email triage | 87.26% | 97.85% | ▲ 10.59 | $0.11 | $0.39 | +259 % |
| Personal data detection | 99.14% | 99.62% | ▲ 0.48 | $0.09 | $0.36 | +294 % |
| Contract clauses | 94.26% | 98.00% | ▲ 3.74 | $0.21 | $0.78 | +277 % |
| Document summaries | 99.89% | 95.33% | ▼ 4.56 | $0.19 | $1.43 | +663 % |
| Questions about a document | 100.00% | 98.89% | ▼ 1.11 | $0.18 | $0.46 | +160 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Mistral Small 4 | Qwen3.8 Flash | Difference | Mistral Small 4 | Qwen3.8 Flash | Difference |
| Invoice extraction | 92.36% | 88.87% | ▼ 3.49 | $0.44 | $1.38 | +212 % |
| Email triage | 88.67% | 96.74% | ▲ 8.07 | $0.11 | $0.46 | +317 % |
| Personal data detection | 99.05% | 99.81% | ▲ 0.76 | $0.09 | $0.38 | +303 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $0.23 | $0.60 | +155 % |
| Document summaries | 97.78% | 94.44% | ▼ 3.34 | $0.18 | $1.22 | +570 % |
| Questions about a document | 100.00% | 99.67% | ▼ 0.33 | $0.18 | $0.53 | +186 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Mistral Small 4 | Qwen3.8 Flash | Difference | Mistral Small 4 | Qwen3.8 Flash | Difference |
| Invoice extraction | 94.87% | 90.46% | ▼ 4.41 | $0.44 | $1.28 | +188 % |
| Email triage | 90.52% | 96.44% | ▲ 5.92 | $0.11 | $0.45 | +298 % |
| Personal data detection | 98.95% | 99.71% | ▲ 0.76 | $0.09 | $0.40 | +317 % |
| Contract clauses | 99.23% | 99.49% | ▲ 0.26 | $0.23 | $0.66 | +182 % |
| Document summaries | 93.22% | 96.33% | ▲ 3.11 | $0.19 | $1.46 | +666 % |
| Questions about a document | 100.00% | 98.78% | ▼ 1.22 | $0.18 | $0.57 | +212 % |
Difference: Qwen3.8 Flash vs. Mistral Small 4; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Mistral Small 4 is more accurate by 13.2 pp. Mistral Small 4 is 2.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 95.58% | 82.36% |
| Error-free documents | 58.00% | 57.33% |
| Per 1,000 documents | $0.41 | $1.15 |
| To fix / 1,000 | 420 | 427 |
| Speed (median) | 1.8 sec | 17.4 sec |
| Valid answers | 100.00% | 90.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Mistral Small 4 is more accurate by 1.8 pp. Mistral Small 4 is 2.3× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 93.64% | 91.79% |
| Error-free documents | 56.00% | 76.67% |
| Per 1,000 documents | $0.44 | $1.02 |
| To fix / 1,000 | 440 | 233 |
| Speed (median) | 2.0 sec | 17.0 sec |
| Valid answers | 100.00% | 96.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Mistral Small 4 is more accurate by 1.3 pp. Mistral Small 4 is 2.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.82% | 93.49% |
| Error-free documents | 51.33% | 87.33% |
| Per 1,000 documents | $0.44 | $1.12 |
| To fix / 1,000 | 487 | 127 |
| Speed (median) | 2.0 sec | 19.0 sec |
| Valid answers | 100.00% | 94.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Mistral Small 4 is more accurate by 3.5 pp. Mistral Small 4 is 3.1× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 92.36% | 88.87% |
| Error-free documents | 32.67% | 74.67% |
| Per 1,000 documents | $0.44 | $1.38 |
| To fix / 1,000 | 673 | 253 |
| Speed (median) | 2.1 sec | 22.0 sec |
| Valid answers | 100.00% | 90.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Mistral Small 4 is more accurate by 4.4 pp. Mistral Small 4 is 2.9× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.87% | 90.46% |
| Error-free documents | 52.67% | 83.33% |
| Per 1,000 documents | $0.44 | $1.28 |
| To fix / 1,000 | 473 | 167 |
| Speed (median) | 2.1 sec | 19.4 sec |
| Valid answers | 100.00% | 94.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 7.8 pp. Mistral Small 4 is 3.2× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 89.70% | 97.48% |
| Error-free documents | 37.33% | 78.67% |
| Per 1,000 documents | $0.09 | $0.30 |
| To fix / 1,000 | 627 | 213 |
| Speed (median) | 0.8 sec | 8.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Qwen3.8 Flash is more accurate by 10.9 pp. Mistral Small 4 is 3.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 87.63% | 98.52% |
| Error-free documents | 31.33% | 86.67% |
| Per 1,000 documents | $0.12 | $0.45 |
| To fix / 1,000 | 687 | 133 |
| Speed (median) | 0.8 sec | 13.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Qwen3.8 Flash is more accurate by 10.6 pp. Mistral Small 4 is 3.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 87.26% | 97.85% |
| Error-free documents | 29.33% | 81.33% |
| Per 1,000 documents | $0.11 | $0.39 |
| To fix / 1,000 | 707 | 187 |
| Speed (median) | 0.8 sec | 12.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Qwen3.8 Flash is more accurate by 8.1 pp. Mistral Small 4 is 4.2× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 88.67% | 96.74% |
| Error-free documents | 35.33% | 72.00% |
| Per 1,000 documents | $0.11 | $0.46 |
| To fix / 1,000 | 647 | 280 |
| Speed (median) | 0.9 sec | 11.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Qwen3.8 Flash is more accurate by 5.9 pp. Mistral Small 4 is 4× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 90.52% | 96.44% |
| Error-free documents | 44.67% | 76.00% |
| Per 1,000 documents | $0.11 | $0.45 |
| To fix / 1,000 | 553 | 240 |
| Speed (median) | 0.9 sec | 13.2 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Mistral Small 4 is more accurate by 0.2 pp. Mistral Small 4 is 3.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.43% | 99.24% |
| Error-free documents | 96.00% | 98.67% |
| Per 1,000 documents | $0.08 | $0.28 |
| To fix / 1,000 | 40 | 13 |
| Speed (median) | 0.8 sec | 7.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Mistral Small 4 is more accurate by 1.8 pp. Mistral Small 4 is 4.4× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 98.76% | 96.95% |
| Error-free documents | 92.00% | 88.67% |
| Per 1,000 documents | $0.09 | $0.41 |
| To fix / 1,000 | 80 | 113 |
| Speed (median) | 0.9 sec | 9.6 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Qwen3.8 Flash is more accurate by 0.5 pp. Mistral Small 4 is 3.9× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.14% | 99.62% |
| Error-free documents | 94.00% | 99.33% |
| Per 1,000 documents | $0.09 | $0.36 |
| To fix / 1,000 | 60 | 7 |
| Speed (median) | 0.9 sec | 12.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Qwen3.8 Flash is more accurate by 0.8 pp. Mistral Small 4 is 4× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.05% | 99.81% |
| Error-free documents | 93.33% | 98.67% |
| Per 1,000 documents | $0.09 | $0.38 |
| To fix / 1,000 | 67 | 13 |
| Speed (median) | 0.9 sec | 10.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Qwen3.8 Flash is more accurate by 0.8 pp. Mistral Small 4 is 4.2× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 98.95% | 99.71% |
| Error-free documents | 93.33% | 98.00% |
| Per 1,000 documents | $0.09 | $0.40 |
| To fix / 1,000 | 67 | 20 |
| Speed (median) | 1.0 sec | 10.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 3.6 pp. Mistral Small 4 is 3.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 91.54% | 95.13% |
| Error-free documents | 43.33% | 69.33% |
| Per 1,000 documents | $0.17 | $0.62 |
| To fix / 1,000 | 567 | 307 |
| Speed (median) | 1.1 sec | 14.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Qwen3.8 Flash is more accurate by 0.9 pp. Mistral Small 4 is 2.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.03% | 99.90% |
| Error-free documents | 92.00% | 98.67% |
| Per 1,000 documents | $0.23 | $0.63 |
| To fix / 1,000 | 80 | 13 |
| Speed (median) | 1.2 sec | 13.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Qwen3.8 Flash is more accurate by 3.7 pp. Mistral Small 4 is 3.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.26% | 98.00% |
| Error-free documents | 46.67% | 87.33% |
| Per 1,000 documents | $0.21 | $0.78 |
| To fix / 1,000 | 533 | 127 |
| Speed (median) | 1.2 sec | 19.7 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Mistral Small 4 is 2.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.23 | $0.60 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 1.3 sec | 14.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Qwen3.8 Flash is more accurate by 0.3 pp. Mistral Small 4 is 2.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.23% | 99.49% |
| Error-free documents | 90.00% | 93.33% |
| Per 1,000 documents | $0.23 | $0.66 |
| To fix / 1,000 | 100 | 67 |
| Speed (median) | 1.2 sec | 16.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 0.2 pp. Mistral Small 4 is 5.2× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.67% | 99.89% |
| Error-free documents | 98.67% | 99.33% |
| Per 1,000 documents | $0.14 | $0.75 |
| To fix / 1,000 | 13 | 7 |
| Speed (median) | 1.0 sec | 17.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Mistral Small 4 is more accurate by 3.6 pp. Mistral Small 4 is 6.7× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.00% | 95.44% |
| Error-free documents | 94.00% | 93.33% |
| Per 1,000 documents | $0.22 | $1.48 |
| To fix / 1,000 | 60 | 67 |
| Speed (median) | 1.6 sec | 34.2 sec |
| Valid answers | 100.00% | 96.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Mistral Small 4 is more accurate by 4.6 pp. Mistral Small 4 is 7.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.89% | 95.33% |
| Error-free documents | 99.33% | 95.33% |
| Per 1,000 documents | $0.19 | $1.43 |
| To fix / 1,000 | 7 | 47 |
| Speed (median) | 1.3 sec | 29.5 sec |
| Valid answers | 100.00% | 95.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Mistral Small 4 is more accurate by 3.3 pp. Mistral Small 4 is 6.7× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.78% | 94.44% |
| Error-free documents | 86.67% | 93.33% |
| Per 1,000 documents | $0.18 | $1.22 |
| To fix / 1,000 | 133 | 67 |
| Speed (median) | 1.2 sec | 23.9 sec |
| Valid answers | 100.00% | 94.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Qwen3.8 Flash is more accurate by 3.1 pp. Mistral Small 4 is 7.7× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 93.22% | 96.33% |
| Error-free documents | 62.00% | 94.67% |
| Per 1,000 documents | $0.19 | $1.46 |
| To fix / 1,000 | 380 | 53 |
| Speed (median) | 1.3 sec | 28.1 sec |
| Valid answers | 100.00% | 96.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Mistral Small 4 is more accurate by 0.2 pp. Mistral Small 4 is 2.9× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 99.78% |
| Error-free documents | 100.00% | 98.67% |
| Per 1,000 documents | $0.15 | $0.44 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 0.8 sec | 8.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Mistral Small 4 is more accurate by 5.8 pp. Mistral Small 4 is 3.3× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 94.22% |
| Error-free documents | 100.00% | 84.67% |
| Per 1,000 documents | $0.21 | $0.71 |
| To fix / 1,000 | 0 | 153 |
| Speed (median) | 0.8 sec | 14.3 sec |
| Valid answers | 100.00% | 98.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Mistral Small 4 is more accurate by 1.1 pp. Mistral Small 4 is 2.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 98.89% |
| Error-free documents | 100.00% | 96.67% |
| Per 1,000 documents | $0.18 | $0.46 |
| To fix / 1,000 | 0 | 33 |
| Speed (median) | 0.8 sec | 8.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Mistral Small 4 is more accurate by 0.3 pp. Mistral Small 4 is 2.9× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 99.67% |
| Error-free documents | 100.00% | 98.67% |
| Per 1,000 documents | $0.18 | $0.53 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 0.8 sec | 10.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Mistral Small 4 is more accurate by 1.2 pp. Mistral Small 4 is 3.1× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 98.78% |
| Error-free documents | 100.00% | 97.33% |
| Per 1,000 documents | $0.18 | $0.57 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 0.8 sec | 10.4 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.