Claude Haiku 5.5 vs Mistral Large 4
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Claude Haiku 5.5 is more accurate and cheaper in 30 of 30 combinations.
More accurate
Claude Haiku 5.5
wins 22 of 30
Cheaper
Claude Haiku 5.5
cheaper in 30 of 30
Faster
Claude Haiku 5.5
2.1 sec vs 31.5 sec
Fewer fixes
Claude Haiku 5.5
33 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Haiku 5.5 | Mistral Large 4 | Difference | Claude Haiku 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 100.00% | 95.39% | ▼ 4.61 | $0.61 | $6.65 | +996 % |
| Email triage | 98.15% | 98.74% | ▲ 0.59 | $0.23 | $3.52 | +1401 % |
| Personal data detection | 99.81% | 99.62% | ▼ 0.19 | $0.19 | $2.89 | +1439 % |
| Contract clauses | 99.69% | 96.10% | ▼ 3.59 | $0.35 | $5.24 | +1376 % |
| Document summaries | 98.33% | 100.00% | ▲ 1.67 | $0.34 | $5.62 | +1557 % |
| Questions about a document | 100.00% | 98.89% | ▼ 1.11 | $0.23 | $4.16 | +1707 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Haiku 5.5 | Mistral Large 4 | Difference | Claude Haiku 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.90% | 97.08% | ▼ 2.82 | $0.62 | $5.69 | +817 % |
| Email triage | 97.63% | 98.15% | ▲ 0.52 | $0.29 | $4.41 | +1431 % |
| Personal data detection | 99.43% | 99.33% | ▼ 0.1 | $0.21 | $3.15 | +1400 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $0.40 | $4.58 | +1047 % |
| Document summaries | 95.89% | 83.33% | ▼ 12.56 | $0.32 | $10.72 | +3203 % |
| Questions about a document | 99.78% | 89.89% | ▼ 9.89 | $0.30 | $7.08 | +2244 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Haiku 5.5 | Mistral Large 4 | Difference | Claude Haiku 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.85% | 97.49% | ▼ 2.36 | $0.71 | $6.72 | +848 % |
| Email triage | 97.11% | 97.85% | ▲ 0.74 | $0.32 | $3.78 | +1081 % |
| Personal data detection | 99.62% | 99.52% | ▼ 0.1 | $0.23 | $2.61 | +1028 % |
| Contract clauses | 100.00% | 99.44% | ▼ 0.56 | $0.48 | $5.12 | +956 % |
| Document summaries | 99.44% | 99.33% | ▼ 0.11 | $0.46 | $7.19 | +1455 % |
| Questions about a document | 100.00% | 93.56% | ▼ 6.44 | $0.32 | $5.77 | +1692 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Haiku 5.5 | Mistral Large 4 | Difference | Claude Haiku 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.44% | 96.51% | ▼ 2.93 | $0.73 | $7.49 | +924 % |
| Email triage | 97.70% | 97.93% | ▲ 0.23 | $0.30 | $4.03 | +1243 % |
| Personal data detection | 100.00% | 99.81% | ▼ 0.19 | $0.23 | $3.16 | +1277 % |
| Contract clauses | 99.95% | 100.00% | ▲ 0.05 | $0.42 | $4.83 | +1049 % |
| Document summaries | 94.11% | 91.33% | ▼ 2.78 | $0.61 | $7.99 | +1202 % |
| Questions about a document | 100.00% | 94.22% | ▼ 5.78 | $0.29 | $5.74 | +1893 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Haiku 5.5 | Mistral Large 4 | Difference | Claude Haiku 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.85% | 88.97% | ▼ 10.88 | $0.77 | $8.71 | +1028 % |
| Email triage | 97.41% | 98.30% | ▲ 0.89 | $0.31 | $3.70 | +1084 % |
| Personal data detection | 99.33% | 98.67% | ▼ 0.66 | $0.23 | $2.96 | +1182 % |
| Contract clauses | 99.38% | 99.28% | ▼ 0.1 | $0.45 | $4.60 | +915 % |
| Document summaries | 92.78% | 72.67% | ▼ 20.11 | $0.66 | $11.26 | +1597 % |
| Questions about a document | 99.22% | 92.33% | ▼ 6.89 | $0.28 | $5.74 | +1923 % |
Difference: Mistral Large 4 vs. Claude Haiku 5.5; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Claude Haiku 5.5 is more accurate by 4.6 pp. Claude Haiku 5.5 is 11× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 95.39% |
| Error-free documents | 100.00% | 77.33% |
| Per 1,000 documents | $0.61 | $6.65 |
| To fix / 1,000 | 0 | 227 |
| Speed (median) | 3.4 sec | 29.0 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Claude Haiku 5.5 is more accurate by 2.8 pp. Claude Haiku 5.5 is 9.2× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.90% | 97.08% |
| Error-free documents | 98.67% | 88.67% |
| Per 1,000 documents | $0.62 | $5.69 |
| To fix / 1,000 | 13 | 113 |
| Speed (median) | 3.4 sec | 26.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Claude Haiku 5.5 is more accurate by 2.4 pp. Claude Haiku 5.5 is 9.5× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.85% | 97.49% |
| Error-free documents | 98.00% | 91.33% |
| Per 1,000 documents | $0.71 | $6.72 |
| To fix / 1,000 | 20 | 87 |
| Speed (median) | 3.9 sec | 35.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Claude Haiku 5.5 is more accurate by 2.9 pp. Claude Haiku 5.5 is 10.2× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.44% | 96.51% |
| Error-free documents | 92.67% | 88.00% |
| Per 1,000 documents | $0.73 | $7.49 |
| To fix / 1,000 | 73 | 120 |
| Speed (median) | 4.4 sec | 41.3 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Claude Haiku 5.5 is more accurate by 10.9 pp. Claude Haiku 5.5 is 11.3× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.85% | 88.97% |
| Error-free documents | 98.00% | 65.33% |
| Per 1,000 documents | $0.77 | $8.71 |
| To fix / 1,000 | 20 | 347 |
| Speed (median) | 4.6 sec | 43.4 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Mistral Large 4 is more accurate by 0.6 pp. Claude Haiku 5.5 is 15× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.15% | 98.74% |
| Error-free documents | 84.00% | 88.67% |
| Per 1,000 documents | $0.23 | $3.52 |
| To fix / 1,000 | 160 | 113 |
| Speed (median) | 1.7 sec | 19.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Mistral Large 4 is more accurate by 0.5 pp. Claude Haiku 5.5 is 15.3× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.63% | 98.15% |
| Error-free documents | 80.00% | 89.33% |
| Per 1,000 documents | $0.29 | $4.41 |
| To fix / 1,000 | 200 | 107 |
| Speed (median) | 1.9 sec | 28.4 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Mistral Large 4 is more accurate by 0.7 pp. Claude Haiku 5.5 is 11.8× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.11% | 97.85% |
| Error-free documents | 74.67% | 82.00% |
| Per 1,000 documents | $0.32 | $3.78 |
| To fix / 1,000 | 253 | 180 |
| Speed (median) | 2.1 sec | 21.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Mistral Large 4 is more accurate by 0.2 pp. Claude Haiku 5.5 is 13.4× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.70% | 97.93% |
| Error-free documents | 80.00% | 82.00% |
| Per 1,000 documents | $0.30 | $4.03 |
| To fix / 1,000 | 200 | 180 |
| Speed (median) | 2.1 sec | 25.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Mistral Large 4 is more accurate by 0.9 pp. Claude Haiku 5.5 is 11.8× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.41% | 98.30% |
| Error-free documents | 76.67% | 84.67% |
| Per 1,000 documents | $0.31 | $3.70 |
| To fix / 1,000 | 233 | 153 |
| Speed (median) | 2.2 sec | 24.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Claude Haiku 5.5 is more accurate by 0.2 pp. Claude Haiku 5.5 is 15.4× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.81% | 99.62% |
| Error-free documents | 98.67% | 97.33% |
| Per 1,000 documents | $0.19 | $2.89 |
| To fix / 1,000 | 13 | 27 |
| Speed (median) | 1.7 sec | 28.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Claude Haiku 5.5 is more accurate by 0.1 pp. Claude Haiku 5.5 is 15× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.43% | 99.33% |
| Error-free documents | 96.00% | 95.33% |
| Per 1,000 documents | $0.21 | $3.15 |
| To fix / 1,000 | 40 | 47 |
| Speed (median) | 1.8 sec | 18.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Claude Haiku 5.5 is more accurate by 0.1 pp. Claude Haiku 5.5 is 11.3× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.62% | 99.52% |
| Error-free documents | 97.33% | 96.67% |
| Per 1,000 documents | $0.23 | $2.61 |
| To fix / 1,000 | 27 | 33 |
| Speed (median) | 1.8 sec | 18.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Claude Haiku 5.5 is more accurate by 0.2 pp. Claude Haiku 5.5 is 13.8× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.81% |
| Error-free documents | 100.00% | 98.67% |
| Per 1,000 documents | $0.23 | $3.16 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 1.9 sec | 21.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Claude Haiku 5.5 is more accurate by 0.7 pp. Claude Haiku 5.5 is 12.8× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.33% | 98.67% |
| Error-free documents | 95.33% | 94.67% |
| Per 1,000 documents | $0.23 | $2.96 |
| To fix / 1,000 | 47 | 53 |
| Speed (median) | 1.8 sec | 23.6 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Claude Haiku 5.5 is more accurate by 3.6 pp. Claude Haiku 5.5 is 14.8× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.69% | 96.10% |
| Error-free documents | 97.33% | 74.67% |
| Per 1,000 documents | $0.35 | $5.24 |
| To fix / 1,000 | 27 | 253 |
| Speed (median) | 2.1 sec | 41.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Claude Haiku 5.5 is 11.5× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.40 | $4.58 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.4 sec | 43.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Claude Haiku 5.5 is more accurate by 0.6 pp. Claude Haiku 5.5 is 10.6× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.44% |
| Error-free documents | 100.00% | 95.33% |
| Per 1,000 documents | $0.48 | $5.12 |
| To fix / 1,000 | 0 | 47 |
| Speed (median) | 2.7 sec | 36.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Claude Haiku 5.5 is 11.5× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 100.00% |
| Error-free documents | 99.33% | 100.00% |
| Per 1,000 documents | $0.42 | $4.83 |
| To fix / 1,000 | 7 | 0 |
| Speed (median) | 2.3 sec | 35.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Claude Haiku 5.5 is more accurate by 0.1 pp. Claude Haiku 5.5 is 10.2× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.38% | 99.28% |
| Error-free documents | 92.00% | 90.67% |
| Per 1,000 documents | $0.45 | $4.60 |
| To fix / 1,000 | 80 | 93 |
| Speed (median) | 2.6 sec | 34.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Mistral Large 4 is more accurate by 1.7 pp. Claude Haiku 5.5 is 16.6× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.33% | 100.00% |
| Error-free documents | 90.00% | 100.00% |
| Per 1,000 documents | $0.34 | $5.62 |
| To fix / 1,000 | 100 | 0 |
| Speed (median) | 2.7 sec | 37.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Claude Haiku 5.5 is more accurate by 12.6 pp. Claude Haiku 5.5 is 33× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 95.89% | 83.33% |
| Error-free documents | 77.33% | 83.33% |
| Per 1,000 documents | $0.32 | $10.72 |
| To fix / 1,000 | 227 | 167 |
| Speed (median) | 2.1 sec | 55.4 sec |
| Valid answers | 100.00% | 83.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Claude Haiku 5.5 is more accurate by 0.1 pp. Claude Haiku 5.5 is 15.6× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.44% | 99.33% |
| Error-free documents | 96.67% | 99.33% |
| Per 1,000 documents | $0.46 | $7.19 |
| To fix / 1,000 | 33 | 7 |
| Speed (median) | 3.5 sec | 48.0 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Claude Haiku 5.5 is more accurate by 2.8 pp. Claude Haiku 5.5 is 13× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 94.11% | 91.33% |
| Error-free documents | 64.67% | 91.33% |
| Per 1,000 documents | $0.61 | $7.99 |
| To fix / 1,000 | 353 | 87 |
| Speed (median) | 3.8 sec | 38.3 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Claude Haiku 5.5 is more accurate by 20.1 pp. Claude Haiku 5.5 is 17× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 92.78% | 72.67% |
| Error-free documents | 56.67% | 72.67% |
| Per 1,000 documents | $0.66 | $11.26 |
| To fix / 1,000 | 433 | 273 |
| Speed (median) | 4.0 sec | 46.4 sec |
| Valid answers | 100.00% | 72.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Claude Haiku 5.5 is more accurate by 1.1 pp. Claude Haiku 5.5 is 18.1× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 98.89% |
| Error-free documents | 100.00% | 97.33% |
| Per 1,000 documents | $0.23 | $4.16 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 1.8 sec | 17.7 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Claude Haiku 5.5 is more accurate by 9.9 pp. Claude Haiku 5.5 is 23.4× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.78% | 89.89% |
| Error-free documents | 98.67% | 78.00% |
| Per 1,000 documents | $0.30 | $7.08 |
| To fix / 1,000 | 13 | 220 |
| Speed (median) | 1.9 sec | 33.6 sec |
| Valid answers | 100.00% | 93.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Claude Haiku 5.5 is more accurate by 6.4 pp. Claude Haiku 5.5 is 17.9× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 93.56% |
| Error-free documents | 100.00% | 89.33% |
| Per 1,000 documents | $0.32 | $5.77 |
| To fix / 1,000 | 0 | 107 |
| Speed (median) | 1.9 sec | 31.5 sec |
| Valid answers | 100.00% | 94.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Claude Haiku 5.5 is more accurate by 5.8 pp. Claude Haiku 5.5 is 19.9× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 94.22% |
| Error-free documents | 100.00% | 90.67% |
| Per 1,000 documents | $0.29 | $5.74 |
| To fix / 1,000 | 0 | 93 |
| Speed (median) | 1.8 sec | 22.8 sec |
| Valid answers | 100.00% | 95.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Claude Haiku 5.5 is more accurate by 6.9 pp. Claude Haiku 5.5 is 20.2× cheaper.
| Metric | Claude Haiku 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.22% | 92.33% |
| Error-free documents | 96.67% | 87.33% |
| Per 1,000 documents | $0.28 | $5.74 |
| To fix / 1,000 | 33 | 127 |
| Speed (median) | 1.8 sec | 19.8 sec |
| Valid answers | 100.00% | 94.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.