Claude Sonnet 5.5 vs Mistral Large 4
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Claude Sonnet 5.5 is more accurate; Mistral Large 4 is cheaper in 15 of 30 combinations.
More accurate
Claude Sonnet 5.5
wins 24 of 30
Cheaper
Mistral Large 4
cheaper in 15 of 30
Faster
Claude Sonnet 5.5
2.1 sec vs 31.5 sec
Fewer fixes
Claude Sonnet 5.5
7 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5.5 | Mistral Large 4 | Difference | Claude Sonnet 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 100.00% | 95.39% | ▼ 4.61 | $9.54 | $6.65 | −30 % |
| Email triage | 98.89% | 98.74% | ▼ 0.15 | $3.21 | $3.52 | +9 % |
| Personal data detection | 100.00% | 99.62% | ▼ 0.38 | $3.22 | $2.89 | −10 % |
| Contract clauses | 99.79% | 96.10% | ▼ 3.69 | $4.23 | $5.24 | +24 % |
| Document summaries | 100.00% | 100.00% | ±0 | $3.60 | $5.62 | +56 % |
| Questions about a document | 100.00% | 98.89% | ▼ 1.11 | $3.84 | $4.16 | +8 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5.5 | Mistral Large 4 | Difference | Claude Sonnet 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.95% | 97.08% | ▼ 2.87 | $10.79 | $5.69 | −47 % |
| Email triage | 98.67% | 98.15% | ▼ 0.52 | $3.92 | $4.41 | +13 % |
| Personal data detection | 99.71% | 99.33% | ▼ 0.38 | $3.52 | $3.15 | −11 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $5.35 | $4.58 | −14 % |
| Document summaries | 98.67% | 83.33% | ▼ 15.34 | $5.01 | $10.72 | +114 % |
| Questions about a document | 100.00% | 89.89% | ▼ 10.11 | $5.03 | $7.08 | +41 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5.5 | Mistral Large 4 | Difference | Claude Sonnet 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.95% | 97.49% | ▼ 2.46 | $11.21 | $6.72 | −40 % |
| Email triage | 98.00% | 97.85% | ▼ 0.15 | $4.21 | $3.78 | −10 % |
| Personal data detection | 100.00% | 99.52% | ▼ 0.48 | $3.87 | $2.61 | −33 % |
| Contract clauses | 100.00% | 99.44% | ▼ 0.56 | $6.05 | $5.12 | −15 % |
| Document summaries | 99.11% | 99.33% | ▲ 0.22 | $5.82 | $7.19 | +24 % |
| Questions about a document | 100.00% | 93.56% | ▼ 6.44 | $5.49 | $5.77 | +5 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5.5 | Mistral Large 4 | Difference | Claude Sonnet 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 100.00% | 96.51% | ▼ 3.49 | $10.99 | $7.49 | −32 % |
| Email triage | 97.70% | 97.93% | ▲ 0.23 | $3.76 | $4.03 | +7 % |
| Personal data detection | 100.00% | 99.81% | ▼ 0.19 | $3.78 | $3.16 | −16 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $5.70 | $4.83 | −15 % |
| Document summaries | 95.56% | 91.33% | ▼ 4.23 | $5.55 | $7.99 | +44 % |
| Questions about a document | 100.00% | 94.22% | ▼ 5.78 | $4.89 | $5.74 | +18 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5.5 | Mistral Large 4 | Difference | Claude Sonnet 5.5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.95% | 88.97% | ▼ 10.98 | $10.71 | $8.71 | −19 % |
| Email triage | 97.78% | 98.30% | ▲ 0.52 | $3.85 | $3.70 | −4 % |
| Personal data detection | 100.00% | 98.67% | ▼ 1.33 | $3.81 | $2.96 | −22 % |
| Contract clauses | 99.95% | 99.28% | ▼ 0.67 | $5.71 | $4.60 | −19 % |
| Document summaries | 97.89% | 72.67% | ▼ 25.22 | $4.89 | $11.26 | +130 % |
| Questions about a document | 100.00% | 92.33% | ▼ 7.67 | $4.90 | $5.74 | +17 % |
Difference: Mistral Large 4 vs. Claude Sonnet 5.5; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Claude Sonnet 5.5 is more accurate by 4.6 pp. Mistral Large 4 is 1.4× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 95.39% |
| Error-free documents | 100.00% | 77.33% |
| Per 1,000 documents | $9.54 | $6.65 |
| To fix / 1,000 | 0 | 227 |
| Speed (median) | 3.5 sec | 29.0 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Claude Sonnet 5.5 is more accurate by 2.9 pp. Mistral Large 4 is 1.9× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 97.08% |
| Error-free documents | 99.33% | 88.67% |
| Per 1,000 documents | $10.79 | $5.69 |
| To fix / 1,000 | 7 | 113 |
| Speed (median) | 4.4 sec | 26.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Claude Sonnet 5.5 is more accurate by 2.5 pp. Mistral Large 4 is 1.7× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 97.49% |
| Error-free documents | 99.33% | 91.33% |
| Per 1,000 documents | $11.21 | $6.72 |
| To fix / 1,000 | 7 | 87 |
| Speed (median) | 6.0 sec | 35.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Claude Sonnet 5.5 is more accurate by 3.5 pp. Mistral Large 4 is 1.5× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 96.51% |
| Error-free documents | 100.00% | 88.00% |
| Per 1,000 documents | $10.99 | $7.49 |
| To fix / 1,000 | 0 | 120 |
| Speed (median) | 5.7 sec | 41.3 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Claude Sonnet 5.5 is more accurate by 11 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 88.97% |
| Error-free documents | 99.33% | 65.33% |
| Per 1,000 documents | $10.71 | $8.71 |
| To fix / 1,000 | 7 | 347 |
| Speed (median) | 4.9 sec | 43.4 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Claude Sonnet 5.5 is more accurate by 0.1 pp. Claude Sonnet 5.5 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.89% | 98.74% |
| Error-free documents | 90.00% | 88.67% |
| Per 1,000 documents | $3.21 | $3.52 |
| To fix / 1,000 | 100 | 113 |
| Speed (median) | 2.0 sec | 19.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Claude Sonnet 5.5 is more accurate by 0.5 pp. Claude Sonnet 5.5 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.67% | 98.15% |
| Error-free documents | 88.00% | 89.33% |
| Per 1,000 documents | $3.92 | $4.41 |
| To fix / 1,000 | 120 | 107 |
| Speed (median) | 2.0 sec | 28.4 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Claude Sonnet 5.5 is more accurate by 0.1 pp. Mistral Large 4 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.00% | 97.85% |
| Error-free documents | 83.33% | 82.00% |
| Per 1,000 documents | $4.21 | $3.78 |
| To fix / 1,000 | 167 | 180 |
| Speed (median) | 1.8 sec | 21.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Mistral Large 4 is more accurate by 0.2 pp. Claude Sonnet 5.5 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.70% | 97.93% |
| Error-free documents | 80.67% | 82.00% |
| Per 1,000 documents | $3.76 | $4.03 |
| To fix / 1,000 | 193 | 180 |
| Speed (median) | 1.8 sec | 25.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Mistral Large 4 is more accurate by 0.5 pp.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.78% | 98.30% |
| Error-free documents | 82.00% | 84.67% |
| Per 1,000 documents | $3.85 | $3.70 |
| To fix / 1,000 | 180 | 153 |
| Speed (median) | 1.7 sec | 24.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Claude Sonnet 5.5 is more accurate by 0.4 pp. Mistral Large 4 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.62% |
| Error-free documents | 100.00% | 97.33% |
| Per 1,000 documents | $3.22 | $2.89 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 1.9 sec | 28.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Claude Sonnet 5.5 is more accurate by 0.4 pp. Mistral Large 4 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.71% | 99.33% |
| Error-free documents | 98.00% | 95.33% |
| Per 1,000 documents | $3.52 | $3.15 |
| To fix / 1,000 | 20 | 47 |
| Speed (median) | 2.2 sec | 18.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Claude Sonnet 5.5 is more accurate by 0.5 pp. Mistral Large 4 is 1.5× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.52% |
| Error-free documents | 100.00% | 96.67% |
| Per 1,000 documents | $3.87 | $2.61 |
| To fix / 1,000 | 0 | 33 |
| Speed (median) | 1.9 sec | 18.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Claude Sonnet 5.5 is more accurate by 0.2 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.81% |
| Error-free documents | 100.00% | 98.67% |
| Per 1,000 documents | $3.78 | $3.16 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 1.9 sec | 21.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Claude Sonnet 5.5 is more accurate by 1.3 pp. Mistral Large 4 is 1.3× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 98.67% |
| Error-free documents | 100.00% | 94.67% |
| Per 1,000 documents | $3.81 | $2.96 |
| To fix / 1,000 | 0 | 53 |
| Speed (median) | 2.0 sec | 23.6 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Claude Sonnet 5.5 is more accurate by 3.7 pp. Claude Sonnet 5.5 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.79% | 96.10% |
| Error-free documents | 98.00% | 74.67% |
| Per 1,000 documents | $4.23 | $5.24 |
| To fix / 1,000 | 20 | 253 |
| Speed (median) | 2.1 sec | 41.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $5.35 | $4.58 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.4 sec | 43.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Claude Sonnet 5.5 is more accurate by 0.6 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 99.44% |
| Error-free documents | 100.00% | 95.33% |
| Per 1,000 documents | $6.05 | $5.12 |
| To fix / 1,000 | 0 | 47 |
| Speed (median) | 2.7 sec | 36.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $5.70 | $4.83 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.7 sec | 35.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Claude Sonnet 5.5 is more accurate by 0.7 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 99.28% |
| Error-free documents | 99.33% | 90.67% |
| Per 1,000 documents | $5.71 | $4.60 |
| To fix / 1,000 | 7 | 93 |
| Speed (median) | 2.6 sec | 34.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Both are equally accurate. Claude Sonnet 5.5 is 1.6× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $3.60 | $5.62 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 1.8 sec | 37.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Claude Sonnet 5.5 is more accurate by 15.3 pp. Claude Sonnet 5.5 is 2.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.67% | 83.33% |
| Error-free documents | 92.00% | 83.33% |
| Per 1,000 documents | $5.01 | $10.72 |
| To fix / 1,000 | 80 | 167 |
| Speed (median) | 2.7 sec | 55.4 sec |
| Valid answers | 100.00% | 83.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Mistral Large 4 is more accurate by 0.2 pp. Claude Sonnet 5.5 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.11% | 99.33% |
| Error-free documents | 94.67% | 99.33% |
| Per 1,000 documents | $5.82 | $7.19 |
| To fix / 1,000 | 53 | 7 |
| Speed (median) | 2.8 sec | 48.0 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Claude Sonnet 5.5 is more accurate by 4.2 pp. Claude Sonnet 5.5 is 1.4× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 95.56% | 91.33% |
| Error-free documents | 73.33% | 91.33% |
| Per 1,000 documents | $5.55 | $7.99 |
| To fix / 1,000 | 267 | 87 |
| Speed (median) | 2.1 sec | 38.3 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Claude Sonnet 5.5 is more accurate by 25.2 pp. Claude Sonnet 5.5 is 2.3× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.89% | 72.67% |
| Error-free documents | 87.33% | 72.67% |
| Per 1,000 documents | $4.89 | $11.26 |
| To fix / 1,000 | 127 | 273 |
| Speed (median) | 2.7 sec | 46.4 sec |
| Valid answers | 100.00% | 72.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Claude Sonnet 5.5 is more accurate by 1.1 pp. Claude Sonnet 5.5 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 98.89% |
| Error-free documents | 100.00% | 97.33% |
| Per 1,000 documents | $3.84 | $4.16 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 1.5 sec | 17.7 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Claude Sonnet 5.5 is more accurate by 10.1 pp. Claude Sonnet 5.5 is 1.4× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 89.89% |
| Error-free documents | 100.00% | 78.00% |
| Per 1,000 documents | $5.03 | $7.08 |
| To fix / 1,000 | 0 | 220 |
| Speed (median) | 2.1 sec | 33.6 sec |
| Valid answers | 100.00% | 93.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Claude Sonnet 5.5 is more accurate by 6.4 pp. Claude Sonnet 5.5 is 1.1× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 93.56% |
| Error-free documents | 100.00% | 89.33% |
| Per 1,000 documents | $5.49 | $5.77 |
| To fix / 1,000 | 0 | 107 |
| Speed (median) | 1.9 sec | 31.5 sec |
| Valid answers | 100.00% | 94.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Claude Sonnet 5.5 is more accurate by 5.8 pp. Claude Sonnet 5.5 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 94.22% |
| Error-free documents | 100.00% | 90.67% |
| Per 1,000 documents | $4.89 | $5.74 |
| To fix / 1,000 | 0 | 93 |
| Speed (median) | 1.4 sec | 22.8 sec |
| Valid answers | 100.00% | 95.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Claude Sonnet 5.5 is more accurate by 7.7 pp. Claude Sonnet 5.5 is 1.2× cheaper.
| Metric | Claude Sonnet 5.5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 92.33% |
| Error-free documents | 100.00% | 87.33% |
| Per 1,000 documents | $4.90 | $5.74 |
| To fix / 1,000 | 0 | 127 |
| Speed (median) | 1.3 sec | 19.8 sec |
| Valid answers | 100.00% | 94.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.