Claude Sonnet 5 vs Mistral Large 4
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Claude Sonnet 5 is more accurate; Mistral Large 4 is cheaper in 19 of 30 combinations.
More accurate
Claude Sonnet 5
wins 19 of 30
Cheaper
Mistral Large 4
cheaper in 19 of 30
Faster
Claude Sonnet 5
3.6 sec vs 31.5 sec
Fewer fixes
Claude Sonnet 5
33 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Mistral Large 4 | Difference | Claude Sonnet 5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.82% | 95.39% | ▼ 4.43 | $8.84 | $6.65 | −25 % |
| Email triage | 98.22% | 98.74% | ▲ 0.52 | $4.01 | $3.52 | −12 % |
| Personal data detection | 99.71% | 99.62% | ▼ 0.09 | $3.50 | $2.89 | −17 % |
| Contract clauses | 100.00% | 96.10% | ▼ 3.9 | $5.04 | $5.24 | +4 % |
| Document summaries | 96.00% | 100.00% | ▲ 4 | $4.08 | $5.62 | +38 % |
| Questions about a document | 100.00% | 98.89% | ▼ 1.11 | $3.88 | $4.16 | +7 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Mistral Large 4 | Difference | Claude Sonnet 5 | Mistral Large 4 | Difference |
| Invoice extraction | 100.00% | 97.08% | ▼ 2.92 | $9.41 | $5.69 | −40 % |
| Email triage | 98.15% | 98.15% | ±0 | $4.91 | $4.41 | −10 % |
| Personal data detection | 98.86% | 99.33% | ▲ 0.47 | $4.06 | $3.15 | −22 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $6.05 | $4.58 | −24 % |
| Document summaries | 93.44% | 83.33% | ▼ 10.11 | $6.48 | $10.72 | +65 % |
| Questions about a document | 100.00% | 89.89% | ▼ 10.11 | $5.14 | $7.08 | +38 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Mistral Large 4 | Difference | Claude Sonnet 5 | Mistral Large 4 | Difference |
| Invoice extraction | 98.97% | 97.49% | ▼ 1.48 | $10.42 | $6.72 | −36 % |
| Email triage | 97.85% | 97.85% | ±0 | $5.11 | $3.78 | −26 % |
| Personal data detection | 99.71% | 99.52% | ▼ 0.19 | $4.40 | $2.61 | −41 % |
| Contract clauses | 98.21% | 99.44% | ▲ 1.23 | $7.11 | $5.12 | −28 % |
| Document summaries | 99.11% | 99.33% | ▲ 0.22 | $5.97 | $7.19 | +20 % |
| Questions about a document | 100.00% | 93.56% | ▼ 6.44 | $5.49 | $5.77 | +5 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Mistral Large 4 | Difference | Claude Sonnet 5 | Mistral Large 4 | Difference |
| Invoice extraction | 98.46% | 96.51% | ▼ 1.95 | $11.51 | $7.49 | −35 % |
| Email triage | 97.56% | 97.93% | ▲ 0.37 | $5.04 | $4.03 | −20 % |
| Personal data detection | 99.81% | 99.81% | ±0 | $4.38 | $3.16 | −28 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $6.58 | $4.83 | −27 % |
| Document summaries | 94.22% | 91.33% | ▼ 2.89 | $6.32 | $7.99 | +26 % |
| Questions about a document | 100.00% | 94.22% | ▼ 5.78 | $4.94 | $5.74 | +16 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Mistral Large 4 | Difference | Claude Sonnet 5 | Mistral Large 4 | Difference |
| Invoice extraction | 99.69% | 88.97% | ▼ 10.72 | $10.69 | $8.71 | −18 % |
| Email triage | 98.67% | 98.30% | ▼ 0.37 | $4.64 | $3.70 | −20 % |
| Personal data detection | 99.71% | 98.67% | ▼ 1.04 | $4.10 | $2.96 | −28 % |
| Contract clauses | 99.95% | 99.28% | ▼ 0.67 | $6.69 | $4.60 | −31 % |
| Document summaries | 96.78% | 72.67% | ▼ 24.11 | $5.04 | $11.26 | +123 % |
| Questions about a document | 100.00% | 92.33% | ▼ 7.67 | $4.93 | $5.74 | +17 % |
Difference: Mistral Large 4 vs. Claude Sonnet 5; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 4.4 pp. Mistral Large 4 is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.82% | 95.39% |
| Error-free documents | 98.67% | 77.33% |
| Per 1,000 documents | $8.84 | $6.65 |
| To fix / 1,000 | 13 | 227 |
| Speed (median) | 3.2 sec | 29.0 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Claude Sonnet 5 is more accurate by 2.9 pp. Mistral Large 4 is 1.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 97.08% |
| Error-free documents | 100.00% | 88.67% |
| Per 1,000 documents | $9.41 | $5.69 |
| To fix / 1,000 | 0 | 113 |
| Speed (median) | 3.6 sec | 26.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Claude Sonnet 5 is more accurate by 1.5 pp. Mistral Large 4 is 1.6× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.97% | 97.49% |
| Error-free documents | 86.67% | 91.33% |
| Per 1,000 documents | $10.42 | $6.72 |
| To fix / 1,000 | 133 | 87 |
| Speed (median) | 3.8 sec | 35.3 sec |
| Valid answers | 100.00% | 98.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Claude Sonnet 5 is more accurate by 2 pp. Mistral Large 4 is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.46% | 96.51% |
| Error-free documents | 81.33% | 88.00% |
| Per 1,000 documents | $11.51 | $7.49 |
| To fix / 1,000 | 187 | 120 |
| Speed (median) | 4.2 sec | 41.3 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Claude Sonnet 5 is more accurate by 10.7 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.69% | 88.97% |
| Error-free documents | 96.67% | 65.33% |
| Per 1,000 documents | $10.69 | $8.71 |
| To fix / 1,000 | 33 | 347 |
| Speed (median) | 4.4 sec | 43.4 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Mistral Large 4 is more accurate by 0.5 pp. Mistral Large 4 is 1.1× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.22% | 98.74% |
| Error-free documents | 84.00% | 88.67% |
| Per 1,000 documents | $4.01 | $3.52 |
| To fix / 1,000 | 160 | 113 |
| Speed (median) | 3.8 sec | 19.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Both are equally accurate. Mistral Large 4 is 1.1× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.15% | 98.15% |
| Error-free documents | 83.33% | 89.33% |
| Per 1,000 documents | $4.91 | $4.41 |
| To fix / 1,000 | 167 | 107 |
| Speed (median) | 4.7 sec | 28.4 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Both are equally accurate. Mistral Large 4 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.85% | 97.85% |
| Error-free documents | 81.33% | 82.00% |
| Per 1,000 documents | $5.11 | $3.78 |
| To fix / 1,000 | 187 | 180 |
| Speed (median) | 4.3 sec | 21.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Mistral Large 4 is more accurate by 0.4 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 97.56% | 97.93% |
| Error-free documents | 78.67% | 82.00% |
| Per 1,000 documents | $5.04 | $4.03 |
| To fix / 1,000 | 213 | 180 |
| Speed (median) | 5.5 sec | 25.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Claude Sonnet 5 is more accurate by 0.4 pp. Mistral Large 4 is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.67% | 98.30% |
| Error-free documents | 88.00% | 84.67% |
| Per 1,000 documents | $4.64 | $3.70 |
| To fix / 1,000 | 120 | 153 |
| Speed (median) | 4.3 sec | 24.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 0.1 pp. Mistral Large 4 is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.71% | 99.62% |
| Error-free documents | 98.00% | 97.33% |
| Per 1,000 documents | $3.50 | $2.89 |
| To fix / 1,000 | 20 | 27 |
| Speed (median) | 2.5 sec | 28.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Mistral Large 4 is more accurate by 0.5 pp. Mistral Large 4 is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.86% | 99.33% |
| Error-free documents | 92.00% | 95.33% |
| Per 1,000 documents | $4.06 | $3.15 |
| To fix / 1,000 | 80 | 47 |
| Speed (median) | 3.2 sec | 18.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Claude Sonnet 5 is more accurate by 0.2 pp. Mistral Large 4 is 1.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.71% | 99.52% |
| Error-free documents | 98.00% | 96.67% |
| Per 1,000 documents | $4.40 | $2.61 |
| To fix / 1,000 | 20 | 33 |
| Speed (median) | 3.7 sec | 18.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Both are equally accurate. Mistral Large 4 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.81% | 99.81% |
| Error-free documents | 98.67% | 98.67% |
| Per 1,000 documents | $4.38 | $3.16 |
| To fix / 1,000 | 13 | 13 |
| Speed (median) | 3.6 sec | 21.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Claude Sonnet 5 is more accurate by 1 pp. Mistral Large 4 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.71% | 98.67% |
| Error-free documents | 98.00% | 94.67% |
| Per 1,000 documents | $4.10 | $2.96 |
| To fix / 1,000 | 20 | 53 |
| Speed (median) | 2.5 sec | 23.6 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 3.9 pp.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 96.10% |
| Error-free documents | 100.00% | 74.67% |
| Per 1,000 documents | $5.04 | $5.24 |
| To fix / 1,000 | 0 | 253 |
| Speed (median) | 3.4 sec | 41.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Mistral Large 4 is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.05 | $4.58 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 43.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Mistral Large 4 is more accurate by 1.2 pp. Mistral Large 4 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 98.21% | 99.44% |
| Error-free documents | 86.67% | 95.33% |
| Per 1,000 documents | $7.11 | $5.12 |
| To fix / 1,000 | 133 | 47 |
| Speed (median) | 4.3 sec | 36.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Mistral Large 4 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.58 | $4.83 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 4.0 sec | 35.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Claude Sonnet 5 is more accurate by 0.7 pp. Mistral Large 4 is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.95% | 99.28% |
| Error-free documents | 99.33% | 90.67% |
| Per 1,000 documents | $6.69 | $4.60 |
| To fix / 1,000 | 7 | 93 |
| Speed (median) | 4.6 sec | 34.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Mistral Large 4 is more accurate by 4 pp. Claude Sonnet 5 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 96.00% | 100.00% |
| Error-free documents | 76.67% | 100.00% |
| Per 1,000 documents | $4.08 | $5.62 |
| To fix / 1,000 | 233 | 0 |
| Speed (median) | 2.9 sec | 37.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Claude Sonnet 5 is more accurate by 10.1 pp. Claude Sonnet 5 is 1.7× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 93.44% | 83.33% |
| Error-free documents | 68.00% | 83.33% |
| Per 1,000 documents | $6.48 | $10.72 |
| To fix / 1,000 | 320 | 167 |
| Speed (median) | 4.7 sec | 55.4 sec |
| Valid answers | 100.00% | 83.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Mistral Large 4 is more accurate by 0.2 pp. Claude Sonnet 5 is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 99.11% | 99.33% |
| Error-free documents | 96.00% | 99.33% |
| Per 1,000 documents | $5.97 | $7.19 |
| To fix / 1,000 | 40 | 7 |
| Speed (median) | 3.6 sec | 48.0 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Claude Sonnet 5 is more accurate by 2.9 pp. Claude Sonnet 5 is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 94.22% | 91.33% |
| Error-free documents | 68.00% | 91.33% |
| Per 1,000 documents | $6.32 | $7.99 |
| To fix / 1,000 | 320 | 87 |
| Speed (median) | 3.4 sec | 38.3 sec |
| Valid answers | 100.00% | 91.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Claude Sonnet 5 is more accurate by 24.1 pp. Claude Sonnet 5 is 2.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 96.78% | 72.67% |
| Error-free documents | 80.67% | 72.67% |
| Per 1,000 documents | $5.04 | $11.26 |
| To fix / 1,000 | 193 | 273 |
| Speed (median) | 3.1 sec | 46.4 sec |
| Valid answers | 100.00% | 72.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 1.1 pp. Claude Sonnet 5 is 1.1× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 98.89% |
| Error-free documents | 100.00% | 97.33% |
| Per 1,000 documents | $3.88 | $4.16 |
| To fix / 1,000 | 0 | 27 |
| Speed (median) | 2.2 sec | 17.7 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Claude Sonnet 5 is more accurate by 10.1 pp. Claude Sonnet 5 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 89.89% |
| Error-free documents | 100.00% | 78.00% |
| Per 1,000 documents | $5.14 | $7.08 |
| To fix / 1,000 | 0 | 220 |
| Speed (median) | 2.6 sec | 33.6 sec |
| Valid answers | 100.00% | 93.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Claude Sonnet 5 is more accurate by 6.4 pp. Claude Sonnet 5 is 1.1× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 93.56% |
| Error-free documents | 100.00% | 89.33% |
| Per 1,000 documents | $5.49 | $5.77 |
| To fix / 1,000 | 0 | 107 |
| Speed (median) | 2.3 sec | 31.5 sec |
| Valid answers | 100.00% | 94.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Claude Sonnet 5 is more accurate by 5.8 pp. Claude Sonnet 5 is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 94.22% |
| Error-free documents | 100.00% | 90.67% |
| Per 1,000 documents | $4.94 | $5.74 |
| To fix / 1,000 | 0 | 93 |
| Speed (median) | 2.2 sec | 22.8 sec |
| Valid answers | 100.00% | 95.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Claude Sonnet 5 is more accurate by 7.7 pp. Claude Sonnet 5 is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Correct fields | 100.00% | 92.33% |
| Error-free documents | 100.00% | 87.33% |
| Per 1,000 documents | $4.93 | $5.74 |
| To fix / 1,000 | 0 | 127 |
| Speed (median) | 2.1 sec | 19.8 sec |
| Valid answers | 100.00% | 94.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.