Claude Sonnet 5 vs Gemini 3.8 Flash
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Gemini 3.8 Flash is more accurate and cheaper in 25 of 30 combinations.
More accurate
Gemini 3.8 Flash
wins 13 of 30
Cheaper
Gemini 3.8 Flash
cheaper in 25 of 30
Faster
Gemini 3.8 Flash
3.2 sec vs 3.6 sec
Fewer fixes
Gemini 3.8 Flash
7 vs 33 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Gemini 3.8 Flash | Difference | Claude Sonnet 5 | Gemini 3.8 Flash | Difference |
| Invoice extraction | 99.82% | 99.82% | ±0 | $8.84 | $3.84 | −57 % |
| Email triage | 98.22% | 98.74% | ▲ 0.52 | $4.01 | $2.39 | −40 % |
| Personal data detection | 99.71% | 99.71% | ±0 | $3.50 | $1.86 | −47 % |
| Contract clauses | 100.00% | 99.90% | ▼ 0.1 | $5.04 | $2.47 | −51 % |
| Document summaries | 96.00% | 100.00% | ▲ 4 | $4.08 | $5.46 | +34 % |
| Questions about a document | 100.00% | 99.89% | ▼ 0.11 | $3.88 | $3.00 | −23 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Gemini 3.8 Flash | Difference | Claude Sonnet 5 | Gemini 3.8 Flash | Difference |
| Invoice extraction | 100.00% | 99.95% | ▼ 0.05 | $9.41 | $4.26 | −55 % |
| Email triage | 98.15% | 99.19% | ▲ 1.04 | $4.91 | $3.06 | −38 % |
| Personal data detection | 98.86% | 99.52% | ▲ 0.66 | $4.06 | $2.19 | −46 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $6.05 | $3.09 | −49 % |
| Document summaries | 93.44% | 100.00% | ▲ 6.56 | $6.48 | $6.69 | +3 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $5.14 | $4.36 | −15 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Gemini 3.8 Flash | Difference | Claude Sonnet 5 | Gemini 3.8 Flash | Difference |
| Invoice extraction | 98.97% | 97.23% | ▼ 1.74 | $10.42 | $7.15 | −31 % |
| Email triage | 97.85% | 98.37% | ▲ 0.52 | $5.11 | $2.74 | −46 % |
| Personal data detection | 99.71% | 99.71% | ±0 | $4.40 | $2.12 | −52 % |
| Contract clauses | 98.21% | 99.90% | ▲ 1.69 | $7.11 | $3.42 | −52 % |
| Document summaries | 99.11% | 100.00% | ▲ 0.89 | $5.97 | $6.11 | +2 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $5.49 | $3.76 | −32 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Gemini 3.8 Flash | Difference | Claude Sonnet 5 | Gemini 3.8 Flash | Difference |
| Invoice extraction | 98.46% | 97.28% | ▼ 1.18 | $11.51 | $7.84 | −32 % |
| Email triage | 97.56% | 98.96% | ▲ 1.4 | $5.04 | $3.30 | −35 % |
| Personal data detection | 99.81% | 99.81% | ±0 | $4.38 | $2.11 | −52 % |
| Contract clauses | 100.00% | 100.00% | ±0 | $6.58 | $3.33 | −49 % |
| Document summaries | 94.22% | 100.00% | ▲ 5.78 | $6.32 | $6.78 | +7 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.94 | $4.05 | −18 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Claude Sonnet 5 | Gemini 3.8 Flash | Difference | Claude Sonnet 5 | Gemini 3.8 Flash | Difference |
| Invoice extraction | 99.69% | 99.95% | ▲ 0.26 | $10.69 | $6.07 | −43 % |
| Email triage | 98.67% | 98.59% | ▼ 0.08 | $4.64 | $2.63 | −43 % |
| Personal data detection | 99.71% | 99.81% | ▲ 0.1 | $4.10 | $2.13 | −48 % |
| Contract clauses | 99.95% | 100.00% | ▲ 0.05 | $6.69 | $3.50 | −48 % |
| Document summaries | 96.78% | 100.00% | ▲ 3.22 | $5.04 | $7.06 | +40 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $4.93 | $4.06 | −18 % |
Difference: Gemini 3.8 Flash vs. Claude Sonnet 5; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.3× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.82% | 99.82% |
| Error-free documents | 98.67% | 98.00% |
| Per 1,000 documents | $8.84 | $3.84 |
| To fix / 1,000 | 13 | 20 |
| Speed (median) | 3.2 sec | 3.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 99.95% |
| Error-free documents | 100.00% | 99.33% |
| Per 1,000 documents | $9.41 | $4.26 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 3.6 sec | 3.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Claude Sonnet 5 is more accurate by 1.7 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.97% | 97.23% |
| Error-free documents | 86.67% | 96.00% |
| Per 1,000 documents | $10.42 | $7.15 |
| To fix / 1,000 | 133 | 40 |
| Speed (median) | 3.8 sec | 4.7 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
Claude Sonnet 5 is more accurate by 1.2 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.46% | 97.28% |
| Error-free documents | 81.33% | 96.67% |
| Per 1,000 documents | $11.51 | $7.84 |
| To fix / 1,000 | 187 | 33 |
| Speed (median) | 4.2 sec | 5.7 sec |
| Valid answers | 100.00% | 97.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.3 pp. Gemini 3.8 Flash is 1.8× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.69% | 99.95% |
| Error-free documents | 96.67% | 99.33% |
| Per 1,000 documents | $10.69 | $6.07 |
| To fix / 1,000 | 33 | 7 |
| Speed (median) | 4.4 sec | 5.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 0.5 pp. Gemini 3.8 Flash is 1.7× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.22% | 98.74% |
| Error-free documents | 84.00% | 88.67% |
| Per 1,000 documents | $4.01 | $2.39 |
| To fix / 1,000 | 160 | 113 |
| Speed (median) | 3.8 sec | 2.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 1 pp. Gemini 3.8 Flash is 1.6× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.15% | 99.19% |
| Error-free documents | 83.33% | 92.67% |
| Per 1,000 documents | $4.91 | $3.06 |
| To fix / 1,000 | 167 | 73 |
| Speed (median) | 4.7 sec | 2.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.5 pp. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 97.85% | 98.37% |
| Error-free documents | 81.33% | 85.33% |
| Per 1,000 documents | $5.11 | $2.74 |
| To fix / 1,000 | 187 | 147 |
| Speed (median) | 4.3 sec | 2.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 1.4 pp. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 97.56% | 98.96% |
| Error-free documents | 78.67% | 90.67% |
| Per 1,000 documents | $5.04 | $3.30 |
| To fix / 1,000 | 213 | 93 |
| Speed (median) | 5.5 sec | 3.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
Claude Sonnet 5 is more accurate by 0.1 pp. Gemini 3.8 Flash is 1.8× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.67% | 98.59% |
| Error-free documents | 88.00% | 87.33% |
| Per 1,000 documents | $4.64 | $2.63 |
| To fix / 1,000 | 120 | 127 |
| Speed (median) | 4.3 sec | 2.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.71% | 99.71% |
| Error-free documents | 98.00% | 98.00% |
| Per 1,000 documents | $3.50 | $1.86 |
| To fix / 1,000 | 20 | 20 |
| Speed (median) | 2.5 sec | 1.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 0.7 pp. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.86% | 99.52% |
| Error-free documents | 92.00% | 96.67% |
| Per 1,000 documents | $4.06 | $2.19 |
| To fix / 1,000 | 80 | 33 |
| Speed (median) | 3.2 sec | 2.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.1× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.71% | 99.71% |
| Error-free documents | 98.00% | 98.00% |
| Per 1,000 documents | $4.40 | $2.12 |
| To fix / 1,000 | 20 | 20 |
| Speed (median) | 3.7 sec | 2.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2.1× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.81% | 99.81% |
| Error-free documents | 98.67% | 98.67% |
| Per 1,000 documents | $4.38 | $2.11 |
| To fix / 1,000 | 13 | 13 |
| Speed (median) | 3.6 sec | 2.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Gemini 3.8 Flash is more accurate by 0.1 pp. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.71% | 99.81% |
| Error-free documents | 98.00% | 98.67% |
| Per 1,000 documents | $4.10 | $2.13 |
| To fix / 1,000 | 20 | 13 |
| Speed (median) | 2.5 sec | 2.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 0.1 pp. Gemini 3.8 Flash is 2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 99.90% |
| Error-free documents | 100.00% | 99.33% |
| Per 1,000 documents | $5.04 | $2.47 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 3.4 sec | 2.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.05 | $3.09 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.6 sec | 2.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
Gemini 3.8 Flash is more accurate by 1.7 pp. Gemini 3.8 Flash is 2.1× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 98.21% | 99.90% |
| Error-free documents | 86.67% | 99.33% |
| Per 1,000 documents | $7.11 | $3.42 |
| To fix / 1,000 | 133 | 7 |
| Speed (median) | 4.3 sec | 2.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $6.58 | $3.33 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 4.0 sec | 3.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.9× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.95% | 100.00% |
| Error-free documents | 99.33% | 100.00% |
| Per 1,000 documents | $6.69 | $3.50 |
| To fix / 1,000 | 7 | 0 |
| Speed (median) | 4.6 sec | 3.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Gemini 3.8 Flash is more accurate by 4 pp. Claude Sonnet 5 is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 96.00% | 100.00% |
| Error-free documents | 76.67% | 100.00% |
| Per 1,000 documents | $4.08 | $5.46 |
| To fix / 1,000 | 233 | 0 |
| Speed (median) | 2.9 sec | 5.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Gemini 3.8 Flash is more accurate by 6.6 pp.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 93.44% | 100.00% |
| Error-free documents | 68.00% | 100.00% |
| Per 1,000 documents | $6.48 | $6.69 |
| To fix / 1,000 | 320 | 0 |
| Speed (median) | 4.7 sec | 6.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Gemini 3.8 Flash is more accurate by 0.9 pp.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 99.11% | 100.00% |
| Error-free documents | 96.00% | 100.00% |
| Per 1,000 documents | $5.97 | $6.11 |
| To fix / 1,000 | 40 | 0 |
| Speed (median) | 3.6 sec | 5.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Gemini 3.8 Flash is more accurate by 5.8 pp. Claude Sonnet 5 is 1.1× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 94.22% | 100.00% |
| Error-free documents | 68.00% | 100.00% |
| Per 1,000 documents | $6.32 | $6.78 |
| To fix / 1,000 | 320 | 0 |
| Speed (median) | 3.4 sec | 5.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
Gemini 3.8 Flash is more accurate by 3.2 pp. Claude Sonnet 5 is 1.4× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 96.78% | 100.00% |
| Error-free documents | 80.67% | 100.00% |
| Per 1,000 documents | $5.04 | $7.06 |
| To fix / 1,000 | 193 | 0 |
| Speed (median) | 3.1 sec | 6.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 0.1 pp. Gemini 3.8 Flash is 1.3× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 99.89% |
| Error-free documents | 100.00% | 99.33% |
| Per 1,000 documents | $3.88 | $3.00 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 2.2 sec | 3.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $5.14 | $4.36 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.6 sec | 3.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.5× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $5.49 | $3.76 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.3 sec | 3.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.94 | $4.05 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.2 sec | 3.6 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Both are equally accurate. Gemini 3.8 Flash is 1.2× cheaper.
| Metric | Claude Sonnet 5 | Gemini 3.8 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $4.93 | $4.06 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.1 sec | 3.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.