ModelVerdict

Comparison

Claude Sonnet 5 vs Gemini 3.5 Flash Lite

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction99.8% / 99.2%100.0% / 99.5%99.0% / 100.0%93.6% / 98.2%98.7% / 98.7%
Email triage98.2% / 96.3%98.2% / 95.8%97.9% / 94.7%——
Personal data detection99.7% / 99.5%98.9% / 98.1%99.7% / 99.6%——
Contract clauses100.0% / 100.0%100.0% / 99.9%98.2% / 98.0%——

Correct fields: Claude Sonnet 5 / Gemini 3.5 Flash Lite; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

Claude Sonnet 5 is more accurate by 0.6 pp. Gemini 3.5 Flash Lite is 10.2× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields99.8%99.2%
Error-free documents99%92%
Per 1,000 documents$8.84$0.87
To fix / 1,0001380
Speed (median)3.2 sec1.7 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
Invoice number100.0%100.0%
Payment reference100.0%96.7%
Invoice date100.0%97.3%
Due date100.0%99.3%
Net by tax rate98.7%98.0%
Tax by rate99.3%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account100.0%100.0%

Documents where they differ

Invoice extraction · Czech (150 documents)

Claude Sonnet 5 is more accurate by 0.5 pp. Gemini 3.5 Flash Lite is 9.1× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields100.0%99.5%
Error-free documents100%93%
Per 1,000 documents$9.41$1.03
To fix / 1,000067
Speed (median)3.6 sec1.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%100.0%
Invoice number100.0%100.0%
Payment reference100.0%95.3%
Invoice date100.0%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%98.7%
Bank account100.0%99.3%

Documents where they differ

Invoice extraction · German (150 documents)

Gemini 3.5 Flash Lite is more accurate by 1 pp. Gemini 3.5 Flash Lite is 10.1× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields99.0%100.0%
Error-free documents87%100%
Per 1,000 documents$10.42$1.03
To fix / 1,0001330
Speed (median)3.8 sec1.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%100.0%
Invoice number100.0%100.0%
Payment reference100.0%100.0%
Invoice date99.3%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate89.3%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account98.0%100.0%

Documents where they differ

Invoice extraction · Spanish (100 documents)

Gemini 3.5 Flash Lite is more accurate by 4.6 pp. Gemini 3.5 Flash Lite is 11.3× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields93.6%98.2%
Error-free documents77%79%
Per 1,000 documents$11.89$1.05
To fix / 1,000230210
Speed (median)4.0 sec1.6 sec
Valid answers95.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Supplier94.0%98.0%
Supplier ID (EIN, IČO…)95.0%100.0%
VAT ID95.0%83.0%
Invoice number95.0%100.0%
Payment reference94.0%99.0%
Invoice date95.0%99.0%
Tax point95.0%98.0%
Due date95.0%100.0%
Net by tax rate79.0%100.0%
Tax by rate95.0%100.0%
Total95.0%100.0%
Currency95.0%100.0%
Bank account95.0%100.0%

Documents where they differ

Invoice extraction · French (97 documents)

Both are equally accurate. Gemini 3.5 Flash Lite is 10.3× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields98.7%98.7%
Error-free documents96%85%
Per 1,000 documents$11.02$1.07
To fix / 1,00041150
Speed (median)4.4 sec1.5 sec
Valid answers99.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Supplier99.0%98.0%
Supplier ID (EIN, IČO…)99.0%100.0%
VAT ID99.0%100.0%
Invoice number99.0%99.0%
Payment reference97.9%91.0%
Invoice date99.0%98.0%
Tax point99.0%98.0%
Due date99.0%100.0%
Net by tax rate96.9%100.0%
Tax by rate99.0%100.0%
Total99.0%100.0%
Currency99.0%100.0%
Bank account97.9%99.0%

Documents where they differ

Email triage · English (US) (150 documents)

Claude Sonnet 5 is more accurate by 1.9 pp. Gemini 3.5 Flash Lite is 9.6× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields98.2%96.3%
Error-free documents84%69%
Per 1,000 documents$4.01$0.42
To fix / 1,000160313
Speed (median)3.8 sec0.7 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Category100.0%100.0%
Priority97.3%84.0%
Sentiment86.7%82.7%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Robert Lewis · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 7/9
  • Luke Sims · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Russell Bates · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Sheila Evans · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Jane Rubio · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Laurie Knight · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Daniel Stewart · Email · Claude Sonnet 5 8/9, Gemini 3.5 Flash Lite 9/9
  • Allison Floyd · Email · Claude Sonnet 5 8/9, Gemini 3.5 Flash Lite 9/9

Email triage · Czech (150 documents)

Claude Sonnet 5 is more accurate by 2.4 pp. Gemini 3.5 Flash Lite is 9.6× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields98.2%95.8%
Error-free documents83%64%
Per 1,000 documents$4.91$0.51
To fix / 1,000167360
Speed (median)4.7 sec0.7 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Category100.0%100.0%
Priority96.0%80.0%
Sentiment87.3%84.0%
Customer name100.0%98.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

Email triage · German (150 documents)

Claude Sonnet 5 is more accurate by 3.2 pp. Gemini 3.5 Flash Lite is 10.7× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields97.9%94.7%
Error-free documents81%57%
Per 1,000 documents$5.11$0.48
To fix / 1,000187433
Speed (median)4.3 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Category100.0%100.0%
Priority96.0%76.0%
Sentiment84.7%76.7%
Customer name100.0%99.3%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Margret Löchel · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 7/9
  • Rolf-Peter Metz · Email · Claude Sonnet 5 7/9, Gemini 3.5 Flash Lite 8/9
  • Swantje Noack · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Raymund Weiß · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Sylwia Gerlach · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Cristina Krause · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Cynthia Hahn · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9
  • Sibille Lehmann · Email · Claude Sonnet 5 9/9, Gemini 3.5 Flash Lite 8/9

Personal data detection · English (US) (150 documents)

Claude Sonnet 5 is more accurate by 0.2 pp. Gemini 3.5 Flash Lite is 8.6× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields99.7%99.5%
Error-free documents98%97%
Per 1,000 documents$3.50$0.41
To fix / 1,0002027
Speed (median)2.5 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Names100.0%100.0%
Email addresses100.0%99.3%
Phone numbers100.0%100.0%
Addresses98.0%98.7%
Dates of birth100.0%98.7%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · Czech (150 documents)

Claude Sonnet 5 is more accurate by 0.8 pp. Gemini 3.5 Flash Lite is 8.9× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields98.9%98.1%
Error-free documents92%88%
Per 1,000 documents$4.06$0.45
To fix / 1,00080120
Speed (median)3.2 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Names96.7%91.3%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses97.3%99.3%
Dates of birth98.0%96.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · German (150 documents)

Claude Sonnet 5 is more accurate by 0.1 pp. Gemini 3.5 Flash Lite is 9.7× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields99.7%99.6%
Error-free documents98%97%
Per 1,000 documents$4.40$0.45
To fix / 1,0002027
Speed (median)3.7 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Names98.7%97.3%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses100.0%100.0%
Dates of birth99.3%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

  • Rosi Karz · Text · Claude Sonnet 5 7/7, Gemini 3.5 Flash Lite 6/7
  • Fritz Rogner · Text · Claude Sonnet 5 7/7, Gemini 3.5 Flash Lite 6/7

Contract clauses · English (US) (150 documents)

Both are equally accurate. Gemini 3.5 Flash Lite is 7.3× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields100.0%100.0%
Error-free documents100%99%
Per 1,000 documents$5.04$0.69
To fix / 1,00007
Speed (median)3.4 sec1.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Provider100.0%100.0%
Provider ID100.0%100.0%
Client100.0%100.0%
Client ID100.0%100.0%
Contract type100.0%99.3%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Both models got the same number of fields right on every example document.

Contract clauses · Czech (150 documents)

Claude Sonnet 5 is more accurate by 0.1 pp. Gemini 3.5 Flash Lite is 7.1× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields100.0%99.9%
Error-free documents100%98%
Per 1,000 documents$6.05$0.85
To fix / 1,000020
Speed (median)3.6 sec0.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Provider100.0%99.3%
Provider ID100.0%100.0%
Client100.0%99.3%
Client ID100.0%100.0%
Contract type100.0%99.3%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · German (150 documents)

Claude Sonnet 5 is more accurate by 0.2 pp. Gemini 3.5 Flash Lite is 9× cheaper.

MetricClaude Sonnet 5Gemini 3.5 Flash Lite
Correct fields98.2%98.0%
Error-free documents87%84%
Per 1,000 documents$7.11$0.79
To fix / 1,000133160
Speed (median)4.3 sec1.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldClaude Sonnet 5Gemini 3.5 Flash Lite
Provider100.0%100.0%
Provider ID87.3%86.0%
Client100.0%100.0%
Client ID89.3%88.7%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%99.3%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ