ModelVerdict

Comparison

Gemini 3.5 Flash Lite vs Qwen3.8 Flash

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction99.2% / 82.4%99.5% / 91.8%100.0% / 93.5%98.2% / 87.9%98.7% / 90.6%
Email triage96.3% / 97.5%95.8% / 98.5%94.7% / 97.9%——
Personal data detection99.5% / 99.2%98.1% / 97.0%99.6% / 99.6%——
Contract clauses100.0% / 95.1%99.9% / 99.9%98.0% / 98.0%——

Correct fields: Gemini 3.5 Flash Lite / Qwen3.8 Flash; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

Gemini 3.5 Flash Lite is more accurate by 16.8 pp. Gemini 3.5 Flash Lite is 1.3× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields99.2%82.4%
Error-free documents92%57%
Per 1,000 documents$0.87$1.15
To fix / 1,00080427
Speed (median)1.7 sec17.4 sec
Valid answers100.0%90.7%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Supplier100.0%85.3%
Supplier ID (EIN, IČO…)100.0%88.7%
Invoice number100.0%85.3%
Payment reference96.7%79.3%
Invoice date97.3%85.3%
Due date99.3%85.3%
Net by tax rate98.0%70.0%
Tax by rate100.0%76.0%
Total100.0%85.3%
Currency100.0%84.0%
Bank account100.0%81.3%

Documents where they differ

Invoice extraction · Czech (150 documents)

Gemini 3.5 Flash Lite is more accurate by 7.7 pp.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields99.5%91.8%
Error-free documents93%77%
Per 1,000 documents$1.03$1.02
To fix / 1,00067233
Speed (median)1.8 sec17.0 sec
Valid answers100.0%96.7%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Supplier100.0%93.3%
Supplier ID (EIN, IČO…)100.0%94.0%
VAT ID100.0%94.0%
Invoice number100.0%94.7%
Payment reference95.3%94.0%
Invoice date100.0%94.7%
Tax point100.0%94.7%
Due date100.0%94.7%
Net by tax rate100.0%80.0%
Tax by rate100.0%80.7%
Total100.0%94.0%
Currency98.7%94.0%
Bank account99.3%90.7%

Documents where they differ

Invoice extraction · German (150 documents)

Gemini 3.5 Flash Lite is more accurate by 6.5 pp. Gemini 3.5 Flash Lite is 1.1× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields100.0%93.5%
Error-free documents100%87%
Per 1,000 documents$1.03$1.12
To fix / 1,0000127
Speed (median)1.5 sec19.0 sec
Valid answers100.0%94.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Supplier100.0%94.0%
Supplier ID (EIN, IČO…)100.0%94.0%
VAT ID100.0%94.0%
Invoice number100.0%92.7%
Payment reference100.0%88.7%
Invoice date100.0%94.0%
Tax point100.0%94.0%
Due date100.0%94.0%
Net by tax rate100.0%94.0%
Tax by rate100.0%94.0%
Total100.0%94.0%
Currency100.0%94.0%
Bank account100.0%94.0%

Documents where they differ

Invoice extraction · Spanish (100 documents)

Gemini 3.5 Flash Lite is more accurate by 10.3 pp. Gemini 3.5 Flash Lite is 1.3× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields98.2%87.9%
Error-free documents79%74%
Per 1,000 documents$1.05$1.40
To fix / 1,000210260
Speed (median)1.6 sec22.3 sec
Valid answers100.0%90.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Supplier98.0%86.0%
Supplier ID (EIN, IČO…)100.0%89.0%
VAT ID83.0%86.0%
Invoice number100.0%89.0%
Payment reference99.0%85.0%
Invoice date99.0%89.0%
Tax point98.0%87.0%
Due date100.0%89.0%
Net by tax rate100.0%86.0%
Tax by rate100.0%90.0%
Total100.0%89.0%
Currency100.0%89.0%
Bank account100.0%89.0%

Documents where they differ

Invoice extraction · French (100 documents)

Gemini 3.5 Flash Lite is more accurate by 8.1 pp. Gemini 3.5 Flash Lite is 1.2× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields98.7%90.6%
Error-free documents85%82%
Per 1,000 documents$1.07$1.23
To fix / 1,000150180
Speed (median)1.5 sec19.8 sec
Valid answers100.0%95.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Supplier98.0%91.0%
Supplier ID (EIN, IČO…)100.0%91.0%
VAT ID100.0%91.0%
Invoice number99.0%90.0%
Payment reference91.0%86.0%
Invoice date98.0%91.0%
Tax point98.0%92.0%
Due date100.0%89.0%
Net by tax rate100.0%91.0%
Tax by rate100.0%94.0%
Total100.0%91.0%
Currency100.0%91.0%
Bank account99.0%90.0%

Documents where they differ

Email triage · English (US) (150 documents)

Qwen3.8 Flash is more accurate by 1.2 pp. Qwen3.8 Flash is 1.4× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields96.3%97.5%
Error-free documents69%79%
Per 1,000 documents$0.42$0.30
To fix / 1,000313213
Speed (median)0.7 sec8.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Category100.0%100.0%
Priority84.0%97.3%
Sentiment82.7%80.7%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%99.3%

Documents where they differ

  • Robert Lewis · Email · Gemini 3.5 Flash Lite 7/9, Qwen3.8 Flash 9/9
  • Luke Sims · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Russell Bates · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Sheila Evans · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Daniel Stewart · Email · Gemini 3.5 Flash Lite 9/9, Qwen3.8 Flash 8/9
  • Allison Floyd · Email · Gemini 3.5 Flash Lite 9/9, Qwen3.8 Flash 8/9
  • David Patel · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Scott Davis · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9

Email triage · Czech (150 documents)

Qwen3.8 Flash is more accurate by 2.7 pp. Qwen3.8 Flash is 1.1× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields95.8%98.5%
Error-free documents64%87%
Per 1,000 documents$0.51$0.45
To fix / 1,000360133
Speed (median)0.7 sec13.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Category100.0%100.0%
Priority80.0%99.3%
Sentiment84.0%88.7%
Customer name98.0%99.3%
Order number100.0%99.3%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

Email triage · German (150 documents)

Qwen3.8 Flash is more accurate by 3.2 pp. Qwen3.8 Flash is 1.2× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields94.7%97.9%
Error-free documents57%81%
Per 1,000 documents$0.48$0.39
To fix / 1,000433187
Speed (median)0.8 sec12.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Category100.0%100.0%
Priority76.0%96.0%
Sentiment76.7%84.7%
Customer name99.3%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Margret Löchel · Email · Gemini 3.5 Flash Lite 7/9, Qwen3.8 Flash 9/9
  • Swantje Noack · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Raymund Weiß · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Sylwia Gerlach · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Cristina Krause · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Cynthia Hahn · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9
  • Linda Bähr · Email · Gemini 3.5 Flash Lite 9/9, Qwen3.8 Flash 8/9
  • Sibille Lehmann · Email · Gemini 3.5 Flash Lite 8/9, Qwen3.8 Flash 9/9

Personal data detection · English (US) (150 documents)

Gemini 3.5 Flash Lite is more accurate by 0.3 pp. Qwen3.8 Flash is 1.5× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields99.5%99.2%
Error-free documents97%99%
Per 1,000 documents$0.41$0.28
To fix / 1,0002713
Speed (median)0.8 sec7.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Names100.0%99.3%
Email addresses99.3%99.3%
Phone numbers100.0%99.3%
Addresses98.7%98.7%
Dates of birth98.7%99.3%
National IDs100.0%99.3%
Bank accounts100.0%99.3%

Documents where they differ

Personal data detection · Czech (150 documents)

Gemini 3.5 Flash Lite is more accurate by 1.1 pp. Qwen3.8 Flash is 1.1× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields98.1%97.0%
Error-free documents88%89%
Per 1,000 documents$0.45$0.41
To fix / 1,000120113
Speed (median)0.8 sec9.6 sec
Valid answers100.0%99.3%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Names91.3%90.7%
Email addresses100.0%98.0%
Phone numbers100.0%97.3%
Addresses99.3%96.7%
Dates of birth96.0%98.0%
National IDs100.0%99.3%
Bank accounts100.0%98.7%

Documents where they differ

Personal data detection · German (150 documents)

Both are equally accurate. Qwen3.8 Flash is 1.3× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields99.6%99.6%
Error-free documents97%99%
Per 1,000 documents$0.45$0.36
To fix / 1,000277
Speed (median)0.8 sec12.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Names97.3%99.3%
Email addresses100.0%99.3%
Phone numbers100.0%99.3%
Addresses100.0%99.3%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

  • Rosi Karz · Text · Gemini 3.5 Flash Lite 6/7, Qwen3.8 Flash 7/7
  • Fritz Rogner · Text · Gemini 3.5 Flash Lite 6/7, Qwen3.8 Flash 7/7

Contract clauses · English (US) (150 documents)

Gemini 3.5 Flash Lite is more accurate by 4.8 pp. Qwen3.8 Flash is 1.1× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields100.0%95.1%
Error-free documents99%69%
Per 1,000 documents$0.69$0.62
To fix / 1,0007307
Speed (median)1.0 sec14.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Provider100.0%69.3%
Provider ID100.0%100.0%
Client100.0%69.3%
Client ID100.0%100.0%
Contract type99.3%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%99.3%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%99.3%
Governing law100.0%99.3%

Documents where they differ

Contract clauses · Czech (150 documents)

Both are equally accurate. Qwen3.8 Flash is 1.4× cheaper.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields99.9%99.9%
Error-free documents98%99%
Per 1,000 documents$0.85$0.63
To fix / 1,0002013
Speed (median)0.9 sec13.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Provider99.3%100.0%
Provider ID100.0%100.0%
Client99.3%100.0%
Client ID100.0%100.0%
Contract type99.3%98.7%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · German (150 documents)

Both are equally accurate.

MetricGemini 3.5 Flash LiteQwen3.8 Flash
Correct fields98.0%98.0%
Error-free documents84%87%
Per 1,000 documents$0.79$0.78
To fix / 1,000160127
Speed (median)1.0 sec19.7 sec
Valid answers100.0%99.3%

Accuracy per field

FieldGemini 3.5 Flash LiteQwen3.8 Flash
Provider100.0%99.3%
Provider ID86.0%94.7%
Client100.0%99.3%
Client ID88.7%94.7%
Contract type100.0%99.3%
Price (net)100.0%99.3%
Currency100.0%99.3%
Billing period100.0%99.3%
Effective date100.0%99.3%
End date99.3%99.3%
Notice period (months)100.0%99.3%
Late-payment penalty (% per day)100.0%99.3%
Governing law100.0%91.3%

Documents where they differ