ModelVerdict

Comparison

DeepSeek V4.1 Flash vs Gemini 3.8 Flash

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction99.4% / 99.8%99.9% / 100.0%99.5% / 97.2%98.3% / 95.9%99.4% / 99.9%
Email triage97.6% / 98.7%97.4% / 99.2%96.3% / 98.4%——
Personal data detection99.6% / 99.7%99.7% / 99.5%99.8% / 99.7%——
Contract clauses100.0% / 99.9%100.0% / 100.0%97.2% / 99.9%——

Correct fields: DeepSeek V4.1 Flash / Gemini 3.8 Flash; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

Gemini 3.8 Flash is more accurate by 0.4 pp. DeepSeek V4.1 Flash is 7.4× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.4%99.8%
Error-free documents93%98%
Per 1,000 documents$0.52$3.84
To fix / 1,0006720
Speed (median)5.7 sec3.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
Invoice number100.0%100.0%
Payment reference96.7%100.0%
Invoice date100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency99.3%100.0%
Bank account97.3%98.0%

Documents where they differ

Invoice extraction · Czech (150 documents)

Gemini 3.8 Flash is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 8.6× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.9%100.0%
Error-free documents99%99%
Per 1,000 documents$0.50$4.26
To fix / 1,000137
Speed (median)5.0 sec3.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Supplier99.3%99.3%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%100.0%
Invoice number100.0%100.0%
Payment reference100.0%100.0%
Invoice date100.0%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account99.3%100.0%

Documents where they differ

Invoice extraction · German (150 documents)

DeepSeek V4.1 Flash is more accurate by 2.3 pp. DeepSeek V4.1 Flash is 12.6× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.5%97.2%
Error-free documents94%96%
Per 1,000 documents$0.57$7.15
To fix / 1,0006040
Speed (median)6.4 sec4.7 sec
Valid answers100.0%97.3%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Supplier99.3%97.3%
Supplier ID (EIN, IČO…)98.7%97.3%
VAT ID99.3%96.7%
Invoice number100.0%97.3%
Payment reference100.0%97.3%
Invoice date100.0%97.3%
Tax point99.3%97.3%
Due date99.3%97.3%
Net by tax rate100.0%96.7%
Tax by rate100.0%97.3%
Total100.0%97.3%
Currency100.0%97.3%
Bank account98.0%97.3%

Documents where they differ

Invoice extraction · Spanish (79 documents)

DeepSeek V4.1 Flash is more accurate by 2.3 pp. DeepSeek V4.1 Flash is 11.1× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields98.3%95.9%
Error-free documents77%95%
Per 1,000 documents$0.71$7.86
To fix / 1,00022850
Speed (median)5.8 sec5.3 sec
Valid answers100.0%96.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Supplier93.7%95.0%
Supplier ID (EIN, IČO…)100.0%96.0%
VAT ID100.0%96.0%
Invoice number100.0%96.0%
Payment reference97.5%96.0%
Invoice date100.0%96.0%
Tax point98.7%96.0%
Due date100.0%96.0%
Net by tax rate88.6%96.0%
Tax by rate100.0%96.0%
Total100.0%96.0%
Currency100.0%96.0%
Bank account98.7%96.0%

Documents where they differ

Invoice extraction · French (74 documents)

Gemini 3.8 Flash is more accurate by 0.5 pp. DeepSeek V4.1 Flash is 9.5× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.4%99.9%
Error-free documents92%99%
Per 1,000 documents$0.65$6.18
To fix / 1,0008110
Speed (median)5.7 sec5.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID98.7%100.0%
Invoice number100.0%100.0%
Payment reference98.7%99.0%
Invoice date100.0%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account94.6%100.0%

Documents where they differ

Email triage · English (US) (150 documents)

Gemini 3.8 Flash is more accurate by 1.1 pp. DeepSeek V4.1 Flash is 10.2× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields97.6%98.7%
Error-free documents79%89%
Per 1,000 documents$0.23$2.39
To fix / 1,000213113
Speed (median)3.8 sec2.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Category100.0%100.0%
Priority96.7%100.0%
Sentiment82.0%88.7%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Russell Bates · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Laurie Knight · Email · DeepSeek V4.1 Flash 9/9, Gemini 3.8 Flash 8/9
  • Daniel Stewart · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Robert Lewis · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Angela Harmon · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9

Email triage · Czech (150 documents)

Gemini 3.8 Flash is more accurate by 1.8 pp. DeepSeek V4.1 Flash is 10.3× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields97.4%99.2%
Error-free documents77%93%
Per 1,000 documents$0.30$3.06
To fix / 1,00022773
Speed (median)4.2 sec2.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Category100.0%100.0%
Priority98.7%99.3%
Sentiment78.0%93.3%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

Email triage · German (145 documents)

Gemini 3.8 Flash is more accurate by 2.1 pp. DeepSeek V4.1 Flash is 9× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields96.3%98.4%
Error-free documents68%85%
Per 1,000 documents$0.30$2.74
To fix / 1,000324147
Speed (median)4.2 sec2.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Category100.0%100.0%
Priority97.2%100.0%
Sentiment69.7%85.3%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Friedbert Hoffmann · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Sylwia Gerlach · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Irmela Warmer · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Roselinde Heinz · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Sibille Lehmann · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Nadja Wiek · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Ibrahim Walter · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9
  • Margret Löchel · Email · DeepSeek V4.1 Flash 8/9, Gemini 3.8 Flash 9/9

Personal data detection · English (US) (150 documents)

Gemini 3.8 Flash is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 6.5× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.6%99.7%
Error-free documents97%98%
Per 1,000 documents$0.29$1.86
To fix / 1,0002720
Speed (median)3.8 sec1.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Names98.7%100.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.7%98.0%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

  • Margaret Mills · Text · DeepSeek V4.1 Flash 6/7, Gemini 3.8 Flash 7/7

Personal data detection · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 0.2 pp. DeepSeek V4.1 Flash is 7× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.7%99.5%
Error-free documents98%97%
Per 1,000 documents$0.31$2.19
To fix / 1,0002033
Speed (median)4.2 sec2.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Names100.0%98.7%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.0%98.0%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Both models got the same number of fields right on every example document.

Personal data detection · German (148 documents)

DeepSeek V4.1 Flash is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 6.9× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields99.8%99.7%
Error-free documents99%98%
Per 1,000 documents$0.31$2.12
To fix / 1,0001320
Speed (median)3.7 sec2.3 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Names100.0%100.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.7%98.0%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

  • Gunnar Zorbach · Text · DeepSeek V4.1 Flash 6/7, Gemini 3.8 Flash 7/7

Contract clauses · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 7.7× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields100.0%99.9%
Error-free documents100%99%
Per 1,000 documents$0.32$2.47
To fix / 1,00007
Speed (median)3.9 sec2.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Provider100.0%99.3%
Provider ID100.0%100.0%
Client100.0%99.3%
Client ID100.0%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · Czech (150 documents)

Both are equally accurate. DeepSeek V4.1 Flash is 7.4× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields100.0%100.0%
Error-free documents100%100%
Per 1,000 documents$0.42$3.09
To fix / 1,00000
Speed (median)4.3 sec2.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Provider100.0%100.0%
Provider ID100.0%100.0%
Client100.0%100.0%
Client ID100.0%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Both models got the same number of fields right on every example document.

Contract clauses · German (145 documents)

Gemini 3.8 Flash is more accurate by 2.7 pp. DeepSeek V4.1 Flash is 6.7× cheaper.

MetricDeepSeek V4.1 FlashGemini 3.8 Flash
Correct fields97.2%99.9%
Error-free documents77%99%
Per 1,000 documents$0.51$3.42
To fix / 1,0002287
Speed (median)4.6 sec2.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashGemini 3.8 Flash
Provider100.0%100.0%
Provider ID81.4%99.3%
Client100.0%100.0%
Client ID82.8%99.3%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ