Google · open weights
Gemma 4 31B
How Gemma 4 31B by Google handles realistic business documents: accuracy, real cost, speed, and where it goes wrong.
List price: $0.09 per 1M input tokens, $0.34 per 1M output tokens · google/gemma-4-31b-it
Results
| Task · documents | Rank | Correct fieldsThe bar: the share of correct fields below which manual fixes cost more than a cheaper model saves. The black mark on the meter shows it. | Per 1,000 documents | To fix / 1,000How many of 1,000 documents have at least one wrong field and need someone to check and fix them. | Speed (median) |
|---|---|---|---|---|---|
| Contract clauses · English (US) | 9/14 | 99.64% | $0.18 | 27 | 2.5 sec |
| Contract clauses · Czech | 11/14 | 99.95% | $0.25 | 7 | 6.0 sec |
| Contract clauses · German | 13/14 | 94.41% | $0.22 | 727 | 2.6 sec |
| Contract clauses · Spanish | 14/14 | 94.41% | $0.24 | 727 | 5.0 sec |
| Contract clauses · French | 14/14 | 94.62% | $0.26 | 693 | 5.3 sec |
| Email triage · English (US) | 11/14 | 96.52% | $0.12 | 280 | 2.2 sec |
| Email triage · Czech | 11/14 | 97.11% | $0.16 | 253 | 2.5 sec |
| Email triage · German | 11/14 | 95.11% | $0.15 | 380 | 3.6 sec |
| Email triage · Spanish | 8/14 | 97.11% | $0.15 | 260 | 2.2 sec |
| Email triage · French | 11/14 | 96.22% | $0.16 | 313 | 2.4 sec |
| Invoice extraction · English (US) | 11/14 | 97.64% | $0.17 | 187 | 8.9 sec |
| Invoice extraction · Czech | 11/14 | 96.10% | $0.21 | 333 | 10.4 sec |
| Invoice extraction · German | 12/14 | 94.87% | $0.20 | 360 | 7.7 sec |
| Invoice extraction · Spanish | 12/14 | 94.62% | $0.20 | 493 | 7.4 sec |
| Invoice extraction · French | 12/14 | 93.54% | $0.22 | 493 | 6.5 sec |
| Personal data detection · English (US) | 3/14 | 99.90% | $0.08 | 7 | 2.4 sec |
| Personal data detection · Czech | 1/14 | 99.81% | $0.12 | 13 | 2.9 sec |
| Personal data detection · German | 3/14 | 99.90% | $0.10 | 7 | 1.9 sec |
| Personal data detection · Spanish | 3/14 | 99.90% | $0.10 | 7 | 3.6 sec |
| Personal data detection · French | 2/14 | 99.81% | $0.12 | 13 | 4.3 sec |
| Questions about a document · English (US) | 2/14 | 100.00% | $0.15 | 0 | 2.1 sec |
| Questions about a document · Czech | 1/14 | 100.00% | $0.21 | 0 | 1.9 sec |
| Questions about a document · German | 2/14 | 100.00% | $0.18 | 0 | 2.1 sec |
| Questions about a document · Spanish | 1/14 | 100.00% | $0.18 | 0 | 1.9 sec |
| Questions about a document · French | 2/14 | 100.00% | $0.19 | 0 | 2.1 sec |
| Document summaries · English (US) | 1/14 | 100.00% | $0.13 | 0 | 2.2 sec |
| Document summaries · Czech | 1/14 | 100.00% | $0.19 | 0 | 3.4 sec |
| Document summaries · German | 1/14 | 100.00% | $0.16 | 0 | 2.9 sec |
| Document summaries · Spanish | 4/14 | 99.67% | $0.16 | 20 | 2.6 sec |
| Document summaries · French | 5/14 | 99.11% | $0.16 | 53 | 3.2 sec |
Compare with another model
- Gemma 4 31B vs Claude Haiku 5.5
- Gemma 4 31B vs Claude Sonnet 5
- Gemma 4 31B vs Claude Sonnet 5.5
- Gemma 4 31B vs DeepSeek V4.1 Flash
- Gemma 4 31B vs Gemini 3.5 Flash Lite
- Gemma 4 31B vs Gemini 3.8 Flash
- Gemma 4 31B vs GLM-5.3 Flash
- Gemma 4 31B vs GPT-6 Luna
- Gemma 4 31B vs GPT-6 Sol
- Gemma 4 31B vs Mistral Large 4
- Gemma 4 31B vs Mistral Medium 3.5
- Gemma 4 31B vs Mistral Small 4
- Gemma 4 31B vs Qwen3.8 Flash
Where it goes wrong
The fields it gets wrong most often and the error types, across all documents in the benchmark.
Free with login
Exactly where the model goes wrong: its weakest fields and the actual wrong answers.
Just your email, no password.
Language tax
How many more tokens this model needs for the same text compared with English.
- Czech 1.64×
- German 1.33×
- French 1.38×
- Spanish 1.30×
- Polish 1.60×
Compliance
- In the EU no
- Zero retention (ZDR) yes
- DPA not verified
- Open weights yes
Served only by third-party hosts on OpenRouter (no EU endpoint listed); self-hosting in the EU possible.
Use it now
The exact request the benchmark sends (same prompt, JSON schema, temperature 0), ready to call Gemma 4 31B via OpenRouter.
Free with login
A ready-to-use prompt and JSON schema for this model.
Just your email, no password.
Badge
Embed the current result on your site; the badge updates with every run.
<a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/contracts-en.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/contracts-cs.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/contracts-de.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/contracts-es.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/contracts-fr.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/emails-en.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/emails-cs.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/emails-de.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/emails-es.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/emails-fr.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/invoices-en.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/invoices-cs.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/invoices-de.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/invoices-es.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/invoices-fr.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/pii-en.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/pii-cs.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/pii-de.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/pii-es.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/pii-fr.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/qa-en.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/qa-cs.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/qa-de.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/qa-es.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/qa-fr.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/summaries-en.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/summaries-cs.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/summaries-de.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/summaries-es.svg" alt="Gemma 4 31B on ModelVerdict"></a><a href="https://modelverdict.ai/en/models/gemma-4-31b/"><img src="https://modelverdict.ai/badge/gemma-4-31b/summaries-fr.svg" alt="Gemma 4 31B on ModelVerdict"></a>