Gemma 4 31B vs GLM-5.3 Flash
Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
GLM-5.3 Flash is more accurate; Gemma 4 31B is cheaper in 30 of 30 combinations.
More accurate
GLM-5.3 Flash
wins 15 of 30
Cheaper
Gemma 4 31B
cheaper in 30 of 30
Faster
Gemma 4 31B
2.9 sec vs 4.4 sec
Fewer fixes
GLM-5.3 Flash
13 vs 27 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemma 4 31B | GLM-5.3 Flash | Difference | Gemma 4 31B | GLM-5.3 Flash | Difference |
| Invoice extraction | 97.64% | 99.94% | ▲ 2.3 | $0.17 | $0.95 | +464 % |
| Email triage | 96.52% | 99.41% | ▲ 2.89 | $0.12 | $0.33 | +175 % |
| Personal data detection | 99.90% | 100.00% | ▲ 0.1 | $0.08 | $0.33 | +286 % |
| Contract clauses | 99.64% | 99.49% | ▼ 0.15 | $0.18 | $0.40 | +121 % |
| Document summaries | 100.00% | 100.00% | ±0 | $0.13 | $0.82 | +545 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.15 | $0.32 | +108 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemma 4 31B | GLM-5.3 Flash | Difference | Gemma 4 31B | GLM-5.3 Flash | Difference |
| Invoice extraction | 96.10% | 99.69% | ▲ 3.59 | $0.21 | $1.02 | +383 % |
| Email triage | 97.11% | 98.89% | ▲ 1.78 | $0.16 | $0.52 | +230 % |
| Personal data detection | 99.81% | 99.33% | ▼ 0.48 | $0.12 | $0.49 | +314 % |
| Contract clauses | 99.95% | 100.00% | ▲ 0.05 | $0.25 | $0.69 | +173 % |
| Document summaries | 100.00% | 100.00% | ±0 | $0.19 | $1.13 | +499 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.21 | $0.46 | +117 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemma 4 31B | GLM-5.3 Flash | Difference | Gemma 4 31B | GLM-5.3 Flash | Difference |
| Invoice extraction | 94.87% | 99.54% | ▲ 4.67 | $0.20 | $1.01 | +406 % |
| Email triage | 95.11% | 98.00% | ▲ 2.89 | $0.15 | $0.43 | +189 % |
| Personal data detection | 99.90% | 99.81% | ▼ 0.09 | $0.10 | $0.40 | +289 % |
| Contract clauses | 94.41% | 100.00% | ▲ 5.59 | $0.22 | $0.65 | +197 % |
| Document summaries | 100.00% | 100.00% | ±0 | $0.16 | $1.08 | +560 % |
| Questions about a document | 100.00% | 98.78% | ▼ 1.22 | $0.18 | $0.41 | +125 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemma 4 31B | GLM-5.3 Flash | Difference | Gemma 4 31B | GLM-5.3 Flash | Difference |
| Invoice extraction | 94.62% | 99.38% | ▲ 4.76 | $0.20 | $1.06 | +425 % |
| Email triage | 97.11% | 99.11% | ▲ 2 | $0.15 | $0.58 | +296 % |
| Personal data detection | 99.90% | 99.81% | ▼ 0.09 | $0.10 | $0.46 | +348 % |
| Contract clauses | 94.41% | 100.00% | ▲ 5.59 | $0.24 | $0.64 | +168 % |
| Document summaries | 99.67% | 96.67% | ▼ 3 | $0.16 | $1.54 | +875 % |
| Questions about a document | 100.00% | 100.00% | ±0 | $0.18 | $0.36 | +101 % |
| Accuracy (correct fields) | Per 1,000 documents | |||||
|---|---|---|---|---|---|---|
| Task · documents | Gemma 4 31B | GLM-5.3 Flash | Difference | Gemma 4 31B | GLM-5.3 Flash | Difference |
| Invoice extraction | 93.54% | 99.08% | ▲ 5.54 | $0.22 | $0.98 | +346 % |
| Email triage | 96.22% | 98.52% | ▲ 2.3 | $0.16 | $0.48 | +201 % |
| Personal data detection | 99.81% | 99.81% | ±0 | $0.12 | $0.41 | +240 % |
| Contract clauses | 94.62% | 99.74% | ▲ 5.12 | $0.26 | $0.69 | +170 % |
| Document summaries | 99.11% | 100.00% | ▲ 0.89 | $0.16 | $1.25 | +663 % |
| Questions about a document | 100.00% | 99.67% | ▼ 0.33 | $0.19 | $0.39 | +103 % |
Difference: GLM-5.3 Flash vs. Gemma 4 31B; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
GLM-5.3 Flash is more accurate by 2.3 pp. Gemma 4 31B is 5.6× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 97.64% | 99.94% |
| Error-free documents | 81.33% | 99.33% |
| Per 1,000 documents | $0.17 | $0.95 |
| To fix / 1,000 | 187 | 7 |
| Speed (median) | 8.9 sec | 4.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
GLM-5.3 Flash is more accurate by 3.6 pp. Gemma 4 31B is 4.8× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 96.10% | 99.69% |
| Error-free documents | 66.67% | 96.67% |
| Per 1,000 documents | $0.21 | $1.02 |
| To fix / 1,000 | 333 | 33 |
| Speed (median) | 10.4 sec | 4.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
GLM-5.3 Flash is more accurate by 4.7 pp. Gemma 4 31B is 5.1× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 94.87% | 99.54% |
| Error-free documents | 64.00% | 94.67% |
| Per 1,000 documents | $0.20 | $1.01 |
| To fix / 1,000 | 360 | 53 |
| Speed (median) | 7.7 sec | 4.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Spanish (150 documents)
GLM-5.3 Flash is more accurate by 4.8 pp. Gemma 4 31B is 5.3× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 94.62% | 99.38% |
| Error-free documents | 50.67% | 92.67% |
| Per 1,000 documents | $0.20 | $1.06 |
| To fix / 1,000 | 493 | 73 |
| Speed (median) | 7.4 sec | 5.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · French (150 documents)
GLM-5.3 Flash is more accurate by 5.5 pp. Gemma 4 31B is 4.5× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 93.54% | 99.08% |
| Error-free documents | 50.67% | 89.33% |
| Per 1,000 documents | $0.22 | $0.98 |
| To fix / 1,000 | 493 | 107 |
| Speed (median) | 6.5 sec | 4.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · English (US) (150 documents)
GLM-5.3 Flash is more accurate by 2.9 pp. Gemma 4 31B is 2.8× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 96.52% | 99.41% |
| Error-free documents | 72.00% | 94.67% |
| Per 1,000 documents | $0.12 | $0.33 |
| To fix / 1,000 | 280 | 53 |
| Speed (median) | 2.2 sec | 3.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Czech (150 documents)
GLM-5.3 Flash is more accurate by 1.8 pp. Gemma 4 31B is 3.3× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 97.11% | 98.89% |
| Error-free documents | 74.67% | 90.00% |
| Per 1,000 documents | $0.16 | $0.52 |
| To fix / 1,000 | 253 | 100 |
| Speed (median) | 2.5 sec | 4.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · German (150 documents)
GLM-5.3 Flash is more accurate by 2.9 pp. Gemma 4 31B is 2.9× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 95.11% | 98.00% |
| Error-free documents | 62.00% | 82.00% |
| Per 1,000 documents | $0.15 | $0.43 |
| To fix / 1,000 | 380 | 180 |
| Speed (median) | 3.6 sec | 3.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · Spanish (150 documents)
GLM-5.3 Flash is more accurate by 2 pp. Gemma 4 31B is 4× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 97.11% | 99.11% |
| Error-free documents | 74.00% | 92.00% |
| Per 1,000 documents | $0.15 | $0.58 |
| To fix / 1,000 | 260 | 80 |
| Speed (median) | 2.2 sec | 4.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Email triage · French (150 documents)
GLM-5.3 Flash is more accurate by 2.3 pp. Gemma 4 31B is 3× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 96.22% | 98.52% |
| Error-free documents | 68.67% | 86.67% |
| Per 1,000 documents | $0.16 | $0.48 |
| To fix / 1,000 | 313 | 133 |
| Speed (median) | 2.4 sec | 4.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · English (US) (150 documents)
GLM-5.3 Flash is more accurate by 0.1 pp. Gemma 4 31B is 3.9× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.90% | 100.00% |
| Error-free documents | 99.33% | 100.00% |
| Per 1,000 documents | $0.08 | $0.33 |
| To fix / 1,000 | 7 | 0 |
| Speed (median) | 2.4 sec | 2.8 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Gemma 4 31B is more accurate by 0.5 pp. Gemma 4 31B is 4.1× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.81% | 99.33% |
| Error-free documents | 98.67% | 99.33% |
| Per 1,000 documents | $0.12 | $0.49 |
| To fix / 1,000 | 13 | 7 |
| Speed (median) | 2.9 sec | 3.8 sec |
| Valid answers | 100.00% | 99.33% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · German (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 3.9× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.90% | 99.81% |
| Error-free documents | 99.33% | 98.67% |
| Per 1,000 documents | $0.10 | $0.40 |
| To fix / 1,000 | 7 | 13 |
| Speed (median) | 1.9 sec | 3.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 4.5× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.90% | 99.81% |
| Error-free documents | 99.33% | 98.67% |
| Per 1,000 documents | $0.10 | $0.46 |
| To fix / 1,000 | 7 | 13 |
| Speed (median) | 3.6 sec | 3.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Both are equally accurate. Gemma 4 31B is 3.4× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.81% | 99.81% |
| Error-free documents | 98.67% | 98.67% |
| Per 1,000 documents | $0.12 | $0.41 |
| To fix / 1,000 | 13 | 13 |
| Speed (median) | 4.3 sec | 3.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 2.2× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.64% | 99.49% |
| Error-free documents | 97.33% | 96.00% |
| Per 1,000 documents | $0.18 | $0.40 |
| To fix / 1,000 | 27 | 40 |
| Speed (median) | 2.5 sec | 3.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 2.7× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.95% | 100.00% |
| Error-free documents | 99.33% | 100.00% |
| Per 1,000 documents | $0.25 | $0.69 |
| To fix / 1,000 | 7 | 0 |
| Speed (median) | 6.0 sec | 4.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · German (150 documents)
GLM-5.3 Flash is more accurate by 5.6 pp. Gemma 4 31B is 3× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 94.41% | 100.00% |
| Error-free documents | 27.33% | 100.00% |
| Per 1,000 documents | $0.22 | $0.65 |
| To fix / 1,000 | 727 | 0 |
| Speed (median) | 2.6 sec | 5.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · Spanish (150 documents)
GLM-5.3 Flash is more accurate by 5.6 pp. Gemma 4 31B is 2.7× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 94.41% | 100.00% |
| Error-free documents | 27.33% | 100.00% |
| Per 1,000 documents | $0.24 | $0.64 |
| To fix / 1,000 | 727 | 0 |
| Speed (median) | 5.0 sec | 4.9 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
GLM-5.3 Flash is more accurate by 5.1 pp. Gemma 4 31B is 2.7× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 94.62% | 99.74% |
| Error-free documents | 30.67% | 96.67% |
| Per 1,000 documents | $0.26 | $0.69 |
| To fix / 1,000 | 693 | 33 |
| Speed (median) | 5.3 sec | 5.1 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · English (US) (150 documents)
Both are equally accurate. Gemma 4 31B is 6.5× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.13 | $0.82 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.2 sec | 7.5 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 6× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.19 | $1.13 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 3.4 sec | 10.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · German (150 documents)
Both are equally accurate. Gemma 4 31B is 6.6× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.16 | $1.08 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.9 sec | 8.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · Spanish (150 documents)
Gemma 4 31B is more accurate by 3 pp. Gemma 4 31B is 9.8× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.67% | 96.67% |
| Error-free documents | 98.00% | 96.67% |
| Per 1,000 documents | $0.16 | $1.54 |
| To fix / 1,000 | 20 | 33 |
| Speed (median) | 2.6 sec | 9.2 sec |
| Valid answers | 100.00% | 96.67% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Document summaries · French (150 documents)
GLM-5.3 Flash is more accurate by 0.9 pp. Gemma 4 31B is 7.6× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 99.11% | 100.00% |
| Error-free documents | 94.67% | 100.00% |
| Per 1,000 documents | $0.16 | $1.25 |
| To fix / 1,000 | 53 | 0 |
| Speed (median) | 3.2 sec | 8.7 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · English (US) (150 documents)
Both are equally accurate. Gemma 4 31B is 2.1× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.15 | $0.32 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 2.1 sec | 2.4 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Both are equally accurate. Gemma 4 31B is 2.2× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.21 | $0.46 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 1.9 sec | 3.0 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · German (150 documents)
Gemma 4 31B is more accurate by 1.2 pp. Gemma 4 31B is 2.2× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 98.78% |
| Error-free documents | 100.00% | 95.33% |
| Per 1,000 documents | $0.18 | $0.41 |
| To fix / 1,000 | 0 | 47 |
| Speed (median) | 2.1 sec | 2.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Spanish (150 documents)
Both are equally accurate. Gemma 4 31B is 2× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 100.00% |
| Error-free documents | 100.00% | 100.00% |
| Per 1,000 documents | $0.18 | $0.36 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 1.9 sec | 2.3 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Gemma 4 31B is more accurate by 0.3 pp. Gemma 4 31B is 2× cheaper.
| Metric | Gemma 4 31B | GLM-5.3 Flash |
|---|---|---|
| Correct fields | 100.00% | 99.67% |
| Error-free documents | 100.00% | 98.67% |
| Per 1,000 documents | $0.19 | $0.39 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 2.1 sec | 2.2 sec |
| Valid answers | 100.00% | 100.00% |
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.