Mistral Medium 3.5 vs Qwen3.8 Flash
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 97.8% / 82.4% | 93.5% / 91.8% | 97.4% / 93.5% | 97.0% / 87.9% | 98.2% / 90.6% |
| Email triage | 94.9% / 97.5% | 94.5% / 98.5% | 92.7% / 97.9% | — | — |
| Personal data detection | 99.7% / 99.2% | 99.8% / 97.0% | 100.0% / 99.6% | — | — |
| Contract clauses | 98.1% / 95.1% | 100.0% / 99.9% | 97.1% / 98.0% | — | — |
Correct fields: Mistral Medium 3.5 / Qwen3.8 Flash; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
Mistral Medium 3.5 is more accurate by 15.4 pp. Qwen3.8 Flash is 3.8× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.8% | 82.4% |
| Error-free documents | 79% | 57% |
| Per 1,000 documents | $4.37 | $1.15 |
| To fix / 1,000 | 207 | 427 |
| Speed (median) | 2.3 sec | 17.4 sec |
| Valid answers | 100.0% | 90.7% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 100.0% | 85.3% |
| Supplier ID (EIN, IČO…) | 100.0% | 88.7% |
| Invoice number | 100.0% | 85.3% |
| Payment reference | 94.7% | 79.3% |
| Invoice date | 98.7% | 85.3% |
| Due date | 99.3% | 85.3% |
| Net by tax rate | 88.0% | 70.0% |
| Tax by rate | 98.7% | 76.0% |
| Total | 100.0% | 85.3% |
| Currency | 100.0% | 84.0% |
| Bank account | 96.0% | 81.3% |
Documents where they differ
- Reid Office Products LLC · A-003849 · Scan · Mistral Medium 3.5 11/11, Qwen3.8 Flash 0/11
- Eagle Partners Co. · 4272 · Clean image · Mistral Medium 3.5 11/11, Qwen3.8 Flash 0/11
- Hughes Janitorial Services Corp. · A-001911 · Scan · Mistral Medium 3.5 11/11, Qwen3.8 Flash 1/11
- Summit Services Inc. · INV-15230 · Scan · Mistral Medium 3.5 11/11, Qwen3.8 Flash 2/11
- Raleigh Engineering Inc. · INV253511 · Scan · Mistral Medium 3.5 10/11, Qwen3.8 Flash 1/11
- Miranda-Vega Group LLC · 4959 · PDF text · Mistral Medium 3.5 10/11, Qwen3.8 Flash 8/11
- Liberty Systems Inc. · INV-17299 · PDF text · Mistral Medium 3.5 11/11, Qwen3.8 Flash 9/11
- Flores-Baker Group Co. · A-005694 · PDF text · Mistral Medium 3.5 11/11, Qwen3.8 Flash 9/11
Invoice extraction · Czech (150 documents)
Mistral Medium 3.5 is more accurate by 1.7 pp. Qwen3.8 Flash is 4.6× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 93.5% | 91.8% |
| Error-free documents | 63% | 77% |
| Per 1,000 documents | $4.69 | $1.02 |
| To fix / 1,000 | 367 | 233 |
| Speed (median) | 2.6 sec | 17.0 sec |
| Valid answers | 100.0% | 96.7% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 90.0% | 93.3% |
| Supplier ID (EIN, IČO…) | 87.3% | 94.0% |
| VAT ID | 85.3% | 94.0% |
| Invoice number | 99.3% | 94.7% |
| Payment reference | 95.3% | 94.0% |
| Invoice date | 88.7% | 94.7% |
| Tax point | 86.7% | 94.7% |
| Due date | 90.7% | 94.7% |
| Net by tax rate | 99.3% | 80.0% |
| Tax by rate | 98.7% | 80.7% |
| Total | 100.0% | 94.0% |
| Currency | 100.0% | 94.0% |
| Bank account | 94.0% | 90.7% |
Documents where they differ
- Sedláček s.r.o. · 2025/0774 · Scan · Mistral Medium 3.5 12/13, Qwen3.8 Flash 0/13
- Pavlík a Zeman s.r.o. · 25500457 · Clean image · Mistral Medium 3.5 9/13, Qwen3.8 Flash 13/13
- Sedlák s.r.o. · 20250158 · Photo · Mistral Medium 3.5 13/13, Qwen3.8 Flash 9/13
- Jiřina Švecová · 25401227 · Clean image · Mistral Medium 3.5 10/13, Qwen3.8 Flash 13/13
- Stejskal, v.o.s. · FV2600175 · Photo · Mistral Medium 3.5 10/13, Qwen3.8 Flash 13/13
- Slavěna Pospíšilová · 26200409 · Scan · Mistral Medium 3.5 10/13, Qwen3.8 Flash 13/13
- Hrubý s.r.o. · DB2500960 · Clean image · Mistral Medium 3.5 9/13, Qwen3.8 Flash 12/13
- Stavsklad s.r.o. · 2025/1111 · Scan · Mistral Medium 3.5 10/13, Qwen3.8 Flash 13/13
Invoice extraction · German (150 documents)
Mistral Medium 3.5 is more accurate by 3.9 pp. Qwen3.8 Flash is 4.2× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.4% | 93.5% |
| Error-free documents | 75% | 87% |
| Per 1,000 documents | $4.72 | $1.12 |
| To fix / 1,000 | 253 | 127 |
| Speed (median) | 2.5 sec | 19.0 sec |
| Valid answers | 100.0% | 94.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 97.3% | 94.0% |
| Supplier ID (EIN, IČO…) | 98.7% | 94.0% |
| VAT ID | 96.0% | 94.0% |
| Invoice number | 100.0% | 92.7% |
| Payment reference | 92.7% | 88.7% |
| Invoice date | 98.0% | 94.0% |
| Tax point | 90.7% | 94.0% |
| Due date | 97.3% | 94.0% |
| Net by tax rate | 98.0% | 94.0% |
| Tax by rate | 100.0% | 94.0% |
| Total | 100.0% | 94.0% |
| Currency | 100.0% | 94.0% |
| Bank account | 97.3% | 94.0% |
Documents where they differ
- Schreinerei Ferdi Schuster · 2025/0939 · Clean image · Mistral Medium 3.5 13/13, Qwen3.8 Flash 0/13
- Bauunternehmung Schröder GmbH · 2026-0622 · Clean image · Mistral Medium 3.5 10/13, Qwen3.8 Flash 0/13
- Meier GmbH · 2025-0264 · Photo · Mistral Medium 3.5 10/13, Qwen3.8 Flash 13/13
- Malerbetrieb Otfried Haas · RE-2025-00168 · Scan · Mistral Medium 3.5 11/13, Qwen3.8 Flash 13/13
- Christoph Haas – Hausmeisterservice · 2025-1432 · Clean image · Mistral Medium 3.5 11/13, Qwen3.8 Flash 13/13
- Ostmetall GmbH · AN-2025-00580 · Clean image · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
- Uwe Hahn · RE2600884 · Clean image · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
- Anneke Kaiser · RE2601022 · Scan · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
Invoice extraction · Spanish (100 documents)
Mistral Medium 3.5 is more accurate by 9.1 pp. Qwen3.8 Flash is 3.4× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.0% | 87.9% |
| Error-free documents | 67% | 74% |
| Per 1,000 documents | $4.75 | $1.40 |
| To fix / 1,000 | 330 | 260 |
| Speed (median) | 2.5 sec | 22.3 sec |
| Valid answers | 100.0% | 90.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 99.0% | 86.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 89.0% |
| VAT ID | 94.0% | 86.0% |
| Invoice number | 100.0% | 89.0% |
| Payment reference | 93.0% | 85.0% |
| Invoice date | 100.0% | 89.0% |
| Tax point | 93.0% | 87.0% |
| Due date | 97.0% | 89.0% |
| Net by tax rate | 85.0% | 86.0% |
| Tax by rate | 100.0% | 90.0% |
| Total | 100.0% | 89.0% |
| Currency | 100.0% | 89.0% |
| Bank account | 100.0% | 89.0% |
Documents where they differ
- Aguirre Formación S.L. · 2025/0652 · Clean image · Mistral Medium 3.5 13/13, Qwen3.8 Flash 0/13
- Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Mistral Medium 3.5 13/13, Qwen3.8 Flash 0/13
- Centro de Formación Centro S.L.U. · A-2025-1405 · Clean image · Mistral Medium 3.5 13/13, Qwen3.8 Flash 0/13
- Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · Mistral Medium 3.5 12/13, Qwen3.8 Flash 0/13
- Talleres Ibérica, S.A. · PF25/1188 · Clean image · Mistral Medium 3.5 13/13, Qwen3.8 Flash 3/13
- Centro de Formación del Sur S.L.U. · F2025-1424 · Scan · Mistral Medium 3.5 11/13, Qwen3.8 Flash 13/13
- Hermanos Peral S.L. · F2025-0581 · Scan · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
- Talleres Rozas Zapata S.L. · FV25-01486 · Clean image · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
Invoice extraction · French (100 documents)
Mistral Medium 3.5 is more accurate by 7.5 pp. Qwen3.8 Flash is 3.9× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 98.2% | 90.6% |
| Error-free documents | 81% | 82% |
| Per 1,000 documents | $4.81 | $1.23 |
| To fix / 1,000 | 190 | 180 |
| Speed (median) | 2.6 sec | 19.8 sec |
| Valid answers | 100.0% | 95.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 99.0% | 91.0% |
| Supplier ID (EIN, IČO…) | 99.0% | 91.0% |
| VAT ID | 98.0% | 91.0% |
| Invoice number | 100.0% | 90.0% |
| Payment reference | 94.0% | 86.0% |
| Invoice date | 100.0% | 91.0% |
| Tax point | 100.0% | 92.0% |
| Due date | 100.0% | 89.0% |
| Net by tax rate | 95.0% | 91.0% |
| Tax by rate | 98.0% | 94.0% |
| Total | 99.0% | 91.0% |
| Currency | 96.0% | 91.0% |
| Bank account | 98.0% | 90.0% |
Documents where they differ
- Établissements Blanc SAS · F-11122 · Scan · Mistral Medium 3.5 11/13, Qwen3.8 Flash 0/13
- Guérin & Fils EURL · 2026-05-688 · Clean image · Mistral Medium 3.5 12/13, Qwen3.8 Flash 1/13
- Nettoyage Mercier SASU · AC-10176 · Clean image · Mistral Medium 3.5 13/13, Qwen3.8 Flash 3/13
- Constance Martin – Rédactrice (EI) · FAC25080663 · Scan · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
- Nettoyage Christine Rivière EI · 2025-12-1174 · Clean image · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
- SA Établissements Gauthier · F2025-1451 · Photo · Mistral Medium 3.5 13/13, Qwen3.8 Flash 12/13
- Lefèvre & Fils SARL · FAC-2026-00198 · Photo · Mistral Medium 3.5 13/13, Qwen3.8 Flash 12/13
- Richard David EI · FAC25091009 · PDF text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 12/13
Email triage · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 2.6 pp. Qwen3.8 Flash is 4.8× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.9% | 97.5% |
| Error-free documents | 57% | 79% |
| Per 1,000 documents | $1.47 | $0.30 |
| To fix / 1,000 | 427 | 213 |
| Speed (median) | 0.8 sec | 8.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 63.3% | 97.3% |
| Sentiment | 90.7% | 80.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 99.3% |
Documents where they differ
- Cody Baldwin · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 9/9
- Danielle Little · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 9/9
- Russell Bates · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Kyle Schwartz · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- James Arnold · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Jane Rubio · Email · Mistral Medium 3.5 9/9, Qwen3.8 Flash 8/9
- Gene Everett · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Dale Sanchez · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
Email triage · Czech (150 documents)
Qwen3.8 Flash is more accurate by 4 pp. Qwen3.8 Flash is 4.4× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.5% | 98.5% |
| Error-free documents | 55% | 87% |
| Per 1,000 documents | $1.95 | $0.45 |
| To fix / 1,000 | 447 | 133 |
| Speed (median) | 0.8 sec | 13.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 63.3% | 99.3% |
| Sentiment | 87.3% | 88.7% |
| Customer name | 100.0% | 99.3% |
| Order number | 100.0% | 99.3% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Simona Kolářová · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 9/9
- Milan Kašpar · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Eduard Stejskal · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Alois Sedlák · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Lucie Kašparová · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Alexandr Kubíček · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Lýdie Tůmová · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Zuzana Brožová · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
Email triage · German (150 documents)
Qwen3.8 Flash is more accurate by 5.1 pp. Qwen3.8 Flash is 4.5× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 92.7% | 97.9% |
| Error-free documents | 48% | 81% |
| Per 1,000 documents | $1.77 | $0.39 |
| To fix / 1,000 | 520 | 187 |
| Speed (median) | 0.8 sec | 12.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 56.7% | 96.0% |
| Sentiment | 78.0% | 84.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Irmela Warmer · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 9/9
- Sibille Lehmann · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 9/9
- Augusta Lange · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 9/9
- Rolf-Peter Metz · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 8/9
- Friedbert Hoffmann · Email · Mistral Medium 3.5 9/9, Qwen3.8 Flash 8/9
- Swantje Noack · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Rosemarie Steuer · Email · Mistral Medium 3.5 8/9, Qwen3.8 Flash 9/9
- Alexej Sauer · Email · Mistral Medium 3.5 7/9, Qwen3.8 Flash 8/9
Personal data detection · English (US) (150 documents)
Mistral Medium 3.5 is more accurate by 0.5 pp. Qwen3.8 Flash is 4.1× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.7% | 99.2% |
| Error-free documents | 98% | 99% |
| Per 1,000 documents | $1.15 | $0.28 |
| To fix / 1,000 | 20 | 13 |
| Speed (median) | 0.8 sec | 7.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Names | 99.3% | 99.3% |
| Email addresses | 100.0% | 99.3% |
| Phone numbers | 100.0% | 99.3% |
| Addresses | 98.7% | 98.7% |
| Dates of birth | 100.0% | 99.3% |
| National IDs | 100.0% | 99.3% |
| Bank accounts | 100.0% | 99.3% |
Documents where they differ
- Margaret Mills · Text · Mistral Medium 3.5 6/7, Qwen3.8 Flash 7/7
Personal data detection · Czech (150 documents)
Mistral Medium 3.5 is more accurate by 2.9 pp. Qwen3.8 Flash is 3.4× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.8% | 97.0% |
| Error-free documents | 99% | 89% |
| Per 1,000 documents | $1.40 | $0.41 |
| To fix / 1,000 | 13 | 113 |
| Speed (median) | 0.8 sec | 9.6 sec |
| Valid answers | 100.0% | 99.3% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Names | 98.7% | 90.7% |
| Email addresses | 100.0% | 98.0% |
| Phone numbers | 100.0% | 97.3% |
| Addresses | 100.0% | 96.7% |
| Dates of birth | 100.0% | 98.0% |
| National IDs | 100.0% | 99.3% |
| Bank accounts | 100.0% | 98.7% |
Documents where they differ
- Zikmund Sedláček · Text · Mistral Medium 3.5 6/7, Qwen3.8 Flash 7/7
- Naděžda Žáková · Text · Mistral Medium 3.5 7/7, Qwen3.8 Flash 6/7
Personal data detection · German (150 documents)
Mistral Medium 3.5 is more accurate by 0.4 pp. Qwen3.8 Flash is 3.9× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.0% | 99.6% |
| Error-free documents | 100% | 99% |
| Per 1,000 documents | $1.38 | $0.36 |
| To fix / 1,000 | 0 | 7 |
| Speed (median) | 0.9 sec | 12.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Names | 100.0% | 99.3% |
| Email addresses | 100.0% | 99.3% |
| Phone numbers | 100.0% | 99.3% |
| Addresses | 100.0% | 99.3% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · English (US) (150 documents)
Mistral Medium 3.5 is more accurate by 3 pp. Qwen3.8 Flash is 3.8× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 98.1% | 95.1% |
| Error-free documents | 87% | 69% |
| Per 1,000 documents | $2.35 | $0.62 |
| To fix / 1,000 | 127 | 307 |
| Speed (median) | 1.1 sec | 14.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Provider | 87.3% | 69.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 88.7% | 69.3% |
| Client ID | 99.3% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 99.3% |
| Governing law | 100.0% | 99.3% |
Documents where they differ
- Santiago-Harris Group Co. · Columbus Printing Inc. · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
- Pittsburgh Construction Co. · Evans Electric LLC · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
- Frye & Sons, Co. · Nunez-Smith Group Inc. · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
- Kim Electric Co. · Ramos & Sons, Co. · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
- Blue Ridge Services Corp. · Bishop-Kim Group LLC · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
- White Landscaping Co. · Douglas-Ali Group LLC · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
- Page Printing LLC · Raleigh Printing Inc. · Contract text · Mistral Medium 3.5 11/13, Qwen3.8 Flash 9/13
- Rose & Sons, Inc. · Eagle Systems Inc. · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 11/13
Contract clauses · Czech (150 documents)
Mistral Medium 3.5 is more accurate by 0.1 pp. Qwen3.8 Flash is 4.9× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.0% | 99.9% |
| Error-free documents | 100% | 99% |
| Per 1,000 documents | $3.06 | $0.63 |
| To fix / 1,000 | 0 | 13 |
| Speed (median) | 1.2 sec | 13.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 98.7% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Interservis s.r.o. · Staněk s.r.o. · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 12/13
Contract clauses · German (150 documents)
Qwen3.8 Flash is more accurate by 0.9 pp. Qwen3.8 Flash is 3.5× cheaper.
| Metric | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.1% | 98.0% |
| Error-free documents | 75% | 87% |
| Per 1,000 documents | $2.76 | $0.78 |
| To fix / 1,000 | 247 | 127 |
| Speed (median) | 1.2 sec | 19.7 sec |
| Valid answers | 100.0% | 99.3% |
Accuracy per field
| Field | Mistral Medium 3.5 | Qwen3.8 Flash |
|---|---|---|
| Provider | 100.0% | 99.3% |
| Provider ID | 82.0% | 94.7% |
| Client | 100.0% | 99.3% |
| Client ID | 80.7% | 94.7% |
| Contract type | 100.0% | 99.3% |
| Price (net) | 100.0% | 99.3% |
| Currency | 100.0% | 99.3% |
| Billing period | 100.0% | 99.3% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 99.3% |
| Notice period (months) | 100.0% | 99.3% |
| Late-payment penalty (% per day) | 100.0% | 99.3% |
| Governing law | 100.0% | 91.3% |
Documents where they differ
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · Mistral Medium 3.5 11/13, Qwen3.8 Flash 13/13
- Richter & Scholz e.K. · Köhler AG · Contract text · Mistral Medium 3.5 11/13, Qwen3.8 Flash 13/13
- Hahn & Schulz GmbH & Co. KG · Alpentec GmbH · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 12/13
- Hansawerk GmbH · Schreinerei Weber AG · Contract text · Mistral Medium 3.5 11/13, Qwen3.8 Flash 10/13
- Kraus Consulting GmbH · Lange Consulting GmbH & Co. KG · Contract text · Mistral Medium 3.5 13/13, Qwen3.8 Flash 12/13
- Neumann Consulting UG (haftungsbeschränkt) · Huber AG · Contract text · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13
- Schulz Systemtechnik GmbH · Elbdata GmbH · Contract text · Mistral Medium 3.5 11/13, Qwen3.8 Flash 12/13
- Winkler GmbH & Co. KG · Berger & Fuchs e.K. · Contract text · Mistral Medium 3.5 12/13, Qwen3.8 Flash 13/13