Comparison
Mistral Large 4 vs Qwen3.8 Flash Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Mistral Large 4 is more accurate; Qwen3.8 Flash is cheaper in 30 of 30 combinations.
More accurate
Mistral Large 4
wins 14 of 30
Cheaper
Qwen3.8 Flash
cheaper in 30 of 30
Faster
Qwen3.8 Flash
14.1 sec vs 31.5 sec
Fewer fixes
Qwen3.8 Flash
67 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance Difference: Qwen3.8 Flash vs. Mistral Large 4; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents) Mistral Large 4 is more accurate by 13 pp. Qwen3.8 Flash is 5.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Reid Office Products LLC · A-003849 · Scan · Mistral Large 4 11/11, Qwen3.8 Flash 0/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Eagle Partners Co. · 4272 · Clean image · Mistral Large 4 11/11, Qwen3.8 Flash 0/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Raleigh Engineering Inc. · INV253511 · Scan · Mistral Large 4 11/11, Qwen3.8 Flash 1/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Hughes Janitorial Services Corp. · A-001911 · Scan · Mistral Large 4 11/11, Qwen3.8 Flash 1/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency Summit Services Inc. · INV-15230 · Scan · Mistral Large 4 11/11, Qwen3.8 Flash 2/11 · differs in: Supplier, Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Total, Currency, Bank account Miranda-Vega Group LLC · 4959 · PDF text · Mistral Large 4 11/11, Qwen3.8 Flash 8/11 · differs in: Payment reference, Net amount by tax rate, Tax amount by tax rate Cochran-Graham Group LLC · A-007505 · Clean image · Mistral Large 4 9/11, Qwen3.8 Flash 11/11 · differs in: Payment reference, Bank account Liberty Systems Inc. · INV-17299 · PDF text · Mistral Large 4 11/11, Qwen3.8 Flash 9/11 · differs in: Net amount by tax rate, Tax amount by tax rate Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · Czech (150 documents) Mistral Large 4 is more accurate by 5.3 pp. Qwen3.8 Flash is 5.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Sedláček s.r.o. · 2025/0774 · Scan · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Sedlák s.r.o. · 20250158 · Photo · Mistral Large 4 12/13, Qwen3.8 Flash 9/13 · differs in: Supplier, Payment reference, Net amount by tax rate, Tax amount by tax rate, Bank account Dvořák s.r.o. · FV2501487 · PDF text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate Hruška spol. s r.o. · 20250328 · PDF text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate Stavmet s.r.o. · 20250906 · PDF text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate Východočeská obchodní s.r.o. · FV2600186 · PDF text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate Holub s.r.o. · FV2500655 · Scan · Mistral Large 4 11/13, Qwen3.8 Flash 13/13 · differs in: Supplier ID (EIN, IČO…), VAT ID Mareš s.r.o. · FV2600300 · PDF text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · German (150 documents) Mistral Large 4 is more accurate by 4 pp. Qwen3.8 Flash is 6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Ostmetall GmbH · AN-2025-00580 · Clean image · Mistral Large 4 0/13, Qwen3.8 Flash 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Bauunternehmung Schröder GmbH · 2026-0622 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Schreinerei Ferdi Schuster · 2025/0939 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Dachdeckerei Fischer GmbH · 2025/0014 · Scan · Mistral Large 4 0/13, Qwen3.8 Flash 12/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Druckerei Baumann GmbH · 2025-0324 · Scan · Mistral Large 4 12/13, Qwen3.8 Flash 13/13 · differs in: Bank account Malerbetrieb Otfried Haas · RE-2025-00168 · Scan · Mistral Large 4 12/13, Qwen3.8 Flash 13/13 · differs in: Bank account Christoph Haas – Hausmeisterservice · 2025-1432 · Clean image · Mistral Large 4 12/13, Qwen3.8 Flash 13/13 · differs in: Bank account Braun IT-Service GmbH · RE2500825 · Photo · Mistral Large 4 13/13, Qwen3.8 Flash 12/13 · differs in: Payment reference Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · Spanish (150 documents) Mistral Large 4 is more accurate by 7.6 pp. Qwen3.8 Flash is 5.4× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Aguirre Formación S.L. · 2025/0652 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Ortuño e Hijos, S.L. · FV26-01184 · Scan · Mistral Large 4 0/13, Qwen3.8 Flash 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Centro de Formación Centro S.L.U. · A-2025-1405 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Talleres Ibérica, S.A. · PF25/1188 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 3/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Due date, Total, Currency, Bank account Construcciones del Norte S.L.U. · PF25/0020 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 12/13 · differs in: Tax point Climatización Levante S.L. · F2025-1305 · Scan · Mistral Large 4 12/13, Qwen3.8 Flash 13/13 · differs in: Supplier Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · French (150 documents) Qwen3.8 Flash is more accurate by 1.5 pp. Qwen3.8 Flash is 6.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Carrosserie Alain Meunier EI · FAC-2026-00869 · Clean image · Mistral Large 4 0/13, Qwen3.8 Flash 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Novabat SASU · 2026-04-646 · PDF text · Mistral Large 4 0/13, Qwen3.8 Flash 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Bernard et Associés SASU · FAC-2025-01115 · Scan · Mistral Large 4 0/13, Qwen3.8 Flash 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Établissements Blanc SAS · F-11122 · Scan · Mistral Large 4 12/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Guérin & Fils EURL · 2026-05-688 · Clean image · Mistral Large 4 13/13, Qwen3.8 Flash 1/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Total, Currency, Bank account Nettoyage Mercier SASU · AC-10176 · Clean image · Mistral Large 4 11/13, Qwen3.8 Flash 3/13 · differs in: VAT ID, Invoice number, Payment reference, Invoice date, Due date, Total, Currency, Bank account Établissements Michel SA · FAC25100622 · Clean image · Mistral Large 4 11/13, Qwen3.8 Flash 13/13 · differs in: Payment reference, Bank account Établissements Denis SASU · FAC-2025-00031 · Scan · Mistral Large 4 11/13, Qwen3.8 Flash 13/13 · differs in: VAT ID, Bank account Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · English (US) (150 documents) Mistral Large 4 is more accurate by 1.3 pp. Qwen3.8 Flash is 11.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Angela Harmon · Email · Mistral Large 4 9/9, Qwen3.8 Flash 7/9 · differs in: Priority, Deadline Jane Rubio · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Laurie Knight · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Cody Baldwin · Email · Mistral Large 4 8/9, Qwen3.8 Flash 9/9 · differs in: Sentiment Joseph Jackson · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · Czech (150 documents) Qwen3.8 Flash is more accurate by 0.4 pp. Qwen3.8 Flash is 9.9× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Simona Kolářová · Email · Mistral Large 4 8/9, Qwen3.8 Flash 9/9 · differs in: Sentiment Milan Matějka · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Růžena Sedláková · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · German (150 documents) Both are equally accurate. Qwen3.8 Flash is 9.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Linda Bähr · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · Spanish (150 documents) Mistral Large 4 is more accurate by 1.2 pp. Qwen3.8 Flash is 8.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Candelas Serra · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Lorenzo Giménez · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Águeda Echeverría · Email · Mistral Large 4 8/9, Qwen3.8 Flash 9/9 · differs in: Priority Anna Barba · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Lucas Santiago · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Albert Blanco · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Sentiment Serafina Catalán · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Reyna Pardo · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · French (150 documents) Mistral Large 4 is more accurate by 1.9 pp. Qwen3.8 Flash is 8.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Élisabeth Gimenez · Email · Mistral Large 4 9/9, Qwen3.8 Flash 7/9 · differs in: Priority, Sentiment Suzanne Marchal · Email · Mistral Large 4 9/9, Qwen3.8 Flash 7/9 · differs in: Category, Priority Sabine Breton · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Amélie Turpin · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Michelle Riou · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Gérard Fournier · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Adrien Fischer · Email · Mistral Large 4 9/9, Qwen3.8 Flash 8/9 · differs in: Priority Raymond Bonnin · Email · Mistral Large 4 8/9, Qwen3.8 Flash 9/9 · differs in: Sentiment Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · English (US) (150 documents) Mistral Large 4 is more accurate by 0.4 pp. Qwen3.8 Flash is 10.4× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · Czech (150 documents) Mistral Large 4 is more accurate by 2.4 pp. Qwen3.8 Flash is 7.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Jonáš Toman · Text · Mistral Large 4 6/7, Qwen3.8 Flash 7/7 · differs in: Addresses Soňa Vítková · Text · Mistral Large 4 6/7, Qwen3.8 Flash 7/7 · differs in: Names Naděžda Žáková · Text · Mistral Large 4 7/7, Qwen3.8 Flash 6/7 · differs in: Names Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · German (150 documents) Qwen3.8 Flash is more accurate by 0.1 pp. Qwen3.8 Flash is 7.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Gunnar Zorbach · Text · Mistral Large 4 6/7, Qwen3.8 Flash 7/7 · differs in: Addresses Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · Spanish (150 documents) Both are equally accurate. Qwen3.8 Flash is 8.4× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · French (150 documents) Qwen3.8 Flash is more accurate by 1 pp. Qwen3.8 Flash is 7.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Michel Martins · Text · Mistral Large 4 6/7, Qwen3.8 Flash 7/7 · differs in: Addresses Susanne Couturier · Text · Mistral Large 4 6/7, Qwen3.8 Flash 7/7 · differs in: Names Édouard Leroy · Text · Mistral Large 4 7/7, Qwen3.8 Flash 6/7 · differs in: Names Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · English (US) (150 documents) Mistral Large 4 is more accurate by 1 pp. Qwen3.8 Flash is 8.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Page Printing LLC · Raleigh Printing Inc. · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 9/13 · differs in: Provider, Client, Effective date, Governing law Seattle Printing Inc. · Gutierrez Landscaping LLC · Contract text · Mistral Large 4 11/13, Qwen3.8 Flash 13/13 · differs in: Provider, Client Rose & Sons, Inc. · Eagle Systems Inc. · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Provider, Client Frontier Solutions Inc. · San Diego Office Products Co. · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Provider, Client Brooks-Johnson Group Inc. · Gallegos-Mullen Group Inc. · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Provider, Client Rodriguez-Patel Group Co. · Orozco-Bryant Group Inc. · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Provider, Client Wilson Supply Inc. · Jones Logistics Corp. · Contract text · Mistral Large 4 11/13, Qwen3.8 Flash 13/13 · differs in: Provider, Client Blue Ridge Services Co. · Foster Janitorial Services Corp. · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Provider, Client Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · Czech (150 documents) Mistral Large 4 is more accurate by 0.1 pp. Qwen3.8 Flash is 7.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · German (150 documents) Mistral Large 4 is more accurate by 1.4 pp. Qwen3.8 Flash is 6.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Hansawerk GmbH · Schreinerei Weber AG · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 10/13 · differs in: Provider ID, Client ID, Governing law Wesermetall e.K. · Weserform GmbH · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 11/13 · differs in: Provider ID, Client ID Meyer AG · Hartmann GmbH · Contract text · Mistral Large 4 11/13, Qwen3.8 Flash 13/13 · differs in: Provider ID, Client ID Hahn & Schulz GmbH & Co. KG · Alpentec GmbH · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 12/13 · differs in: Governing law Maintec GmbH · Schreinerei Wagner GmbH · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 12/13 · differs in: Governing law Kraus Consulting GmbH · Lange Consulting GmbH & Co. KG · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 12/13 · differs in: Governing law Schulz Systemtechnik GmbH · Elbdata GmbH · Contract text · Mistral Large 4 11/13, Qwen3.8 Flash 12/13 · differs in: Provider ID, Client ID, Governing law Richter & Albrecht e.K. · Elbmetall UG (haftungsbeschränkt) · Contract text · Mistral Large 4 13/13, Qwen3.8 Flash 12/13 · differs in: Governing law Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · Spanish (150 documents) Both are equally accurate. Qwen3.8 Flash is 8.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · French (150 documents) Qwen3.8 Flash is more accurate by 0.2 pp. Qwen3.8 Flash is 7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · English (US) (150 documents) Mistral Large 4 is more accurate by 0.1 pp. Qwen3.8 Flash is 7.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · Czech (150 documents) Qwen3.8 Flash is more accurate by 12.1 pp. Qwen3.8 Flash is 7.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Alois Sedlák, Peter Tesař, Rudolf Vítek · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Andrea Dostálová, Mojmír Strnad, Luděk Hruška · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Václav Vítek, Svatoslav Němec · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Blanka Krausová · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Magdalena Sedláčková · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Teodor Hruška · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Milan Matějka, Jana Dostálová, Zora Fialová · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Vanda Vacková · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · German (150 documents) Mistral Large 4 is more accurate by 4 pp. Qwen3.8 Flash is 5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Dogan Wernecke · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Helen Noack, Pietro Birnbaum, Mehmet Lorch · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · Spanish (150 documents) Qwen3.8 Flash is more accurate by 3.1 pp. Qwen3.8 Flash is 6.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Lucas Santiago · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Mamen Sabater, María Del Carmen Blasco, Victoria Calvet · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Amador Maestre, Marciano Goicoechea · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Santiago Manzano, Crescencia Jover · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Julieta Acuña, Paloma Chaparro, Ana Belén Parejo · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · French (150 documents) Qwen3.8 Flash is more accurate by 23.7 pp. Qwen3.8 Flash is 7.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Odette Bourdon · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Sabine Breton, David Coulon · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Capucine Maréchal, Victor Perez · Document · Mistral Large 4 6/6, Qwen3.8 Flash 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Augustin Bruneau, Thomas Millet, Aurélie Muller · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Aimée Hamel · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Raymond Bonnin, Hugues Tessier, Grégoire Aubry · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Luce Vasseur · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Daniel Rossi · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · English (US) (150 documents) Qwen3.8 Flash is more accurate by 0.9 pp. Qwen3.8 Flash is 9.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · Czech (150 documents) Qwen3.8 Flash is more accurate by 4.3 pp. Qwen3.8 Flash is 9.9× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Jak dlouho poskytovatel uchovává zálohy dat? … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Jaká je reakční doba u požadavků … · Document · Mistral Large 4 6/6, Qwen3.8 Flash 1/6 · differs in: Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Na jakou e-mailovou adresu hlásí objednatel … · Document · Mistral Large 4 5/6, Qwen3.8 Flash 0/6 · differs in: Question 1, Question 2, Question 3, Question 5, Question 6 SLA: Jaká je reakční doba u požadavků … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 4/6 · differs in: Question 1, Question 2, Question 3, Question 5 SLA: Na jakou slevu z měsíčního paušálu … · Document · Mistral Large 4 6/6, Qwen3.8 Flash 3/6 · differs in: Question 1, Question 3, Question 6 SLA: Jaká je reakční doba u požadavků … · Document · Mistral Large 4 4/6, Qwen3.8 Flash 6/6 · differs in: Question 2, Question 5 SLA: Jaká smluvní pokuta hrozí poskytovateli za … · Document · Mistral Large 4 4/6, Qwen3.8 Flash 6/6 · differs in: Question 3, Question 4 SLA: Na jakou slevu z měsíčního paušálu … · Document · Mistral Large 4 6/6, Qwen3.8 Flash 5/6 · differs in: Question 1 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · German (150 documents) Qwen3.8 Flash is more accurate by 5.3 pp. Qwen3.8 Flash is 12.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Welche Vertragsstrafe schuldet der Anbieter bei … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: An welche E-Mail-Adresse meldet der Auftraggeber … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Wie lang ist die Reaktionszeit bei … · Document · Mistral Large 4 6/6, Qwen3.8 Flash 4/6 · differs in: Question 5, Question 6 SLA: Wie lange bewahrt der Anbieter Datensicherungen … · Document · Mistral Large 4 5/6, Qwen3.8 Flash 6/6 · differs in: Question 3 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · Spanish (150 documents) Qwen3.8 Flash is more accurate by 5.4 pp. Qwen3.8 Flash is 10.9× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: ¿Cuál es el tiempo de respuesta … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿Qué abono sobre la cuota mensual … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿A qué dirección de correo electrónico … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿Cuál es el tiempo de respuesta … · Document · Mistral Large 4 4/6, Qwen3.8 Flash 6/6 · differs in: Question 4, Question 6 SLA: ¿Durante cuánto tiempo conserva el Proveedor … · Document · Mistral Large 4 5/6, Qwen3.8 Flash 6/6 · differs in: Question 3 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · French (150 documents) Qwen3.8 Flash is more accurate by 6.5 pp. Qwen3.8 Flash is 10.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Quel est le délai d'intervention pour … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Quel avoir sur la redevance mensuelle … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: À quelle adresse e-mail le Client … · Document · Mistral Large 4 0/6, Qwen3.8 Flash 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Quel avoir sur la redevance mensuelle … · Document · Mistral Large 4 6/6, Qwen3.8 Flash 4/6 · differs in: Question 5, Question 6 SLA: À partir de quelle date le … · Document · Mistral Large 4 5/6, Qwen3.8 Flash 6/6 · differs in: Question 6 SLA: Quel avoir sur la redevance mensuelle … · Document · Mistral Large 4 6/6, Qwen3.8 Flash 5/6 · differs in: Question 5 SLA: Quel est le délai d'intervention pour … · Document · Mistral Large 4 4/6, Qwen3.8 Flash 4/6 · differs in: Question 4, Question 5 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.