Comparison
Mistral Large 4 vs Mistral Medium 3.5 Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Mistral Medium 3.5 is more accurate and cheaper in 30 of 30 combinations.
More accurate
Mistral Medium 3.5
wins 18 of 30
Cheaper
Mistral Medium 3.5
cheaper in 30 of 30
Faster
Mistral Medium 3.5
1.0 sec vs 31.5 sec
Fewer fixes
Mistral Medium 3.5
20 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance Difference: Mistral Medium 3.5 vs. Mistral Large 4; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents) Mistral Medium 3.5 is more accurate by 2.4 pp. Mistral Medium 3.5 is 1.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Cochran-Graham Group LLC · A-007505 · Clean image · Mistral Large 4 9/11, Mistral Medium 3.5 11/11 · differs in: Payment reference, Bank account Miranda-Vega Group LLC · 4959 · PDF text · Mistral Large 4 11/11, Mistral Medium 3.5 10/11 · differs in: Net amount by tax rate Raleigh Engineering Inc. · INV253511 · Scan · Mistral Large 4 11/11, Mistral Medium 3.5 10/11 · differs in: Net amount by tax rate Mason-Nelson Group LLC · 2025-3952 · Photo · Mistral Large 4 10/11, Mistral Medium 3.5 11/11 · differs in: Bank account Sarah Villanueva · 2025-7876 · Clean image · Mistral Large 4 10/11, Mistral Medium 3.5 11/11 · differs in: Bank account Gomez & Sons, LLC · 7855 · Scan · Mistral Large 4 10/11, Mistral Medium 3.5 9/11 · differs in: Net amount by tax rate, Tax amount by tax rate, Bank account Jon Miller · INV250236 · Clean image · Mistral Large 4 11/11, Mistral Medium 3.5 10/11 · differs in: Bank account Archer-Smith Group LLC · A-004846 · Scan · Mistral Large 4 10/11, Mistral Medium 3.5 10/11 · differs in: Net amount by tax rate, Bank account Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · Czech (150 documents) Mistral Large 4 is more accurate by 3.6 pp. Mistral Medium 3.5 is 1.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Pavlík a Zeman s.r.o. · 25500457 · Clean image · Mistral Large 4 13/13, Mistral Medium 3.5 9/13 · differs in: Payment reference, Invoice date, Tax point, Due date Hrubý s.r.o. · DB2500960 · Clean image · Mistral Large 4 13/13, Mistral Medium 3.5 9/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Tax point Jiřina Švecová · 25401227 · Clean image · Mistral Large 4 13/13, Mistral Medium 3.5 10/13 · differs in: Supplier ID (EIN, IČO…), VAT ID, Bank account Stejskal, v.o.s. · FV2600175 · Photo · Mistral Large 4 13/13, Mistral Medium 3.5 10/13 · differs in: Invoice date, Tax point, Due date Slavěna Pospíšilová · 26200409 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 10/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID Stavsklad s.r.o. · 2025/1111 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 10/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID Michaela Strnadová · 25600363 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Supplier ID (EIN, IČO…), VAT ID Sedláček s.r.o. · 2025/0774 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Bank account Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · German (150 documents) Mistral Large 4 is more accurate by 0.1 pp. Mistral Medium 3.5 is 1.4× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Ostmetall GmbH · AN-2025-00580 · Clean image · Mistral Large 4 0/13, Mistral Medium 3.5 12/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Dachdeckerei Fischer GmbH · 2025/0014 · Scan · Mistral Large 4 0/13, Mistral Medium 3.5 12/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Meier GmbH · 2025-0264 · Photo · Mistral Large 4 13/13, Mistral Medium 3.5 10/13 · differs in: Invoice date, Tax point, Due date Bauunternehmung Schröder GmbH · 2026-0622 · Clean image · Mistral Large 4 13/13, Mistral Medium 3.5 10/13 · differs in: Supplier, Invoice date, Tax point Druckerei Baumann GmbH · 2025-0324 · Scan · Mistral Large 4 12/13, Mistral Medium 3.5 13/13 · differs in: Bank account Malerbetrieb Otfried Haas · RE-2025-00168 · Scan · Mistral Large 4 12/13, Mistral Medium 3.5 11/13 · differs in: VAT ID, Tax point, Bank account Christoph Haas – Hausmeisterservice · 2025-1432 · Clean image · Mistral Large 4 12/13, Mistral Medium 3.5 11/13 · differs in: VAT ID, Tax point, Bank account Braun IT-Service GmbH · RE2500825 · Photo · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Payment reference Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · Spanish (150 documents) Mistral Medium 3.5 is more accurate by 0.4 pp. Mistral Medium 3.5 is 1.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Ortuño e Hijos, S.L. · FV26-01184 · Scan · Mistral Large 4 0/13, Mistral Medium 3.5 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Centro de Formación del Sur S.L.U. · F2025-1424 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Tax point, Due date Hermanos Peral S.L. · F2025-0581 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Net amount by tax rate Talleres Rozas Zapata S.L. · FV25-01486 · Clean image · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Payment reference Academia Checa S.L. · F2025-0208 · Clean image · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Tax point Leyre Lladó Vall · F2025-1476 · Photo · Mistral Large 4 11/13, Mistral Medium 3.5 12/13 · differs in: Bank account Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Tax point Distribuciones Levante S.L.U. · A-2026-0526 · PDF text · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Net amount by tax rate Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · French (150 documents) Mistral Medium 3.5 is more accurate by 9.6 pp. Mistral Medium 3.5 is 1.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Carrosserie Alain Meunier EI · FAC-2026-00869 · Clean image · Mistral Large 4 0/13, Mistral Medium 3.5 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Novabat SASU · 2026-04-646 · PDF text · Mistral Large 4 0/13, Mistral Medium 3.5 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Bernard et Associés SASU · FAC-2025-01115 · Scan · Mistral Large 4 0/13, Mistral Medium 3.5 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Établissements Michel SA · FAC25100622 · Clean image · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Payment reference, Bank account Nettoyage Mercier SASU · AC-10176 · Clean image · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Supplier, Supplier ID (EIN, IČO…) Établissements Denis SASU · FAC-2025-00031 · Scan · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: VAT ID, Bank account Maçonnerie Arnaude Dumont EI · FAC26021277 · Scan · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Invoice number, Payment reference Établissements Blanc SAS · F-11122 · Scan · Mistral Large 4 12/13, Mistral Medium 3.5 11/13 · differs in: VAT ID, Net amount by tax rate, Currency Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · English (US) (150 documents) Mistral Large 4 is more accurate by 3.9 pp. Mistral Medium 3.5 is 2.4× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Danielle Little · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Russell Bates · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Kyle Schwartz · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority James Arnold · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Gene Everett · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Laurie Knight · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Cody Baldwin · Email · Mistral Large 4 8/9, Mistral Medium 3.5 7/9 · differs in: Priority Dale Sanchez · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · Czech (150 documents) Mistral Large 4 is more accurate by 3.6 pp. Mistral Medium 3.5 is 2.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Milan Kašpar · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Eduard Stejskal · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Alois Sedlák · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Lucie Kašparová · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Sentiment Alexandr Kubíček · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Lýdie Tůmová · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Zuzana Brožová · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Simona Kolářová · Email · Mistral Large 4 8/9, Mistral Medium 3.5 7/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · German (150 documents) Mistral Large 4 is more accurate by 5.1 pp. Mistral Medium 3.5 is 2.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Irmela Warmer · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Sibille Lehmann · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Augusta Lange · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Rolf-Peter Metz · Email · Mistral Large 4 8/9, Mistral Medium 3.5 7/9 · differs in: Priority Friedbert Hoffmann · Email · Mistral Large 4 8/9, Mistral Medium 3.5 9/9 · differs in: Priority Swantje Noack · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Rosemarie Steuer · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Alexej Sauer · Email · Mistral Large 4 8/9, Mistral Medium 3.5 7/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · Spanish (150 documents) Mistral Large 4 is more accurate by 3.8 pp. Mistral Medium 3.5 is 2.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Lucas Santiago · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Mamen Sabater · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Águeda Echeverría · Email · Mistral Large 4 8/9, Mistral Medium 3.5 9/9 · differs in: Priority Anna Barba · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Margarita Zaragoza · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Omar Navarro · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Itziar Gomila · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Amalia Bello · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · French (150 documents) Mistral Large 4 is more accurate by 4.1 pp. Mistral Medium 3.5 is 2.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Édouard Rolland · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Priority, Sentiment Adrien Fischer · Email · Mistral Large 4 9/9, Mistral Medium 3.5 7/9 · differs in: Category, Sentiment Christine Antoine · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Jérôme Aubry · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Sabine Breton · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Alfred Briand · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Jules Weiss · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Paulette Lenoir · Email · Mistral Large 4 9/9, Mistral Medium 3.5 8/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · English (US) (150 documents) Mistral Medium 3.5 is more accurate by 0.1 pp. Mistral Medium 3.5 is 2.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Margaret Mills · Text · Mistral Large 4 7/7, Mistral Medium 3.5 6/7 · differs in: Names Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · Czech (150 documents) Mistral Medium 3.5 is more accurate by 0.5 pp. Mistral Medium 3.5 is 2.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Jonáš Toman · Text · Mistral Large 4 6/7, Mistral Medium 3.5 7/7 · differs in: Addresses Soňa Vítková · Text · Mistral Large 4 6/7, Mistral Medium 3.5 7/7 · differs in: Names Zikmund Sedláček · Text · Mistral Large 4 7/7, Mistral Medium 3.5 6/7 · differs in: Names Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · German (150 documents) Mistral Medium 3.5 is more accurate by 0.5 pp. Mistral Medium 3.5 is 1.9× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Gunnar Zorbach · Text · Mistral Large 4 6/7, Mistral Medium 3.5 7/7 · differs in: Addresses Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · Spanish (150 documents) Mistral Large 4 is more accurate by 0.2 pp. Mistral Medium 3.5 is 2.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · French (150 documents) Mistral Medium 3.5 is more accurate by 0.9 pp. Mistral Medium 3.5 is 2.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Laurent Bertin · Text · Mistral Large 4 7/7, Mistral Medium 3.5 6/7 · differs in: Names Michel Martins · Text · Mistral Large 4 6/7, Mistral Medium 3.5 7/7 · differs in: Addresses Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · English (US) (150 documents) Mistral Medium 3.5 is more accurate by 2 pp. Mistral Medium 3.5 is 2.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Santiago-Harris Group Co. · Columbus Printing Inc. · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client Pittsburgh Construction Co. · Evans Electric LLC · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client Frye & Sons, Co. · Nunez-Smith Group Inc. · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client Kim Electric Co. · Ramos & Sons, Co. · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client Seattle Printing Inc. · Gutierrez Landscaping LLC · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client Blue Ridge Services Corp. · Bishop-Kim Group LLC · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client White Landscaping Co. · Douglas-Ali Group LLC · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider, Client Page Printing LLC · Raleigh Printing Inc. · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Provider, Client Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · Czech (150 documents) Both are equally accurate. Mistral Medium 3.5 is 1.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · German (150 documents) Mistral Large 4 is more accurate by 2.3 pp. Mistral Medium 3.5 is 1.9× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Wesermetall e.K. · Weserform GmbH · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Provider ID, Client ID Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Provider ID, Client ID Hansawerk GmbH · Schreinerei Weber AG · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Provider ID, Client ID Richter & Scholz e.K. · Köhler AG · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Provider ID, Client ID Richter & Albrecht e.K. · Elbmetall UG (haftungsbeschränkt) · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 11/13 · differs in: Provider ID, Client ID Meyer AG · Hartmann GmbH · Contract text · Mistral Large 4 11/13, Mistral Medium 3.5 13/13 · differs in: Provider ID, Client ID Maintec GmbH · Schreinerei Wagner GmbH · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Client ID Neumann Consulting UG (haftungsbeschränkt) · Huber AG · Contract text · Mistral Large 4 13/13, Mistral Medium 3.5 12/13 · differs in: Provider ID Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · Spanish (150 documents) Both are equally accurate. Mistral Medium 3.5 is 1.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · French (150 documents) Mistral Medium 3.5 is more accurate by 0.7 pp. Mistral Medium 3.5 is 1.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · English (US) (150 documents) Both are equally accurate. Mistral Medium 3.5 is 3.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · Czech (150 documents) Mistral Medium 3.5 is more accurate by 16.7 pp. Mistral Medium 3.5 is 4.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Alois Sedlák, Peter Tesař, Rudolf Vítek · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Andrea Dostálová, Mojmír Strnad, Luděk Hruška · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Václav Vítek, Svatoslav Němec · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Teodor Hruška · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Vanda Vacková · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Růžena Sedláková, Alžběta Pokorná · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · German (150 documents) Mistral Medium 3.5 is more accurate by 0.7 pp. Mistral Medium 3.5 is 3.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Dogan Wernecke · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · Spanish (150 documents) Mistral Medium 3.5 is more accurate by 8.7 pp. Mistral Medium 3.5 is 4.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Lucas Santiago · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Mamen Sabater, María Del Carmen Blasco, Victoria Calvet · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Amador Maestre, Marciano Goicoechea · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · French (150 documents) Mistral Medium 3.5 is more accurate by 27.3 pp. Mistral Medium 3.5 is 6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Odette Bourdon · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Sabine Breton, David Coulon · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Augustin Bruneau, Thomas Millet, Aurélie Muller · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Aimée Hamel · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Raymond Bonnin, Hugues Tessier, Grégoire Aubry · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Luce Vasseur · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Daniel Rossi · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · English (US) (150 documents) Mistral Medium 3.5 is more accurate by 1.1 pp. Mistral Medium 3.5 is 2.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · Czech (150 documents) Mistral Medium 3.5 is more accurate by 10.1 pp. Mistral Medium 3.5 is 2.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Jaká je reakční doba u požadavků … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Jak dlouho poskytovatel uchovává zálohy dat? … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Jaká je reakční doba u požadavků … · Document · Mistral Large 4 4/6, Mistral Medium 3.5 6/6 · differs in: Question 2, Question 5 SLA: Na jakou slevu z měsíčního paušálu … · Document · Mistral Large 4 4/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 6 SLA: Jaká smluvní pokuta hrozí poskytovateli za … · Document · Mistral Large 4 4/6, Mistral Medium 3.5 6/6 · differs in: Question 3, Question 4 SLA: Od kterého dne je dokument účinný? … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 6 SLA: Na jakou e-mailovou adresu hlásí objednatel … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 4 SLA: Na jakou e-mailovou adresu hlásí objednatel … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 6 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · German (150 documents) Mistral Medium 3.5 is more accurate by 6.4 pp. Mistral Medium 3.5 is 2.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Welche Vertragsstrafe schuldet der Anbieter bei … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: An welche E-Mail-Adresse meldet der Auftraggeber … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Wie hoch ist die monatliche Pauschale … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 4 SLA: Wie lange bewahrt der Anbieter Datensicherungen … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 3 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · Spanish (150 documents) Mistral Medium 3.5 is more accurate by 5.8 pp. Mistral Medium 3.5 is 2.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: ¿Cuál es el tiempo de respuesta … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿Qué abono sobre la cuota mensual … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿A qué dirección de correo electrónico … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿Cuál es el tiempo de respuesta … · Document · Mistral Large 4 4/6, Mistral Medium 3.5 6/6 · differs in: Question 4, Question 6 SLA: ¿Durante cuánto tiempo conserva el Proveedor … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 3 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · French (150 documents) Mistral Medium 3.5 is more accurate by 7.7 pp. Mistral Medium 3.5 is 2.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Quel est le délai d'intervention pour … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Quel avoir sur la redevance mensuelle … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: À quelle adresse e-mail le Client … · Document · Mistral Large 4 0/6, Mistral Medium 3.5 6/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Quel est le délai d'intervention pour … · Document · Mistral Large 4 4/6, Mistral Medium 3.5 6/6 · differs in: Question 4, Question 6 SLA: À partir de quelle date le … · Document · Mistral Large 4 5/6, Mistral Medium 3.5 6/6 · differs in: Question 6 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.