Comparison
Gemma 4 31B vs Mistral Large 4 Same documents, same prompt: where each model gets it right, what it really costs, and how fast it responds.
Verdict
Gemma 4 31B is more accurate and cheaper in 30 of 30 combinations.
More accurate
Gemma 4 31B
wins 17 of 30
Cheaper
Gemma 4 31B
cheaper in 30 of 30
Faster
Gemma 4 31B
2.9 sec vs 31.5 sec
Fewer fixes
Gemma 4 31B
27 vs 107 documents per 1,000
Across 30 task and document-language combinations (speed and fixes: median).
At a glance Difference: Mistral Large 4 vs. Gemma 4 31B; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents) Gemma 4 31B is more accurate by 2.3 pp. Gemma 4 31B is 39.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Harmon Logistics LLC · INV256017 · Scan · Gemma 4 31B 8/11, Mistral Large 4 11/11 · differs in: Net amount by tax rate, Tax amount by tax rate, Bank account Cochran-Graham Group LLC · A-007505 · Clean image · Gemma 4 31B 11/11, Mistral Large 4 9/11 · differs in: Payment reference, Bank account Austin Landscaping Inc. · INV-17836 · Scan · Gemma 4 31B 9/11, Mistral Large 4 11/11 · differs in: Supplier ID (EIN, IČO…), Bank account Summit Services Inc. · INV-15230 · Scan · Gemma 4 31B 10/11, Mistral Large 4 11/11 · differs in: Bank account Jennifer Moore · 5113 · Scan · Gemma 4 31B 10/11, Mistral Large 4 11/11 · differs in: Bank account Archer-Smith Group LLC · A-004846 · Scan · Gemma 4 31B 11/11, Mistral Large 4 10/11 · differs in: Bank account Gomez & Sons, LLC · 7855 · Scan · Gemma 4 31B 9/11, Mistral Large 4 10/11 · differs in: Net amount by tax rate, Tax amount by tax rate, Bank account Johnson Electric LLC · INV251373 · Photo · Gemma 4 31B 10/11, Mistral Large 4 11/11 · differs in: Net amount by tax rate Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · Czech (150 documents) Mistral Large 4 is more accurate by 1 pp. Gemma 4 31B is 26.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Jiřina Švecová · 25401227 · Clean image · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Supplier, Bank account Bednář spol. s r.o. · 20250610 · Clean image · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Invoice date, Tax point Stejskal, v.o.s. · FV2600175 · Photo · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Supplier, Due date Ekolog s.r.o. · FV2600132 · Scan · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Invoice date, Bank account Hruška a Šťastný s.r.o. · 2025/0324 · Clean image · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Payment reference Moravská energetická spol. s r.o. · 25101373 · Scan · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Bank account Michaela Strnadová · 25600363 · Scan · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Supplier ID (EIN, IČO…) Holub s.r.o. · FV2500655 · Scan · Gemma 4 31B 12/13, Mistral Large 4 11/13 · differs in: Supplier ID (EIN, IČO…), VAT ID, Tax amount by tax rate Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · German (150 documents) Mistral Large 4 is more accurate by 2.6 pp. Gemma 4 31B is 33.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Ostmetall GmbH · AN-2025-00580 · Clean image · Gemma 4 31B 13/13, Mistral Large 4 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Dachdeckerei Fischer GmbH · 2025/0014 · Scan · Gemma 4 31B 10/13, Mistral Large 4 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Wesermetall GmbH · RE2501375 · Scan · Gemma 4 31B 9/13, Mistral Large 4 13/13 · differs in: Invoice date, Tax point, Due date, Bank account Spedition Müller GmbH · 2026-1446 · Scan · Gemma 4 31B 8/13, Mistral Large 4 12/13 · differs in: VAT ID, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Bank account Zimmermann & Schulz GmbH · RE11274 · Scan · Gemma 4 31B 10/13, Mistral Large 4 13/13 · differs in: Invoice date, Tax point, Due date Schmidt & Bauer GmbH & Co. KG · RE-2025-01397 · Scan · Gemma 4 31B 10/13, Mistral Large 4 13/13 · differs in: Invoice date, Tax point, Bank account Richter GmbH & Co. KG · 2025-0509 · Clean image · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Invoice date, Tax point Nordtec GmbH & Co. KG · RE-2025-00909 · Scan · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Currency, Bank account Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · Spanish (150 documents) Mistral Large 4 is more accurate by 1.9 pp. Gemma 4 31B is 37× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Ortuño e Hijos, S.L. · FV26-01184 · Scan · Gemma 4 31B 13/13, Mistral Large 4 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Hermanos Peral S.L. · F2025-0581 · Scan · Gemma 4 31B 10/13, Mistral Large 4 13/13 · differs in: Supplier ID (EIN, IČO…), VAT ID, Net amount by tax rate Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Invoice date, Due date Talavera y Aller Asociados, S.L. · 2025/0610 · Scan · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Payment reference, Bank account Distribuciones Mayo Santana, S.L.U. · A-2025-0563 · Clean image · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Supplier ID (EIN, IČO…), VAT ID Talleres Rozas Zapata S.L. · FV25-01486 · Clean image · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Bank account Construcciones del Norte S.L.U. · PF25/0020 · Clean image · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Payment reference Rebeca Silva Miranda · FV25-00491 · Scan · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Bank account Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Invoice extraction · French (150 documents) Gemma 4 31B is more accurate by 4.6 pp. Gemma 4 31B is 39.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Novabat SASU · 2026-04-646 · PDF text · Gemma 4 31B 13/13, Mistral Large 4 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Carrosserie Alain Meunier EI · FAC-2026-00869 · Clean image · Gemma 4 31B 12/13, Mistral Large 4 0/13 · differs in: Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account Bernard et Associés SASU · FAC-2025-01115 · Scan · Gemma 4 31B 11/13, Mistral Large 4 0/13 · differs in: Supplier, VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency Lefèvre & Fils SARL · FAC-2026-00198 · Photo · Gemma 4 31B 8/13, Mistral Large 4 13/13 · differs in: Invoice date, Tax point, Due date, Net amount by tax rate, Bank account Guérin & Fils EURL · 2026-05-688 · Clean image · Gemma 4 31B 10/13, Mistral Large 4 13/13 · differs in: VAT ID, Net amount by tax rate, Bank account Établissements Michel SA · FAC25100622 · Clean image · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Payment reference, Bank account Établissements Denis SASU · FAC-2025-00031 · Scan · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: VAT ID, Bank account Nettoyage Christine Rivière EI · 2025-12-1174 · Clean image · Gemma 4 31B 11/13, Mistral Large 4 13/13 · differs in: Supplier ID (EIN, IČO…), Bank account Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · English (US) (150 documents) Mistral Large 4 is more accurate by 2.2 pp. Gemma 4 31B is 29.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Sheila Evans · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Gene Everett · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Laurie Knight · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Cody Baldwin · Email · Gemma 4 31B 9/9, Mistral Large 4 8/9 · differs in: Sentiment Jason Davis · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Daniel Stewart · Email · Gemma 4 31B 7/9, Mistral Large 4 8/9 · differs in: Priority Allison Floyd · Email · Gemma 4 31B 7/9, Mistral Large 4 8/9 · differs in: Priority Christine Copeland · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · Czech (150 documents) Mistral Large 4 is more accurate by 1 pp. Gemma 4 31B is 27.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Alois Sedlák · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Lucie Kašparová · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Simona Kolářová · Email · Gemma 4 31B 9/9, Mistral Large 4 8/9 · differs in: Sentiment Natálie Kratochvílová · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Šimon Beran · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Magdalena Sedláčková · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Ctibor Dušek · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Vanda Vacková · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · German (150 documents) Mistral Large 4 is more accurate by 2.7 pp. Gemma 4 31B is 25.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Alexej Sauer · Email · Gemma 4 31B 7/9, Mistral Large 4 8/9 · differs in: Priority Sylwia Gerlach · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Benedikt Speer · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Cristina Krause · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Cynthia Hahn · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Roselinde Heinz · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Linda Bähr · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Nadja Wiek · Email · Gemma 4 31B 9/9, Mistral Large 4 8/9 · differs in: Sentiment Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · Spanish (150 documents) Mistral Large 4 is more accurate by 0.8 pp. Gemma 4 31B is 27.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Lucas Santiago · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Albert Blanco · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Elena Arrieta · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Reyna Pardo · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Lucho Marco · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Eutropio Piñeiro · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Paca Ibañez · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Agustina Cañellas · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Email triage · French (150 documents) Mistral Large 4 is more accurate by 2.1 pp. Gemma 4 31B is 23.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Paul Chauvet · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Amélie Turpin · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Alfred Briand · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Capucine Maréchal · Email · Gemma 4 31B 9/9, Mistral Large 4 8/9 · differs in: Sentiment Adrien Fischer · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Sylvie Duhamel · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Deadline Augustin Bruneau · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Sentiment Aimée Hamel · Email · Gemma 4 31B 8/9, Mistral Large 4 9/9 · differs in: Priority Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · English (US) (150 documents) Gemma 4 31B is more accurate by 0.3 pp. Gemma 4 31B is 34.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · Czech (150 documents) Gemma 4 31B is more accurate by 0.5 pp. Gemma 4 31B is 26.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Jonáš Toman · Text · Gemma 4 31B 7/7, Mistral Large 4 6/7 · differs in: Addresses Soňa Vítková · Text · Gemma 4 31B 7/7, Mistral Large 4 6/7 · differs in: Names Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · German (150 documents) Gemma 4 31B is more accurate by 0.4 pp. Gemma 4 31B is 25.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · Spanish (150 documents) Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 30.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Personal data detection · French (150 documents) Gemma 4 31B is more accurate by 1.1 pp. Gemma 4 31B is 24.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Michel Martins · Text · Gemma 4 31B 7/7, Mistral Large 4 6/7 · differs in: Addresses Susanne Couturier · Text · Gemma 4 31B 7/7, Mistral Large 4 6/7 · differs in: Names Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · English (US) (150 documents) Gemma 4 31B is more accurate by 3.5 pp. Gemma 4 31B is 29.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Santiago-Harris Group Co. · Columbus Printing Inc. · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Pittsburgh Construction Co. · Evans Electric LLC · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Frye & Sons, Co. · Nunez-Smith Group Inc. · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Kim Electric Co. · Ramos & Sons, Co. · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Seattle Printing Inc. · Gutierrez Landscaping LLC · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Blue Ridge Services Corp. · Bishop-Kim Group LLC · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client White Landscaping Co. · Douglas-Ali Group LLC · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Welch-Krause Group Corp. · Cain-Jackson Group LLC · Contract text · Gemma 4 31B 13/13, Mistral Large 4 11/13 · differs in: Provider, Client Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · Czech (150 documents) Both are equally accurate. Gemma 4 31B is 18× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · German (150 documents) Mistral Large 4 is more accurate by 5 pp. Gemma 4 31B is 23.3× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · Spanish (150 documents) Mistral Large 4 is more accurate by 5.6 pp. Gemma 4 31B is 20.4× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Gráficas Levante S.L. · Distribuciones Durán Martin S.L.U. · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Hermanos Corominas, S.L. · Eutimio Galán Redondo – Fontanería · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Armas Asesores S.L. · Bermejo y Mata Asociados S.L. · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Gráficas Perales Fortuny, S.L. · Anunciación Nogueira Cepeda · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Leiva e Hijos S.L. · Elías Peñalver Delgado – Electricidad · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Carpintería Gargallo Arévalo, S.L. · Gráficas Reyes Macías S.L.U. · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Araujo y Costa Asociados, S.L. · Domínguez Logística S.L. · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Jacinta Gual Polo – Pintura y decoración · Lladó y Checa Asociados S.A. · Contract text · Gemma 4 31B 12/13, Mistral Large 4 13/13 · differs in: Late-payment penalty (% per day) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Contract clauses · French (150 documents) Mistral Large 4 is more accurate by 4.7 pp. Gemma 4 31B is 18× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · English (US) (150 documents) Both are equally accurate. Gemma 4 31B is 44.1× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · Czech (150 documents) Gemma 4 31B is more accurate by 16.7 pp. Gemma 4 31B is 56.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Alois Sedlák, Peter Tesař, Rudolf Vítek · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Andrea Dostálová, Mojmír Strnad, Luděk Hruška · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Václav Vítek, Svatoslav Němec · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Teodor Hruška · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Vanda Vacková · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Růžena Sedláková, Alžběta Pokorná · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · German (150 documents) Gemma 4 31B is more accurate by 0.7 pp. Gemma 4 31B is 44.2× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Dogan Wernecke · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · Spanish (150 documents) Gemma 4 31B is more accurate by 8.3 pp. Gemma 4 31B is 50.7× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Lucas Santiago · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Amador Maestre, Marciano Goicoechea · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Mamen Sabater, María Del Carmen Blasco, Victoria Calvet · Document · Gemma 4 31B 5/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Document summaries · French (150 documents) Gemma 4 31B is more accurate by 26.4 pp. Gemma 4 31B is 68.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Odette Bourdon · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Sabine Breton, David Coulon · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Augustin Bruneau, Thomas Millet, Aurélie Muller · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Aimée Hamel · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Raymond Bonnin, Hugues Tessier, Grégoire Aubry · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Luce Vasseur · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Daniel Rossi · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words) Agathe Leroy · Document · Gemma 4 31B 5/6, Mistral Large 4 6/6 · differs in: Amounts Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · English (US) (150 documents) Gemma 4 31B is more accurate by 1.1 pp. Gemma 4 31B is 26.9× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · Czech (150 documents) Gemma 4 31B is more accurate by 10.1 pp. Gemma 4 31B is 33.5× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Jaká je reakční doba u požadavků … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Jak dlouho poskytovatel uchovává zálohy dat? … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Jaká je reakční doba u požadavků … · Document · Gemma 4 31B 6/6, Mistral Large 4 4/6 · differs in: Question 2, Question 5 SLA: Na jakou slevu z měsíčního paušálu … · Document · Gemma 4 31B 6/6, Mistral Large 4 4/6 · differs in: Question 1, Question 6 SLA: Jaká smluvní pokuta hrozí poskytovateli za … · Document · Gemma 4 31B 6/6, Mistral Large 4 4/6 · differs in: Question 3, Question 4 SLA: Od kterého dne je dokument účinný? … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 6 SLA: Na jakou e-mailovou adresu hlásí objednatel … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 4 SLA: Na jakou e-mailovou adresu hlásí objednatel … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 6 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · German (150 documents) Gemma 4 31B is more accurate by 6.4 pp. Gemma 4 31B is 31.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Welche Vertragsstrafe schuldet der Anbieter bei … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: An welche E-Mail-Adresse meldet der Auftraggeber … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Wie hoch ist die monatliche Pauschale … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 4 SLA: Wie lange bewahrt der Anbieter Datensicherungen … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 3 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · Spanish (150 documents) Gemma 4 31B is more accurate by 5.8 pp. Gemma 4 31B is 31.6× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: ¿Cuál es el tiempo de respuesta … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿Qué abono sobre la cuota mensual … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿A qué dirección de correo electrónico … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: ¿Cuál es el tiempo de respuesta … · Document · Gemma 4 31B 6/6, Mistral Large 4 4/6 · differs in: Question 4, Question 6 SLA: ¿Durante cuánto tiempo conserva el Proveedor … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 3 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.
Questions about a document · French (150 documents) Gemma 4 31B is more accurate by 7.7 pp. Gemma 4 31B is 29.8× cheaper.
Accuracy per field Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ SLA: Quel est le délai d'intervention pour … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Quel avoir sur la redevance mensuelle … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: À quelle adresse e-mail le Client … · Document · Gemma 4 31B 6/6, Mistral Large 4 0/6 · differs in: Question 1, Question 2, Question 3, Question 4, Question 5, Question 6 SLA: Quel est le délai d'intervention pour … · Document · Gemma 4 31B 6/6, Mistral Large 4 4/6 · differs in: Question 4, Question 6 SLA: À partir de quelle date le … · Document · Gemma 4 31B 6/6, Mistral Large 4 5/6 · differs in: Question 6 Free with login
Accuracy field by field and the documents where the models differ.
Unlock for free Just your email, no password.