ModelVerdict

Language gap

Language gap: how much worse a model does outside English

Same kinds of documents, same instructions, different language. The gap shows how much accuracy a model loses on documents in another language compared with English ones.

Invoice extraction · Czech

ModelCorrect fields 82% – 100%EnglishCzechGapError-free documents (Czech / English)
Qwen3.8 Flash
Qwen
82.36%91.33%+9.0 pp76.67% / 57.33%
Mistral Large 4
Mistral
95.39%97.09%+1.7 pp88.67% / 77.33%
DeepSeek V4.1 Flash
DeepSeek
99.39%99.88%+0.5 pp98.67% / 93.33%
Claude Sonnet 5
Anthropic
99.82%100.00%+0.2 pp100.00% / 98.67%
Gemini 3.5 Flash Lite
Google
99.21%99.39%+0.2 pp93.33% / 92.00%
Gemini 3.8 Flash
Google
99.82%99.94%+0.1 pp99.33% / 98.00%
GPT-6 Sol
OpenAI
99.94%99.88%−0.1 pp98.67% / 99.33%
Claude Haiku 5.5
Anthropic
100.00%99.94%−0.1 pp99.33% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%99.94%−0.1 pp99.33% / 100.00%
GLM-5.3 Flash
Z.ai
99.94%99.64%−0.3 pp96.67% / 99.33%
Mistral Small 4
Mistral
95.58%95.21%−0.4 pp65.33% / 58.00%
GPT-6 Luna
OpenAI
99.70%99.33%−0.4 pp94.00% / 96.67%
Gemma 4 31B
Google
97.64%96.12%−1.5 pp66.67% / 81.33%
Mistral Medium 3.5
Mistral
97.76%94.85%−2.9 pp67.33% / 79.33%

Only fields present in both language versions of the document are compared (Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Invoice extraction · German

ModelCorrect fields 82% – 100%EnglishGermanGapError-free documents (German / English)
Qwen3.8 Flash
Qwen
82.36%93.39%+11.0 pp87.33% / 57.33%
Mistral Large 4
Mistral
95.39%97.45%+2.1 pp92.00% / 77.33%
Gemini 3.5 Flash Lite
Google
99.21%100.00%+0.8 pp100.00% / 92.00%
Mistral Medium 3.5
Mistral
97.76%98.12%+0.4 pp81.33% / 79.33%
DeepSeek V4.1 Flash
DeepSeek
99.39%99.58%+0.2 pp95.33% / 93.33%
Mistral Small 4
Mistral
95.58%95.64%+0.1 pp58.67% / 58.00%
GPT-6 Sol
OpenAI
99.94%99.94%±0 pp99.33% / 99.33%
Claude Sonnet 5.5
Anthropic
100.00%99.94%−0.1 pp99.33% / 100.00%
Claude Haiku 5.5
Anthropic
100.00%99.82%−0.2 pp98.00% / 100.00%
GLM-5.3 Flash
Z.ai
99.94%99.52%−0.4 pp95.33% / 99.33%
GPT-6 Luna
OpenAI
99.70%99.15%−0.5 pp91.33% / 96.67%
Claude Sonnet 5
Anthropic
99.82%98.79%−1.0 pp86.67% / 98.67%
Gemma 4 31B
Google
97.64%95.21%−2.4 pp66.67% / 81.33%
Gemini 3.8 Flash
Google
99.82%97.27%−2.5 pp96.67% / 98.00%

Only fields present in both language versions of the document are compared (Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Invoice extraction · Spanish

ModelCorrect fields 82% – 100%EnglishSpanishGapError-free documents (Spanish / English)
Qwen3.8 Flash
Qwen
82.36%89.09%+6.7 pp78.67% / 57.33%
Mistral Small 4
Mistral
95.58%97.33%+1.8 pp75.33% / 58.00%
Mistral Large 4
Mistral
95.39%96.36%+1.0 pp88.00% / 77.33%
Gemini 3.5 Flash Lite
Google
99.21%99.64%+0.4 pp96.00% / 92.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
97.76%97.58%−0.2 pp75.33% / 79.33%
GLM-5.3 Flash
Z.ai
99.94%99.27%−0.7 pp92.67% / 99.33%
Claude Haiku 5.5
Anthropic
100.00%99.33%−0.7 pp92.67% / 100.00%
GPT-6 Luna
OpenAI
99.70%98.97%−0.7 pp88.67% / 96.67%
GPT-6 Sol
OpenAI
99.94%99.09%−0.8 pp90.00% / 99.33%
DeepSeek V4.1 Flash
DeepSeek
99.39%97.94%−1.4 pp78.00% / 93.33%
Claude Sonnet 5
Anthropic
99.82%98.18%−1.6 pp81.33% / 98.67%
Gemini 3.8 Flash
Google
99.82%97.27%−2.5 pp96.67% / 98.00%
Gemma 4 31B
Google
97.64%93.94%−3.7 pp50.67% / 81.33%

Only fields present in both language versions of the document are compared (Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Invoice extraction · French

ModelCorrect fields 82% – 100%EnglishFrenchGapError-free documents (French / English)
Qwen3.8 Flash
Qwen
82.36%90.24%+7.9 pp83.33% / 57.33%
Mistral Medium 3.5
Mistral
97.76%98.42%+0.7 pp86.00% / 79.33%
DeepSeek V4.1 Flash
DeepSeek
99.39%99.52%+0.1 pp94.67% / 93.33%
Gemini 3.8 Flash
Google
99.82%99.94%+0.1 pp99.33% / 98.00%
GPT-6 Sol
OpenAI
99.94%99.88%−0.1 pp98.67% / 99.33%
Claude Sonnet 5.5
Anthropic
100.00%99.94%−0.1 pp99.33% / 100.00%
Claude Haiku 5.5
Anthropic
100.00%99.82%−0.2 pp98.00% / 100.00%
Claude Sonnet 5
Anthropic
99.82%99.64%−0.2 pp96.67% / 98.67%
Gemini 3.5 Flash Lite
Google
99.21%98.91%−0.3 pp88.00% / 92.00%
Mistral Small 4
Mistral
95.58%95.21%−0.4 pp56.00% / 58.00%
GPT-6 Luna
OpenAI
99.70%99.03%−0.7 pp89.33% / 96.67%
GLM-5.3 Flash
Z.ai
99.94%98.91%−1.0 pp89.33% / 99.33%
Gemma 4 31B
Google
97.64%93.21%−4.4 pp51.33% / 81.33%
Mistral Large 4
Mistral
95.39%89.88%−5.5 pp78.67% / 77.33%

Only fields present in both language versions of the document are compared (Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Email triage · Czech

ModelCorrect fields 86% – 100%EnglishCzechGapError-free documents (Czech / English)
Qwen3.8 Flash
Qwen
97.48%98.52%+1.0 pp86.67% / 78.67%
Gemma 4 31B
Google
96.52%97.11%+0.6 pp74.67% / 72.00%
Gemini 3.8 Flash
Google
98.74%99.19%+0.4 pp92.67% / 88.67%
GPT-6 Luna
OpenAI
97.48%97.93%+0.4 pp81.33% / 77.33%
Claude Sonnet 5
Anthropic
98.22%98.15%−0.1 pp83.33% / 84.00%
GPT-6 Sol
OpenAI
99.04%98.96%−0.1 pp90.67% / 92.00%
Claude Sonnet 5.5
Anthropic
98.89%98.67%−0.2 pp88.00% / 90.00%
DeepSeek V4.1 Flash
DeepSeek
97.63%97.41%−0.2 pp77.33% / 78.67%
Mistral Medium 3.5
Mistral
94.89%94.52%−0.4 pp55.33% / 57.33%
Gemini 3.5 Flash Lite
Google
96.30%95.78%−0.5 pp64.00% / 68.67%
GLM-5.3 Flash
Z.ai
99.41%98.89%−0.5 pp90.00% / 94.67%
Claude Haiku 5.5
Anthropic
98.15%97.63%−0.5 pp80.00% / 84.00%
Mistral Large 4
Mistral
98.74%98.15%−0.6 pp89.33% / 88.67%
Mistral Small 4
Mistral
89.70%87.63%−2.1 pp31.33% / 37.33%

Only fields present in both language versions of the document are compared (Category, Priority, Sentiment, Customer name, Order number, Invoice number, Amount, Currency, Deadline). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Email triage · German

ModelCorrect fields 86% – 100%EnglishGermanGapError-free documents (German / English)
Qwen3.8 Flash
Qwen
97.48%97.85%+0.4 pp81.33% / 78.67%
Claude Sonnet 5
Anthropic
98.22%97.85%−0.4 pp81.33% / 84.00%
Gemini 3.8 Flash
Google
98.74%98.37%−0.4 pp85.33% / 88.67%
GPT-6 Luna
OpenAI
97.48%96.96%−0.5 pp72.67% / 77.33%
GPT-6 Sol
OpenAI
99.04%98.22%−0.8 pp84.00% / 92.00%
Claude Sonnet 5.5
Anthropic
98.89%98.00%−0.9 pp83.33% / 90.00%
Mistral Large 4
Mistral
98.74%97.85%−0.9 pp82.00% / 88.67%
Claude Haiku 5.5
Anthropic
98.15%97.11%−1.0 pp74.67% / 84.00%
DeepSeek V4.1 Flash
DeepSeek
97.63%96.37%−1.3 pp68.00% / 78.67%
Gemma 4 31B
Google
96.52%95.11%−1.4 pp62.00% / 72.00%
GLM-5.3 Flash
Z.ai
99.41%98.00%−1.4 pp82.00% / 94.67%
Gemini 3.5 Flash Lite
Google
96.30%94.67%−1.6 pp56.67% / 68.67%
Mistral Medium 3.5
Mistral
94.89%92.74%−2.1 pp48.00% / 57.33%
Mistral Small 4
Mistral
89.70%87.26%−2.4 pp29.33% / 37.33%

Only fields present in both language versions of the document are compared (Category, Priority, Sentiment, Customer name, Order number, Invoice number, Amount, Currency, Deadline). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Email triage · Spanish

ModelCorrect fields 88% – 100%EnglishSpanishGapError-free documents (Spanish / English)
Gemma 4 31B
Google
96.52%97.11%+0.6 pp74.00% / 72.00%
Gemini 3.8 Flash
Google
98.74%98.96%+0.2 pp90.67% / 88.67%
GLM-5.3 Flash
Z.ai
99.41%99.11%−0.3 pp92.00% / 94.67%
Claude Haiku 5.5
Anthropic
98.15%97.70%−0.5 pp80.00% / 84.00%
GPT-6 Sol
OpenAI
99.04%98.44%−0.6 pp86.00% / 92.00%
Claude Sonnet 5
Anthropic
98.22%97.56%−0.7 pp78.67% / 84.00%
GPT-6 Luna
OpenAI
97.48%96.81%−0.7 pp72.00% / 77.33%
Gemini 3.5 Flash Lite
Google
96.30%95.56%−0.7 pp65.33% / 68.67%
Mistral Medium 3.5
Mistral
94.89%94.15%−0.7 pp54.00% / 57.33%
Qwen3.8 Flash
Qwen
97.48%96.74%−0.7 pp72.00% / 78.67%
Mistral Large 4
Mistral
98.74%97.93%−0.8 pp82.00% / 88.67%
Mistral Small 4
Mistral
89.70%88.67%−1.0 pp35.33% / 37.33%
DeepSeek V4.1 Flash
DeepSeek
97.63%96.52%−1.1 pp72.00% / 78.67%
Claude Sonnet 5.5
Anthropic
98.89%97.70%−1.2 pp80.67% / 90.00%

Only fields present in both language versions of the document are compared (Category, Priority, Sentiment, Customer name, Order number, Invoice number, Amount, Currency, Deadline). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Email triage · French

ModelCorrect fields 88% – 100%EnglishFrenchGapError-free documents (French / English)
Mistral Small 4
Mistral
89.70%90.52%+0.8 pp44.67% / 37.33%
Claude Sonnet 5
Anthropic
98.22%98.67%+0.5 pp88.00% / 84.00%
Gemini 3.5 Flash Lite
Google
96.30%96.15%−0.1 pp68.67% / 68.67%
Gemini 3.8 Flash
Google
98.74%98.59%−0.2 pp87.33% / 88.67%
GPT-6 Luna
OpenAI
97.48%97.26%−0.2 pp76.00% / 77.33%
Gemma 4 31B
Google
96.52%96.22%−0.3 pp68.67% / 72.00%
Mistral Large 4
Mistral
98.74%98.30%−0.4 pp84.67% / 88.67%
GPT-6 Sol
OpenAI
99.04%98.59%−0.4 pp87.33% / 92.00%
Mistral Medium 3.5
Mistral
94.89%94.15%−0.7 pp54.00% / 57.33%
Claude Haiku 5.5
Anthropic
98.15%97.41%−0.7 pp76.67% / 84.00%
DeepSeek V4.1 Flash
DeepSeek
97.63%96.74%−0.9 pp72.67% / 78.67%
GLM-5.3 Flash
Z.ai
99.41%98.52%−0.9 pp86.67% / 94.67%
Qwen3.8 Flash
Qwen
97.48%96.44%−1.0 pp76.00% / 78.67%
Claude Sonnet 5.5
Anthropic
98.89%97.78%−1.1 pp82.00% / 90.00%

Only fields present in both language versions of the document are compared (Category, Priority, Sentiment, Customer name, Order number, Invoice number, Amount, Currency, Deadline). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Personal data detection · Czech

ModelCorrect fields 96% – 100%EnglishCzechGapError-free documents (Czech / English)
Mistral Medium 3.5
Mistral
99.71%99.81%+0.1 pp98.67% / 98.00%
DeepSeek V4.1 Flash
DeepSeek
99.62%99.71%+0.1 pp98.00% / 97.33%
GPT-6 Luna
OpenAI
99.62%99.62%±0 pp97.33% / 97.33%
GPT-6 Sol
OpenAI
99.71%99.71%±0 pp98.00% / 98.00%
Gemma 4 31B
Google
99.90%99.81%−0.1 pp98.67% / 99.33%
Gemini 3.8 Flash
Google
99.71%99.52%−0.2 pp96.67% / 98.00%
Claude Sonnet 5.5
Anthropic
100.00%99.71%−0.3 pp98.00% / 100.00%
Mistral Large 4
Mistral
99.62%99.33%−0.3 pp95.33% / 97.33%
Claude Haiku 5.5
Anthropic
99.81%99.43%−0.4 pp96.00% / 98.67%
Mistral Small 4
Mistral
99.43%98.76%−0.7 pp92.00% / 96.00%
GLM-5.3 Flash
Z.ai
100.00%99.33%−0.7 pp99.33% / 100.00%
Claude Sonnet 5
Anthropic
99.71%98.86%−0.8 pp92.00% / 98.00%
Gemini 3.5 Flash Lite
Google
99.52%98.10%−1.4 pp88.00% / 97.33%
Qwen3.8 Flash
Qwen
99.24%96.95%−2.3 pp88.67% / 98.67%

Only fields present in both language versions of the document are compared (Names, Email addresses, Phone numbers, Addresses, Dates of birth, National IDs, Bank accounts). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Personal data detection · German

ModelCorrect fields 98% – 100%EnglishGermanGapError-free documents (German / English)
Qwen3.8 Flash
Qwen
99.24%99.62%+0.4 pp99.33% / 98.67%
Mistral Medium 3.5
Mistral
99.71%100.00%+0.3 pp100.00% / 98.00%
DeepSeek V4.1 Flash
DeepSeek
99.62%99.81%+0.2 pp98.67% / 97.33%
Gemini 3.5 Flash Lite
Google
99.52%99.62%+0.1 pp97.33% / 97.33%
Claude Sonnet 5
Anthropic
99.71%99.71%±0 pp98.00% / 98.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.8 Flash
Google
99.71%99.71%±0 pp98.00% / 98.00%
Gemma 4 31B
Google
99.90%99.90%±0 pp99.33% / 99.33%
GPT-6 Luna
OpenAI
99.62%99.62%±0 pp97.33% / 97.33%
GPT-6 Sol
OpenAI
99.71%99.71%±0 pp98.00% / 98.00%
Mistral Large 4
Mistral
99.62%99.52%−0.1 pp96.67% / 97.33%
Claude Haiku 5.5
Anthropic
99.81%99.62%−0.2 pp97.33% / 98.67%
GLM-5.3 Flash
Z.ai
100.00%99.81%−0.2 pp98.67% / 100.00%
Mistral Small 4
Mistral
99.43%99.14%−0.3 pp94.00% / 96.00%

Only fields present in both language versions of the document are compared (Names, Email addresses, Phone numbers, Addresses, Dates of birth, National IDs, Bank accounts). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Personal data detection · Spanish

ModelCorrect fields 94% – 100%EnglishSpanishGapError-free documents (Spanish / English)
Qwen3.8 Flash
Qwen
99.24%99.81%+0.6 pp98.67% / 98.67%
DeepSeek V4.1 Flash
DeepSeek
99.62%99.90%+0.3 pp99.33% / 97.33%
Claude Haiku 5.5
Anthropic
99.81%100.00%+0.2 pp100.00% / 98.67%
Mistral Large 4
Mistral
99.62%99.81%+0.2 pp98.67% / 97.33%
Claude Sonnet 5
Anthropic
99.71%99.81%+0.1 pp98.67% / 98.00%
Gemini 3.8 Flash
Google
99.71%99.81%+0.1 pp98.67% / 98.00%
GPT-6 Sol
OpenAI
99.71%99.81%+0.1 pp98.67% / 98.00%
GPT-6 Luna
OpenAI
99.62%99.71%+0.1 pp98.00% / 97.33%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
99.90%99.90%±0 pp99.33% / 99.33%
Mistral Medium 3.5
Mistral
99.71%99.62%−0.1 pp97.33% / 98.00%
GLM-5.3 Flash
Z.ai
100.00%99.81%−0.2 pp98.67% / 100.00%
Mistral Small 4
Mistral
99.43%99.05%−0.4 pp93.33% / 96.00%
Gemini 3.5 Flash Lite
Google
99.52%95.81%−3.7 pp73.33% / 97.33%

Only fields present in both language versions of the document are compared (Names, Email addresses, Phone numbers, Addresses, Dates of birth, National IDs, Bank accounts). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Personal data detection · French

ModelCorrect fields 94% – 100%EnglishFrenchGapError-free documents (French / English)
Qwen3.8 Flash
Qwen
99.24%99.71%+0.5 pp98.00% / 98.67%
Gemini 3.8 Flash
Google
99.71%99.81%+0.1 pp98.67% / 98.00%
DeepSeek V4.1 Flash
DeepSeek
99.62%99.71%+0.1 pp98.00% / 97.33%
Claude Sonnet 5
Anthropic
99.71%99.71%±0 pp98.00% / 98.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Luna
OpenAI
99.62%99.62%±0 pp97.33% / 97.33%
GPT-6 Sol
OpenAI
99.71%99.71%±0 pp98.00% / 98.00%
Gemma 4 31B
Google
99.90%99.81%−0.1 pp98.67% / 99.33%
Mistral Medium 3.5
Mistral
99.71%99.62%−0.1 pp97.33% / 98.00%
GLM-5.3 Flash
Z.ai
100.00%99.81%−0.2 pp98.67% / 100.00%
Mistral Small 4
Mistral
99.43%98.95%−0.5 pp93.33% / 96.00%
Claude Haiku 5.5
Anthropic
99.81%99.33%−0.5 pp95.33% / 98.67%
Mistral Large 4
Mistral
99.62%98.67%−0.9 pp94.67% / 97.33%
Gemini 3.5 Flash Lite
Google
99.52%94.95%−4.6 pp67.33% / 97.33%

Only fields present in both language versions of the document are compared (Names, Email addresses, Phone numbers, Addresses, Dates of birth, National IDs, Bank accounts). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Contract clauses · Czech

ModelCorrect fields 90% – 100%EnglishCzechGapError-free documents (Czech / English)
Mistral Small 4
Mistral
91.54%99.03%+7.5 pp92.00% / 43.33%
Qwen3.8 Flash
Qwen
95.13%99.90%+4.8 pp98.67% / 69.33%
Mistral Large 4
Mistral
96.10%100.00%+3.9 pp100.00% / 74.67%
Mistral Medium 3.5
Mistral
98.10%100.00%+1.9 pp100.00% / 87.33%
GLM-5.3 Flash
Z.ai
99.49%100.00%+0.5 pp100.00% / 96.00%
Gemma 4 31B
Google
99.64%99.95%+0.3 pp99.33% / 97.33%
Claude Haiku 5.5
Anthropic
99.69%100.00%+0.3 pp100.00% / 97.33%
Claude Sonnet 5.5
Anthropic
99.79%100.00%+0.2 pp100.00% / 98.00%
GPT-6 Luna
OpenAI
99.79%100.00%+0.2 pp100.00% / 98.67%
Gemini 3.8 Flash
Google
99.90%100.00%+0.1 pp100.00% / 99.33%
Claude Sonnet 5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
DeepSeek V4.1 Flash
DeepSeek
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.5 Flash Lite
Google
99.95%99.85%−0.1 pp98.00% / 99.33%

Only fields present in both language versions of the document are compared (Provider, Provider ID, Client, Client ID, Contract type, Price (net), Currency, Billing period, Effective date, End date, Notice period (months), Late-payment penalty (% per day), Governing law). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Contract clauses · German

ModelCorrect fields 90% – 100%EnglishGermanGapError-free documents (German / English)
Mistral Large 4
Mistral
96.10%99.44%+3.3 pp95.33% / 74.67%
Qwen3.8 Flash
Qwen
95.13%98.00%+2.9 pp87.33% / 69.33%
Mistral Small 4
Mistral
91.54%94.26%+2.7 pp46.67% / 43.33%
GLM-5.3 Flash
Z.ai
99.49%100.00%+0.5 pp100.00% / 96.00%
Claude Haiku 5.5
Anthropic
99.69%100.00%+0.3 pp100.00% / 97.33%
Claude Sonnet 5.5
Anthropic
99.79%100.00%+0.2 pp100.00% / 98.00%
GPT-6 Luna
OpenAI
99.79%100.00%+0.2 pp100.00% / 98.67%
Gemini 3.8 Flash
Google
99.90%99.90%±0 pp99.33% / 99.33%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
98.10%97.13%−1.0 pp75.33% / 87.33%
Claude Sonnet 5
Anthropic
100.00%98.21%−1.8 pp86.67% / 100.00%
Gemini 3.5 Flash Lite
Google
99.95%98.00%−2.0 pp84.00% / 99.33%
DeepSeek V4.1 Flash
DeepSeek
100.00%97.08%−2.9 pp76.00% / 100.00%
Gemma 4 31B
Google
99.64%94.41%−5.2 pp27.33% / 97.33%

Only fields present in both language versions of the document are compared (Provider, Provider ID, Client, Client ID, Contract type, Price (net), Currency, Billing period, Effective date, End date, Notice period (months), Late-payment penalty (% per day), Governing law). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Contract clauses · Spanish

ModelCorrect fields 90% – 100%EnglishSpanishGapError-free documents (Spanish / English)
Mistral Small 4
Mistral
91.54%100.00%+8.5 pp100.00% / 43.33%
Qwen3.8 Flash
Qwen
95.13%100.00%+4.9 pp100.00% / 69.33%
Mistral Large 4
Mistral
96.10%100.00%+3.9 pp100.00% / 74.67%
Mistral Medium 3.5
Mistral
98.10%100.00%+1.9 pp100.00% / 87.33%
GLM-5.3 Flash
Z.ai
99.49%100.00%+0.5 pp100.00% / 96.00%
Claude Haiku 5.5
Anthropic
99.69%99.95%+0.3 pp99.33% / 97.33%
Claude Sonnet 5.5
Anthropic
99.79%100.00%+0.2 pp100.00% / 98.00%
GPT-6 Luna
OpenAI
99.79%100.00%+0.2 pp100.00% / 98.67%
Gemini 3.8 Flash
Google
99.90%100.00%+0.1 pp100.00% / 99.33%
Claude Sonnet 5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
DeepSeek V4.1 Flash
DeepSeek
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.5 Flash Lite
Google
99.95%99.79%−0.2 pp98.00% / 99.33%
Gemma 4 31B
Google
99.64%94.41%−5.2 pp27.33% / 97.33%

Only fields present in both language versions of the document are compared (Provider, Provider ID, Client, Client ID, Contract type, Price (net), Currency, Billing period, Effective date, End date, Notice period (months), Late-payment penalty (% per day), Governing law). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Contract clauses · French

ModelCorrect fields 90% – 100%EnglishFrenchGapError-free documents (French / English)
Mistral Small 4
Mistral
91.54%99.23%+7.7 pp90.00% / 43.33%
Qwen3.8 Flash
Qwen
95.13%99.49%+4.4 pp93.33% / 69.33%
Mistral Large 4
Mistral
96.10%99.28%+3.2 pp90.67% / 74.67%
Mistral Medium 3.5
Mistral
98.10%100.00%+1.9 pp100.00% / 87.33%
GLM-5.3 Flash
Z.ai
99.49%99.74%+0.2 pp96.67% / 96.00%
Claude Sonnet 5.5
Anthropic
99.79%99.95%+0.2 pp99.33% / 98.00%
Gemini 3.8 Flash
Google
99.90%100.00%+0.1 pp100.00% / 99.33%
Gemini 3.5 Flash Lite
Google
99.95%99.95%±0 pp99.33% / 99.33%
Claude Sonnet 5
Anthropic
100.00%99.95%±0 pp99.33% / 100.00%
DeepSeek V4.1 Flash
DeepSeek
100.00%99.85%−0.1 pp98.00% / 100.00%
Claude Haiku 5.5
Anthropic
99.69%99.38%−0.3 pp92.00% / 97.33%
GPT-6 Sol
OpenAI
100.00%99.59%−0.4 pp94.67% / 100.00%
GPT-6 Luna
OpenAI
99.79%99.33%−0.5 pp91.33% / 98.67%
Gemma 4 31B
Google
99.64%94.62%−5.0 pp30.67% / 97.33%

Only fields present in both language versions of the document are compared (Provider, Provider ID, Client, Client ID, Contract type, Price (net), Currency, Billing period, Effective date, End date, Notice period (months), Late-payment penalty (% per day), Governing law). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Document summaries · Czech

ModelCorrect fields 82% – 100%EnglishCzechGapError-free documents (Czech / English)
GPT-6 Sol
OpenAI
99.56%100.00%+0.4 pp100.00% / 97.33%
Gemini 3.5 Flash Lite
Google
99.22%99.56%+0.3 pp97.33% / 95.33%
DeepSeek V4.1 Flash
DeepSeek
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.8 Flash
Google
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Luna
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Small 4
Mistral
99.67%99.00%−0.7 pp94.00% / 98.67%
Claude Sonnet 5.5
Anthropic
100.00%98.67%−1.3 pp92.00% / 100.00%
Claude Haiku 5.5
Anthropic
98.33%95.89%−2.4 pp77.33% / 90.00%
Claude Sonnet 5
Anthropic
96.00%93.44%−2.6 pp68.00% / 76.67%
Qwen3.8 Flash
Qwen
99.89%95.44%−4.4 pp93.33% / 99.33%
Mistral Large 4
Mistral
100.00%83.33%−16.7 pp83.33% / 100.00%

Only fields present in both language versions of the document are compared (Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words)). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Document summaries · German

ModelCorrect fields 94% – 100%EnglishGermanGapError-free documents (German / English)
Claude Sonnet 5
Anthropic
96.00%99.11%+3.1 pp96.00% / 76.67%
Claude Haiku 5.5
Anthropic
98.33%99.44%+1.1 pp96.67% / 90.00%
Gemini 3.5 Flash Lite
Google
99.22%99.89%+0.7 pp99.33% / 95.33%
GPT-6 Sol
OpenAI
99.56%100.00%+0.4 pp100.00% / 97.33%
Mistral Small 4
Mistral
99.67%99.89%+0.2 pp99.33% / 98.67%
DeepSeek V4.1 Flash
DeepSeek
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.8 Flash
Google
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Luna
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Large 4
Mistral
100.00%99.33%−0.7 pp99.33% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%99.11%−0.9 pp94.67% / 100.00%
Qwen3.8 Flash
Qwen
99.89%95.33%−4.6 pp95.33% / 99.33%

Only fields present in both language versions of the document are compared (Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words)). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Document summaries · Spanish

ModelCorrect fields 90% – 100%EnglishSpanishGapError-free documents (Spanish / English)
DeepSeek V4.1 Flash
DeepSeek
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.8 Flash
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%99.67%−0.3 pp98.00% / 100.00%
GPT-6 Sol
OpenAI
99.56%97.89%−1.7 pp87.33% / 97.33%
Claude Sonnet 5
Anthropic
96.00%94.22%−1.8 pp68.00% / 76.67%
Mistral Small 4
Mistral
99.67%97.78%−1.9 pp86.67% / 98.67%
GPT-6 Luna
OpenAI
100.00%97.00%−3.0 pp82.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%96.67%−3.3 pp96.67% / 100.00%
Gemini 3.5 Flash Lite
Google
99.22%95.33%−3.9 pp72.00% / 95.33%
Claude Haiku 5.5
Anthropic
98.33%94.11%−4.2 pp64.67% / 90.00%
Claude Sonnet 5.5
Anthropic
100.00%95.56%−4.4 pp73.33% / 100.00%
Qwen3.8 Flash
Qwen
99.89%94.44%−5.4 pp93.33% / 99.33%
Mistral Large 4
Mistral
100.00%91.33%−8.7 pp91.33% / 100.00%

Only fields present in both language versions of the document are compared (Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words)). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Document summaries · French

ModelCorrect fields 72% – 100%EnglishFrenchGapError-free documents (French / English)
Claude Sonnet 5
Anthropic
96.00%96.78%+0.8 pp80.67% / 76.67%
DeepSeek V4.1 Flash
DeepSeek
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.8 Flash
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%99.11%−0.9 pp94.67% / 100.00%
GPT-6 Luna
OpenAI
100.00%98.78%−1.2 pp92.67% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%97.89%−2.1 pp87.33% / 100.00%
GPT-6 Sol
OpenAI
99.56%97.22%−2.3 pp83.33% / 97.33%
Qwen3.8 Flash
Qwen
99.89%96.33%−3.6 pp94.67% / 99.33%
Gemini 3.5 Flash Lite
Google
99.22%94.67%−4.5 pp71.33% / 95.33%
Claude Haiku 5.5
Anthropic
98.33%92.78%−5.5 pp56.67% / 90.00%
Mistral Small 4
Mistral
99.67%93.22%−6.5 pp62.00% / 98.67%
Mistral Large 4
Mistral
100.00%72.67%−27.3 pp72.67% / 100.00%

Only fields present in both language versions of the document are compared (Amounts, Deadlines, Responsible people, Rejected proposals (must not appear), Superseded deadlines (must not appear), Length (max words)). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Questions about a document · Czech

ModelCorrect fields 88% – 100%EnglishCzechGapError-free documents (Czech / English)
GPT-6 Luna
OpenAI
99.11%100.00%+0.9 pp100.00% / 96.00%
DeepSeek V4.1 Flash
DeepSeek
99.22%100.00%+0.8 pp100.00% / 98.67%
Gemini 3.8 Flash
Google
99.89%100.00%+0.1 pp100.00% / 99.33%
Claude Sonnet 5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.5 Flash Lite
Google
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Small 4
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%100.00%±0 pp100.00% / 100.00%
Claude Haiku 5.5
Anthropic
100.00%99.78%−0.2 pp98.67% / 100.00%
Qwen3.8 Flash
Qwen
99.78%94.22%−5.6 pp84.67% / 98.67%
Mistral Large 4
Mistral
98.89%89.89%−9.0 pp78.00% / 97.33%

Only fields present in both language versions of the document are compared (Question 1, Question 2, Question 3, Question 4, Question 5, Question 6). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Questions about a document · German

ModelCorrect fields 92% – 100%EnglishGermanGapError-free documents (German / English)
DeepSeek V4.1 Flash
DeepSeek
99.22%100.00%+0.8 pp100.00% / 98.67%
Gemini 3.8 Flash
Google
99.89%100.00%+0.1 pp100.00% / 99.33%
Claude Haiku 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Claude Sonnet 5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.5 Flash Lite
Google
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Small 4
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
Qwen3.8 Flash
Qwen
99.78%98.89%−0.9 pp96.67% / 98.67%
GPT-6 Luna
OpenAI
99.11%98.00%−1.1 pp91.33% / 96.00%
GLM-5.3 Flash
Z.ai
100.00%98.78%−1.2 pp95.33% / 100.00%
Mistral Large 4
Mistral
98.89%93.56%−5.3 pp89.33% / 97.33%

Only fields present in both language versions of the document are compared (Question 1, Question 2, Question 3, Question 4, Question 5, Question 6). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Questions about a document · Spanish

ModelCorrect fields 94% – 100%EnglishSpanishGapError-free documents (Spanish / English)
DeepSeek V4.1 Flash
DeepSeek
99.22%100.00%+0.8 pp100.00% / 98.67%
GPT-6 Luna
OpenAI
99.11%99.67%+0.6 pp98.67% / 96.00%
Gemini 3.8 Flash
Google
99.89%100.00%+0.1 pp100.00% / 99.33%
Claude Haiku 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Claude Sonnet 5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Gemini 3.5 Flash Lite
Google
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Small 4
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%100.00%±0 pp100.00% / 100.00%
Qwen3.8 Flash
Qwen
99.78%99.67%−0.1 pp98.67% / 98.67%
Mistral Large 4
Mistral
98.89%94.22%−4.7 pp90.67% / 97.33%

Only fields present in both language versions of the document are compared (Question 1, Question 2, Question 3, Question 4, Question 5, Question 6). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Questions about a document · French

ModelCorrect fields 92% – 100%EnglishFrenchGapError-free documents (French / English)
DeepSeek V4.1 Flash
DeepSeek
99.22%100.00%+0.8 pp100.00% / 98.67%
GPT-6 Luna
OpenAI
99.11%99.56%+0.5 pp98.00% / 96.00%
Gemini 3.8 Flash
Google
99.89%100.00%+0.1 pp100.00% / 99.33%
Claude Sonnet 5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Claude Sonnet 5.5
Anthropic
100.00%100.00%±0 pp100.00% / 100.00%
Gemma 4 31B
Google
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Medium 3.5
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
Mistral Small 4
Mistral
100.00%100.00%±0 pp100.00% / 100.00%
GPT-6 Sol
OpenAI
100.00%100.00%±0 pp100.00% / 100.00%
GLM-5.3 Flash
Z.ai
100.00%99.67%−0.3 pp98.67% / 100.00%
Gemini 3.5 Flash Lite
Google
100.00%99.56%−0.4 pp98.00% / 100.00%
Claude Haiku 5.5
Anthropic
100.00%99.22%−0.8 pp96.67% / 100.00%
Qwen3.8 Flash
Qwen
99.78%98.78%−1.0 pp97.33% / 98.67%
Mistral Large 4
Mistral
98.89%92.33%−6.6 pp87.33% / 97.33%

Only fields present in both language versions of the document are compared (Question 1, Question 2, Question 3, Question 4, Question 5, Question 6). Fields that exist in one country only (such as the VAT ID on a Czech invoice) are left out.

Log in with email

We use your email only to log you in (and for the digest if you tick it). No spam.