Difference: Qwen3.8 Flash vs. Claude Sonnet 5; accuracy in percentage points, price in percent. The better value is in bold. Click a task to see the details.
Invoice extraction · English (US) (150 documents)
Claude Sonnet 5 is more accurate by 17.5 pp. Qwen3.8 Flash is 7.7× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
Reid Office Products LLC · A-003849 · Scan · Claude Sonnet 5 11/11, Qwen3.8 Flash 0/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Eagle Partners Co. · 4272 · Clean image · Claude Sonnet 5 11/11, Qwen3.8 Flash 0/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Raleigh Engineering Inc. · INV253511 · Scan · Claude Sonnet 5 11/11, Qwen3.8 Flash 1/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Hughes Janitorial Services Corp. · A-001911 · Scan · Claude Sonnet 5 11/11, Qwen3.8 Flash 1/11 · differs in: Supplier, Supplier ID (EIN, IČO…), Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency
Summit Services Inc. · INV-15230 · Scan · Claude Sonnet 5 11/11, Qwen3.8 Flash 2/11 · differs in: Supplier, Invoice number, Payment reference, Invoice date, Due date, Net amount by tax rate, Total, Currency, Bank account
Miranda-Vega Group LLC · 4959 · PDF text · Claude Sonnet 5 11/11, Qwen3.8 Flash 8/11 · differs in: Payment reference, Net amount by tax rate, Tax amount by tax rate
Liberty Systems Inc. · INV-17299 · PDF text · Claude Sonnet 5 11/11, Qwen3.8 Flash 9/11 · differs in: Net amount by tax rate, Tax amount by tax rate
Flores-Baker Group Co. · A-005694 · PDF text · Claude Sonnet 5 11/11, Qwen3.8 Flash 9/11 · differs in: Net amount by tax rate, Tax amount by tax rate
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · Czech (150 documents)
Claude Sonnet 5 is more accurate by 8.2 pp. Qwen3.8 Flash is 9.2× cheaper.
Mareš s.r.o. · FV2600300 · PDF text · Claude Sonnet 5 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate
Elektrolog spol. s r.o. · 26700422 · PDF text · Claude Sonnet 5 13/13, Qwen3.8 Flash 11/13 · differs in: Net amount by tax rate, Tax amount by tax rate
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Invoice extraction · German (150 documents)
Claude Sonnet 5 is more accurate by 5.5 pp. Qwen3.8 Flash is 9.3× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · Claude Sonnet 5 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Aguirre Formación S.L. · 2025/0652 · Clean image · Claude Sonnet 5 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Claude Sonnet 5 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Centro de Formación Centro S.L.U. · A-2025-1405 · Clean image · Claude Sonnet 5 13/13, Qwen3.8 Flash 0/13 · differs in: Supplier, Supplier ID (EIN, IČO…), VAT ID, Invoice number, Payment reference, Invoice date, Tax point, Due date, Net amount by tax rate, Tax amount by tax rate, Total, Currency, Bank account
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Czech (150 documents)
Claude Sonnet 5 is more accurate by 1.9 pp. Qwen3.8 Flash is 10× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · Spanish (150 documents)
Both are equally accurate. Qwen3.8 Flash is 11.6× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Personal data detection · French (150 documents)
Both are equally accurate. Qwen3.8 Flash is 10.4× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Contract clauses · French (150 documents)
Claude Sonnet 5 is more accurate by 0.5 pp. Qwen3.8 Flash is 10.2× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · Czech (150 documents)
Claude Sonnet 5 is more accurate by 5.8 pp. Qwen3.8 Flash is 7.2× cheaper.
Accuracy over all 150 documents in this language, including the non-public part. 40 of them are published as examples.
Documents where they differ
On the 40 published examples, both models got the same fields right. The differences in the table above come from the rest of the dataset, mostly the non-public part, which we keep private so models can't learn from it.
Free with login
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Questions about a document · French (150 documents)
Claude Sonnet 5 is more accurate by 1.2 pp. Qwen3.8 Flash is 8.7× cheaper.
Accuracy field by field and the documents where the models differ.
Just your email, no password.
Every model's output for this document, field by field. The first three examples of each task are open.Exactly where the model goes wrong: its weakest fields and the actual wrong answers.Accuracy field by field and the documents where the models differ.A ready-to-use prompt and JSON schema for this model.Download all results as CSV and JSON.Log in with your email, no password, to unlock every detail: model errors, all examples, code, and data downloads.