ModelVerdict

Benjamin Diaz

English (US)Text7 fields

Document en-p0001 · layout hr · 7 fields · public part of the dataset · Same invoice in Czech → · Report an error in this example

Text (the model received exactly this text)

Employee record – Brooks and Sons

Employee: Benjamin Diaz
Date of birth: March 18, 1976
SSN: 923-27-1486
Home address: 2085 Cooper Knoll, Coryborough, AL 78740
Phone: (720) 555-0040
Personal email: benjamin.diaz@mail.example
Direct deposit account: 354040340527

Hired as staff accountant starting August 27, 2026, 90-day probation period.

Employer: Brooks and Sons, EIN 24-8029232

Verdict

Cheapest with no errors: Gemma 4 31B at $0.11 per 1,000 documents.

  • Claude Sonnet 5.5 is also error-free, but 33.8× more expensive.

Prompt given to every model

Find all personal data of natural persons in the text below (for anonymisation) and return only
JSON with these keys, each a list of strings (an empty list when there is none):

person_names       full names of people, each person once, as written in the text
email_addresses    email addresses of people
phone_numbers      phone numbers of people, as written
postal_addresses   home or delivery addresses of people, as written (street, city, ZIP)
birth_dates        dates of birth (YYYY-MM-DD)
national_ids       national identification numbers (e.g. SSN, birth numbers)
bank_accounts      bank account numbers of people, as written

Rules:
- Only data of natural persons. Company names, company registration or tax numbers (EIN, IČO,
  VAT), generic company addresses such as info@ or support@, order and ticket numbers are not
  personal data: leave them out.
- Dates that are not dates of birth (meetings, deliveries, start dates) are not personal data.
- Do not invent or complete values; copy them from the text.

How we score

Exact match per field after normalizing dates, amounts, and whitespace. Missing diacritics count as an error. Cost is the actual token spend of this run, converted at the rate shown in the footer.

What each model extracted

FieldCorrect valueGemma 4 31B7 / 7 fieldsGPT-6 Luna7 / 7 fieldsMistral Small 47 / 7 fieldsQwen3.8 Flash7 / 7 fieldsClaude Haiku 5.57 / 7 fieldsGLM-5.3 Flash7 / 7 fieldsDeepSeek V4.1 Flash7 / 7 fieldsGemini 3.5 Flash Lite7 / 7 fieldsMistral Medium 3.57 / 7 fieldsGemini 3.8 Flash7 / 7 fieldsGPT-6 Sol7 / 7 fieldsMistral Large 47 / 7 fieldsClaude Sonnet 57 / 7 fieldsClaude Sonnet 5.57 / 7 fields
NamesBenjamin DiazBenjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)Benjamin Diaz (correct)
Email addressesbenjamin.diaz@mail.examplebenjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)benjamin.diaz@mail.example (correct)
Phone numbers(720) 555-0040(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)(720) 555-0040 (correct)
Addresses2085 Cooper Knoll, Coryborough, AL 787402085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)2085 Cooper Knoll, Coryborough, AL 78740 (correct)
Dates of birth1976-03-181976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)March 18, 1976 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)1976-03-18 (correct)
National IDs923-27-1486923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)923-27-1486 (correct)
Bank accounts354040340527354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)354040340527 (correct)
Tokensinput / output412 / 124482 / 152392 / 123711 / 4231,099 / 332367 / 493615 / 321400 / 181392 / 123400 / 471482 / 148567 / 1,4571,097 / 1431,099 / 143
including hidden reasoningbilled as output061024618939322500361571,25400
including cached inputinput billed at a discount300256001320000000
Cost of this documentthis run$0.0001$0.0001$0.0001$0.0003$0.0003$0.0003$0.0003$0.0006$0.0015$0.0021$0.0024$0.0034$0.0036$0.0036
Per 1,000 documentsfor documents of this type$0.11$0.12$0.13$0.27$0.28$0.30$0.32$0.57$1.51$2.07$2.44$3.43$3.62$3.63
Latencythis run5.8 s2.3 s1.2 s7.5 s2.3 s3.6 s2.8 s0.9 s1 s2.1 s2.6 s107.5 s2.4 s1.8 s

Log in with email

We use your email only to log you in (and for the digest if you tick it). No spam.