ModelVerdict

SLA: What service credit, as a share …

Anglais (US)Document6 champs

Document en-p0003 · mise en page sla · 6 champs · partie publique du jeu de données · Même facture · Tchèque → · Signaler une erreur dans cet exemple

Document et questions (le modèle a reçu exactement ce texte)

Hopkins-Mendoza
EXHIBIT B TO THE MASTER SERVICES AGREEMENT – SERVICE LEVEL AGREEMENT

1. Scope and Term
1.1 This Service Level Agreement (the "SLA") defines the operating and support levels for the cloud application that Hopkins-Mendoza (the "Provider") operates for the Customer.
1.2 The monthly fee for the services under this SLA is $2,400, excluding applicable taxes.
1.3 This SLA is effective as of February 19, 2026 and replaces the version dated June 7, 2025.

2. Service Availability
2.1 The Provider guarantees a monthly availability of the production environment of 99.7%. The target availability of the test environment is 97% and does not give rise to service credits.
2.2 Availability is measured by the Provider's monitoring system at 5-minute intervals. The Provider sends the Customer a monthly availability report by the 5th business day of the following month.
2.3 Scheduled maintenance does not count as downtime. The Provider will notify the Customer of scheduled maintenance at least 10 days in advance, and maintenance will not exceed 4 hours per calendar month.
2.4 Maintenance is normally performed on weekends during night hours.

3. Support and Response Times
3.1 The Customer reports incidents through the service portal or by email to support@hopkins-mendoza.example. Priority 1 incidents are accepted 24 hours a day, 7 days a week.
3.2 For Priority 1 incidents (critical failure, the service is completely unavailable), the Provider responds within 4 hours of the report and restores the service or provides a workaround within 6 hours.
3.3 For Priority 2 incidents (limited functionality with no workaround), the Provider responds within 8 hours of the report during business hours.
3.4 Priority 3 and lower requests are handled no later than the next business day.

4. Service Credits
4.1 If the monthly availability of the production environment falls below the guaranteed level, the Customer is entitled to a service credit of 15% of the monthly fee for the affected month.
4.2 Service credits for any calendar month shall not exceed 50% of the monthly fee in total. The Customer must claim a credit in writing within 30 days after the end of the month.
4.3 Billing questions are handled by the Provider's sales team at billing@hopkins-mendoza.example.

---

Questions:
1. What service credit, as a share of the monthly fee, is the Customer entitled to if the guaranteed availability is not met? (percent)
2. How far in advance must the Provider announce scheduled maintenance? (number of days)
3. To what email address does the Customer report incidents? (email address)
4. What is the response time for Priority 1 incidents? (number of hours)
5. For how long does the Provider keep data backups? (number of days)
6. What is the response time for Priority 2 incidents? (number of hours)

Verdict

Le moins cher sans erreur : Mistral Small 4, à 0,12 € pour 1 000 documents.

  • Mistral Large 4 ne fait aucune erreur non plus, mais coûte 41,7× plus cher.

Prompt soumis à chaque modèle

You answer questions about a business document. Below the document there are six numbered
questions. Answer each of them using only the text of the document and return only JSON with the
keys q1 to q6 (q1 = the answer to question 1, and so on).

Rules:
- Each question states in parentheses the unit or format of the answer. Answer in that unit.
- Counts (of days, months, hours) and percentages as a number without the unit and without the %
  sign, e.g. "14" or "0.05".
- Amounts as a number with a decimal point, no thousands separators and no currency symbol,
  e.g. "1500.00".
- Dates as YYYY-MM-DD.
- Time ranges in 24-hour format HH:MM-HH:MM, e.g. "08:00-17:00".
- Email addresses exactly as they appear in the document.
- If the document does not contain the answer to a question, return null. Do not guess and do not
  add information that is not in the document.

Notre notation

Correspondance exacte par champ, après normalisation des dates, des montants et des espaces. Les diacritiques manquants comptent comme une erreur. Le coût correspond à la consommation réelle de tokens de cette exécution, convertie au taux indiqué en bas de page.

Ce que chaque modèle a extrait

ChampValeur correcteMistral Small 46 / 6 champsGemma 4 31B6 / 6 champsGPT-6 Luna6 / 6 champsGLM-5.3 Flash6 / 6 champsQwen3.8 Flash6 / 6 champsClaude Haiku 5.56 / 6 champsDeepSeek V4.1 Flash6 / 6 champsGemini 3.5 Flash Lite6 / 6 champsMistral Medium 3.56 / 6 champsGPT-6 Sol6 / 6 champsGemini 3.8 Flash6 / 6 champsClaude Sonnet 56 / 6 champsClaude Sonnet 5.56 / 6 champsMistral Large 46 / 6 champs
Question 11515 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)15 (correct)
Question 21010 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)10 (correct)
Question 3support@hopkins-mendoza.examplesupport@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)support@hopkins-mendoza.example (correct)
Question 444 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)4 (correct)
Question 5—— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)— (correct)
Question 688 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)8 (correct)
Tokensentrée / sortie890 / 51924 / 52919 / 184853 / 2501 121 / 2651 671 / 2451 020 / 191912 / 66890 / 51919 / 44912 / 5921 669 / 531 671 / 53978 / 2 377
dont raisonnement cachéfacturé comme sortie00138199198188152000551002 208
dont en cacheentrée facturée à prix réduit2142560025602700000000
Coût de ce documentcette exécution0,0001 €0,0001 €0,0002 €0,0002 €0,0002 €0,0003 €0,0003 €0,0004 €0,0016 €0,0021 €0,0027 €0,0036 €0,0036 €0,0052 €
Pour 1 000 documentspour ce même type de document0,12 €0,14 €0,17 €0,23 €0,24 €0,27 €0,27 €0,40 €1,58 €2,10 €2,67 €3,56 €3,56 €5,18 €
Latencecette exécution0,7 s3,2 s4,4 s2,7 s5,4 s2,3 s4,6 s0,8 s0,7 s2,2 s3 s1,7 s2,5 s27,6 s

Connexion par e-mail

Nous utilisons votre e-mail uniquement pour la connexion (et le résumé si vous le cochez). Pas de spam.