Company policy: As of what date is the …
Document et questions (le modèle a reçu exactement ce texte)
Gardner Ltd TRAVEL, EXPENSE AND REMOTE WORK POLICY 1. General Provisions 1.1 This policy sets out the rules for business travel, expense reimbursement and remote work for all employees of Gardner Ltd (the "Company"). 1.2 This policy is effective as of July 18, 2025 and supersedes the policy dated September 1, 2024. 1.3 Any expense above $2,500 must be approved in advance by the head of the department. Expenses above $25,000 also require the approval of the Chief Executive Officer. 2. Business Travel 2.1 All business trips must be approved in advance by the employee's direct manager. Employees may request a travel advance of up to 90% of the estimated trip cost. 2.2 The per diem for domestic business trips is $40 per calendar day for trips lasting 5 to 12 hours and $74 per calendar day for trips lasting more than 12 hours. 2.3 Hotel rates may not exceed $200 per night, or $325 per night in New York City. More expensive lodging requires the written consent of the head of the department. 2.4 Employees who use a personal vehicle for business travel are reimbursed at $0.60 per mile. Parking fees and tolls are reimbursed at actual cost against receipts. 3. Expense Reports and Reimbursement 3.1 Employees must submit an expense report with all receipts no later than 15 business days after returning from the trip. 3.2 Approved expenses are reimbursed within 14 days of approval, usually with the next regular payroll. 3.3 Questions about expense reports go to the accounting team at accounting@gardner.example; questions about the interpretation of this policy go to Human Resources at hr@gardner.example. 4. Remote Work 4.1 With the consent of their manager, employees may work remotely for up to 1 day per week. 4.2 Remote work days must be entered in the attendance system at least 2 business days in advance. 4.3 Employees are responsible for the security of Company equipment and data and must connect only through the Company VPN. Any costs of working from home are governed by a separate agreement. 4.4 On remote work days, employees must be reachable by phone and email during regular working hours. --- Questions: 1. As of what date is the document effective? (date) 2. Within how many business days after returning from a trip must the expense report be submitted? (number of business days) 3. What is the maximum hotel rate per night outside New York City? (amount in USD) 4. What is the per diem per calendar day for a domestic business trip lasting more than 12 hours? (amount in USD) 5. How many business days in advance must remote work be entered in the attendance system? (number of business days) 6. What is the limit for a single taxi ride on a business trip? (amount in USD)
Verdict
Le moins cher sans erreur : GPT-6 Luna, à 0,12 € pour 1 000 documents.
- Gemini 3.8 Flash ne fait aucune erreur non plus, mais coûte 35,1× plus cher.
Prompt soumis à chaque modèle
You answer questions about a business document. Below the document there are six numbered questions. Answer each of them using only the text of the document and return only JSON with the keys q1 to q6 (q1 = the answer to question 1, and so on). Rules: - Each question states in parentheses the unit or format of the answer. Answer in that unit. - Counts (of days, months, hours) and percentages as a number without the unit and without the % sign, e.g. "14" or "0.05". - Amounts as a number with a decimal point, no thousands separators and no currency symbol, e.g. "1500.00". - Dates as YYYY-MM-DD. - Time ranges in 24-hour format HH:MM-HH:MM, e.g. "08:00-17:00". - Email addresses exactly as they appear in the document. - If the document does not contain the answer to a question, return null. Do not guess and do not add information that is not in the document.
Notre notation
Correspondance exacte par champ, après normalisation des dates, des montants et des espaces. Les diacritiques manquants comptent comme une erreur. Le coût correspond à la consommation réelle de tokens de cette exécution, convertie au taux indiqué en bas de page.
Ce que chaque modèle a extrait
| Champ | Valeur correcte | GPT-6 Luna6 / 6 champs | Mistral Small 46 / 6 champs | Gemma 4 31B6 / 6 champs | Claude Haiku 5.56 / 6 champs | GLM-5.3 Flash6 / 6 champs | DeepSeek V4.1 Flash6 / 6 champs | Qwen3.8 Flash6 / 6 champs | Gemini 3.5 Flash Lite6 / 6 champs | Mistral Medium 3.56 / 6 champs | GPT-6 Sol6 / 6 champs | Claude Sonnet 56 / 6 champs | Claude Sonnet 5.56 / 6 champs | Mistral Large 46 / 6 champs | Gemini 3.8 Flash6 / 6 champs |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Question 1 | 2025-07-18 | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) | 2025-07-18 (correct) |
| Question 2 | 15 | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) | 15 (correct) |
| Question 3 | 200.00 | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) | 200.00 (correct) |
| Question 4 | 74.00 | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) | 74.00 (correct) |
| Question 5 | 2 | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) | 2 (correct) |
| Question 6 | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Tokens | entrée / sortie | 911 / 79 | 886 / 61 | 912 / 61 | 1 609 / 48 | 850 / 203 | 1 011 / 221 | 1 126 / 437 | 900 / 74 | 886 / 59 | 911 / 47 | 1 607 / 48 | 1 609 / 48 | 974 / 1 507 | 900 / 1 041 |
| dont raisonnement caché | facturé comme sortie | 30 | 0 | 0 | 0 | 149 | 179 | 360 | 0 | 0 | 0 | 0 | 0 | 1 301 | 967 |
| dont en cache | entrée facturée à prix réduit | 0 | 214 | 3 | 0 | 0 | 270 | 256 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Coût de ce document | cette exécution | 0,0001 € | 0,0001 € | 0,0001 € | 0,0002 € | 0,0002 € | 0,0003 € | 0,0003 € | 0,0004 € | 0,0016 € | 0,0021 € | 0,0034 € | 0,0034 € | 0,0035 € | 0,0042 € |
| Pour 1 000 documents | pour ce même type de document | 0,12 € | 0,13 € | 0,14 € | 0,17 € | 0,21 € | 0,29 € | 0,31 € | 0,42 € | 1,63 € | 2,11 € | 3,40 € | 3,40 € | 3,51 € | 4,21 € |
| Latence | cette exécution | 2,4 s | 0,8 s | 1,3 s | 1,6 s | 2,1 s | 5,3 s | 5,9 s | 0,9 s | 0,7 s | 2,1 s | 2 s | 2,3 s | 23,2 s | 4,7 s |