Tasks · desk · Spreadsheet
Days out per machine per month for the insurer
rental-utilization · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
The insurer wants days out for each of our machines, month by month for January to June. Work it out from the contract history and save it as utilization.csv - Hank's note says how we count.
Workspace
- equipment_list.xlsx
- note_from_hank.txt
- rental_contracts_export_2026-07-01.csv
Expected deliverables
- utilization.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| every machine under its current name | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| days out per month | csv_values_match | yes | 0 |
| half-year total | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.4 | 0.0202 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.5 | 0.2463 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "rental-utilization".