Tasks · desk · Extraction
Monthly usage and charges from the utility bills
utility-bills-extraction · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Can you pull July and August usage and charges off our electric and water bills into utility_usage.csv? The bills are in the folder and my note has the layout I need for the budget.
Workspace
- note_from_business_manager.txt
- utility_bills/Northfork_summary_bill_Aug2026.pdf
- utility_bills/Northfork_summary_bill_Jul2026.pdf
- utility_bills/RiverbendWater_07-2026.pdf
- utility_bills/RiverbendWater_08-2026.pdf
- utility_bills/lighting_acct_statement_0902.pdf
- utility_bills/scan_lot_lighting_bill.pdf
Expected deliverables
- utility_usage.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| one row per account per month | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| account, utility and month | csv_values_match | yes | 0 |
| usage | csv_values_match | yes | 0 |
| read types and units | csv_values_match | yes | 0 |
| current charges | csv_values_match | yes | 0 |
| late fees | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.0 | 0.0145 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.6 | 0.1849 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "utility-bills-extraction".