Tasks · desk · Bookkeeping
Apply today's lockbox checks to open invoices
lockbox-apply · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Please apply this morning's lockbox file against our open invoices - Lucia's email has how she wants it done and the bank's file layout is in the folder. Save applied.csv and unapplied.csv.
Workspace
- LBX2291_20260909.csv
- LBX2291_20260910.csv
- email_from_lucia.txt
- lockbox_file_layout.txt
- open_ar_2026-09-09.xlsx
Expected deliverables
- applied.csv
- unapplied.csv
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| applied.csv columns | csv_columns | yes | 0 |
| unapplied.csv columns | csv_columns | yes | 0 |
| applied per invoice and write-offs | custom | yes | 0 |
| nothing misapplied and cash ties to the file total | custom | yes | 0 |
| unapplied checks | csv_set_equal | yes | 0 |
| unapplied amounts | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.2 | 0.0196 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.8 | 0.3163 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "lockbox-apply".