Tasks · desk · Bookkeeping
Find supplier payments we made twice
duplicate-payments · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
A supplier says we paid them twice this year - can you find every payment we have made twice? Hannah's note says how to judge it. Save the list as duplicate_payments.csv.
Workspace
- ap_payments_register_2026-01-01_to_2026-08-31.csv
- note_from_controller.txt
- vendor_master_2026-09-01.xlsx
- vendor_refunds_received_2026.csv
Expected deliverables
- duplicate_payments.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| duplicate payments | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| original payment | csv_values_match | yes | 0 |
| amount overpaid | csv_values_match | yes | 0 |
| look-alikes not listed | text_not_contains | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 2.1 | 0.0289 | |
| Codex / GPT-5.6 sol | 3 | 3 | 2.4 | 0.2751 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "duplicate-payments".