Business Bench

Tasks · desk · Bookkeeping

Turn September returns into credit notes and apply them

credit-notes-apply · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Can you turn September's returns into credit notes and apply them to what customers owe? Our returns policy in the folder has the rules. I need credit_notes.csv and invoice_balances.csv back.

Workspace

  • invoice_lines_2026-06-01_to_2026-09-30.csv
  • open_invoices_2026-09-30.xlsx
  • returns_and_credits_policy.md
  • rma_returns_log_2026-09.csv

Expected deliverables

  • credit_notes.csv
  • invoice_balances.csv

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
credit note columnscsv_columnsyes0
credit notes issuedcsv_set_equalyes0
credit and fee per RMAcsv_values_matchyes0
applied and unapplied per RMAcsv_values_matchyes0
every open invoice listedcsv_set_equalyes0
invoice balances after creditscsv_values_matchyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash331.80.0217
Codex / GPT-5.6 sol332.70.3115

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "credit-notes-apply".