Business Bench

Tasks · desk · Reformatting

Build the Amazon inventory upload from the product sheet

amazon-inventory-loader · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Please get our products ready for Amazon: turn amazon_listing_sheet.xlsx into an Inventory Loader file using the template. My notes on how we list things are in the folder. Save it as amazon_inventory.csv.

Workspace

  • Inventory_Loader_template.csv
  • amazon_listing_sheet.xlsx
  • amazon_upload_notes.txt

Expected deliverables

  • amazon_inventory.csv

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
Inventory Loader columns, exact ordercsv_columnsyes0
one row per skucsv_set_equalyes0
row countcsv_row_countyes0
product id and typecsv_values_matchyes0
item condition codecsv_values_matchyes0
price rulescsv_values_matchyes0
quantity and fulfillmentcustomyes0
add-deletecsv_values_matchyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash331.10.0169
Codex / GPT-5.6 sol331.80.2893

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "amazon-inventory-loader".