Business Bench

Tasks · desk · Tooling

Stock page for the workshop tablet

inventory-tracker-page · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Can you turn the latest stock export into the stock page for the pour-station tablet? Marta's note says what she wants on it. Save it as index.html.

Workspace

  • note_from_marta.txt
  • stock_on_hand_2026-08-14.csv
  • stock_on_hand_2026-09-12.csv

Expected deliverables

  • index.html

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
index.html existsfile_existsyes0
every stocked item namedtext_contains_allyes0
archived lines left offtext_not_containsyes0
total stock valuetext_numbers_presentyes0
page structurecustomyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash332.50.0347
Codex / GPT-5.6 sol334.50.4042

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "inventory-tracker-page".