Business Bench

Tasks · desk · Drafting

Water shutoff notices for the riser valve work

maintenance-notices · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Please write the resident notices for next month's water shutoffs at Meadowbrook Terrace - one for each building, in a notices folder. Margaret's note says what goes in them.

Workspace

  • building_contacts.csv
  • email_from_rivera_mechanical.txt
  • note_from_property_manager.txt
  • riser_valve_schedule_rivera_mechanical.xlsx

Expected deliverables

  • notices/*[Aa][Ss][Pp][Ee][Nn]*
  • notices/*[Bb][Ii][Rr][Cc][Hh]*
  • notices/*[Cc][Yy][Pp][Rr][Ee][Ss][Ss]*
  • notices/*[Dd][Oo][Gg][Ww][Oo][Oo][Dd]*

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
notice for Aspen Housefile_existsyes0
notice for Birch Housefile_existsyes0
notice for Cypress Housefile_existsyes0
notice for Dogwood Housefile_existsyes0
each notice carries its own factscustomyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash321.30.0131
Codex / GPT-5.6 sol331.10.1462

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "maintenance-notices".