Business Bench

Tasks · desk · Drafting

Fall appeal letter for the Hatch Farm campaign

fundraising-appeal · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Please draft this fall's appeal letter for the Hatch Farm campaign. Shirley's campaign notes say what it needs, and the gift export and the foundation's letter are in the folder. Save it as appeal.md.

Workspace

  • appeal_letter_2025_yearend.md
  • campaign_notes_hatch_farm.md
  • gifts_export_2026-09-10.csv
  • osei_foundation_match_letter.pdf

Expected deliverables

  • appeal.md

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
appeal.md existsfile_existsyes0
campaign figurestext_numbers_presentyes0
outdated figures absenttext_not_containsyes0
match amount and deadlinecustomyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash332.10.0270
Codex / GPT-5.6 sol332.40.2255

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "fundraising-appeal".