FY2026 fundraising figures for the board
donor-annual-figures · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Nadia needs this year's fundraising figures for the board packet - totals against last year, the top ten donors and donor retention. Put them in annual_figures.xlsx with live formulas and write a cover memo as memo.md. Her email and the gift policy are in the folder.
Workspace
- email_from_treasurer.txt
- gift_reporting_policy.txt
- gifts_export_2024-01-01_to_2026-06-30.csv
Expected deliverables
- annual_figures.xlsx
- memo.md
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| annual_figures.xlsx exists | file_exists | yes | 0 |
| live formulas | xlsx_has_formulas | yes | 0 |
| no error cells | xlsx_no_errors | yes | 2 |
| FY2026 net cash raised | xlsx_value_present | yes | 0 |
| FY2025 net cash raised | xlsx_value_present | yes | 1 |
| top donor FY2026 total | xlsx_value_present | yes | 0 |
| retained donors | xlsx_value_present | yes | 0 |
| donor retention rate | custom | yes | 0 |
| memo carries both years' totals | text_numbers_present | yes | 0 |
| memo says the foundation gift was refunded | text_sentence_matches | yes | 1 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 1 | 1 | 13.0 | 0.1285 | |
| Codex / GPT-5.6 sol | 1 | 1 | 9.2 | 0.8874 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "donor-annual-figures".