Write this month's past-due reminders
overdue-reminders · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Nadia's out, so please write this month's past-due payment reminders from the open invoice export - one file per customer in a reminders folder. Her guidelines are in the folder, and Dale's email has a couple of notes.
Workspace
- email_from_dale.txt
- open_invoices_2026-09-30.csv
- payment_plans.csv
- reminder_guidelines.md
Expected deliverables
- reminders/*.md
- reminders/*[Dd][Oo][Rr][Ss][Ee][Yy]*
- reminders/*[Rr][Ee][Dd][Ww][Oo][Oo][Dd]*
- reminders/*[Yy][Ee][Ll][Ll][Oo][Ww][Tt][Aa][Ii][Ll]*
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| reminder files | file_exists | yes | 0 |
| Redwood Property Mgmt reminder figures | text_numbers_present | yes | 0 |
| Yellowtail Seafood reminder figures | text_numbers_present | yes | 0 |
| Dorsey Freight credit hold paragraph | text_sentence_matches | yes | 0 |
| per-customer reminder facts | custom | yes | 3 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.2 | 0.0165 | |
| Codex / GPT-5.6 sol | 0 | 0 | 1.8 | 0.2230 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "overdue-reminders".