Tasks · desk · Bookkeeping
Split last week's tip pool by shift
tip-pooling · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Can you split last week's tips for payroll? The POS export, the cash envelope sheet, the time clock and Hana's tip pool memo are all in the folder. Save it as tip_distribution.csv.
Workspace
- cash_tip_envelopes_wk33.xlsx
- pos_checks_2026-08-10_to_2026-08-16.csv
- timeclock_punches_wk33.csv
- tip_pool_memo.txt
Expected deliverables
- tip_distribution.csv
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| payout sheet columns | csv_columns | yes | 1 |
| one line per person per shift | csv_row_count | yes | 0 |
| managers take nothing | text_not_contains | yes | 0 |
| tip shares per person per shift | custom | yes | 1 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 2 | 2 | 2.3 | 0.0282 | |
| Codex / GPT-5.6 sol | 3 | 3 | 3.6 | 0.3955 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "tip-pooling".