Tasks · desk · Extraction
Match the scanned field trip slips to the class roster
permission-forms-scanned · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Ms. Osei scanned the field trip permission slips that came back. Please match them up with her class roster and save it as consents.csv - her note says what the office needs.
Workspace
- note_from_ms_osei.txt
- permission_slips/Scan_2026-09-22_001.pdf
- permission_slips/Scan_2026-09-22_002.pdf
- permission_slips/Scan_2026-09-22_003.pdf
- permission_slips/Scan_2026-09-22_004.pdf
- permission_slips/Scan_2026-09-22_005.pdf
- permission_slips/Scan_2026-09-22_006.pdf
- permission_slips/Scan_2026-09-22_007.pdf
- permission_slips/Scan_2026-09-22_008.pdf
- permission_slips/Scan_2026-09-22_009.pdf
- permission_slips/Scan_2026-09-22_010.pdf
- permission_slips/Scan_2026-09-22_011.pdf
- permission_slips/Scan_2026-09-22_012.pdf
- permission_slips/Scan_2026-09-22_013.pdf
- room4_roster.csv
Expected deliverables
- consents.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 2 |
| one row per roster student | csv_set_equal | yes | 2 |
| row count | csv_row_count | yes | 2 |
| student and guardian names | csv_values_match | yes | 2 |
| guardian phone | csv_values_match | yes | 2 |
| permission and signature | csv_values_match | yes | 2 |
| photo release | csv_values_match | yes | 2 |
| date signed | csv_values_match | yes | 2 |
| other-class slip left out | text_not_contains | yes | 2 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 1 | 1 | 31.0 | 0.1150 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.7 | 0.3101 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "permission-forms-scanned".