Tasks · desk · Extraction
Key this week's customer POs into order entry
purchase-orders-pdf · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Please get this week's customer purchase orders into the order entry template so we can import them. Carla's note has the details. Save it as po_lines.csv.
Workspace
- customer_list.csv
- customer_pos/Northfield_order_NAB-0926.pdf
- customer_pos/PO PR-24920.pdf
- customer_pos/Pemberton PO PH-7627 (1).pdf
- customer_pos/Pemberton PO PH-7627.pdf
- customer_pos/WPL_PO_4500018241.pdf
- customer_pos/fax_20260914_0932.pdf
- note_from_carla.txt
- order_entry_template.csv
Expected deliverables
- po_lines.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| template columns | csv_columns | yes | 0 |
| one row per PO line | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| PO header fields | csv_values_match | yes | 0 |
| part numbers and descriptions | csv_values_match | yes | 0 |
| quantities and unit prices | csv_values_match | yes | 0 |
| line amounts | csv_values_match | yes | 0 |
| need-by dates | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 2.0 | 0.0403 | |
| Codex / GPT-5.6 sol | 3 | 3 | 3.2 | 0.4344 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "purchase-orders-pdf".