Business Bench

Tasks · desk · Extraction

Daily hours from the scanned caregiver time sheets

timesheets-scanned · timeout 1800 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

The caregivers' time sheets for this pay period are scanned in the folder. Can you turn them into timesheet_hours.csv for payroll? Gloria's note explains what the upload needs.

Workspace

  • note_from_gloria.txt
  • scanned_timesheets/IMG_4410.pdf
  • scanned_timesheets/IMG_4417.pdf
  • scanned_timesheets/scan_0829_okafor.pdf
  • scanned_timesheets/scan_0905_okafor.pdf
  • scanned_timesheets/scan_0912_okafor.pdf
  • scanned_timesheets/visit_log_kimberly_wk1.pdf
  • scanned_timesheets/visit_log_kimberly_wk2.pdf

Expected deliverables

  • timesheet_hours.csv

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
requested columnscsv_columnsyes0
one row per person per daycsv_set_equalyes0
row countcsv_row_countyes0
employee and datecsv_values_matchyes0
hours per daycsv_values_matchyes0
signature flagcsv_values_matchyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash333.70.0336
Codex / GPT-5.6 sol332.10.2520

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "timesheets-scanned".