Tasks · desk · Spreadsheet
Q2 leads and won revenue by marketing source
lead-source-rollup · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Dmitri wants to know where our Q2 leads came from and what they turned into, by marketing source. Use the CRM export and Sofia's code sheet and save lead_sources.csv - her email explains how to count.
Workspace
- campaign_codes_2026.xlsx
- crm_leads_export_2026-07-02.csv
- email_from_sofia.txt
Expected deliverables
- lead_sources.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| every source plus Untracked | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| leads per source | csv_values_match | yes | 0 |
| won revenue per source | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.0 | 0.0166 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.5 | 0.2080 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "lead-source-rollup".