$400 in API credits per rollout on one paper
One 12-hour agent rollout replicating a research paper (o1 IterativeAgent on PaperBench)
Dated 7 Apr 2025Source checked 11 Oct 2026Page out of reach at the last check, 17 Oct 2026Basis: stated
In the source's own words
“We estimate that on average it costs $400 in API credits to run an o1 IterativeAgent 12-hour rollout on a single paper in PaperBench.”
Where it was read
arXiv, PaperBench (v3), checked 11 Oct 2026
Everything read from this source (1)Archived copy, 4 Oct 2026
What it is about
Figures it counts in
- $1,500 per taskDatasets, tasks and environments, cost to produce, per task
- 36Prices per task behind every valuation of a task set