paperbench-expanded

PaperBench High-Difficulty and Expanded Tasks: paper reproduction beyond machine learning. 93 tasks in 12 research areas, run in domain-native software and graded by clean replay. 12 public tasks.

This set expands PaperBench beyond machine learning with high-difficulty tasks across the sciences. It tests the complete scientific reproduction workflow: translate a published paper into the intended experiment, execute it in a domain-native environment, and produce evidence another researcher can independently regenerate. A plausible result is not enough if the submitted procedure models the wrong system or cannot reproduce its own evidence.