Mathematics
Large Language Monkeys
Studies how repeated sampling affects problem solving by recording individual generated solutions and their correctness.
525items
13subjects
MIT for released model samples; Apache-2.0 for the author evaluation code. Original problem and reference sources retain their upstream licenses.license
mathematicsdomain
software_engineeringdomain
reasoningdomain
textmodality
item-level responses released
Saturation status: No
About this data
Dataset name: Large Language Monkeys: Monkey Business
Complete released prompts, model-generated solutions and per-sample correctness flags from the original Monkey Business repeated-sampling collection.
525 items · 28,780,000 recorded attempts. Browse item pages to see all observations. Filters and means apply to the current page.
Loading observation records…