Software Engineering
ResearchCodeBench
ResearchCodeBench tests whether models can implement a missing piece of a recent machine learning paper's code, given the paper itself and the surrounding file, with curated tests deciding whether the filled in code works.
212items
31subjects
unknownlicense
software_engineeringdomain
ml_engineeringdomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect