whitecircle/swe-rebench-v2-clean-python-tasks
SWE-rebench-V2 clean Python tasks A train/test split of Python tasks from nebius/SWE-rebench-V2. We took the Python subset of the original dataset and kept only the tasks where the golden patch passes the unit tests and the empty patch does not. train: 3,837 instances from 408 repositories test: 500 instances from 100 repositories The split is made by repository, so no repository appears in both splits. We evaluated multiple models on the test split as of June 2026 — the… See the full description on the dataset page: https://huggingface.co/datasets/whitecircle/swe-rebench-v2-clean-python-tasks.
SWE-rebench-V2 clean Python tasks
A train/test split of Python tasks from nebius/SWE-rebench-V2. We took the Python subset of the original dataset and kept only the tasks where the golden patch passes the unit tests and the empty patch does not.
- train: 3,837 instances from 408 repositories
- test: 500 instances from 100 repositories
The split is made by repository, so no repository appears in both splits.
We evaluated multiple models on the test split as of June 2026 — the comparison is here.
