Team Ai
Datasetpublic

whitecircle/swe-rebench-v2-clean-python-tasks

SWE-rebench-V2 clean Python tasks A train/test split of Python tasks from nebius/SWE-rebench-V2. We took the Python subset of the original dataset and kept only the tasks where the golden patch passes the unit tests and the empty patch does not. train: 3,837 instances from 408 repositories test: 500 instances from 100 repositories The split is made by repository, so no repository appears in both splits. We evaluated multiple models on the test split as of June 2026 — the… See the full description on the dataset page: https://huggingface.co/datasets/whitecircle/swe-rebench-v2-clean-python-tasks.

sourceHugging Facecc-by-4.0updated 3mo agoView on Hugging Face
1likes728downloads
Dataset Card

SWE-rebench-V2 clean Python tasks

A train/test split of Python tasks from nebius/SWE-rebench-V2. We took the Python subset of the original dataset and kept only the tasks where the golden patch passes the unit tests and the empty patch does not.

  • —train: 3,837 instances from 408 repositories
  • —test: 500 instances from 100 repositories

The split is made by repository, so no repository appears in both splits.

[image]

[image]

We evaluated multiple models on the test split as of June 2026 — the comparison is here.