AmazonScience/migration-bench-java-utg

1---2license: apache-2.03dataset_info:4  features:5  - name: repo6    dtype: string7  - name: base_commit8    dtype: string9  - name: license10    dtype: string11  splits:12  - name: test13    num_examples: 481414programming_languages:15- java16tags:17- coding18- code-migration19- java20- amazon21- amazon-science22- aws23task_categories:24- text-generation25---26 27# MigrationBench28<table>29  <tr>30    <td style="padding: 0;">31      <a href="https://huggingface.co/collections/AmazonScience/migrationbench-68125452fc21a4564b92b6c3">32        <img src="https://img.shields.io/badge/-🤗 MigrationBench-4d5eff?style=flatten&labelColor" alt="MigrationBench (Hugging Face)">33      </a>34    </td>35    <td style="padding: 0;">36      <a href="https://github.com/amazon-science/MigrationBench">37        <img src="https://img.shields.io/badge/MigrationBench-000000?style=flatten&logo=github" alt="MigrationBench (GitHub)">38      </a>39    </td>40    <td style="padding: 0;">41      <a href="https://github.com/amazon-science/SDFeedback">42        <img src="https://img.shields.io/badge/SDFeedback-000000?style=flatten&logo=github&logoColor=white" alt="SDFeedback (GitHub)">43      </a>44    </td>45    <td style="padding: 0;">46      <a href="https://arxiv.org/abs/2505.09569">47        <img src="https://img.shields.io/badge/arXiv-2505.09569-b31b1b.svg?style=flatten" alt="MigrationBench (arXiv)">48      </a>49    </td>50    <td style="padding: 0; padding-left: 10px; vertical-align: middle;">51      <a href="https://huggingface.co/datasets/AmazonScience/migration-bench-java-full">52        <img src="https://img.shields.io/badge/-🤗 java--full-8a98ff?style=flat&labelColor" alt="java-full">53      </a>54    </td>55    <td style="padding: 0; vertical-align: middle;">56      <a href="https://huggingface.co/datasets/AmazonScience/migration-bench-java-selected">57        <img src="https://img.shields.io/badge/-🤗 java--selected-8a98ff?style=flat&labelColor" alt="java-selected">58      </a>59    </td>60    <td style="padding: 0; vertical-align: middle;">61      <a href="https://huggingface.co/datasets/AmazonScience/migration-bench-java-utg">62        <img src="https://img.shields.io/badge/-🤗 java--utg-8a98ff?style=flat&labelColor" alt="java-utg">63      </a>64    </td>65  </tr>66</table>67 68 69## 1. 📖 Overview70 71[🤗 MigrationBench](https://huggingface.co/collections/AmazonScience/migrationbench-68125452fc21a4564b92b6c3)72is a large-scale code migration benchmark dataset at the **repository** level,73across multiple programming languages.74 75- Current and initial release includes `java 8` repositories with the `maven` build system, as of May 2025.76 77 78## 2. Datasets79 80There are three datasets in [🤗 MigrationBench](https://huggingface.co/collections/AmazonScience/migrationbench-68125452fc21a4564b92b6c3):81- All repositories included in the datasets are available on GitHub, under the `MIT` or `Apache-2.0` license.82 83| Index | Dataset                                       | Size  | Notes                                                                                               |84|-------|-----------------------------------------------|-------|-----------------------------------------------------------------------------------------------------|85| 1     | [🤗 `AmazonScience/migration-bench-java-full`](https://huggingface.co/datasets/AmazonScience/migration-bench-java-full)         | 5,102 | Each repo has a test directory or at least one test case                              |86| 2     | [🤗 `AmazonScience/migration-bench-java-selected`](https://huggingface.co/datasets/AmazonScience/migration-bench-java-selected) |   300 | A **subset** of [🤗 `migration-bench-java-full`](https://huggingface.co/datasets/AmazonScience/migration-bench-java-full)                                          |87| 3     | [🤗 `AmazonScience/migration-bench-java-utg`](https://huggingface.co/datasets/AmazonScience/migration-bench-java-utg)           | 4,814 | The unit test generation (utg) dataset, **disjoint** with [🤗 `migration-bench-java-full`](https://huggingface.co/datasets/AmazonScience/migration-bench-java-full)|88 89 90## 3. Metadata91 92Metadata is provided in the `csv` file for each dataset:93 941. `repo (str)`: The original repo URL without the `https://github.com/` prefix951. `base_commit (str)`: Base commit id96    - At this commit with `java 8` and `maven`, the repository is able to (1) compile and (2) pass existing unit tests and integration tests if any97    - It is the starting point for code migration from `java 8`981. `license (str)`: The license of the repository, either `MIT` or `Apache2.0` for the whole dataset99 100 101## 4. 📚 Citation102 103```bibtex104@misc{liu2025migrationbenchrepositorylevelcodemigration,105      title={MigrationBench: Repository-Level Code Migration Benchmark from Java 8},106      author={Linbo Liu and Xinle Liu and Qiang Zhou and Lin Chen and Yihan Liu and Hoan Nguyen and Behrooz Omidvar-Tehrani and Xi Shen and Jun Huan and Omer Tripp and Anoop Deoras},107      year={2025},108      eprint={2505.09569},109      archivePrefix={arXiv},110      primaryClass={cs.SE},111      url={https://arxiv.org/abs/2505.09569},112}113```114