OneScience-Group/mp20

1---2# User-Defined Tags3tags:4  - MP-205  - Materials Project6  - crystal structure7  - inorganic materials8  - CIF9  - materials generation10language:11  - en12  - zh13license: cc-by-4.014---15<p align="center">16  <strong>17    <span style="font-size: 30px;">MP-20</span>18  </strong>19</p>20 21## Dataset Description22 23MP-20 is derived from the Materials Project database (Jain et al., 2013) and contains approximately 45,000 common inorganic materials. It covers most experimentally known materials with no more than 20 atoms in the unit cell. The data includes elemental compositions, CIF structures, space groups, formation energies per atom, DFT band gaps, bulk moduli, and magnetic densities.24 25Source paper: A. Jain *et al.*, *Commentary: The Materials Project: A materials genome approach to accelerating materials innovation*, **APL Materials 1**, 011002 (2013).<br>26Paper: https://pubs.aip.org/aip/apm/article/1/1/011002/119685<br>27DOI: https://doi.org/10.1063/1.481232328 29This repository provides both raw CSV files and preprocessed caches. The data split contains 27,136 structures in the training set, 9,047 structures in the validation set, and 9,046 structures in the test set, for a total of 45,229 crystal structures.30 31The current data package contains 30 data files totaling approximately 83 MB.32 33## Supported Tasks34 35This standardized data repository organizes the MP-20 training, validation, and test data for:36 37- Data analysis and statistics for inorganic crystal structures38- Training and evaluation of crystal structure generation tasks39- Conditional modeling of material properties40- Research on properties such as formation energy, band gap, bulk modulus, and magnetic density41- Crystal data loading, preprocessing, and data pipeline validation42 43## Dataset Format and Structure44 45The data files are located in the `data/MP20/` directory:46 47```text48data/MP20/49├── raw/mp_20/50│   ├── train.csv51│   ├── val.csv52│   └── test.csv53└── cache/mp_20/54    ├── train/55    ├── val/56    └── test/57```58 59| File Path | Format | Shape / Content | Description |60|---|---|---|---|61| `raw/mp_20/train.csv` | CSV + CIF | 27,136 structures | Raw crystal and property data for the training set |62| `raw/mp_20/val.csv` | CSV + CIF | 9,047 structures | Raw crystal and property data for the validation set |63| `raw/mp_20/test.csv` | CSV + CIF | 9,046 structures | Raw crystal and property data for the test set |64| `cache/mp_20/train/` | NPY + JSON | 27,136 structures | Preprocessed cache for the training set |65| `cache/mp_20/val/` | NPY + JSON | 9,047 structures | Preprocessed cache for the validation set |66| `cache/mp_20/test/` | NPY + JSON | 9,046 structures | Preprocessed cache for the test set |67| `metadata/sha256_manifest.txt` | SHA256 | 30 records | Data file integrity checksum manifest |68 69### CSV Data Format70 71Each row in a CSV file corresponds to one crystal structure. The `cif` field stores complete multiline CIF text, so the number of samples cannot be determined using a standard text line count.72 73| Field | Type | Description |74|---|---|---|75| `material_id` | str | Materials Project structure ID |76| `pretty_formula` | str | Chemical formula |77| `elements` | list[str] | Set of elements in the structure |78| `cif` | str | Crystal structure in CIF format |79| `spacegroup_number` | int | Space group number |80| `formation_energy_per_atom` | float | Formation energy per atom |81| `dft_band_gap` | float | DFT band gap |82| `dft_bulk_modulus` | float / null | DFT bulk modulus; null for some samples |83| `dft_mag_density` | float | DFT magnetic density |84 85### Cache Data Format86 87Each `train`, `val`, and `test` cache directory contains the following files:88 89| File | Type | Shape | Description |90|---|---|---|---|91| `atomic_numbers.npy` | int64 | `[N_atoms_total]` | Atomic numbers concatenated across all structures |92| `cell.npy` | float64 | `[N_structures, 3, 3]` | Unit-cell matrices |93| `num_atoms.npy` | int64 | `[N_structures]` | Number of atoms in each structure |94| `pos.npy` | float64 | `[N_atoms_total, 3]` | Fractional coordinates concatenated across all structures |95| `structure_id.npy` | str | `[N_structures]` | Structure IDs |96| `formation_energy_per_atom.json` | JSON | `[N_structures]` | Formation energy per atom property |97| `dft_band_gap.json` | JSON | `[N_structures]` | DFT band gap property |98| `dft_bulk_modulus.json` | JSON | `[N_structures]` | DFT bulk modulus property |99| `dft_mag_density.json` | JSON | `[N_structures]` | DFT magnetic density property |100 101## How to Use the Dataset102 103Download the dataset:104 105```bash106hf download OneScience-Group/mp20 --repo-type dataset107```108 109Validate the dataset directory, sample counts, array shapes, and SHA256 checksums:110 111```bash112python scripts/validate_mp20.py \113  --dataset-root data/MP20 \114  --checksum-manifest metadata/sha256_manifest.txt115```116 117Skip SHA256 verification and check only the data structure:118 119```bash120python scripts/validate_mp20.py \121  --dataset-root data/MP20 \122  --skip-checksum123```124 125## Official OneScience Information126 127| Platform | OneScience Main Repository | Skills Repository |128|---|---|---|129| Gitee | https://gitee.com/onescience-ai/onescience | https://gitee.com/onescience-ai/oneskills |130| GitHub | https://github.com/onescience-ai/OneScience | https://github.com/onescience-ai/oneskills |131 132## Limitations and License133 134This repository standardizes the directory structure of the MP-20 data and provides raw CSV files, preprocessed caches, a checksum manifest, and a validation script. It does not generate new samples or alter the original crystal structures or property data.135 136- The structures and properties in the data come from the Materials Project and the original MP-20 data curation pipeline. When using the data, cite the 2013 Materials Project paper by Jain et al. and the specific data version used.137- Some material properties contain missing values and must be filtered or masked as appropriate for the task.138- The Materials Project states that its data is licensed under the [Creative Commons Attribution 4.0 International (CC BY 4.0)](https://creativecommons.org/licenses/by/4.0/) license. This repository uses the same data license; appropriate attribution must be retained when using or redistributing the data.139- If individual entries contain third-party contributed data or additional restrictions, refer to the source of the corresponding entry and the information on its Materials Project page.140