Datasetpublic

NickIBrody/rust-code-suite

NickIBrody/rust-code-suite Rust Code Suite is a public raw Rust source corpus built from open-source repositories and selected historical git revisions. Splits train.jsonl validation.jsonl test.jsonl Schema { "id": "owner/repo:path:chunk", "text": "...", "arch": "rust", "syntax": "rust", "kind": "rust-source", "repo": "owner/repo", "path": "src/lib.rs", "license": "GPL-2.0", "commit": "abcdef123456", "source_url":… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/rust-code-suite.

sourceHugging Faceupdated 5mo agoView on Hugging Face

1likes58downloads

rootREADME.md

README.md151 linesDownload Raw Back to root

1---2pretty_name: Rust Code Suite3language:4- code5tags:6- code7- rust8- systems-programming9- code-corpus10task_categories:11- text-generation12size_categories:13- 100K<n<1M14source_datasets:15- original16---17 18# NickIBrody/rust-code-suite19 20Rust Code Suite is a public raw Rust source corpus built from open-source repositories and selected historical git revisions.21 22## Splits23 24- `train.jsonl`25- `validation.jsonl`26- `test.jsonl`27 28## Schema29 30```json31{32  "id": "owner/repo:path:chunk",33  "text": "...",34  "arch": "rust",35  "syntax": "rust",36  "kind": "rust-source",37  "repo": "owner/repo",38  "path": "src/lib.rs",39  "license": "GPL-2.0",40  "commit": "abcdef123456",41  "source_url": "https://github.com/owner/repo/blob/abcdef123456/src/lib.rs"42}43```44 45## Build Summary46 47```json48{49  "total_examples": 1079332,50  "arch_counts": {51    "rust": 107933252  },53  "syntax_counts": {54    "rust": 107933255  },56  "kind_counts": {57    "rust-source": 738167,58    "macro-heavy": 251258,59    "testsuite": 87434,60    "inline": 247361  },62  "top_repos": [63    [64      "RustPython/RustPython",65      8000066    ],67    [68      "rhaiscript/rhai",69      8000070    ],71    [72      "rust-lang/cargo",73      8000074    ],75    [76      "rust-lang/rust-analyzer",77      8000078    ],79    [80      "rust-lang/rust",81      8000082    ],83    [84      "rustdesk/rustdesk",85      8000086    ],87    [88      "clap-rs/clap",89      7789090    ],91    [92      "rust-lang/rustfmt",93      7768294    ],95    [96      "rust-lang/rust-clippy",97      7504998    ],99    [100      "serde-rs/serde",101      59024102    ],103    [104      "tokio-rs/tokio",105      57979106    ],107    [108      "rust-lang/rustup",109      54353110    ],111    [112      "hyperium/hyper",113      44769114    ],115    [116      "awslabs/aws-sdk-rust",117      29884118    ],119    [120      "mozilla/uniffi-rs",121      23585122    ],123    [124      "BurntSushi/ripgrep",125      21317126    ],127    [128      "serde-rs/json",129      20506130    ],131    [132      "rust-bitcoin/rust-secp256k1",133      16189134    ],135    [136      "tokio-rs/prost",137      11952138    ],139    [140      "rust-lang/rustlings",141      6059142    ]143  ],144  "avg_chars": 1887.91,145  "size_estimate_bytes": 2037683839,146  "train": 971127,147  "validation": 54238,148  "test": 53967149}150```151