Team Ai
Datasetpublic

OpenScientificCodeRegistry/Database

Open Scientific Code Registry (OSCR): the authors' scripts The code published by the authors of open-access neuroscience papers, as found and verified by Open Scientific Code Registry (OSCR). Each file is here exactly as it is at the source, at the verified commit, under the license of its repository. 330,094 unique files (2,965 MB of text) from 7,102 repositories, in 18 Parquet block(s). Only files whose repository's license allows redistribution, confirmed by the repository's… See the full description on the dataset page: https://huggingface.co/datasets/OpenScientificCodeRegistry/Database.

sourceHugging Faceotherupdated 3d agoView on Hugging Face
0likes4.6kdownloads
Dataset Card

Open Scientific Code Registry (OSCR): the authors' scripts

The code published by the authors of open-access neuroscience papers, as found and verified by Open Scientific Code Registry (OSCR). Each file is here exactly as it is at the source, at the verified commit, under the license of its repository.

  • —330,094 unique files (2,965 MB of text) from 7,102 repositories, in 18 Parquet block(s).
  • —Only files whose repository's license allows redistribution, confirmed by the repository's own license file (or, for an archive without one, by its record). Files without such a license are never copied here: Open Scientific Code Registry (OSCR) links to them at the source.
  • —No text of any paper.

Layout

  • —blocks/NNNNN.parquet: one row per unique file (SHA-256 of its text): sha256, language, size, lines, content. zstd page compression, 64 rows per row group: a single file can be read with HTTP range requests (for example with hyparquet in a browser). A published block never changes; new files go into new blocks.
  • —manifests/<xx>/<repository>.json: per repository, its URL, commit and license, and for each file its path, digest, and the (block, row) holding its text.

Licenses

Each file keeps the license of its repository, given in the repository's manifest (license, license_confirmed_by). Repositories by license:

licenserepositories
MIT2914
CC-BY-4.01631
GPL-3.01055
Apache-2.0540
BSD-3-Clause320
CC0-1.0120
GPL-2.096
BSD-2-Clause85
AGPL-3.072
CC-BY-NC-4.056
other-open47
CC-BY-NC-SA-4.046
LGPL-3.025
CC-BY-NC-ND-4.025
MPL-2.015
LGPL-2.115
CC-BY-SA-4.015
Artistic-2.09
CECILL-2.15
Unlicense4
EUPL-1.24
CC-BY-ND-4.03

Files under a non-commercial license (CC BY-NC…) may only be reused non-commercially.

Takedown

An author who wants a file removed: open an issue at https://github.com/NeuraCrypt/OSCR/issues.