Datasetpublic

Podtech/llm-jp-corpus-v4-ja_wiki

llm-jp-corpus-v4 — ja_wiki Mirror of the ja/ja_wiki sub-corpus of LLM-jp Corpus v4, built by the LLM-jp Corpus Building WG (NII). Source: https://gitlab.llm-jp.nii.ac.jp/datasets/llm-jp-corpus-v4 Sub-corpus: ja_wiki Files: 6 × jsonl.gz (1.9 GB compressed) Format: one JSON object per line, with a text key and a meta key (document id, URL, and other provenance fields). Directory layout mirrors the upstream repository. License CC BY-SA 3.0 — inherited from the… See the full description on the dataset page: https://huggingface.co/datasets/Podtech/llm-jp-corpus-v4-ja_wiki.

sourceHugging Facecc-by-sa-3.0updated 2mo agoView on Hugging Face

0likes1.6kdownloads

Dataset Card

llm-jp-corpus-v4 — `ja_wiki`

Mirror of the ja/ja_wiki sub-corpus of LLM-jp Corpus v4, built by the LLM-jp Corpus Building WG (NII).

—Source: https://gitlab.llm-jp.nii.ac.jp/datasets/llm-jp-corpus-v4
—Sub-corpus: ja_wiki
—Files: 6 × jsonl.gz (1.9 GB compressed)
—Format: one JSON object per line, with a text key and a meta key (document id, URL, and other provenance fields).

Directory layout mirrors the upstream repository.

License

CC BY-SA 3.0 — inherited from the upstream sub-corpus. Attribution goes to the LLM-jp Corpus Building WG and to the original data providers listed in the upstream README, which remains the authoritative statement of terms for this data.