datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
bayan-simplification-corpus
Synthetic simplification data card — v1
Versions. main and the v1 tag hold v1 (Gemma 4 31B generator, Qwen3.8 27B judge). The previous
DeepSeek release is kept at the v0 tag: load_dataset("Congi-libya/bayan-simplification-corpus", revision="v0").
A full v0 vs v1 comparison is in Cogni-Libya/Bayan#45.
Paths under scripts/ and docs/ refer to the Bayan repository;
paths under data/processed/ are the project's working files and are not part of this dataset.
Version 1 of… See the full description on the dataset page: https://huggingface.co/datasets/Congi-libya/bayan-simplification-corpus.simplification-datasetДанный dataset был собран из корпуса "RuSimpleSentEval" (https://github.com/dialogue-evaluation/RuSimpleSentEval), а также "RuAdapt" (https://github.com/Digital-Pushkin-Lab/RuAdapt) для задачи упрощения текста (text simplification).
from datasets import load_dataset
data_files = {'train':"train.csv",'test':"test.csv"}
dataset = load_dataset("r1char9/simplification", data_files=data_files)
train_df = dataset['train'].to_pandas()
test_df = dataset['test'].to_pandas()
age-specific-text-simplification
Age-Specific Text Simplification Dataset
Dataset Description
This dataset contains complex texts simplified into age-appropriate versions for children aged 3, 4, and 5 years old. Each original text has been professionally adapted to match the cognitive development, vocabulary, and comprehension abilities of each specific age group.
Dataset Summary
Total Examples: 17,177
Training Split: 15,459 examples
Validation Split: 1,718 examples
Languages:… See the full description on the dataset page: https://huggingface.co/datasets/hasankursun/age-specific-text-simplification.bfs-optimal-symbolic-algebra-simplification-trajectories
ISRE v7 BFS Trajectories
This dataset contains BFS-optimal symbolic algebra simplification trajectories
for the ISRE research project.
Each row is one trajectory. Nested fields are stored as JSON strings to preserve
the original AST and step structure without lossy flattening.
What This Dataset Is
This is not a natural-language instruction dataset. It is a symbolic algebra
policy-learning dataset.
Each trajectory starts from a deliberately scrambled algebraic… See the full description on the dataset page: https://huggingface.co/datasets/NecroMOnk/bfs-optimal-symbolic-algebra-simplification-trajectories.task934_turk_simplification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task934_turk_simplification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task934_turk_simplification.Estonian-Text-Simplification
Estonian Text Simplification
This repository contains resources and models for Estonian text simplification, including datasets and pre-trained models.
Files
Dataset Files
simplification_training_set.json: A dataset used to fine-tune LLaMA 3.1 for text simplification.
src: The source of the data.
original: The original sentence to be simplified.
simpl_lex: A lexical simplification (may be empty).
simpl_final: The final simplified sentence.… See the full description on the dataset page: https://huggingface.co/datasets/vulturuldemare/Estonian-Text-Simplification.wiki_simplifications_dutch_dedup_splitThis is a variant of the original dataset.
It was shuffled (seed=42);
Deduplicated on rows (96,613 rows removed);
Split into train, validation and test sets (the latter have 8192 samples each)
Reproduction
from datasets import load_dataset, Dataset, DatasetDict
ds = load_dataset("UWV/Leesplank_NL_wikipedia_simplifications", split="train")
ds = ds.shuffle(seed=42)
print("original", ds)
df = ds.to_pandas()
df = df.drop_duplicates().reset_index()
ds = Dataset.from_pandas(df)… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/wiki_simplifications_dutch_dedup_split.legal-simplification-pt
Dataset Structure
Configuration: random_split
train_random
validation_random
test_random
Configuration: by_source
acordaos_tcu
stf_decisions
stf_votes
tjsp
trf5
ulysses_tesemo
chatgpt-dutch-simplification
Dataset Card for ChatGPT Dutch Simplification
Dataset Summary
Created in light of a master thesis by Charlotte Van de Velde as part of the Master of Science in Artificial Intelligence at KU Leuven.
Charlotte is supervised by Vincent Vandeghinste and Bram Vanroy.
The dataset contains Dutch source sentences and aligned simplified sentences, generated with ChatGPT. All splits combined, the dataset
consists of 1267 entries.
Charlotte used gpt-3.5-turbo with the following… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/chatgpt-dutch-simplification.wikilarge-text-simplificationbisect_fr_prompt_textual_simplification
bisect_fr_prompt_textual_simplification
Summary
bisect_fr_prompt_textual_simplification is a subset of the Dataset of French Prompts (DFP).It contains 9,889,420 rows that can be used for a textual simplification task.The original data (without prompts) comes from the dataset BiSECT by Kim et al. where only the French part has been kept.A list of prompts (see below) was then applied in order to build the input and target columns and thus obtain the same format as the xP3… See the full description on the dataset page: https://huggingface.co/datasets/CATIE-AQ/bisect_fr_prompt_textual_simplification.Leesplank_NL_wikipedia_simplificationsThe set contains 2.87M pragraphs of prompt/result combinations, where the prompt is a paragraph from Dutch Wikipedia and the result is a simplified text, which could include more than one paragraph.
This dataset was created by UWV, as a part of project "Leesplank", an effort to generate datasets that are ethically and legally sound.
The basis of this dataset was the wikipedia extract as a part of Gigacorpus (http://gigacorpus.nl/). The lines were fed one by one into GPT 4 1106 preview, where… See the full description on the dataset page: https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications.Leesplank_NL_wikipedia_simplifications_preprocessed
Dataset Card for Dataset Name
A synthetic dataset made by simplifying Dutch Wikipedia entries. This is a processed version of an earlier publication.
Dataset Details
Dataset Description
Leesplank_nl_wikipedia_simplifications_preprocessed is based on https://huggingface.co/datasets/BramVanroy/wiki_simplifications_dutch_dedup_split, which in itself is based on our own dataset (https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications), but… See the full description on the dataset page: https://huggingface.co/datasets/UWV/Leesplank_NL_wikipedia_simplifications_preprocessed.medical-reports-simplification-dataset
🏥 Medical Reports Simplification Dataset
📋 Description
Dataset créé avec Gemini 2.5 Pro (Preview) pour entraîner des modèles à simplifier les rapports médicaux complexes en explications compréhensibles pour les patients.
🎯 Objectif : Démocratiser l'accès à l'information médicale en rendant les rapports techniques accessibles au grand public.
🔧 Génération du Dataset
Génération : Gemini 2.5 Pro (Preview)
Validation : Contrôle qualité automatisé… See the full description on the dataset page: https://huggingface.co/datasets/Sadou/medical-reports-simplification-dataset.task111_asset_sentence_simplification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task111_asset_sentence_simplification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task111_asset_sentence_simplification.med_paragraph_simplificationspanish_simplification_20k
Dataset Card: spanish_simplification_20k
This dataset provides 20K samples for Spanish simplification across a diverse range of topics, designed for people with cognitive challenges. The samples vary in length, from short to long. This dataset can supplement a larger training corpus for fine-tuning small language models, such as Gemma 4B, to simplify complex Spanish into simpler Spanish or translate English directly into simplified Spanish.
Dataset Contributors… See the full description on the dataset page: https://huggingface.co/datasets/khaledmahmoud/spanish_simplification_20k.nemotron-cc-atomic-simplification-gemma4-31b
nemotron-cc atomic-statement simplification (Gemma 4 31B-it)
2,000,000 records: source text from
nvidia/nemotron-cc-v2.1 (High-Quality-Synthetic
split) rewritten by google/gemma-4-31B-it into a sequence of atomic, Subject-Verb-Object
statements.
Generated with vLLM 0.22.1 in-process batch inference (see src/generate/run.py in the
producing repo), TP=4, max_model_len=16384, max_tokens=8192, prompts filtered to
<=8192 templated tokens.
Fields
id: original… See the full description on the dataset page: https://huggingface.co/datasets/rpisano/nemotron-cc-atomic-simplification-gemma4-31b.legal_simplification_corpus
Dataset Card for "legal_simplification_corpus"
More Information needed
english-text-simplification-for-finetuningnews-not-not-ela-text-simplificationbiendata_text_simplificationflan_combined_task934_turk_simplificationadaption-legal-clause-simplification
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
adaption-legal_clause_simplification
This dataset contains pairs of formal legal or policy clauses and their simplified, plain-language equivalents. The prompts feature complex contractual language regarding payments, confidentiality, and benefits, while the completions provide clear, concise restatements. It is designed for training models to translate legalese into accessible text.… See the full description on the dataset page: https://huggingface.co/datasets/Karthikrv/adaption-legal-clause-simplification.adaption-legal-text-simplification
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
adaption-legal_text_simplification
This dataset contains pairs of formal legal or institutional text prompts and their corresponding simplified, plain-language completions. The content focuses on translating complex terms regarding consumer responsibilities, examination policies, and liability into clear, everyday English. It is designed for training models to perform legal text… See the full description on the dataset page: https://huggingface.co/datasets/Karthikrv/adaption-legal-text-simplification.dutch-municipal-sentence-simplificationflan_combined_task111_asset_sentence_simplificationwikilarge-text-simplificationhindi-text-simplification-for-finetuningasset_simplification_promptsource