datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
stablebridge-pruning-eval
Stablebridge Pruning Evaluation Dataset
Evaluation dataset for the Stablebridge context pruner/highlighter model, measuring sentence-level pruning quality on US stablecoin regulatory documents.
Dataset Structure
File
Records
Description
queries.jsonl
93
Regulatory queries (JSONL with _id and text fields)
corpus.jsonl
38
US stablecoin regulatory documents (full text)
qrels/test.tsv
2,704
Query-document relevance judgments
pruning_labels/test.jsonl
10,006… See the full description on the dataset page: https://huggingface.co/datasets/sugiv/stablebridge-pruning-eval.fr-wiki-popular-200-tokenizer-pruning
French Wikipedia corpus for tokenizer pruning
Prepared by Daniil Koblov. Contains 200 complete plain-text article extracts:
180 training articles and 20 held-out articles, split with Python's random seed 1337.
Candidates come from the 2025 monthly French Wikipedia top-1000 pageview lists.
Articles must appear in at least three months. Ranking uses month recurrence,
then the sum of reciprocal monthly ranks. The first 200 qualifying articles are
shuffled and split. Non-article… See the full description on the dataset page: https://huggingface.co/datasets/dakoblov/fr-wiki-popular-200-tokenizer-pruning.amortized-neuron-pruning-effects
Amortized Neuron-Ablation Effects (for pruning)
Exact mean-ablation effects of individual MLP neurons in transformer LMs, paired
with cheap forward/backward signals, for the task of amortized causal
intervention-effect prediction at neuron granularity (pruning).
The intervention unit is a single MLP neuron (blocks.{l}.mlp.hook_post channel).
For every (prompt, neuron) we record the exact effect of replacing that neuron's
last-token activation with its dataset mean, m(x… See the full description on the dataset page: https://huggingface.co/datasets/almogtavor/amortized-neuron-pruning-effects.stablebridge-regulatory-pruning-eval