Datasetpublic

uv-scripts/dataset-stats

Dataset Statistics UV scripts for analyzing HuggingFace datasets using streaming mode. Scripts finepdfs-stats.py - Temporal Educational Quality Analysis Analyze educational quality trends across CommonCrawl dumps using Polars streaming. Answers: "Is the web getting more educational over time?" Features: Polars streaming (no download of 300GB+ dataset) Temporal analysis across 106 CommonCrawl dumps (2013-2025) ASCII chart visualizations Uploads… See the full description on the dataset page: https://huggingface.co/datasets/uv-scripts/dataset-stats.

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

4likes78downloads

settings

This repository belongs to uv-scripts on Hugging Face.

Team Ai never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namedataset-stats

visibilitypublic

licenceapache-2.0

gatedno

owneruv-scripts

Account settings