pushshift
pushshift-reddit-comments
Dataset Card for "pushshift-reddit"
More Information needed
pushshift-reddit
Dataset Card for "pushshift-reddit"
More Information needed
pushshift-reddit
Reddit Data Archive & Analysis Pipeline
π Overview
A comprehensive pipeline for archiving, processing, and analyzing Reddit data from 2005 to 2025. This repository contains tools for downloading Reddit's historical data, converting it to optimized formats, and performing detailed schema analysis and community studies.
ποΈ Repository Structure
βββ scripts/ # Analysis scripts
βββ analysis/ # Analysis methods andβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Avni2110/pushshift-reddit.pushshift-reddit
Reddit Data Archive & Analysis Pipeline
π Overview
A comprehensive pipeline for archiving, processing, and analyzing Reddit data from 2005 to 2025. This repository contains tools for downloading Reddit's historical data, converting it to optimized formats, and performing detailed schema analysis and community studies.
ποΈ Repository Structure
βββ scripts/ # Analysis scripts
βββ analysis/ # Analysisβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Binxk/pushshift-reddit.reddit_pushshift_dataset_cleaned
π Cleaned Reddit Pushshift Dataset (Parquet)
π Dataset Description
This dataset is a highly optimized, meticulously cleaned, and structured version of the raw Reddit Pushshift dump. It has been transformed from massive .zst compressed JSON files into highly efficient, columnar Parquet files, making it immediately ready for Big Data analytics, SQL querying (via DuckDB), and Large Language Model (LLM) training.
The dataset includes both Reddit Submissions (Posts)β¦ See the full description on the dataset page: https://huggingface.co/datasets/anhchanghoangsg/reddit_pushshift_dataset_cleaned.pushshift-reddit-comments
Dataset Card for "pushshift-reddit"
More Information needed
