Team Ai
Datasetpublic

werty1248/Korea-Related-Reddit-posts

Comments: werty1248/Korea-Related-Reddit-comments This dataset may contain aggressive content. Source Subreddit comments/submissions 2005-06 to 2024-12 Korea/Korean related posts only Subset Targeted subreddits r/hanguk r/Korea* r/Korean* r/kpop* Posts Contains at least one Korean character in the selftext (body). Comments Only comments that reply to Korean posts as defined above. Statistics Total data: 3.28TB Korea/Korean-related… See the full description on the dataset page: https://huggingface.co/datasets/werty1248/Korea-Related-Reddit-posts.

sourceHugging Faceupdated 2y agoView on Hugging Face
5likes30downloads
Dataset Card

Source

Subset

  • —Targeted subreddits
  • —r/hanguk
  • —r/Korea*
  • —r/Korean*
  • —r/kpop*
  • —Posts
  • —Contains at least one Korean character in the selftext (body).
  • —Comments
  • —Only comments that reply to Korean posts as defined above.

Statistics

  • —Total data: 3.28TB
  • —Korea/Korean-related subreddit data: 3.66GB
  • —1,755,918 posts
  • —18,376,820 comments
  • —Posts including Korean character
  • —41,328 posts
  • —Posts written in Korean
  • —7,684 posts
  • —Comments reply to posts that including Korean character
  • —589,887 comments

License

  • —No license specified, the work may be protected by copyright.
  • —https://www.reddit.com/r/pushshift/comments/1akrhg3/separatedumpfilesforthetop40k_subreddits/

Attribute

  • —subreddit: 레딧 채널명
  • —subreddit_id: 레딧 채널 id
  • —id: 게시글 id
  • —url: url
  • —title: 제목
  • —selftext: 본문
  • —num_comments: 댓글 수
  • —over_18: 18세 이상 확인 가능
  • —created_utc: 작성일시
  • —ups: 좋아요 수
  • —downs: 싫어요 수
  • —score: ups - downs ?
  • —author: 작성자
  • —major_language: 본문의 주요 언어
  • —korean_ratio: (한글 개수) / (한글 개수 + 알파벳 개수)
  • —has_korean: 본문에 한글 포함 여부 (항상 True)
@article{,
title= {Subreddit comments/submissions 2005-06 to 2024-12},
journal= {},
author= {Watchful1},
year= {},
url= {https://www.reddit.com/r/pushshift/comments/1itme1k/separate_dump_files_for_the_top_40k_subreddits/?},
abstract= {This is the top 40,000 subreddits from reddit's history in separate files. You can use your torrent client to only download the subreddit's you're interested in.

These are from the pushshift dumps from 2005-06 to 2024-12 which can be found here https://academictorrents.com/details/ba051999301b109eab37d16f027b3f49ade2de13

These are zstandard compressed ndjson files. Example python scripts for parsing the data can be found here https://github.com/Watchful1/PushshiftDumps

If you have questions, please reply to this reddit post or DM u/Watchful on reddit or respond to this post https://www.reddit.com/r/pushshift/comments/1akrhg3/separate_dump_files_for_the_top_40k_subreddits/},
keywords= {reddit},
terms= {},
license= {},
superseded= {}
}