datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
gelbooru-webp-4Mpixel
Gelbooru 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/gelbooru_full. And all the resized images are maintained here.
There are 11463682 images in total. The maximum ID of these images is 12575222. Last updated at 2025-09-09 09:40:06 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/gelbooru-webp-4Mpixel.anime_pictures-webp-4Mpixel
Anime-Pictures 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/anime_pictures_full. And all the resized images are maintained here.
There are 642979 images in total. The maximum ID of these images is 885353. Last updated at 2025-09-24 01:12:10 CST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/anime_pictures-webp-4Mpixel.safebooru-webp-4Mpixel
Safebooru 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/safebooru_full. And all the resized images are maintained here.
There are 5756655 images in total. The maximum ID of these images is 5974383. Last updated at 2025-08-06 08:31:53 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/safebooru-webp-4Mpixel.danbooru2024-webp-4Mpixel
🎨 Danbooru2024 Webp 4MPixel Dataset
📊 Dataset Overview
The Danbooru2024-Webp dataset is a comprehensive collection focused on animation and illustration artwork, derived from the official Danbooru platform. It contains approximately 8.05 million high-quality, user-annotated images with corresponding tags and textual descriptions.
This dataset is 4MP-focused webp resized-dataset of Danbooru2024.
✨ Features
📋 Metadata Support
Includes a Parquet… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/danbooru2024-webp-4Mpixel.fancaps-webp-4Mpixel
Fancaps 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/fancaps_full. And all the resized images are maintained here.
There are 29004217 images in total. The maximum ID of these images is 31449533. Last updated at 2025-09-04 22:10:59 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/fancaps-webp-4Mpixel.imagenet-w21-webp-wds
Dataset Summary
This is a copy of the full Winter21 release of ImageNet in webdataset tar format with WEBP encoded images. This release consists of 19167 classes, 2674 fewer classes than the original 21841 class Fall11 release of the full ImageNet.
The classes were removed due to these concerns: https://www.image-net.org/update-sep-17-2019.php
This is the same contents as https://huggingface.co/datasets/timm/imagenet-w21-wds but encoded in webp at ~56% of the size, shard count… See the full description on the dataset page: https://huggingface.co/datasets/timm/imagenet-w21-webp-wds.sankaku-webp-4Mpixel
Sankaku 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/sankaku_full. And all the resized images are maintained here.
There are 16492859 images in total. The maximum ID of these images is 36864051. Last updated at 2025-01-02 12:41:55 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/sankaku-webp-4Mpixel.konachan-webp-4Mpixel
Konachan 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/konachan_full. And all the resized images are maintained here.
There are 319012 images in total. The maximum ID of these images is 391069. Last updated at 2025-07-22 02:47:52 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/konachan-webp-4Mpixel.danbooru2023-webp-4Mpixel_indexIndex files of KBlueLeaf/danbooru2023-webp-4Mpixel.
You can download images from KBlueLeaf/danbooru2023-webp-4Mpixel with cheesechaser.
from cheesechaser.datapool import DanbooruWebpDataPool
pool = DanbooruWebpDataPool()
# download danbooru images with webp format, to directory /data/danbooru_webp
pool.batch_download_to_directory(
resource_ids=range(6000000, 6001000),
dst_dir='/data/danbooru_webp',
max_workers=12,
)
webpii
WebPII Dataset
Split
Samples
Train
40,384
Test
4,481
Total
44,865
For more information, see webpii.github.io
e621_newest-webp-4Mpixel
E621 Newest 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/e621_newest. And all the resized images are maintained here.
There are 963455 images in total. The maximum ID of these images is 5753265. Last updated at 2025-08-09 00:50:53 JST.
This dataset only contains newest webp images, if you are looking for old webp images, just see NebulaeWis/e621-2024-webp-4Mpixel.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/e621_newest-webp-4Mpixel.rule34-webp-4Mpixel
Rule34 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/rule34_full. And all the resized images are maintained here.
There are 11336686 images in total. The maximum ID of these images is 13078768. Last updated at 2025-04-13 16:02:32 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/rule34-webp-4Mpixel.e621-2024-webp-4Mpixel_indexIndex files of NebulaeWis/e621-2024-webp-4Mpixel.
You can download images from NebulaeWis/e621-2024-webp-4Mpixel with cheesechaser.
from cheesechaser.datapool import E621NewestWebpDataPool
pool = E621NewestWebpDataPool()
# download e621 #2010000-2010300, to directory /data/e621
pool.batch_download_to_directory(
resource_ids=range(2010000, 2010300),
dst_dir='/data/e621',
max_workers=12,
)
TreeOfLife-10M-WEBP
Dataset Card for TreeOfLife-10M-WEBP
Dataset Description
This is an optimized version of the TreeOfLife-10M dataset,
containing over 10 million images covering 454 thousand taxa in the tree of life.
This version has been processed to improve usability and reduce storage requirements while maintaining full compatibility with the original dataset structure.
Dataset Summary
This version modifies the original dataset as follows:
Corrupted files were… See the full description on the dataset page: https://huggingface.co/datasets/birder-project/TreeOfLife-10M-WEBP.danbooru2023-webp-4Mpixel
Danbooru 2023 webp: A space-efficient version of Danbooru 2023
This dataset is a resized/re-encoded version of danbooru2023.
Which removed the non-image/truncated files and resize all of them into smaller size.
This dataset already be updated to latest_id = 7,832,883.
Thx to DeepGHS!
Notice: content of updates folder and deepghs/danbooru_newest-webp-4Mpixel have been merged to 2000~2999.tar, You can ignore all the content in updates folder safely!
Details
This… See the full description on the dataset page: https://huggingface.co/datasets/KBlueLeaf/danbooru2023-webp-4Mpixel.zerochan-webp-4Mpixel
Zerochan Newest 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/zerochan_full. And all the resized images are maintained here.
There are 4106075 images in total. The maximum ID of these images is 4588400. Last updated at 2025-09-22 02:45:45 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/zerochan-webp-4Mpixel.yande-webp-4Mpixel
Yande Newest 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/yande_full. And all the resized images are maintained here.
There are 1124961 images in total. The maximum ID of these images is 1236881. Last updated at 2025-07-25 04:14:33 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/yande-webp-4Mpixel.nozomi_standalone-webp-4Mpixel
Nozomi 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/nozomi_standalone_full. And all the resized images are maintained here.
There are 22427878 images in total. The maximum ID of these images is 36722740. Last updated at 2025-09-13 00:18:56 CST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/nozomi_standalone-webp-4Mpixel.sankaku_curated_webp-4Mpixel
Sankaku WebP 4M (Repackaged)
Curated subset selected for training purposes
Repackaged version of deepghs/sankaku-webp-4Mpixel with:
Images organized by ID (0-9) in tar archives
Includes filtered tag list (tag_id_mapping.json)
Contains selected image IDs (unique_ids.json)
Note: Contains anime-style artwork (may include NSFW content).