datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
phaseShift_shell_result_pdf
Phase Resonance / IRS-DCE
Topological Dynamics & Artificial Cognitive Physics
Open Structural Record of Basis-Relative Reorganization in Transformer Representation Space
All pdf Creative Creative Commons Attribution No Derivatives 4.0 International
This repository provides comprehensive PDF research materials and Python scripts and something for mathematical proofs in the field of AI.
📢 Achievement: total 51k+ Downloads!… See the full description on the dataset page: https://huggingface.co/datasets/meta13sphere/phaseShift_shell_result_pdf.Reverse_Shell_Payloads_Dataset
🐚 Reverse Shell Payloads Dataset
A curated and structured dataset of reverse shell payloads used by penetration testers, red teams, and ethical hackers to establish remote command-line access during security assessments.
This dataset provides a diverse set of payloads across multiple platforms and scripting languages, including Bash, PowerShell, Python, Perl, and Netcat.
📁 Dataset Format
The dataset is provided in .jsonl (JSON Lines) format — each line represents a… See the full description on the dataset page: https://huggingface.co/datasets/darkknight25/Reverse_Shell_Payloads_Dataset.marin-starcoderdata_shellgdpval-shellmbgfnet-closed-shell-4d5d-gw-dataset
Closed-shell 4d/5d transition-metal complexes: PBE0 + G0W0 quasiparticle dataset
2,210 closed-shell mononuclear 4d and 5d transition-metal complexes (17 metals: Y, Zr, Nb, Mo, Ru,
Rh, Pd, Ag, Cd from the 4d row; Hf, Ta, W, Re, Os, Ir, Pt, Au, Hg from the 5d row), each with a DFT
(PBE0/cc-pVDZ, relativistic small-core pseudopotential on the metal) and a one-shot G0W0@PBE0
quasiparticle-energy calculation. Built to extend MBGF-Net
(Venturella, Li, Hillenbrand, Zhu… See the full description on the dataset page: https://huggingface.co/datasets/primateria/mbgfnet-closed-shell-4d5d-gw-dataset.MET-Bench-Shell
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models
Vanya Cohen and Raymond Mooney · ICML 2026
Paper · Project page · Load the dataset · Citation
Domains: Chess · Shell Game · Minecraft
MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Shell Game domain.
Shell Game
A ball is placed under one of three shells. The shells are swapped pairwise, and the goal… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Shell.mbgfnet-closed-shell-3d-gw-dataset
Closed-shell 3d transition-metal complexes: PBE0 + G0W0 quasiparticle dataset
2,100 closed-shell mononuclear 3d transition-metal complexes (Sc–Zn), each with a DFT (PBE0/cc-pVDZ) and a
one-shot G0W0@PBE0/cc-pVDZ quasiparticle-energy calculation, built to train and benchmark
MBGF-Net (Venturella, Li, Hillenbrand, Zhu, arXiv:2407.20384) — a graph
neural network that predicts the GW self-energy from cheap DFT quantities — on transition-metal chemistry, which
the original paper's… See the full description on the dataset page: https://huggingface.co/datasets/primateria/mbgfnet-closed-shell-3d-gw-dataset.mbgfnet-open-shell-3d-gw-dataset
Open-shell 3d transition-metal complexes: PBE0 + unrestricted G0W0 quasiparticle dataset
1,240 open-shell mononuclear 3d transition-metal complexes (Ti, V, Cr, Mn, Fe, Co, Ni; spin
multiplicity 1-6, including broken-symmetry open-shell singlets — see note below), each with a
spin-unrestricted DFT (UKS-PBE0/cc-pVDZ) and one-shot unrestricted G0W0@PBE0/cc-pVDZ (UGWAC)
quasiparticle-energy calculation, built to extend MBGF-Net
(Venturella, Li, Hillenbrand, Zhu, arXiv:2407.20384) —… See the full description on the dataset page: https://huggingface.co/datasets/primateria/mbgfnet-open-shell-3d-gw-dataset.shellcode_i_a32Shellcode_IA32 is a dataset for shellcode generation from English intents. The shellcodes are compilable on Intel Architecture 32-bits.shell-safety-v1.1
Shell Safety v1.1
A synthetic dataset of safe/unsafe shell commands with respective running session contexts.
v1 has only a safe column with boolean values.
This version has a label column with 3 values: allow, ask or deny; making it closer to permissions handler in coding harness.
alchemist-shell.ai-hackathon-2025This project is described in detail at this website:
https://alchemist-shellai-hackathon-2025.readthedocs.io/en/latest/
The codes and relevant materials are available here:
https://github.com/Sukantabasu/alchemist-shell.ai-hackathon-2025
The trained models (in pkl format) are stored in this HF repository.
shell_game_eef_global
shell_game — delta EEF, global instruction
Cups hide a red block, the cups are shuffled by hand, and the arm lifts the cup the block ended
under. 45 episodes, 18,442 frames.
Delta EEF, 10-dim. Every frame carries the same sentence:
Find the cup hiding the block after the swaps and move it into the basket.
Paired with shell_game_eef_subtask, which differs only in the language: same episodes, same
action space, per-frame subtasks instead of one sentence.
Converted from the… See the full description on the dataset page: https://huggingface.co/datasets/ghkim-rlwrld/shell_game_eef_global.ShellRisk-Bench
ShellRisk-Bench
ShellRisk-Bench is a reproducible benchmark for context-free binary risk
classification of individual shell-command submissions. It asks whether a
command poses meaningful cyber or system risk when evaluated without task,
user, or session context.
Release: The v0.1 Parquet train and test splits are publicly available
through Dataset Viewer and load_dataset().
The benchmark contains a deterministic train split of 16,772 rows and test
split of 4,194 rows. The test… See the full description on the dataset page: https://huggingface.co/datasets/kontext-security/ShellRisk-Bench.shell_game_eef_subtask
shell_game — delta EEF, per-frame subtask
Cups hide a red block, the cups are shuffled by hand, and the arm lifts the cup the block ended
under. 45 episodes, 18,442 frames.
Delta EEF, 10-dim. Six sentences, assigned per frame:
observe 6,051 frames
uncover the left cup 2,203
uncover the middle cup 1,517
uncover the right cup 1,848
move the red cube into the basket 6,823
Labels are derived from state… See the full description on the dataset page: https://huggingface.co/datasets/ghkim-rlwrld/shell_game_eef_subtask.shellminator-bash-sft100kShellOps
ShellOps
ShellOps is a verifiable dataset suite for CLI agents that interact with filesystem workspaces through executable shell actions. It accompanies the paper Learning CLI Agents with Structured Action Credit under Selective Observation.
The dataset focuses on shell-driven information extraction and file editing tasks, where an agent receives a natural language instruction, observes an initial workspace, executes CLI actions, and is scored by verifiable terminal… See the full description on the dataset page: https://huggingface.co/datasets/Hoyant-Su/ShellOps.shell-attack-evolution-dataset
Shell Honeypot Attack Request–Response Dataset
A standardized, MITRE ATT&CK–annotated dataset of post-login shell
attacks captured by Cowrie SSH/Telnet
honeypots across two collection periods — 2021–2022 and 2024. It pairs
attacker shell commands with real captured system responses, enabling both
longitudinal threat analysis and the training/evaluation of AI-driven honeypots.
This is the open-source release accompanying the paper “Unveiling Evolving
Threats: A Data Analysis… See the full description on the dataset page: https://huggingface.co/datasets/zyw-286/shell-attack-evolution-dataset.shell_game_joint_global
shell_game — joint actions, global instruction
Cups hide a red block, the cups are shuffled by hand, and the arm lifts the cup the block ended
under and drops it in a basket. 45 episodes, 18,442 frames.
Absolute joint targets, 8-dim. Every frame carries the same sentence:
Find the cup hiding the block after the swaps and move it into the basket.
This is the only one of the three whose action space the DROID runtime already speaks.
Converted from the recorder's DROID-schema… See the full description on the dataset page: https://huggingface.co/datasets/ghkim-rlwrld/shell_game_joint_global.Shell-Code-Large
Shell-Code-Large
Shell-Code-Large is a large-scale corpus of Shell scripting source code comprising approximately 640,000 code samples stored in JSON Lines (.jsonl) format. The dataset is designed to support research in large language model (LLM) pretraining, code intelligence, DevOps automation, cloud infrastructure engineering, system administration, and software engineering automation.
By providing a high-volume, language-specific corpus focused exclusively on Shell scripting… See the full description on the dataset page: https://huggingface.co/datasets/ajibawa-2023/Shell-Code-Large.Shellcode_Exploit_Dataset
Shellcode Exploit Dataset for Red Team GPT Training
Dataset Overview
The Shellcode Exploit Dataset is a comprehensive collection of 700 unique shellcode exploits, spanning 2021–2025, designed for training machine learning models, particularly for red team and cybersecurity research. The dataset includes a diverse set of vulnerabilities, platforms, architectures, and payload goals, sourced from Exploit-DB, GitHub, CTF challenges, and CVE databases.
It is structured in JSON… See the full description on the dataset page: https://huggingface.co/datasets/darkknight25/Shellcode_Exploit_Dataset.linux-shell-corpus-ru-en
Linux Shell RU/EN
A bilingual (Russian / English) Linux shell assistant dataset in chat format.
Overview
This dataset contains 25,000 chat-format examples with a consistent system / user / assistant structure.
The corpus started as a direct Linux command mapping dataset, but has been expanded into a broader shell-assistant training set that now includes:
direct command generation
short command sequences and pipelines
safer operational alternatives
debugging commands… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/linux-shell-corpus-ru-en.203-checkerboard-shellgameThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 16,
"total_frames": 11649,
"total_tasks": 1,
"total_videos": 48,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:16"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/LeRobot-worldwide-hackathon/203-checkerboard-shellgame.shell_game_touchsooping
Affine SN120 Training Dataset (Cleaned)
Ready-to-train dataset for Bittensor Subnet 120 (Affine)
Base model: Qwen3-32B | Hardware: 4-8x A100/H100 80GB
Quick Start
# 1. Prepare balanced training data (uses ALL cleaned data by default)
cd /root/affine-polish-dataset
python prepare_training_data.py
# 2. Or cap at a specific size
python prepare_training_data.py --max-sft 50000
# 3. Train SFT on all data
bash training/scripts/04_train.sh sft
# 4. Train GRPO on top… See the full description on the dataset page: https://huggingface.co/datasets/ShellFace/sooping.shell-safety-transcriptsConverted from tomngdev/shell-safety into conversations transcripts.
Structure is for my own training with static system prompt and changing <SessionContext> block
NL-SHELL-MULTI
NL-SHELL-MULTI: A Combined Dataset for Natural Language to Shell Command Translation
This dataset is an aggregation of three existing datasets, designed to provide a comprehensive resource for training models that translate natural language queries into shell commands and vice-versa.
Dataset Sources
The NL-SHELL-MULTI dataset is constructed from the following publicly available datasets:
NL2Bash: A dataset of natural language commands and their corresponding bash… See the full description on the dataset page: https://huggingface.co/datasets/Mitchins/NL-SHELL-MULTI.Dans-Toolmaxx-ShellCommandsStack2Graph_KG_shell
Shell StackOverflow Knowledge Graph
Summary
This Hugging Face dataset repository contains the Shell shard of the Stack2Graph StackOverflow Knowledge Graph.
Hugging Face uses one dataset repository per programming language, so this repository is directly cloneable without an extra top-level archive wrapper.
The artifact is optimized for graph-based retrieval, SPARQL analytics, and retrieval-augmented question answering over Stack Overflow content.
Stack2Graph… See the full description on the dataset page: https://huggingface.co/datasets/Mo7art/Stack2Graph_KG_shell.HateSieve-Dataset-multimodal-hate-triplets
Multimodal Hate Triplets
This is the triplet dataset accompanying our paper, A Context-Aware Contrastive Learning Framework for Hateful Meme Detection and Segmentation, by Xuanyu Su, Yansong Li, Diana Inkpen, and Nathalie Japkowicz, published in Findings of the Association for Computational Linguistics: NAACL 2025. The dataset was constructed for contrastive learning in HateSieve, the framework introduced in the paper. See the ACL Anthology record for publication details and the… See the full description on the dataset page: https://huggingface.co/datasets/Shelly97/HateSieve-Dataset-multimodal-hate-triplets.shell-cmd-instruct
Used to train models that interact directly with shells
Note: This dataset is out-dated in the llm world, probably easier to just setup a tool with a decent model that supports tooling.
Follow-up details of my process
MacOS terminal commands for now. This dataset is still in alpha stages and will be modified.
Contains 500 somewhat unique training examples so far.
GPT4 seems like a good candidate for generating more data, licensing would need to be addressed.
I fine-tuned… See the full description on the dataset page: https://huggingface.co/datasets/byroneverson/shell-cmd-instruct.