datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
harmless_alpaca_jaJapanese auto-translation of mlabonne/harmless_alpacausing llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF
Python-Code-Solutions
Python Code Solutions
Features
1000k of Python Code Solutions for Text Generation and Question Answering
Python Coding Problems labelled by topic and difficulty
Recommendations
Train your Model on Logical Operations and Mathematical Problems Before Training it on this. This is optional for Fine Tuning 2B parameter + models.
Format the prompts in a orderly way when formatting data eg. {question} Solution: {solution} Topic: {topic}
olmocr_science_pdfs-software_developmenthttps://huggingface.co/datasets/allenai/dolma3_pool/tree/main/data/olmocr_science_pdfs-software_development
arxiv-softwares-2021OmniGIRLThis repository contains the data presented in OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution. OmniGIRL is a GitHub issue resolution benchmark that is multilingual, multimodal, and multi-domain. It includes 959 task instances collected from repositories across four programming languages (Python, JavaScript, TypeScript, and Java) and eight different domains.
engineering-software-ui
Engineering Software UI Dataset
Screenshots (frames) of real engineering software UIs, extracted from tutorial
videos, for training a vision encoder that recognizes software interfaces
across engineering domains.
Contents
4 software tools (of a 1386-tool master list), 420 UI frames
(~0.1 GB so far), covering 4 engineering domains.
Each software is a folder:
meta.json — software name, domain, category, vendor, source video id, resolution, frame counts… See the full description on the dataset page: https://huggingface.co/datasets/jeeva0810/engineering-software-ui.datapoints_round1_dpsk_software_engineering_shard1_daytona_n100k1olmocr_science_pdfs-softwarehttps://huggingface.co/datasets/allenai/dolma3_pool/tree/main/data/olmocr_science_pdfs-software
dialogue-word-concentration
Dialogue Word Concentration
A reproducible numerical analysis of the Cornell Movie-Dialogs Corpus:
617 movie IDs, 304,439 word-bearing sampled utterances, 3,210,011 words. It
carries per-film measurements and source-matched titles, credited to Cornell.
Built by Inkwell, the IDE for screenwriters.
Change the threshold and inspect the distribution across films in the
interactive explorer,
or read the dialogue methods and sources.
What the files hold
data/films.csv:… See the full description on the dataset page: https://huggingface.co/datasets/Inkwell-Software/dialogue-word-concentration.software_requirementstraining-embeddingsdatapoints_round1_dpsk_software_engineering_shard2_daytona_n100k1skillbench-software-dbSoftware-ArchitectureSoftware-Architecture
I am releasing a Large Dataset covering topics related to Software-Architecture.
This dataset consists of around 450,000 lines of data in jsonl.
I have included following topics:
Architectural Frameworks
Architectural Patterns for Reliability
Architectural Patterns for Scalability
Architectural Patterns
Architectural Quality Attributes
Architectural Testing
Architectural Views
Architectural Decision-Making
Advanced Research
Cloud-Based Architectures
Component-Based… See the full description on the dataset page: https://huggingface.co/datasets/ajibawa-2023/Software-Architecture.Software-Engineering-Dataset_90_10arxiv-software-repo-links-datacite-enrichment-format
arXiv Software Repository Links - DataCite Enrichment Format
A collection of metadata enrichments, formatted for DataCite's enrichment API, that add links between arXiv papers (via DOI) and the software repositories they reference or are supplemented by.
Quick Start
from datasets import load_dataset
ds = load_dataset("cometadata/arxiv-software-repo-links-datacite-enrichment-format")
Dataset Description
Each record is a DataCite-style enrichment instruction… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/arxiv-software-repo-links-datacite-enrichment-format.macro_prosody_sample_set
Alexandria Voice Corpus — Multilingual Macro-Prosody Telemetry
Version 1.1 — Replacement release
This pack supersedes the earlier Korean & Hindi two-language release. That release was built on a pipeline with several unresolved quality-gate bugs (documented below). This version corrects all known issues and expands to seven typologically diverse languages.
No audio is included. This is a structured acoustic feature dataset for linguistic research, speech technology, and… See the full description on the dataset page: https://huggingface.co/datasets/moonscape-software/macro_prosody_sample_set.United_States_State_Legislation_with_SummariesTest Push
us-k12-schools-directory
US K-12 Schools Directory
A directory of 124,613 US K-12 schools covering all 50 states, DC, and US territories,
compiled from federal and state government sources. Each record carries directory
information (address, phone, website), enrollment and demographics, and, where a source
supplied it, a principal name and email.
This is a compilation of public government data. It is not a survey, and no field was
independently verified against the school itself.
Loading… See the full description on the dataset page: https://huggingface.co/datasets/robworks-software/us-k12-schools-directory.g2-software-reviews
G2 Software Reviews
111,441 B2B software reviews from G2, covering the 79 most-reviewed products, spanning 2012 to 2026.
The largest public G2 review corpus by a wide margin. Before this, the biggest available was a sample of under 1,000 rows.
What is in here that is not in other review datasets
A structured pros-and-cons split on 35,137 reviews. G2 asks "what do you like best" and "what do you dislike" as separate prompts, so those are separate columns rather… See the full description on the dataset page: https://huggingface.co/datasets/FreshCrawl/g2-software-reviews.CVE_CWE_Software_Mapping_Dataset
CVE-CWE Software Weakness Mapping Dataset
Dataset description
This dataset maps Common Vulnerabilities and Exposures (CVEs) to Common Weakness Enumeration (CWE) entries in the CWE-699 Software category. It combines CVE descriptions with CWE descriptions and parent-category information for security research and vulnerability classification.
Dataset structure
The dataset is provided as Global_Dataset.csv. Its main fields include:
CVE-ID: CVE… See the full description on the dataset page: https://huggingface.co/datasets/regularpooria/CVE_CWE_Software_Mapping_Dataset.softwarearxiv-software-engineering-datasetsoftwarek12-standards-instruction-tasks
K-12 Curriculum Tasks (generated)
2,489 generated instruction/input/output records covering five curriculum tasks:
assessment creation, learning objective generation, misconception detection, standard
explanation, and standards Q&A. Content is predominantly mathematics.
Important: the name is misleading
Despite the name, this dataset contains no school directory data. There are four
columns - task, input, output, metadata - and no staff, principal, or school… See the full description on the dataset page: https://huggingface.co/datasets/robworks-software/k12-standards-instruction-tasks.capterra-b2b-software-reviews
Capterra B2B Software Reviews
56,606 B2B software reviews from Capterra, covering 66 products across 11 software categories.
Most public review datasets are star rating + review text. This one carries five separate rating dimensions, pros and cons as distinct pre-split fields, reviewer firmographics, and, unusually, an incentive disclosure flag recording whether the reviewer was given a gift card, referred by the vendor, or wrote the review unprompted.
Why this is… See the full description on the dataset page: https://huggingface.co/datasets/FreshCrawl/capterra-b2b-software-reviews.SweSetupBench-liteThis repository contains the data presented in SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarks.
software_vulnerabilities_dataset
Cybersecurity Vulnerabilities Dataset
Overview
This dataset, vulnerabilities.jsonl, is a comprehensive collection of 1000 common software vulnerabilities across multiple programming languages, designed for use in cybersecurity research, penetration testing, and secure coding education.
Each entry details a specific vulnerability, including its type, description, code snippet, exploitation techniques, and mitigation strategies.
The dataset is structured in JSON Lines… See the full description on the dataset page: https://huggingface.co/datasets/darkknight25/software_vulnerabilities_dataset.arxiv-software-repo-links
arXiv Software Repository Links
A dataset mapping arXiv papers (via DOI) to software repositories they reference or which are implementations of the work. Additionaly includes co-citation analysis and community clustering.
Implementation detection is conducted using the evamxb/dev-author-em-clf model from sci-soft-models
Quick Start
from datasets import load_dataset
# Load DOI-to-repo links
links = load_dataset("cometadata/arxiv-software-repo-links", "links")
#… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/arxiv-software-repo-links.nemotron-terminal-software_engineering
nemotron-terminal-software_engineering
Per-source partition of nvidia/Nemotron-Terminal-Corpus,
filtered to source == "software_engineering". The difficulty column preserves the original
easy / medium / mixed split (na for the dataset_adapters/* files, which
did not carry a difficulty label).
Partitioning scheme:
adapters_{code,math,swe} — rows from dataset_adapters/{code,math,swe}.parquet
{skill} (e.g. debugging, security, …) — rows from
synthetic_tasks/skill_based/{easy,medium… See the full description on the dataset page: https://huggingface.co/datasets/laion/nemotron-terminal-software_engineering.