datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
text2sql-loop-engineering-data
text2sql-loop-engineering course data
Data package for the course repository https://github.com/mushan-shine/text2sql-loop-engineering .
Load it into your own Databricks workspace from a notebook with scripts/load_course_data.py.
Contents: the BEAVER dw data warehouse (97 tables) and the benchmark tables prepared in step 1
(questions, table metadata, gold results validated against BEAVER's official MySQL engine), plus the
dev set and step-1 result files.
Source and… See the full description on the dataset page: https://huggingface.co/datasets/MuShan795/text2sql-loop-engineering-data.civil-engineering-gemma-datallm-engineering-journey-datadata-engineering-sft-100k
Data Engineering SFT 100K
A synthetic supervised fine-tuning dataset of 100,000 high-quality conversations covering modern data engineering practices — Apache Spark, dbt, Airflow, Kafka, Delta Lake, BigQuery, and Snowflake. Designed to train AI assistants that can help data engineers build, optimize, and debug production data pipelines.
Dataset Description
This dataset covers the full spectrum of data engineering across 7 specialized categories. Each record… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/data-engineering-sft-100k.knowledgebase-electric_engineering_test_dataThis dataset are based on question answering iterations of this dataset:
"STEM-AI-mtl/Electrical-engineering"
Question answering using Deepseek R1 from TogetherAI API checkpoint
Usage:
Reasoning trace data to injecteed as CoT chain in SCIENCE related task.
gene-data-engineering-instruct
data-engineering-instruct v6
Gate-passed instruction data for data-engineering — published when 50 fresh examples cleared the quality bar
Kind: synthetic
Domain: data-engineering
Records: 300
Created: 2026-06-23T23:33:16+00:00
SHA-256: e016d58204900a8d1301fe29dd3eb2098309b52400383f07175bda2543b44865
Pipeline: v2.0.0
Filters: {"min_quality": 0.55, "limit": 1000, "source": null, "backend": "llama", "min_judge": 0.7}
Generated by: Qwen3-4B-Instruct-2507-Q4_K_M.gguf… See the full description on the dataset page: https://huggingface.co/datasets/Gene829/gene-data-engineering-instruct.financial-data-engineering-sample
Financial Data Engineering — Expert RLHF Sample
Free sample from the Provenance AI Financial Data Engineering dataset.
Two files are included:
financial-data-engineering-sample.jsonl — 10 SFT examples (standard instruction-following format)
financial-data-engineering-dpo-sample.jsonl — 5 preference pairs (DPO format, chosen + rejected)
The full dataset (25 SFT examples + 25 DPO pairs + 3 multi-turn conversations + case study) is available commercially. See the full repository for… See the full description on the dataset page: https://huggingface.co/datasets/ProvenanceAI/financial-data-engineering-sample.full-stack-ai-engineering-datadata_engineering_8_with_code_datasetdatadata-engineering-patterns
Data Engineering Patterns Dataset
Common data engineering patterns with descriptions and use cases.
SFD-Defense-Engineering-DataDataEngineering_Project