data-engineering
text2sql-loop-engineering-data
text2sql-loop-engineering course data
Data package for the course repository https://github.com/mushan-shine/text2sql-loop-engineering .
Load it into your own Databricks workspace from a notebook with scripts/load_course_data.py.
Contents: the BEAVER dw data warehouse (97 tables) and the benchmark tables prepared in step 1
(questions, table metadata, gold results validated against BEAVER's official MySQL engine), plus the
dev set and step-1 result files.
Source and… See the full description on the dataset page: https://huggingface.co/datasets/MuShan795/text2sql-loop-engineering-data.civil-engineering-gemma-datallm-engineering-journey-datadata-engineering-sft-100k
Data Engineering SFT 100K
A synthetic supervised fine-tuning dataset of 100,000 high-quality conversations covering modern data engineering practices — Apache Spark, dbt, Airflow, Kafka, Delta Lake, BigQuery, and Snowflake. Designed to train AI assistants that can help data engineers build, optimize, and debug production data pipelines.
Dataset Description
This dataset covers the full spectrum of data engineering across 7 specialized categories. Each record… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/data-engineering-sft-100k.knowledgebase-electric_engineering_test_dataThis dataset are based on question answering iterations of this dataset:
"STEM-AI-mtl/Electrical-engineering"
Question answering using Deepseek R1 from TogetherAI API checkpoint
Usage:
Reasoning trace data to injecteed as CoT chain in SCIENCE related task.
financial-data-engineering-sample
Financial Data Engineering — Expert RLHF Sample
Free sample from the Provenance AI Financial Data Engineering dataset.
Two files are included:
financial-data-engineering-sample.jsonl — 10 SFT examples (standard instruction-following format)
financial-data-engineering-dpo-sample.jsonl — 5 preference pairs (DPO format, chosen + rejected)
The full dataset (25 SFT examples + 25 DPO pairs + 3 multi-turn conversations + case study) is available commercially. See the full repository for… See the full description on the dataset page: https://huggingface.co/datasets/ProvenanceAI/financial-data-engineering-sample.