data-engineering
text2sql-loop-engineering-data
text2sql-loop-engineering course data
Data package for the course repository https://github.com/mushan-shine/text2sql-loop-engineering .
Load it into your own Databricks workspace from a notebook with scripts/load_course_data.py.
Contents: the BEAVER dw data warehouse (97 tables) and the benchmark tables prepared in step 1
(questions, table metadata, gold results validated against BEAVER's official MySQL engine), plus the
dev set and step-1 result files.
Source and… See the full description on the dataset page: https://huggingface.co/datasets/MuShan795/text2sql-loop-engineering-data.civil-engineering-gemma-datallm-engineering-journey-datadata-engineering-sft-100k
Data Engineering SFT 100K
A synthetic supervised fine-tuning dataset of 100,000 high-quality conversations covering modern data engineering practices — Apache Spark, dbt, Airflow, Kafka, Delta Lake, BigQuery, and Snowflake. Designed to train AI assistants that can help data engineers build, optimize, and debug production data pipelines.
Dataset Description
This dataset covers the full spectrum of data engineering across 7 specialized categories. Each record… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/data-engineering-sft-100k.knowledgebase-electric_engineering_test_dataThis dataset are based on question answering iterations of this dataset:
"STEM-AI-mtl/Electrical-engineering"
Question answering using Deepseek R1 from TogetherAI API checkpoint
Usage:
Reasoning trace data to injecteed as CoT chain in SCIENCE related task.
gene-data-engineering-instruct
data-engineering-instruct v6
Gate-passed instruction data for data-engineering — published when 50 fresh examples cleared the quality bar
Kind: synthetic
Domain: data-engineering
Records: 300
Created: 2026-06-23T23:33:16+00:00
SHA-256: e016d58204900a8d1301fe29dd3eb2098309b52400383f07175bda2543b44865
Pipeline: v2.0.0
Filters: {"min_quality": 0.55, "limit": 1000, "source": null, "backend": "llama", "min_judge": 0.7}
Generated by: Qwen3-4B-Instruct-2507-Q4_K_M.gguf… See the full description on the dataset page: https://huggingface.co/datasets/Gene829/gene-data-engineering-instruct.