datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Magicoder-OSS-Instruct-75KThis is the OSS-Instruct dataset generated by gpt-3.5-turbo-1106 developed by OpenAI. Please pay attention to OpenAI's usage policy when adopting this dataset: https://openai.com/policies/usage-policies.
Magicoder-Evol-Instruct-110KA decontaminated version of evol-codealpaca-v1. Decontamination is done in the same way as StarCoder (bigcode decontamination process).
mixtral-magicoder
Mixtral Magicoder: Source Code Is All You Need on various programming languages
We sampled programming languages from https://huggingface.co/datasets/bigcode/the-stack-dedup and pushed to https://huggingface.co/datasets/malaysia-ai/starcoderdata-sample
After that, we use Magicoder: Source Code Is All You Need on various programming languages template, we target at least 10k rows for each programming languages.
C++, 10747 rows
C#, 10193 rows
CUDA, 13843 rows
Dockerfile, 13286 rows… See the full description on the dataset page: https://huggingface.co/datasets/mesolitica/mixtral-magicoder.Magicoder-OSS-Instruct-Rust-cleaned-3.9K
🦀 Magicoder-OSS-Instruct-Rust (3.9K Cleaned)
Magicoder-OSS-Instruct-Rust is a high-quality, syntax-verified dataset of 3,909 Rust coding instructions derived from real-world open-source GitHub projects.
This dataset is extracted from ise-uiuc/Magicoder-OSS-Instruct-75K, filtered specifically for Rust, and validated via in-memory compiler checks. No language translation was applied; the dataset remains in its original English format.
⚙️ Filtering and Verification… See the full description on the dataset page: https://huggingface.co/datasets/WrittenWithRust/Magicoder-OSS-Instruct-Rust-cleaned-3.9K.Magicoder-OSS-Instruct-75K-Instruction-Responsetrain-magicoder
Magicoder OSS-Instruct — Training, unified schema
A seeded sample of ise-uiuc/Magicoder-OSS-Instruct-75K, made into retrieval training pairs and reshaped into the strict schema shared by every dataset in this collection. One of the 15 domain sources (code, medical, science, finance, legal) added to the collection's general sources.
Source
ise-uiuc/Magicoder-OSS-Instruct-75K @ 5f839b1f368a
Task
coding problem → solution
Domain · languages
code · eng
Queries /… See the full description on the dataset page: https://huggingface.co/datasets/Hyukkyu/train-magicoder.Magicoder-Evol-Instruct-110K-sftThis dataset is a fork of https://huggingface.co/datasets/ise-uiuc/Magicoder-Evol-Instruct-110K.
It is just a version with the samples of CodeUltraFeedback filtered out.
Magicoder-Evol-Instruct-110K-python
Dataset Card for "Magicoder-Evol-Instruct-110K-python"
from datasets import load_dataset
# Load your dataset
dataset = load_dataset("pxyyy/Magicoder-Evol-Instruct-110K", split="train") # Replace with your dataset and split
# Define a filter function
def contains_python(entry):
for c in entry["messages"]:
if "python" in c['content'].lower():
return True
# return "python" in entry["messages"].lower() # Replace 'column_name' with the column to search
#… See the full description on the dataset page: https://huggingface.co/datasets/pxyyy/Magicoder-Evol-Instruct-110K-python.Magicoder-Evol-Instruct-110K-sandboxes-1magicoder-microThis is a tiny instruction tuning dataset derived from ise-uiuc/Magicoder-OSS-Instruct-75K. Each training item should tokenizer to fewer than 1,000 tokens.
Magicoder-Evol-Instruct-Cleanmagicoderhttps://huggingface.co/datasets/ise-uiuc/Magicoder-OSS-Instruct-75K
features: coding, single-turn, task
only select python code
length: 38.3k
DCAgent2_terminal_bench_2_laion_glm46-Magicoder-Evol-Instruct-110K-sandboxes-160e2f1b4magicoder_evol_instruct_binarized
Dataset Card for "magicoder_evol_instruct_binarized"
More Information needed
magicoder-evol-instruct-110k-sandboxes-traces-terminus-2codefeedback-single-turn-reformat-magicoderMagicoder-OAIperturbed-docker-exp-magicoder-tasks-2_glm_4.7_traces_jupiter_upsampled_10kmagicoder-glaive-code-instruct-v2Magicoder-Evol-Instruct-10K-ft-splitchat-formatted-magicoder
Dataset Card for "chat-formatted-magicoder"
More Information needed
Magicoder-Evol-Instruct-110K
Dataset Card for "Magicoder-Evol-Instruct-110K"
More Information needed
ise-uiuc___Magicoder-OSS-Instruct-75Kmagicoder-cot-92k
Magicoder COT 92K
Chain-of-Thought distilled dataset for code generation tasks.
Dataset Description
This dataset contains 92,334 examples with added <think> reasoning traces, distilled from the original Magicoder-Evol-Instruct-110K dataset.
Source
Base dataset: ise-uiuc/Magicoder-Evol-Instruct-110K
Distillation model: Mistral-7B-Instruct-v0.2-AWQ
Method: vLLM inference with 50 parallel workers
Format
Each example contains:
instruction: The coding… See the full description on the dataset page: https://huggingface.co/datasets/domofon/magicoder-cot-92k.Magicoder-Evol-Instruct-110K-sandboxes-1_10k_glm_4.7_traces_jupiterseed_code_magicoder_exploitperturbed-docker-exp-magicoder-tasks-2_glm_4.7_traces_locetashMagicoder-OSS-Instruct-Rust-TR-3.9K
🦀 Magicoder-OSS-Instruct-Rust-Turkish (3.9K)
Magicoder-OSS-Instruct-Rust-Turkish, WrittenWithRust/Magicoder-OSS-Instruct-Rust-cleaned-3.9K veri setindeki 3.909 adet sentaksı doğrulanmış İngilizce Rust instruction örneğinin tamamen Türkçe diline çevrilmesiyle oluşturulmuş yüksek kaliteli bir kod veri setidir.
Bu veri seti, Büyük Dil Modellerine (LLM) Türkçe Rust kodlama becerisi, problem çözme yeteneği ve karmaşık mimarileri açıklama kabiliyeti kazandırmak üzere Instruction… See the full description on the dataset page: https://huggingface.co/datasets/WrittenWithRust/Magicoder-OSS-Instruct-Rust-TR-3.9K.magicoder-evol-instruct-110k-with-embeddings-no-dupsMagicoder-Evol-Instruct-500-CodeLlama-70b-tokenized-0.5-Special-Token