datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Codemixed_New
Codemixed ASR Dataset
Unified collection of code-mixed ASR datasets.
codemixed-id-hate-speech
Code-mixed Indonesian Hate Speech Dataset
Manually annotated hate speech dataset for Indonesian-Javanese and
Indonesian-Sundanese code-mixed text, enriched with LLM-generated augmentations.
Burmese-English-Code-Mixed-Corpus
🇲🇲 Burmese-English Code-Mixed Corpus ꒰ 1,111 Rows ꒱
A high-quality, human-curated dataset of code-mixed Burmese and English sentences, specifically designed for Natural Language Processing (NLP) and Machine Learning (ML) research.
Dataset Details
Organization: DatarrX
Creator: Khant Sint Heinn (Kalix Louis)
Number of Rows: 1,111
Language: Burmese (Unicode) & English Mix
Dataset Format: .txt
License: Apache 2.0
Description
The Burmese-English Code-Mixed… See the full description on the dataset page: https://huggingface.co/datasets/DatarrX/Burmese-English-Code-Mixed-Corpus.code-trainer-v9-mixed
code-trainer-v9-mixed
40,401-row mixed training dataset for supervised fine-tuning (SFT) in the
Code-Trainer / RTPI pipeline.
Used for both Qwen 14B (V9 SFT) and Gemma 26B (aggressive-full1 SFT) training.
Composition
Slice
Source
Rows (train)
Purpose
A -- Code generation
cmndcntrlcyber/code-trainer-offsec-dataset (8K subsample)
7,074
Preserve code-gen quality
B -- Tool calling
glaiveai/glaive-function-calling-v2 (19K cap)
~15,125
High-density tool… See the full description on the dataset page: https://huggingface.co/datasets/atlas-institute/code-trainer-v9-mixed.Code-Mixed-Sentiment-Analysis-Dataset
Dataset Generation:
Initially, we select the Amazon Review Dataset as our base data, referenced from Ni et al. (2019)[^1]. We randomly extract 100,000 instances from this dataset. The original labels in this dataset are ratings, scaled from 1 to 5. For our specific task, we categorize them into Positive (rating > 3), Neutral (rating = 3), and Negative (rating < 3), ensuring a balanced number of instances for each label. To generate the synthetic Code-mixed dataset, we apply two… See the full description on the dataset page: https://huggingface.co/datasets/md-nishat-008/Code-Mixed-Sentiment-Analysis-Dataset.hindi-english-code-mixed-tweets-sentimentcode-instruct-mixed
Description
Filtered/normalised subsets of public code-instruction datasets (Magicoder OSS-Instruct & Evol-Instruct, CodeFeedback, Glaive). The source column attributes each row to its origin; each source retains its upstream licence.
Derived dataset. Source material retains its original per-item licence (see source/repo columns); treat as other / mixed. Provided as-is.
Usage
from datasets import load_dataset
ds = load_dataset("PotatoHD/code-instruct-mixed")
Code-Mixed-Offensive-Language-Detection-Dataset
Code-Mixed-Offensive-Language-Identification
This is a dataset for the offensive language detection task. It contains 100k code mixed data. The languages are Bangla-English-Hindi.
Dataset Generation:
Initially, the labelling schema of OLID[^1] and SOLID[^2] serves as the seed data, from which we randomly select 100,000 data instances. The labels in this dataset are categorized as Non-Offensive and Offensive for the purpose of our task. We meticulously ensure an equal… See the full description on the dataset page: https://huggingface.co/datasets/md-nishat-008/Code-Mixed-Offensive-Language-Detection-Dataset.belebele_hin_Latn_codemixedcode-trainer-v7-mixedamthinking_code_math_mixed_100kFiltered_Dakshina_Natural_CodeMixedcodemixed-ind-classificationhindi-english-code-mixedThis dataset was compiled from various open sources online including some asr datasets and some percenteage of data generated using prompt engineering on generative llms. Some sources used are listed down below:
https://github.com/l3cube-pune/code-mixed-nlp?tab=readme-ov-file
https://github.com/piyushmakhija5/hinglishNorm
https://github.com/ishan00/translation-for-code-switching-acl/tree/master
codemixed-ind-classificationcode-trainer-v8-mixedgujarati-english-codemixed-sentiment
Gujarati-English / Hindi-English Code-Mixed Sentiment Dataset
Dataset Summary
This dataset addresses an empirically confirmed gap in the code-mixed
sentiment analysis literature: a systematic literature review of 48
retrieved records (39 core studies) found zero existing
Gujarati-English code-mixed sentiment datasets, despite Gujarati having
over 55 million native speakers. This dataset provides the first
Gujarati-English resource of this kind, alongside… See the full description on the dataset page: https://huggingface.co/datasets/ShrutiPatel3011/gujarati-english-codemixed-sentiment.v3-v1_v2_code_mixed_syntheic_correct_noisy_pairs
Sinhala Spelling Correction Dataset
Dataset Description
This dataset contains Sinhala text pairs for training spelling correction models. It includes:
Dyslexic/Noisy sentences: Text with spelling errors, typos, and dyslexia-like mistakes
Clean sentences: Corrected versions of the text
Dataset Statistics
Split
Samples
Train
37,712
Test
9,428
Total
47,140
Features
dyslexic_sentence: Input text with errors (string)… See the full description on the dataset page: https://huggingface.co/datasets/SPEAK-PP/v3-v1_v2_code_mixed_syntheic_correct_noisy_pairs.en-hi-codemixed-corpusCode_Mixed_video_ComplaintEn-Bn-Code-Mixed-Two-Class-Sentiment-Dataset📊 En-Bn-Code-Mixed-Two-Class-Sentiment-Dataset
The En-Bn-Code-Mixed-Two-Class-Sentiment-Dataset is a multilingual dataset of 100,000 product review texts designed for code-mixed sentiment analysis involving English, Bengali, and Roman Bengali.
Each record includes:
🆔 Id
🛒 ProductId
💬 Code-Mixed-Text
💡 Sentiment
The dataset captures diverse linguistic styles, authentic code-mixing, and real-world sentiment patterns from multilingual digital communication.
🌐 Text Distribution
The dataset… See the full description on the dataset page: https://huggingface.co/datasets/DaliaBarua/En-Bn-Code-Mixed-Two-Class-Sentiment-Dataset.debug-mixed-rlhf-codemarc-code-mixed-small
marc-code-mixed-small
This dataset is based on The Multilingual Amazon Reviews Corpus.
It contains German (DE), English (EN), Spanish (ES), and French (FR) languages.
The labels are 0 (DE), 1 (EN), 2 (ES), and 3 (FR).
Each review contains all four languages.
Total number of tokens:
In training set: 10195342
In test set: 842760
In validation set: 842760
nep_eng_code-mixed_asr_datasetuk-en-code-mixed-asr-2h
uk-en-code-mixed-asr-2h
A 2-hour dataset of Ukrainian-English code-mixed speech for automatic speech recognition, recorded by a single male speaker across 16 speaking-style personas covering software engineering domains (.NET, React, DevOps, project management).
Samples: 448
Total duration: 2h 6m 35s
Language: 446 mixed (code-mixed) + 2 uk (monolingual)
Speaker: 1 male voice, 16 personas (varied pacing, formality, topic; 15 map to Valera, 1 to ValeraAlt)
Audio format: OGG Opus… See the full description on the dataset page: https://huggingface.co/datasets/vnikitin/uk-en-code-mixed-asr-2h.telugu-qa-codemixed
Telugu QA Paraphrases
A synthetic multilingual query-rewriting dataset for evaluating retrieval robustness under Telugu-English code mixing.
Dataset Description
This dataset extends an existing Telugu QA dataset by generating multiple query variants with increasing levels of Telugu-English code mixing.
Each example contains:
question : Original English question
answer : Ground-truth answer
level_0 : English paraphrase
level_1 : Light Telugu-English code mixing… See the full description on the dataset page: https://huggingface.co/datasets/nlpctx/telugu-qa-codemixed.codemixed-ind-classification
CodeMixed_ind_Classification
Deduplicated copy of kornwtp/codemixed-ind-classification.
Splits
split
rows
train
956
code-mixed-bangla-english-asrPOS_hinglish_codemixed_tweetsArzEn-CodeMixed
ArzEn-CodeMixed: English-Arabic Intra-Sentential Code-Mixed Translation Dataset
This dataset contains aligned English, Arabic, and English-Arabic as well as Arabic-English intra-sentential code-mixed sentences, created for evaluating large LLMs on translating code-mixed text. It is constructed from the ArzEn-MultiGenre parallel corpus and enhanced with carefully prompted and human-validated code-mixed variants.
Dataset Details
Instances: Each entry contains:… See the full description on the dataset page: https://huggingface.co/datasets/taha-alnasser/ArzEn-CodeMixed.