datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
financial-news-multisource
Multi-Source Financial & General News
🚀 57.1 MILLION ROWS OF NEWS CONTENT — one unified corpus for market-aware AI/ML
I combined 24 public news datasets (many small on their own) into one consistent, ready-to-use layer so you don’t have to wrangle them yourself. Everything is normalized to a minimal schema (date, text, extra_fields) and shipped as Parquet shards per subset—streamable, DuckDB-friendly, and built with a trading date policy (this can be edited if folks see other… See the full description on the dataset page: https://huggingface.co/datasets/idleengine/financial-news-multisource.financial-news-multisource
Multi-Source Financial & General News
🚀 57.1 MILLION ROWS OF NEWS CONTENT — one unified corpus for market-aware AI/ML
I combined 24 public news datasets (many small on their own) into one consistent, ready-to-use layer so you don’t have to wrangle them yourself. Everything is normalized to a minimal schema (date, text, extra_fields) and shipped as Parquet shards per subset—streamable, DuckDB-friendly, and built with a trading date policy (this can be edited if folks see other use… See the full description on the dataset page: https://huggingface.co/datasets/Brianferrell787/financial-news-multisource.multisource-memory-benchmark
Multi-Source Memory Benchmark
Status — anonymous artefact for double-blind review (NeurIPS 2026 Evaluations & Datasets Track).
Author identities, organisations, and funders are intentionally withheld until the review period concludes.
A diagnostic testbed for selective question-answering (ANSWER / SKIP) over conflicting multi-source personal memory.
Each persona has five evidence streams projected from a single latent event table with known, controlled per-source distortions… See the full description on the dataset page: https://huggingface.co/datasets/anon-neuripsed26/multisource-memory-benchmark.AgentFEM-MultiSource-Heat-2D
AgentFEM · Multi-source heat conduction
Two smooth volumetric heat sources in a rectangular conducting plate. Learn how source placement, spread, intensity, geometry and conductivity shape the temperature field.
256 independently solved parameter sets · full meshes and fields · 192 / 32 / 32 split · CC BY 4.0
Built with AgentFEM. A small, reproducible engineering dataset for surrogate learning, field prediction and numerical-method experiments.
Physical problem… See the full description on the dataset page: https://huggingface.co/datasets/HaomingLuo/AgentFEM-MultiSource-Heat-2D.multisource-membench
Multi-Source Memory Benchmark
Status — public release.
A diagnostic testbed for selective question-answering (ANSWER / SKIP) over conflicting multi-source personal memory.
Each persona has five evidence streams projected from a single latent event table with known, controlled per-source distortions (bias direction, dropout rate, granularity), allowing methods to be measured against the latent ground truth rather than against any single source.
The benchmark accompanies the… See the full description on the dataset page: https://huggingface.co/datasets/ytc1997/multisource-membench.v2.5-box-precise-and-multi-source-suplement
v2.5 box precise and multi source suplement
Quick card
Field
Reference
Use
Train or inspect probable-fire proposals and the separate fire/smoke annotation view.
Expected input
Original images; COCO xywh boxes in original-image pixels; choose fire_smoke or probable_fire.
Example
Read one probable_fire row, retain image dimensions and its source-specific box view.
Limits
Public rights-filtered subset; not the complete retained training corpus. Do… See the full description on the dataset page: https://huggingface.co/datasets/fireviewer/v2.5-box-precise-and-multi-source-suplement.multisource_textMulti-Source-Video-Captioning
Multi-source Video Captioning (MSVC) Dataset Card
Dataset details
Dataset type:
MSVC is a set of collected video captioning data. It is constructed to ensure a robust and thorough evaluation of Video-LLMs' video-captioning capabilities.
Dataset detail:
MSVC is introduced to address limitations in existing video caption benchmarks, MSVC samples a total of 1,500 videos with human-annotated captions from MSVD, MSRVTT, and VATEX, ensuring diverse scenarios and domains.… See the full description on the dataset page: https://huggingface.co/datasets/DAMO-NLP-SG/Multi-Source-Video-Captioning.multisource_tok_nobookcode-multi-line-infilling-benchmark
Dataset Summary
This dataset is used to evaluate Multi-Line fill in the middle code completion capabilities of a system.
The dataset is derived from SWE-Bench dataset.
Evaluation is performed by stiching the generated middle portion, with the other patch and passing into the SWE Evaluation harness, which runs unit test verification and calculate Pass@1.
Data Instances
In addition to the fields already calculated by SWE-Bench dataset, this dataset contains five… See the full description on the dataset page: https://huggingface.co/datasets/sourcegraph/code-multi-line-infilling-benchmark.flan_source_race_high_Write_a_multi_choice_question_options_given__67iran_cpi_and_inflation_multisource
شاخص بهای مصرفکننده و تورم ایران (چندمرجعی)
سریهای رسمیِ شاخص قیمت مصرفکننده (CPI) و نرخ تورم ایران از دو مرجعِ رسمی: مرکز آمار
ایران (ماهانه) و بانک مرکزی (سالانه، سریِ تاریخیِ بلند). هر مرجع سریِ مستقلِ خود را دارد و در
کنارشان یک نمای یکپارچه ارائه میشود.
پوشش: بانک مرکزی سالانه ۱۳۱۵–۱۴۰۱ · مرکز آمار ماهانه ۱۳۹۰–۱۴۰۵
سطح: ملی · واحد: شاخص و درصد
شاخصها
شاخص
مرجع
تناوب
شاخص قیمت مصرفکننده
مرکز آمار (پایهٔ ۱۴۰۰) · بانک مرکزی (پایهٔ ۱۳۹۵)… See the full description on the dataset page: https://huggingface.co/datasets/Farmaanaa/iran_cpi_and_inflation_multisource.sonarvision-multisource-v6
🌊 KADAL Multi-Source Side-Scan Sonar Dataset (v6)
SIH 2026 | SIH26057 (Ministry of Earth Sciences / NIOT) — AI-Powered Automated Underwater Marine Debris and Anomaly Detection System using Side-Scan Sonar Imagery.
Official Project Source Code & Documentation:🔗 https://github.com/Dinoman67/sonarvision(Refer to the GitHub repository for preprocessing scripts, augmentations, model weights, edge dashboard, and optional supporting features such as C2 (NMEA/KML) exports… See the full description on the dataset page: https://huggingface.co/datasets/Dinoman1221/sonarvision-multisource-v6.lemonseed-multisource-cogen
lemonseed-multisource-cogen
LemonSeed — multi-source teacher-co-gen training.
Contents
intelligent_multisource_train.jsonl (464 rows)
Format
JSON Lines (.jsonl), one example per line.
Provenance
LLM-teacher co-generated instruction/chat data for LemonSeed fine-tuning.
pii-detection-multisource-en-saudi-arabic
PII Detection Multisource EN + Saudi/Arabic
284,619 English examples. 2,088,335 labelled spans. 31 entity types. One label space.
Four public PII datasets, merged into a single schema, plus Saudi and Arabic
coverage that none of them had, plus material for two failure modes that matter
when you run redaction in production.
Built for OnKith, a privacy first voice assistant that
transcribes speech and strips personal information on the device itself, before
anything is allowed to… See the full description on the dataset page: https://huggingface.co/datasets/KhalidAlharbi377/pii-detection-multisource-en-saudi-arabic.buzz_sources_033_processed_unified_multi_newsartificial-intelligence-multi-source-datasetcrux-mds-multi_news-sourcesummarization_wikilingua_multisource_chatgpt_segmentationflan_source_task611_mutual_multi_turn_dialogue_291multisource-esco-set
MultiSource-ESCO-Skills: A Unified Dataset for Skill Extraction
This dataset aggregates data from multiple sources—course descriptions, CV content, and job descriptions—all linked to ESCO skills. It is designed to help researchers and practitioners develop and fine-tune NLP models (e.g., BERT or SentenceTransformer-based models) for automated skill extraction.
Dataset Overview
Name: MultiSource-ESCO-Skills
Sources:
Course Content: Educational course materials
CV Content:… See the full description on the dataset page: https://huggingface.co/datasets/Boanerges/multisource-esco-set.ko-multisource-retrieval-dataset
구성
여러 공개 출처를 하나의 스키마로 통합한 한국어 query–passage 페어 데이터셋입니다.
stage1, stage2 두 subset. 각각 train 100,000 / valid 10,000행 (총 220,000행, parquet, 151MB)
필드
설명
dataset
원 출처 식별자 (18종)
query
질의문 (2~2,020자)
passage
대응 문서 (10~2,050자)
출처
AI 허브 — 기계독해 지식검색 일반상식 도서자료 행정문서 뉴스기사 금융법률 숫자연산 표정보 추상요약 이벤트 (AI허브_ 접두사)
KLUE — klue-mrc klue-nli klue-sts
기타 — kakao-nli 공공데이터포털-deepqa LGNLP
참고
출처별로 페어 성격이 다르므로 용도에 맞게 필터링을 권장합니다.
klue-nli klue-sts… See the full description on the dataset page: https://huggingface.co/datasets/FronyAI/ko-multisource-retrieval-dataset.high_quality_data_10k_multisourcelemonseed-multisource-cogen-diversified
lemonseed-multisource-cogen-diversified
LemonSeed — multi-source diversified teacher-co-gen training (v2).
Contents
intelligent_multisource_diversified_train_v2.jsonl (464 rows)
Format
JSON Lines (.jsonl), one example per line.
Provenance
LLM-teacher co-generated instruction/chat data for LemonSeed fine-tuning.
flan_source_race_middle_Write_a_multi_choice_question_options_given__116lemonseed-multisource-cogen-corrective
lemonseed-multisource-cogen-corrective
LemonSeed — multi-source corrective teacher-co-gen training (v3).
Contents
intelligent_multisource_corrective_train_v3.jsonl (522 rows)
Format
JSON Lines (.jsonl), one example per line.
Provenance
LLM-teacher co-generated instruction/chat data for LemonSeed fine-tuning.
persian-multi-source-corpus
license: mit
--- 📚 Persian Multi-Source Dataset Collection
🌟 Dataset Overview
A comprehensive Persian language dataset combining diverse sources to create a rich training corpus for language models.
📊 Data Sources
🌐 Public Datasets
MaralGPT Collections
Persian blogs
Persian quotes
Story Collections
TinyStories-Farsi
FarsiTinyStories
News & Media
Farsi news corpus
Persian daily news
Persian blog posts
Conversation & QA
Persian QA pairs
Telegram channel content
Specialized Content… See the full description on the dataset page: https://huggingface.co/datasets/yeganehmohammadi98/persian-multi-source-corpus.biomedical-multi-source-finetuneheterogeneous-multisource-kg-benchmark
Heterogeneous Multi-Source Knowledge Graph Benchmark
A benchmark for evaluating multi-source knowledge graph construction and cross-source question answering systems. The benchmark comprises 50 questions designed to assess systems' ability to reason across heterogeneous data sources (structured SQL, semi-structured JSON, and unstructured text).
Dataset Overview
Property
Value
Questions
50
Question Categories
Source Attribution, Entity Integration, Conflict… See the full description on the dataset page: https://huggingface.co/datasets/Cool-EdwardH/heterogeneous-multisource-kg-benchmark.flan_source_race_high_Write_a_multi_choice_question_for_the_following_article_72