Team Ai
30 shown

datasets

Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.

modalityAllTextImageAudioTabularVideo
taskAllText generationQuestion answeringImage classificationSpeech
sizeAllUnder 1K1K – 10K100K – 1M1M – 10M
formatAllParquetJSONCSVWebDataset
sortTrendingMost likedMost usedRecently updatedNewest
Clear all
01mteb /resultstext1M<n<10M18 likes268k downloads2d agoHugging Face02mteb /sts12-sts STS12 An MTEB dataset Massive Text Embedding Benchmark SemEval-2012 Task 6. Task category t2t Domains Encyclopaedic, News, Written Reference https://www.aclweb.org/anthology/S12-1051.pdf How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS12"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how to… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts12-sts.textsentence-similarity1K<n<10K8 likes85k downloads7mo agoHugging Face03mteb /nfcorpus NFCorpus An MTEB dataset Massive Text Embedding Benchmark NFCorpus: A Full-Text Learning to Rank Dataset for Medical Information Retrieval Task category t2t Domains Medical, Academic, Written Reference https://www.cl.uni-heidelberg.de/statnlpgroup/nfcorpus/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["NFCorpus"]) evaluator = mteb.MTEB(task) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/nfcorpus.texttext-retrieval100K<n<1M3 likes49k downloads1y agoHugging Face04morteza20 /mteb_leaderboard [!NOTE]Previously it was possible to submit models results to MTEB by adding the results to the model metadata. This is no longer an option as we want to ensure high quality metadata. This repository contain the results of the embedding benchmark evaluated using the package mteb. Reference 🦾 Leaderboard An up to date leaderboard of embedding models 📚 mteb Guides and instructions on how to use mteb, including running, submitting scores, etc. 🙋 Questions Questions about the… See the full description on the dataset page: https://huggingface.co/datasets/morteza20/mteb_leaderboard.0 likes43k downloads2y agoHugging Face05mteb /banking77 Banking77Classification An MTEB dataset Massive Text Embedding Benchmark Dataset composed of online banking queries annotated with their corresponding intents. Task category t2c Domains Written Reference https://arxiv.org/abs/2003.04807 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["Banking77Classification"]) evaluator = mteb.MTEB(task) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/banking77.texttext-classification10K<n<100K19 likes32k downloads1y agoHugging Face06mteb /amazon_massive_intent MassiveIntentClassification An MTEB dataset Massive Text Embedding Benchmark MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Task category t2c Domains Spoken Reference https://arxiv.org/abs/2204.08582 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["MassiveIntentClassification"]) evaluator =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/amazon_massive_intent.texttext-classification100K<n<1M27 likes29k downloads7mo agoHugging Face07mteb /arguana ArguAna An MTEB dataset Massive Text Embedding Benchmark ArguAna: Retrieval of the Best Counterargument without Prior Topic Knowledge Task category Retrieval (text-to-text) Domains Social, Web, Written Reference ACL Source datasets: mteb/arguana How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_task("ArguAna") evaluator = mteb.MTEB([task]) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/arguana.texttext-retrieval10K<n<100K7 likes27k downloads6mo agoHugging Face08mteb /sts22-crosslingual-sts STS22.v2 An MTEB dataset Massive Text Embedding Benchmark SemEval 2022 Task 8: Multilingual News Article Similarity. Version 2 filters updated on STS22 by removing pairs where one of entries contain empty sentences. Task category t2t Domains News, Written Reference https://competitions.codalab.org/competitions/33835 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts22-crosslingual-sts.textsentence-similarity10K<n<100K16 likes25k downloads7mo agoHugging Face09mteb /scifact SciFact An MTEB dataset Massive Text Embedding Benchmark SciFact verifies scientific claims using evidence from the research literature containing scientific paper abstracts. Task category t2t Domains Academic, Medical, Written Reference https://github.com/allenai/scifact How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SciFact"]) evaluator = mteb.MTEB(task)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/scifact.texttext-retrieval1K<n<10K5 likes25k downloads1y agoHugging Face10mteb /sickr-sts SICK-R An MTEB dataset Massive Text Embedding Benchmark Semantic Textual Similarity SICK-R dataset Task category t2t Domains Web, Written Reference https://aclanthology.org/L14-1314/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SICK-R"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how to run models… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sickr-sts.textsentence-similarity1K<n<10K6 likes23k downloads7mo agoHugging Face11mteb /sts13-sts STS13 An MTEB dataset Massive Text Embedding Benchmark SemEval STS 2013 dataset. Task category t2t Domains Web, News, Non-fiction, Written Reference https://www.aclweb.org/anthology/S13-1004/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS13"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts13-sts.textsentence-similarity1K<n<10K1 likes23k downloads7mo agoHugging Face12mteb /scidocs SCIDOCS An MTEB dataset Massive Text Embedding Benchmark SciDocs, a new evaluation benchmark consisting of seven document-level tasks ranging from citation prediction, to document classification and recommendation. Task category t2t Domains Academic, Written, Non-fiction Reference https://allenai.org/data/scidocs How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/scidocs.texttext-retrieval10K<n<100K6 likes23k downloads7mo agoHugging Face13mteb /sts14-sts STS14 An MTEB dataset Massive Text Embedding Benchmark SemEval STS 2014 dataset. Currently only the English dataset Task category t2t Domains Blog, Web, Spoken Reference https://www.aclweb.org/anthology/S14-1002 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS14"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts14-sts.textsentence-similarity1K<n<10K2 likes22k downloads7mo agoHugging Face14mteb /biosses-sts BIOSSES An MTEB dataset Massive Text Embedding Benchmark Biomedical Semantic Similarity Estimation. Task category t2t Domains Medical Reference https://tabilab.cmpe.boun.edu.tr/BIOSSES/DataSet.html How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["BIOSSES"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more… See the full description on the dataset page: https://huggingface.co/datasets/mteb/biosses-sts.textsentence-similarityn<1K2 likes21k downloads1y agoHugging Face15mteb /stsbenchmark-sts STSBenchmark An MTEB dataset Massive Text Embedding Benchmark Semantic Textual Similarity Benchmark (STSbenchmark) dataset. Task category t2t Domains Blog, News, Written Reference https://github.com/PhilipMay/stsb-multi-mt/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STSBenchmark"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/stsbenchmark-sts.textsentence-similarity1K<n<10K19 likes19k downloads7mo agoHugging Face16mteb /twentynewsgroups-clustering TwentyNewsgroupsClustering.v2 An MTEB dataset Massive Text Embedding Benchmark Clustering of the 20 Newsgroups dataset (subject only). Task category t2c Domains News, Written Reference https://scikit-learn.org/0.19/datasets/twenty_newsgroups.html How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["TwentyNewsgroupsClustering.v2"]) evaluator = mteb.MTEB(task)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/twentynewsgroups-clustering.texttext-classificationn<1K1 likes17k downloads1y agoHugging Face17mteb /ClimateFEVER_test_top_250_only_w_correct-v2 ClimateFEVERHardNegatives An MTEB dataset Massive Text Embedding Benchmark CLIMATE-FEVER is a dataset adopting the FEVER methodology that consists of 1,535 real-world claims regarding climate-change. The hard negative version has been created by pooling the 250 top documents per query from BM25, e5-multilingual-large and e5-mistral-instruct. Task category t2t Domains Encyclopaedic, Written Reference https://www.sustainablefinance.uzh.ch/en/research/climate-fever.html… See the full description on the dataset page: https://huggingface.co/datasets/mteb/ClimateFEVER_test_top_250_only_w_correct-v2.texttext-retrieval10K<n<100K0 likes17k downloads1y agoHugging Face18mteb /summeval SummEvalSummarization.v2 An MTEB dataset Massive Text Embedding Benchmark News Article Summary Semantic Similarity Estimation. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly. Task category t2t Domains News, Written Reference https://github.com/Yale-LILY/SummEval How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/summeval.textsummarizationn<1K11 likes15k downloads1y agoHugging Face19mteb /fiqa FiQA2018 An MTEB dataset Massive Text Embedding Benchmark Financial Opinion Mining and Question Answering Task category t2t Domains Written, Financial Reference https://sites.google.com/view/fiqa/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["FiQA2018"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more… See the full description on the dataset page: https://huggingface.co/datasets/mteb/fiqa.texttext-retrieval10K<n<100K5 likes13k downloads1y agoHugging Face20mteb /common_voice_21_00 likes12k downloads1y agoHugging Face21mteb /DBPedia_test_top_250_only_w_correct-v2 DBPediaHardNegatives An MTEB dataset Massive Text Embedding Benchmark DBpedia-Entity is a standard test collection for entity search over the DBpedia knowledge base. The hard negative version has been created by pooling the 250 top documents per query from BM25, e5-multilingual-large and e5-mistral-instruct. Task category t2t Domains Written, Encyclopaedic Reference https://github.com/iai-group/DBpedia-Entity/ How to evaluate on this task You can evaluate… See the full description on the dataset page: https://huggingface.co/datasets/mteb/DBPedia_test_top_250_only_w_correct-v2.texttext-retrieval100K<n<1M0 likes11k downloads1y agoHugging Face22mteb /BornholmBitextMining BornholmBitextMining An MTEB dataset Massive Text Embedding Benchmark Danish Bornholmsk Parallel Corpus. Bornholmsk is a Danish dialect spoken on the island of Bornholm, Denmark. Historically it is a part of east Danish which was also spoken in Scania and Halland, Sweden. Task categoryt2t Domains Web, Social, Fiction, Written Reference https://aclanthology.org/W19-6138/ Source datasets: strombergnlp/bornholmsk_parallel How to evaluate on this task… See the full description on the dataset page: https://huggingface.co/datasets/mteb/BornholmBitextMining.texttranslation1K<n<10K0 likes8.3k downloads7mo agoHugging Face23mteb /sts15-sts STS15 An MTEB dataset Massive Text Embedding Benchmark SemEval STS 2015 dataset Task category t2t Domains Blog, News, Web, Written, Spoken Reference https://www.aclweb.org/anthology/S15-2010 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS15"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts15-sts.textsentence-similarity1K<n<10K2 likes8.3k downloads7mo agoHugging Face24mteb /sprintduplicatequestions-pairclassification SprintDuplicateQuestions An MTEB dataset Massive Text Embedding Benchmark Duplicate questions from the Sprint community. Task category t2t Domains Programming, Written Reference https://www.aclweb.org/anthology/D18-1131/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SprintDuplicateQuestions"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sprintduplicatequestions-pairclassification.texttext-classificationn<1K0 likes8.2k downloads7mo agoHugging Face25mteb /trec-covid TRECCOVID An MTEB dataset Massive Text Embedding Benchmark TRECCOVID is an ad-hoc search challenge based on the COVID-19 dataset containing scientific articles related to the COVID-19 pandemic. Task category t2t Domains Medical, Academic, Written Reference https://ir.nist.gov/covidSubmit/index.html How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["TRECCOVID"])… See the full description on the dataset page: https://huggingface.co/datasets/mteb/trec-covid.texttext-retrieval100K<n<1M5 likes8k downloads7mo agoHugging Face26mteb /amazon_massive_scenario MassiveScenarioClassification An MTEB dataset Massive Text Embedding Benchmark MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Task category t2c Domains Spoken Reference https://arxiv.org/abs/2204.08582 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["MassiveScenarioClassification"]) evaluator =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/amazon_massive_scenario.texttext-classification1M<n<10M6 likes8k downloads1y agoHugging Face27mteb /arena-resultsThis dataset contains the saved results from MTEB-Arena tabular1K<n<10K4 likes7.9k downloads1y agoHugging Face28mteb /tweet_sentiment_extraction TweetSentimentExtractionClassification An MTEB dataset Massive Text Embedding Benchmark Task category t2c Domains Social, Written Reference https://www.kaggle.com/competitions/tweet-sentiment-extraction/overview How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["TweetSentimentExtractionClassification"]) evaluator = mteb.MTEB(task) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/tweet_sentiment_extraction.texttext-classification10K<n<100K38 likes7.7k downloads1y agoHugging Face29mteb /stackexchange-clustering StackExchangeClustering.v2 An MTEB dataset Massive Text Embedding Benchmark Clustering of titles from 121 stackexchanges. Clustering of 25 sets, each with 10-50 classes, and each class with 100 - 1000 sentences. Task category t2c Domains Web, Written Reference https://arxiv.org/abs/2104.07081 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/stackexchange-clustering.texttext-classificationn<1K1 likes7.6k downloads7mo agoHugging Face30mteb /SciDocsRR SciDocsRR An MTEB dataset Massive Text Embedding Benchmark Ranking of related scientific papers based on their title. Task category t2t Domains Academic, Non-fiction, Written Reference https://allenai.org/data/scidocs How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SciDocsRR"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/SciDocsRR.texttext-ranking100K<n<1M0 likes7.5k downloads1y agoHugging Face

Listings come live from the Hugging Face Hub API. Team Ai does not host these files.