datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
peka_persian_knowledge_assessment
PeKA (Persian Knowledge Assessment)
PeKA is a dataset introduced in the paper "Advancing Persian LLM Evaluation", accepted at NAACL 2025 findings. It was developed as part of a broader effort to evaluate and benchmark large language models (LLMs) for multiple Persian knowledge topics.
For comprehensive details regarding the dataset’s construction, scope, task, and intended use, please refer to the original paper.
This dataset is constructed so that answering these questions… See the full description on the dataset page: https://huggingface.co/datasets/MatinaAI/peka_persian_knowledge_assessment.cooking-knowledge-basics
Comprehensive Cooking Knowledge Q&A Dataset
This dataset (cooking_knowledge.csv) contains a rich collection of synthetically generated Question-Answer (Q&A) pairs covering diverse aspects of cooking knowledge, with particular emphasis on food chemistry, flavor pairing, cooking techniques, dietary accommodations, and culinary traditions. The data was created using a large language model with advanced reasoning capabilities, prompted with various grounded contexts and real-world… See the full description on the dataset page: https://huggingface.co/datasets/ktiyab/cooking-knowledge-basics.Current_Trivia_Knowledge-benchmark
Current Trivia Knowledge RAG Benchmark
Short Summary:
A 140-QA pair (70 train, 70 test) dataset for real-world RAG evaluation. It features current knowledge questions unavailable to LLMs trained before 2024 (e.g., GPT-4o) across diverse domains, and includes human feedback for the training set, enabling robust assessment of contextual information's critical impact on LLM accuracy.
Introduction & Motivation:
This dataset addresses the critical need for a dynamic… See the full description on the dataset page: https://huggingface.co/datasets/TPelc/Current_Trivia_Knowledge-benchmark.qulture-general-knowledge-dataset
Qulture General Knowledge Question Dataset
An open dataset containing 16 families of general knowledge questions, for a total of 64 records.
Diverse-Knowledge
Everything Data
This data is synthetically generated by a ton of open and closed source models. This is basically a parsed version of yearly log form a small dialouge based testing to anylyze model's response on it then perform human evals on it.
The data contains information about everything from every domain, most of the pairs included in this data are preferred by humans as the model's response.
It can be used for topic modeling, or human preference evals etc.
Rest anyone can do… See the full description on the dataset page: https://huggingface.co/datasets/kunu5402/Diverse-Knowledge.HRE-ToM-KnowledgePerceptionThe Knowledge-Perception task aims to evaluate the ability to link perception to knowledge. Each scenario involves one person moving an object to a new location and another person leaving and later returning to the room. The second person either observes or does not observe the other person moving the object.
The following template can be used to evaluate LLMs on the Knowledge-Perception task:f"Read the scenario and answer the question by using step by step reasoning:\n\nScenario:… See the full description on the dataset page: https://huggingface.co/datasets/Z3R6X/HRE-ToM-KnowledgePerception.
