textmachinelab/quail
Dataset Card for "quail" Dataset Summary QuAIL is a reading comprehension dataset. QuAIL contains 15K multi-choice questions in texts 300-350 tokens long 4 domains (news, user stories, fiction, blogs).QuAIL is balanced and annotated for question types. Supported Tasks and Leaderboards More Information Needed Languages More Information Needed Dataset Structure Data Instances quail Size of… See the full description on the dataset page: https://huggingface.co/datasets/textmachinelab/quail.
Dataset Card for "quail"
Table of Contents
- Dataset Description
- Dataset Summary
- Supported Tasks and Leaderboards
- Languages
- Dataset Structure
- Data Instances
- Data Fields
- Data Splits
- Dataset Creation
- Curation Rationale
- Source Data
- Annotations
- Personal and Sensitive Information
- Considerations for Using the Data
- Social Impact of Dataset
- Discussion of Biases
- Other Known Limitations
- Additional Information
- Dataset Curators
- Licensing Information
- Citation Information
- Contributions
Dataset Description
- Homepage: https://text-machine-lab.github.io/blog/2020/quail/
- Repository: https://github.com/text-machine-lab/quail
- Paper: Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks
- Point of Contact: More Information Needed
- Size of downloaded dataset files: 6.41 MB
- Size of the generated dataset: 29.62 MB
- Total amount of disk used: 36.03 MB
Dataset Summary
QuAIL is a reading comprehension dataset. QuAIL contains 15K multi-choice questions in texts 300-350 tokens long 4 domains (news, user stories, fiction, blogs).QuAIL is balanced and annotated for question types.
Supported Tasks and Leaderboards
Languages
Dataset Structure
Data Instances
quail
- Size of downloaded dataset files: 6.41 MB
- Size of the generated dataset: 29.62 MB
- Total amount of disk used: 36.03 MB
An example of 'train' looks as follows.
This example was too long and was cropped:
{
"answers": ["the cousin is not friendly", "the cousin could have been pretier", "not enough information", "the cousin was too nice"],
"context": "\"That fall came and I went back to Michigan and the school year went by and summer came and I never really thought about it. I'm...",
"context_id": "f001",
"correct_answer_id": 0,
"domain": "fiction",
"id": "f001_19",
"metadata": {
"author": "Joseph Devon",
"title": "Black Eyed Susan",
"url": "http://manybooks.net/pages/devonjother08black_eyed_susan/0.html"
},
"question": "After the events in the text what does the author think about the cousin?",
"question_id": "19",
"question_type": "Subsequent_state"
}Data Fields
The data fields are the same among all splits.
quail
id: astringfeature.context_id: astringfeature.question_id: astringfeature.domain: astringfeature.author: astringfeature.title: astringfeature.url: astringfeature.context: astringfeature.question: astringfeature.question_type: astringfeature.answers: alistofstringfeatures.correct_answer_id: aint32feature.
Data Splits
Dataset Creation
Curation Rationale
Source Data
Initial Data Collection and Normalization
Who are the source language producers?
Annotations
Annotation process
Who are the annotators?
Personal and Sensitive Information
Considerations for Using the Data
Social Impact of Dataset
Discussion of Biases
Other Known Limitations
Additional Information
Dataset Curators
Licensing Information
Citation Information
@inproceedings{DBLP:conf/aaai/RogersKDR20,
author = {Anna Rogers and
Olga Kovaleva and
Matthew Downey and
Anna Rumshisky},
title = {Getting Closer to {AI} Complete Question Answering: {A} Set of Prerequisite
Real Tasks},
booktitle = {The Thirty-Fourth {AAAI} Conference on Artificial Intelligence, {AAAI}
2020, The Thirty-Second Innovative Applications of Artificial Intelligence
Conference, {IAAI} 2020, The Tenth {AAAI} Symposium on Educational
Advances in Artificial Intelligence, {EAAI} 2020, New York, NY, USA,
February 7-12, 2020},
pages = {8722--8731},
publisher = {{AAAI} Press},
year = {2020},
url = {https://aaai.org/ojs/index.php/AAAI/article/view/6398},
timestamp = {Thu, 04 Jun 2020 13:18:48 +0200},
biburl = {https://dblp.org/rec/conf/aaai/RogersKDR20.bib},
bibsource = {dblp computer science bibliography, https://dblp.org}
}
Contributions
Thanks to @sai-prasanna, @ngdodd for adding this dataset.
