ai2_arc allenai

Dataset Card for "ai2_arc" Dataset Summary A new dataset of 7,787 genuine grade-school level, multiple-choice science questions, assembled to encourage research in advanced question-answering. The dataset is partitioned into a Challenge Set and an Easy Set, where the former contains only questions answered incorrectly by both a retrieval-based algorithm and a word co-occurrence algorithm. We are also including a corpus of over 14 million science sentences… See the full description on the dataset page: https://huggingface.co/datasets/allenai/ai2_arc.

类型
dataset
许可
cc-by-sa-4.0
语言
en
下载量
480,331
点赞
382
访问
public
文件
0

标签

  • 评测基准
  • 问答
  • 文本数据集
  • NLP

摘要

AI2 ARC（AI2 Reasoning Challenge）是艾伦人工智能研究院构建的约 7,787 道小学级别科学多选题数据集，用于推动高级问答研究。数据集分为 Challenge Set 和 Easy Set，其中挑战集仅包含基于检索算法和词共现算法均回答错误的题目，难度更高。该数据集广泛用于评测大语言模型的科学推理与常识问答能力，是问答任务的重要基准。

README

--- annotations_creators: - found language_creators: - found language: - en license: - cc-by-sa-4.0 multilinguality: - monolingual size_categories: - 1K<n<10K source_datasets: - original task_categories: - question-answering task_ids: - open-domain-qa - multiple-choice-qa pretty_name: Ai2Arc langua…

查看完整页面 · 查看原文