wikitext Salesforce
Dataset Card for "wikitext" Dataset Summary The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License. Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/wikitext.
- 类型
- dataset
- 许可
- cc-by-sa-3.0
- 语言
- en
- 下载量
- 1,498,204
- 点赞
- 758
- 访问
- public
- 文件
- 0
标签
- 预训练语料
- 文本数据集
- 大语言模型
- 文本生成
- NLP
- 评测基准
摘要
WikiText 是经典英文语言建模评测数据集，从维基百科优质/精选文章中提取超1亿token，提供 wikitext-2 与 wikitext-103 两种规模，各有 raw（字符级）与非 raw（词级）版本。相比 PTB 更具规模、词汇量更大并保留原始大小写、标点和数字，适合训练和评测需要利用长程依赖的语言模型，是文本生成与掩码语言建模的标准基准。
README
--- annotations_creators: - no-annotation language_creators: - crowdsourced language: - en license: - cc-by-sa-3.0 - gfdl multilinguality: - monolingual size_categories: - 1M<n<10M source_datasets: - original task_categories: - text-generation - fill-mask task_ids: - language-modeling - masked-lang…