cosmopedia HuggingFaceTB
Cosmopedia v0.1 Image generated by DALL-E, the prompt was generated by Mixtral-8x7B-Instruct-v0.1 Note: Cosmopedia v0.2 is available at smollm-corpus User: What do you think "Cosmopedia" could mean? Hint: in our case it's not related to cosmology. Mixtral-8x7B-Instruct-v0.1: A possible meaning for "Cosmopedia" could be an encyclopedia or collection of information about different cultures, societies, and topics from around the world, emphasizing diversity and global… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceTB/cosmopedia.
- Typ
- dataset
- Lizenz
- apache-2.0
- Sprache
- en
- Downloads
- 22,274
- Likes
- 740
- Zugriff
- public
- Dateien
- 0
Tags
- 预训练语料
- 合成数据
- 文本生成
- 大语言模型
- Synthetic Data
- 预训练语料库
- Mehrsprachig
Zusammenfassung
Cosmopedia v0.1 ist ein synthetischer Textdatensatz mit über 30 Millionen Dateien und 25 Milliarden Token, erzeugt von Mixtral-8x7B-Instruct-v0.1. Er deckt mit 8 Splits verschiedene Quellen ab (Stanford, OpenStax, KhanAcademy, Web-Samples, Geschichten, WikiHow) und generiert passende Texte in unter…
README
--- dataset_info: - config_name: auto_math_text features: - name: prompt dtype: string - name: text_token_length dtype: int64 - name: text dtype: string - name: seed_data dtype: string - name: format dtype: string - name: audience dtype: string splits: - name: train num_bytes: 8777587297.907892 num…