Skup podataka sa Hugging Face · Salesforce
WikiText
- Licenca
- CC BY-SA 3.0, gfdldozvoljena komercijalna upotreba
- Licenca dozvoljava komercijalnu upotrebu. Obično treba navesti autora — tačni uslovi su u tekstu licence.
- Formati
- parquet, PARQUET
- Veličina
- 614 MB
- Ažurirano
- 4. 1. 2024.
Opis
Dataset Card for "wikitext" Dataset Summary The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License. Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far…
Opis sa Hugging Face, skraćen.
Fajlovi (14)
- PARQUETwikitext-103-raw-v1/test-00000-of-00001.parquet715 kB
- PARQUETwikitext-103-raw-v1/train-00000-of-00002.parquet150 MB
- PARQUETwikitext-103-raw-v1/train-00001-of-00002.parquet150 MB
- PARQUETwikitext-103-raw-v1/validation-00000-of-00001.parquet642 kB
- PARQUETwikitext-103-v1/test-00000-of-00001.parquet705 kB
- PARQUETwikitext-103-v1/train-00000-of-00002.parquet149 MB
- PARQUETwikitext-103-v1/train-00001-of-00002.parquet149 MB
- PARQUETwikitext-103-v1/validation-00000-of-00001.parquet640 kB
- PARQUETwikitext-2-raw-v1/test-00000-of-00001.parquet715 kB
- PARQUETwikitext-2-raw-v1/train-00000-of-00001.parquet6,1 MB
- PARQUETwikitext-2-raw-v1/validation-00000-of-00001.parquet642 kB
- PARQUETwikitext-2-v1/test-00000-of-00001.parquet669 kB
- PARQUETwikitext-2-v1/train-00000-of-00001.parquet5,8 MB
- PARQUETwikitext-2-v1/validation-00000-of-00001.parquet603 kB
DataHunter ne čuva i ne deli ove fajlove: svaki link vodi do izvornog sajta. Pre upotrebe tamo proverite licencu.