Skup podataka sa Hugging Face · Salesforce

WikiText

Licenca
CC BY-SA 3.0, gfdldozvoljena komercijalna upotreba
Licenca dozvoljava komercijalnu upotrebu. Obično treba navesti autora — tačni uslovi su u tekstu licence.
Formati
parquet, PARQUET
Veličina
614 MB
Ažurirano
4. 1. 2024.

Opis

Dataset Card for "wikitext" Dataset Summary The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License. Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far…

Opis sa Hugging Face, skraćen.

Fajlovi (14)

  • PARQUETwikitext-103-raw-v1/test-00000-of-00001.parquet715 kB
  • PARQUETwikitext-103-raw-v1/train-00000-of-00002.parquet150 MB
  • PARQUETwikitext-103-raw-v1/train-00001-of-00002.parquet150 MB
  • PARQUETwikitext-103-raw-v1/validation-00000-of-00001.parquet642 kB
  • PARQUETwikitext-103-v1/test-00000-of-00001.parquet705 kB
  • PARQUETwikitext-103-v1/train-00000-of-00002.parquet149 MB
  • PARQUETwikitext-103-v1/train-00001-of-00002.parquet149 MB
  • PARQUETwikitext-103-v1/validation-00000-of-00001.parquet640 kB
  • PARQUETwikitext-2-raw-v1/test-00000-of-00001.parquet715 kB
  • PARQUETwikitext-2-raw-v1/train-00000-of-00001.parquet6,1 MB
  • PARQUETwikitext-2-raw-v1/validation-00000-of-00001.parquet642 kB
  • PARQUETwikitext-2-v1/test-00000-of-00001.parquet669 kB
  • PARQUETwikitext-2-v1/train-00000-of-00001.parquet5,8 MB
  • PARQUETwikitext-2-v1/validation-00000-of-00001.parquet603 kB

DataHunter ne čuva i ne deli ove fajlove: svaki link vodi do izvornog sajta. Pre upotrebe tamo proverite licencu.

Pronađi druge skupove