Team Ai
Datasetpublic

hf-internal-testing/tokenization_test_data

Dataset Card for Dataset Name This dataset card aims to be a base template for new datasets. It has been generated using this raw template. Dataset Details Dataset Description Curated by: [More Information Needed] Funded by [optional]: [More Information Needed] Shared by [optional]: [More Information Needed] Language(s) (NLP): [More Information Needed] License: [More Information Needed] Dataset Sources [optional]… See the full description on the dataset page: https://huggingface.co/datasets/hf-internal-testing/tokenization_test_data.

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes17downloads
20 commits on main
01571011y ago

Upload tokenization_data_cases.json

itazap
dd364371y ago

Delete tokenization_data_cases.json

itazap
9aba6111y ago

Upload tokenization_data_cases.json

itazap
95f39e41y ago

Delete tokenization_data.json

itazap
8c9ae9a1y ago

Upload tokenization_data.json

itazap
f8776961y ago

Delete tokenizer_data_fixed.json

itazap
678453f1y ago

Upload tokenizer_data_fixed.json

itazap
e7039b31y ago

Delete tokenizer_data_fixed.json

itazap
6b657e31y ago

Upload tokenizer_data_fixed.json

itazap
d2acd2a1y ago

Delete tokenization_data.json

itazap
08ca1131y ago

Upload tokenization_data.json

itazap
44e4b471y ago

Delete tokenization_test_data.json

itazap
77128381y ago

Upload tokenization_test_data.json

itazap
af94ea41y ago

Delete tokenization_test_data.json

itazap
636a2a31y ago

Create README.md

itazap
a4022511y ago

Upload tokenization_test_data.json

itazap
6b7e6dc1y ago

Delete .gitattributes

itazap
f2841d71y ago

Delete tokenization_test_data.json

itazap
143e2621y ago

Upload tokenization_test_data.json

itazap
58169891y ago

initial commit

itazap