Modelpublic

hellosindh/indus-script-models

sourceHugging Facecc-by-4.0updated 6mo agoView on Hugging Face

0likes

tokenizer_config.json12 linesDownload Raw Back to electra

1{
2  "backend": "tokenizers",
3  "cls_token": "[CLS]",
4  "is_local": true,
5  "mask_token": "[MASK]",
6  "model_max_length": 1000000000000000019884624838656,
7  "pad_token": "[PAD]",
8  "sep_token": "[SEP]",
9  "tokenizer_class": "TokenizersBackend",
10  "unk_token": "[UNK]"
11}
12