Modelpublic

siditom/tokenizer-codon_optimization-refined_expr

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes

tokenizer_config.json13 linesDownload Raw Back to root

1{2  "bos_token": "<s>",3  "cls_token": "<cls>",4  "eos_token": "</s>",5  "mask_token": "<msk>",6  "model_max_length": 512,7  "pad_token": "<pad>",8  "padding_side": "right",9  "sep_token": "<sep>",10  "tokenizer_class": "PreTrainedTokenizerFast",11  "unk_token": "<unk>"12}13