Modelpublic

codefuse-ai/CodeFuse-CodeGeeX2-6B

sourceHugging Faceotherupdated 3y agoView on Hugging Face

4likes21downloads

tokenizer_config.json16 linesDownload Raw Back to root

1{2  "auto_map": {3    "AutoTokenizer": [4      "tokenization_chatglm.ChatGLMTokenizer",5      null6    ]7  },8  "clean_up_tokenization_spaces": false,9  "do_lower_case": false,10  "legacy": false,11  "model_max_length": 1000000000000000019884624838656,12  "padding_side": "left",13  "remove_space": false,14  "tokenizer_class": "ChatGLMTokenizer"15}16