Modelpublic

RichardErkhov/bigcode_-_gpt_bigcode-santacoder-4bits

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes12downloads

special_tokens_map.json25 linesDownload Raw Back to root

1{2  "additional_special_tokens": [3    "<|endoftext|>",4    "<fim-prefix>",5    "<fim-middle>",6    "<fim-suffix>",7    "<fim-pad>"8  ],9  "bos_token": {10    "content": "<|endoftext|>",11    "lstrip": false,12    "normalized": false,13    "rstrip": false,14    "single_word": false15  },16  "eos_token": {17    "content": "<|endoftext|>",18    "lstrip": false,19    "normalized": false,20    "rstrip": false,21    "single_word": false22  },23  "unk_token": "<|endoftext|>"24}25