Team Ai
Modelpublic

prelington/CodexTrouter

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
1likes
roottokenizer.json
tokenizer.json5 linesDownload Raw Back to root
1from transformers import AutoTokenizer2 3tokenizer = AutoTokenizer.from_pretrained("microsoft/phi-2")4tokenizer.save_pretrained("./ProTalk/")5