Team Ai
Datasetpublic

model-metadata/code_execution_files

sourceHugging Faceupdated 7mo agoView on Hugging Face
0likes25kdownloads
utter-project_EuroLLM-9B_2.txt43 linesDownload Raw Back to root
1```CODE: 2# Load model directly3from transformers import AutoTokenizer, AutoModelForCausalLM4 5tokenizer = AutoTokenizer.from_pretrained("utter-project/EuroLLM-9B")6model = AutoModelForCausalLM.from_pretrained("utter-project/EuroLLM-9B")7```8 9ERROR: 10Traceback (most recent call last):11  File "/tmp/utter-project_EuroLLM-9B_21djTTe.py", line 24, in <module>12    tokenizer = AutoTokenizer.from_pretrained("utter-project/EuroLLM-9B")13  File "/tmp/.cache/uv/environments-v2/31d9dd746308ee4e/lib/python3.13/site-packages/transformers/models/auto/tokenization_auto.py", line 1140, in from_pretrained14    return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)15           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^16  File "/tmp/.cache/uv/environments-v2/31d9dd746308ee4e/lib/python3.13/site-packages/transformers/tokenization_utils_base.py", line 2097, in from_pretrained17    return cls._from_pretrained(18           ~~~~~~~~~~~~~~~~~~~~^19        resolved_vocab_files,20        ^^^^^^^^^^^^^^^^^^^^^21    ...<9 lines>...22        **kwargs,23        ^^^^^^^^^24    )25    ^26  File "/tmp/.cache/uv/environments-v2/31d9dd746308ee4e/lib/python3.13/site-packages/transformers/tokenization_utils_base.py", line 2343, in _from_pretrained27    tokenizer = cls(*init_inputs, **init_kwargs)28  File "/tmp/.cache/uv/environments-v2/31d9dd746308ee4e/lib/python3.13/site-packages/transformers/models/llama/tokenization_llama_fast.py", line 154, in __init__29    super().__init__(30    ~~~~~~~~~~~~~~~~^31        vocab_file=vocab_file,32        ^^^^^^^^^^^^^^^^^^^^^^33    ...<10 lines>...34        **kwargs,35        ^^^^^^^^^36    )37    ^38  File "/tmp/.cache/uv/environments-v2/31d9dd746308ee4e/lib/python3.13/site-packages/transformers/tokenization_utils_fast.py", line 108, in __init__39    raise ValueError(40    ...<2 lines>...41    )42ValueError: Cannot instantiate this tokenizer from a slow version. If it's based on sentencepiece, make sure you have sentencepiece installed.43