Cant run the model with the most basic code

#7
by masterchop - opened

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")
model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")

shows error:
Traceback (most recent call last):
File "", line 1, in
File "/transformers/models/auto/auto_factory.py", line 482, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
File "/transformers/models/auto/configuration_auto.py", line 1022, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
File "/transformers/models/auto/configuration_auto.py", line 723, in getitem
raise KeyError(key)
KeyError: 'mistral'

What am I missing?

I got the same errors. I think the problem is from API side?

This comment has been hidden

You might have to install it from source , as the associated model code hasn't been released as a new transformers version yet.

pip install git+https://github.com/huggingface/transformers 

Hope this helps !

I have the same issue

Hi i was facing same issue, Instead of pip install transformers, as someone stated above earlier use this
!pip install git+https://github.com/huggingface/transformers

Mistral AI_ org

Mistral is now part of the official 4.34.0 Transformers release. The above workarounds are not necessary anymore, just make sure to pip install "transformers>=4.34.0".

lerela changed discussion status to closed

Sign up or log in to comment