How do you install this?

#3
by JonOne - opened

I can’t find instructions on how to install this. Can anyone help? Thanks

should that code snippet work?

from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("chavinlo/gpt4-x-alpaca")
model = AutoModelForCausalLM.from_pretrained("chavinlo/gpt4-x-alpaca")

I need to try this out! having issues to run from this snippet too.

Traceback (most recent call last):
File "/Users/gabrielabreu/isa/gpt4xalpaca.py", line 3, in
tokenizer = AutoTokenizer.from_pretrained("chavinlo/gpt4-x-alpaca")
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 676, in from_pretrained
raise ValueError(
ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

I need to try this out! having issues to run from this snippet too.

Traceback (most recent call last):
File "/Users/gabrielabreu/isa/gpt4xalpaca.py", line 3, in
tokenizer = AutoTokenizer.from_pretrained("chavinlo/gpt4-x-alpaca")
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 676, in from_pretrained
raise ValueError(
ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

Update your tokenizer version to the latest

Sign up or log in to comment