Can't load model config :(

#1
by gheorghebg11 - opened

I'm not able to load the config

ValueError: `rope_scaling` must be a dictionary with two fields, `type` and `factor`, got {'factor': 8.0, 'low_freq_factor': 1.0, 'high_freq_factor': 4.0, 'original_max_position_embeddings': 8192, 'rope_type': 'llama3'}
McGill NLP Group org

Hi, please update your transformer version to atleast 4.42.3. Let me know if the error still persists.

Thanks that fixed it! Oh I guess llm2vec hasn't been released in a while and the pypi version still requires transformers<=4.40.2. All good!

gheorghebg11 changed discussion status to closed

Sign up or log in to comment