Errors on The state dictionary

#4
by baconnier - opened

When i try:

RAG_used = RAGPretrainedModel.from_pretrained("jinaai/jina-colbert-v2")
I got :
ValueError: The state dictionary of the model you are trying to load is corrupted. Are you sure it was properly saved?

Jina AI org

hi @baconnier have you installed flash_attn as one of the dependency?

flash_attn has strict cuda, rocm requirement. Would it be possible to use the new model cpu only or even mps?

I got the same error when trying to initialize model with Colbert Checkpoint. flash-attn is installed and its version is 2.6.3. Is there any way to fix this?

Getting the same error during training, but inference works fine with Ragatouille.

Sign up or log in to comment