Unable to run the model with SwiftChat sample app
#10
by
jfcmelo
- opened
I've successfully loaded the model in the app and the HUGGING_FACE_HUB_TOKEN env var was set correctly after log in using the hugging face CLI. However when running the model I got the following error:
/Documents/huggingface/models/mistralai/Mistral-7B-Instruct-v0.3/config.json. Please verify that you have set the HUGGING_FACE_HUB_TOKEN environment variable."
If you'd like, you can try this example where I'm using MistralCoreML on macOS with Swift.