Issue with inference endpoint - serverless
I'm currently facing an issue while trying to consume the model using the inference endpoint serverless. I am getting an error -
{'error': 'Loading /data/nomic-ai_nomic-embed-text-v1/ requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.'}
I would greatly appreciate any insights, suggestions, or guidance on how to resolve this issue. Has anyone faced a similar problem or can anyone point out what I might be missing?
Thank you in advance for your help!
I had a similar problem.
If you are using SentenceTransformer, you likely need to update your package to the latest version:pip install -U sentence-transformers
It might then complain that the model was built with version 2.4dev0... which isn't in pip yet. To fix that, you can download the git main and install with the following:
git clone https://github.com/UKPLab/sentence-transformers
cd sentence-transformers/
pip install -e .
from what I'm told, we would need a custom handler: https://huggingface.co/docs/inference-endpoints/guides/custom_handler
I unfortunately won't have time to look at this for a while but PRs are welcome!