How multilingual-e5-large can be used as a standalone service to support Python like OpenAIEmbeddings?
#33
by
chenkun
- opened
Hi,
How multilingual-e5-large can be used as a standalone service to support Python like OpenAIEmbeddings?
(Like FastChat, but multilingual-e5-large is not in the list of models supported by FastChat.)
My current deployment method is HuggingFaceEmbedding, but it cannot be shared between multiple programs:
embedding = HuggingFaceEmbeddings(
model_name='xxx'
)
You can build a Flask application to serve the model as API and call API in other programs