How multilingual-e5-large can be used as a standalone service to support Python like OpenAIEmbeddings?

#33
by chenkun - opened

Hi,

How multilingual-e5-large can be used as a standalone service to support Python like OpenAIEmbeddings?
(Like FastChat, but multilingual-e5-large is not in the list of models supported by FastChat.)

My current deployment method is HuggingFaceEmbedding, but it cannot be shared between multiple programs:

embedding = HuggingFaceEmbeddings(
    model_name='xxx'
)

You can build a Flask application to serve the model as API and call API in other programs

Hi @TungLam , could you give me a specific code example or tutorial link? Thank you.

Sign up or log in to comment