Free and ready to use Yi-6B-200K-GGUF model as OpenAI API compatible endpoint
#2
by
limcheekin
- opened
Hi there,
I've successfully deployed the model as an OpenAI API-compatible endpoint, which you can access via the following link:
https://huggingface.co/spaces/limcheekin/Yi-6B-200K-GGUF.
This API has been made possible thanks to the generous contributions of the following individuals and resources:
- The original model's publisher.
- The
TheBlokewho shared the quantized models. - The
llama-cpp-pythonpackage. - HuggingFace Spaces.
If you find this resource valuable and wish to show your support, we would greatly appreciate it if you could "star" the space.
Thank you for your support and interest.
I just give it a try and it works well!
We may also sponsor such work in the near future. Please watch our github repo for the latest news.
A personal suggestion, you may consider adding a more user friendly front-end to the HF space.
FancyZhao
changed discussion status to
closed