Provide GGUF model files

by stevapple - opened Sep 13

Sep 13

Hello! I came across your work and would like to give it a try on my laptop with llama.cpp. It only supports GGUF models, a compact model format also supported by Hugging Face Hub. Would you consider providing model files in GGUF so that llama.cpp and Ollama users can deploy them conveniently?

WeeeicheN

USTC-KnowledgeComputingLab org Sep 27

Hello! I came across your work and would like to give it a try on my laptop with llama.cpp. It only supports GGUF models, a compact model format also supported by Hugging Face Hub. Would you consider providing model files in GGUF so that llama.cpp and Ollama users can deploy them conveniently?

Thanks for your suggestion，we'll give it a shot these days.

2985mN1

USTC-KnowledgeComputingLab org Oct 10

Hi, stevapple! We have done it at this page, please take a visit :)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment