Hugging Face's logo

shenzhi-wang
/
Llama3.1-8B-Chinese-Chat

Text Generation
Transformers
Safetensors
GGUF
English
Chinese
llama
llama-factory
orpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
21

大佬。啥时候出3.1的4bit版本啊

#9
by shenbushou - opened
Discussion
shenbushou

求3.1的4bit版本啊，目前保有量较大的gpu有3060，但是运行16bit会爆显存，求4bit的

shenzhi-wang
 Owner

这里有

https://huggingface.co/shenzhi-wang/Llama3.1-8B-Chinese-Chat/blob/main/gguf/llama3.1_8b_chinese_chat_q4_k_m.gguf

shenzhi-wang changed discussion status to closed

Sign up or log in to comment