Hugging Face's logo

deepseek-ai
/
deepseek-llm-67b-chat

Text Generation
Transformers
PyTorch
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
11

Can you provide 4-bits version ?

#7
by hanswang73 - opened
Discussion
hanswang73

Can you provide 4-bits version ?

Beygo

You can find the 4-bit AWQ version here:
https://huggingface.co/TheBloke/deepseek-llm-67b-chat-AWQ/tree/main

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment