Hugging Face's logo

internlm
/
internlm2-chat-20b-4bits

Text Generation
Transformers
PyTorch
internlm
feature-extraction
conversational
custom_code
4-bit precision
awq
Model card Files Community
4

Lmdeploy是必须安装的吗？

#2
by jiyintor - opened
Discussion
jiyintor

如题。
如果不安装请问有参考代码或者指南吗？
如果模型是用AWQ量化的，理论上直接使用awq加载就行吧？

Sign up or log in to comment