OPEA
/

cogvlm2-llama3-chat-19B-qvision-int4-sym-inc

Model card Files Files and versions Community

cicdatopea commited on 13 days ago

Commit

a7bf653

•

1 Parent(s): 19c9cc1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ datasets:
 ## Model Details
-This model is an int4 model with group_size 128 and symmetric quantization of [THUDM/cogvlm2-llama3-chat-19B](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B).
 ## How To Use
 ### INT4 Inference
 ```python

 ## Model Details
+This model is an int4 model with group_size 128 and symmetric quantization of [THUDM/cogvlm2-llama3-chat-19B](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B) generated by [intel/auto-round](https://github.com/intel/auto-round).
 ## How To Use
 ### INT4 Inference
 ```python