jiangchengchengNLP
/

Mistral-Small-3.2-24B-Instruct-W8A8

8-bit precision

compressed-tensors

Model card Files Files and versions

jiangchengchengNLP commited on Jul 20

Commit

d4aeaa7

·

verified ·

1 Parent(s): 9b52571

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -2,4 +2,5 @@
 license: apache-2.0
 base_model:
 - mistralai/Mistral-Small-3.2-24B-Instruct-2506
----

 license: apache-2.0
 base_model:
 - mistralai/Mistral-Small-3.2-24B-Instruct-2506
+---
+This model can be used in vllm or sglang produced by llm-compressor.