---
tags:
- quantized
- 2-bit
- 3-bit
- 4-bit
- 5-bit
- 6-bit
- 8-bit
- GGUF
- transformers
- pytorch
- qwen2
- text-generation
- conversational
- autotrain_compatible
- endpoints_compatible
- text-generation-inference
- text-generation
license: other
license_name: tongyi-qianwen
license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE
library_name: transformers
pipeline_tag: text-generation
---
I got broken models when use the k quantize so there's no k quantized models(sad)