tags: | |
- quantized | |
- 2-bit | |
- 3-bit | |
- 4-bit | |
- 5-bit | |
- 6-bit | |
- 8-bit | |
- GGUF | |
- transformers | |
- pytorch | |
- qwen2 | |
- text-generation | |
- conversational | |
- autotrain_compatible | |
- endpoints_compatible | |
- text-generation-inference | |
- text-generation | |
license: other | |
license_name: tongyi-qianwen | |
license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE | |
library_name: transformers | |
pipeline_tag: text-generation | |
I got broken models when use the k quantize so there's no k quantized models(sad) |