|
--- |
|
tags: |
|
- quantized |
|
- 2-bit |
|
- 3-bit |
|
- 4-bit |
|
- 5-bit |
|
- 6-bit |
|
- 8-bit |
|
- GGUF |
|
- transformers |
|
- pytorch |
|
- qwen2 |
|
- text-generation |
|
- conversational |
|
- autotrain_compatible |
|
- endpoints_compatible |
|
- text-generation-inference |
|
- text-generation |
|
license: other |
|
license_name: tongyi-qianwen |
|
license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE |
|
library_name: transformers |
|
inference: false |
|
pipeline_tag: text-generation |
|
--- |
|
I got broken models when use the k quantize so there's no k quantized models(sad) |
