File size: 517 Bytes
52ceb51 4fa94d8 52ceb51 3d8a43e 4fa94d8 52ceb51 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
tags:
- quantized
- 2-bit
- 3-bit
- 4-bit
- 5-bit
- 6-bit
- 8-bit
- GGUF
- transformers
- pytorch
- qwen2
- text-generation
- conversational
- autotrain_compatible
- endpoints_compatible
- text-generation-inference
- text-generation
license: other
license_name: tongyi-qianwen
license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE
library_name: transformers
inference: false
pipeline_tag: text-generation
---
I got broken models when use the k quantize so there's no k quantized models(sad) |