metadata
library_name: transformers
tags:
- AWQ
- Miqu
- Senku
A quantized version of Shinoji Research's Senku 70B Full. Quantized through AWQ:
Quantization settings:
{"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }