Edit model card

SOLAR-10.7B

Model Details

Quantization

  • AWQ applied using following parameters.
    • zero_point: True
    • q_group_size: 128
    • w_bit: 4
    • version: GEMM
Downloads last month
12
Safetensors
Model size
1.78B params
Tensor type
I32
·
FP16
·
Inference Examples
Inference API (serverless) is not available, repository is disabled.