Edit model card

4Bit AWQ量化，未测试，不建议使用。

采用带有flash_attn的环境进行量化

Safetensors

Model size

2.69B params

Tensor type

I32

BF16

FP16

Inference Examples

Inference API (serverless) does not yet support model repos that contain custom code.