hugging-quants
/

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (13)

not able to install autoawq

#18 opened 4 months ago by

Finetuning AWQ model

#17 opened 11 months ago by

add base model

#16 opened about 1 year ago by

No support for num_beams >1?

#15 opened about 1 year ago by

The original model supported Chinese, but the current quantized version does not. Will this issue be fixed in the future?

#14 opened about 1 year ago by