Kalei
/

Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom / config.json

Commit History

Rename rope_type to type for transformers

0a1f36e
verified

Kalei commited on Jul 31

Removed Additional rope_scaling parameters

3fbaa80

bkb2135 commited on Jul 30

Update config.json

f15102d
verified

joaogante HF staff commited on Jul 23

Add files using large-upload tool

e8fe2dc
verified

alvarobartt HF staff commited on Jul 19