Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

ModelCloud
/

Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-gptq-4bit / quantize_config.json

Commit History

Upload folder using huggingface_hub (#1)

a4ac1ca
verified

lrl-modelcloud commited on Jul 23