neuralmagic
/

Meta-Llama-3.1-70B-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Meta-Llama-3.1-70B-quantized.w8a8 / model-00004-of-00015.safetensors

alexmarques's picture

Upload folder using huggingface_hub

6b4fc75 verified 3 months ago

history blame contribute delete

4.9 GB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

SHA256: b8ccbb14a14a6e453fa28e327d8c183f1d7736be4a9163b7f3a06dfbc5c72b7b
Pointer size: 135 Bytes
Size of remote file: 4.9 GB

Raw pointer file

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.