gurro
/

llama-3.1-8B-quanto-int4

8-bit precision

Model card Files Files and versions Community

llama-3.1-8B-quanto-int4

1 contributor

History: 7 commits

gurro's picture

Upload quanto_qmap.json with huggingface_hub

26d50f9 verified 3 months ago

.gitattributes

1.52 kB

initial commit 3 months ago
config.json

886 Bytes

Upload config.json with huggingface_hub 3 months ago
generation_config.json

180 Bytes

Upload generation_config.json with huggingface_hub 3 months ago
model-00001-of-00002.safetensors

4.76 GB
LFS

Upload model-00001-of-00002.safetensors with huggingface_hub 3 months ago
model-00002-of-00002.safetensors

1.05 GB
LFS

Upload model-00002-of-00002.safetensors with huggingface_hub 3 months ago
model.safetensors.index.json

105 kB

Upload model.safetensors.index.json with huggingface_hub 3 months ago
quanto_qmap.json

23.5 kB

Upload quanto_qmap.json with huggingface_hub 3 months ago