matrixportal
/

Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-Q4_K_S-GGUF

1 contributor

History: 4 commits

matrixportal's picture

Upload README.md with huggingface_hub

78b1b7f verified 1 day ago

.gitattributes

1.64 kB

Upload imatrix.dat with huggingface_hub 1 day ago
README.md

15.7 kB

Upload README.md with huggingface_hub 1 day ago
imatrix.dat

4.99 MB
LFS

Upload imatrix.dat with huggingface_hub 1 day ago
llama-3.1-8b-instruct-q4_k_s-imat.gguf

4.69 GB
LFS

Upload llama-3.1-8b-instruct-q4_k_s-imat.gguf with huggingface_hub 1 day ago