codegood
/

Llama_3.1_8B_GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama_3.1_8B_GGUF

1 contributor

History: 2 commits

codegood's picture

Upload folder using huggingface_hub

9529162 verified 3 months ago

.gitattributes

2.26 kB

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q2_k.gguf

3.18 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q3_k_l.gguf

4.32 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q3_k_m.gguf

4.02 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q3_k_s.gguf

3.66 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q4_0.gguf

4.66 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q4_k_m.gguf

4.92 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q4_k_s.gguf

4.69 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q5_0.gguf

5.6 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q5_k_m.gguf

1.75 GB
LFS

Upload folder using huggingface_hub 3 months ago
meta-llama-3.1-8b-instruct-q5_k_s.gguf

5.6 GB
LFS

Upload folder using huggingface_hub 3 months ago