Hugging Face's logo

QuantFactory
/
Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation
GGUF
vllm
sparsity
Inference Endpoints
Model card Files Community
Sparse-Llama-3.1-8B-2of4-GGUF / .gitattributes

Commit History

Upload Sparse-Llama-3.1-8B-2of4.Q4_0_8_8.gguf with huggingface_hub
45cd383
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q4_0_4_8.gguf with huggingface_hub
0a0605b
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q4_0_4_4.gguf with huggingface_hub
1740907
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q4_K_S.gguf with huggingface_hub
65ad6fb
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q3_K_S.gguf with huggingface_hub
1dbdb39
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q3_K_M.gguf with huggingface_hub
cbcb27c
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q3_K_L.gguf with huggingface_hub
6218e92
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q2_K.gguf with huggingface_hub
98695b5
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q5_1.gguf with huggingface_hub
f830001
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q5_0.gguf with huggingface_hub
0a8ebd8
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q5_K_S.gguf with huggingface_hub
cbe03d4
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q5_K_M.gguf with huggingface_hub
53e452b
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q6_K.gguf with huggingface_hub
cb15065
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q8_0.gguf with huggingface_hub
0d7a372
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q4_0.gguf with huggingface_hub
604fb8f
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q4_1.gguf with huggingface_hub
3a3a6b4
verified

aashish1904 commited on

Upload Sparse-Llama-3.1-8B-2of4.Q4_K_M.gguf with huggingface_hub
ecf1278
verified

aashish1904 commited on

initial commit
f749b15
verified

aashish1904 commited on