Text Generation
GGUF
vllm
sparsity
Inference Endpoints
aashish1904's picture
Upload Sparse-Llama-3.1-8B-2of4.Q3_K_L.gguf with huggingface_hub
6218e92 verified