PrunaAI
/

nvidia-Llama3-ChatQA-1.5-70B-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

nvidia-Llama3-ChatQA-1.5-70B-GGUF-smashed

2 contributors

History: 8 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload Llama3-ChatQA-1.5-70B.fp16.bin-00006-of-00007.gguf with huggingface_hub

bcf48db verified 6 months ago

.gitattributes

2.1 kB

Upload Llama3-ChatQA-1.5-70B.fp16.bin-00006-of-00007.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.Q4_0.gguf

40 GB
LFS

Upload Llama3-ChatQA-1.5-70B.Q4_0.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.Q4_K_M.gguf

42.5 GB
LFS

Upload Llama3-ChatQA-1.5-70B.Q4_K_M.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.Q6_K.gguf-00001-of-00007.gguf

9.42 GB
LFS

Upload Llama3-ChatQA-1.5-70B.Q6_K.gguf-00001-of-00007.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.Q6_K.gguf-00004-of-00007.gguf

9.07 GB
LFS

Upload Llama3-ChatQA-1.5-70B.Q6_K.gguf-00004-of-00007.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.Q6_K.gguf-00006-of-00007.gguf

8.74 GB
LFS

Upload Llama3-ChatQA-1.5-70B.Q6_K.gguf-00006-of-00007.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.Q8_0.gguf-00001-of-00007.gguf

12.2 GB
LFS

Upload Llama3-ChatQA-1.5-70B.Q8_0.gguf-00001-of-00007.gguf with huggingface_hub 6 months ago
Llama3-ChatQA-1.5-70B.fp16.bin-00006-of-00007.gguf

21.3 GB
LFS

Upload Llama3-ChatQA-1.5-70B.fp16.bin-00006-of-00007.gguf with huggingface_hub 6 months ago