TheBlokes Base Llama 2 GPTQ's - a lallesx Collection

lallesx 's Collections

TheBlokes Base Llama 2 GGML's

TheBlokes Base Llama 2 GGUF's

TheBlokes Base Llama 2 GPTQ's

TheBlokes Base Llama quants

TheBlokes Base Llama 2 GPTQ's

updated Sep 10, 2023

His base GPTQ quants for Llama 2 & CodeLlama

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 20.6k • 81
TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 14.6k • 263
TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 714 • 120
TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 36.3k • 362
TheBloke/Llama-2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.94k • 83
TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 6.13k • 261
TheBloke/CodeLlama-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 158 • 14
TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 338 • 46
TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 75 • 23
TheBloke/CodeLlama-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 52 • 11
TheBloke/CodeLlama-13B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 516 • 39
TheBloke/CodeLlama-13B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 61 • 20
TheBloke/CodeLlama-34B-GPTQ

Text Generation • Updated Sep 27, 2023 • 46 • 20
TheBloke/CodeLlama-34B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.22k • 74
TheBloke/CodeLlama-34B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 25 • 14