MaziyarPanahi

/

Llama-3-8B-Instruct-32k-v0.1-GGUF

like 56

Can you explain the significance of 'Q[some number][alphabets]', 'Q[some number][alphabet]_[alphabet]' after 'Llama-3-8B-Instruct-32k-v0.1.*****' ?

Llama-3-8B-Instruct-32k-v0.1.Q2_K.gguf
Llama-3-8B-Instruct-32k-v0.1.Q3_K_L.gguf
Llama-3-8B-Instruct-32k-v0.1.Q3_K_M.gguf
Llama-3-8B-Instruct-32k-v0.1.Q3_K_S.gguf
Llama-3-8B-Instruct-32k-v0.1.Q4_K_M.gguf
Llama-3-8B-Instruct-32k-v0.1.Q4_K_S.gguf
Llama-3-8B-Instruct-32k-v0.1.Q5_K_M.gguf
Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf
Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf
Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf
Llama-3-8B-Instruct-32k-v0.1.fp16.gguf
Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf
Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf
Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf
Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf
Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf