Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2-1.5B-Instruct-GGUF
like
8
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Qwen2-1.5B-Instruct-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
da6cb90864a2fda86850409cacb7255c07acf03d6c4537f2abaa39b057cd74f3
56c80ef
verified
6 months ago
.gitattributes
Safe
2.6 kB
da6cb90864a2fda86850409cacb7255c07acf03d6c4537f2abaa39b057cd74f3
6 months ago
Qwen2-1.5B-Instruct.IQ1_M.gguf
Safe
464 MB
LFS
1a00199528bcaa518112b9fb3713fe29f351e66c27af5d703d97361aceb990b5
6 months ago
Qwen2-1.5B-Instruct.IQ1_S.gguf
Safe
437 MB
LFS
1a00199528bcaa518112b9fb3713fe29f351e66c27af5d703d97361aceb990b5
6 months ago
Qwen2-1.5B-Instruct.IQ2_XS.gguf
Safe
550 MB
LFS
1a00199528bcaa518112b9fb3713fe29f351e66c27af5d703d97361aceb990b5
6 months ago
Qwen2-1.5B-Instruct.IQ3_XS.gguf
Safe
732 MB
LFS
d7b33f3b3a4c5822960c80b8e0aa102d5193b69d91f715218142b47f46dadcdf
6 months ago
Qwen2-1.5B-Instruct.IQ4_XS.gguf
Safe
896 MB
LFS
d7b33f3b3a4c5822960c80b8e0aa102d5193b69d91f715218142b47f46dadcdf
6 months ago
Qwen2-1.5B-Instruct.Q2_K.gguf
Safe
676 MB
LFS
1f11870748daf2ee4869f68ff8a4fc66ca8287bae85a773bddeae7ec64787d3a
6 months ago
Qwen2-1.5B-Instruct.Q3_K_L.gguf
Safe
880 MB
LFS
1f11870748daf2ee4869f68ff8a4fc66ca8287bae85a773bddeae7ec64787d3a
6 months ago
Qwen2-1.5B-Instruct.Q3_K_M.gguf
Safe
824 MB
LFS
b50ce61c3ea9bccc0966f9f2f6728c83fadb808784b4f3559e4facf4b26ab0ed
6 months ago
Qwen2-1.5B-Instruct.Q3_K_S.gguf
Safe
761 MB
LFS
b50ce61c3ea9bccc0966f9f2f6728c83fadb808784b4f3559e4facf4b26ab0ed
6 months ago
Qwen2-1.5B-Instruct.Q4_K_M.gguf
Safe
986 MB
LFS
266263bc39e40ca9fc5d16d03dba0b74ebfef5fb8ffae5b4e94b320c446ac6a3
6 months ago
Qwen2-1.5B-Instruct.Q4_K_S.gguf
Safe
940 MB
LFS
266263bc39e40ca9fc5d16d03dba0b74ebfef5fb8ffae5b4e94b320c446ac6a3
6 months ago
Qwen2-1.5B-Instruct.Q5_K_M.gguf
Safe
1.13 GB
LFS
dae1d38225723125a6bf56fa94c590519406b1be9595eb89fb7141ab2e8c51b2
6 months ago
Qwen2-1.5B-Instruct.Q5_K_S.gguf
Safe
1.1 GB
LFS
03e13749df7d6a028b16240dab2f1b73a99471386fbc528080769d17e29653da
6 months ago
Qwen2-1.5B-Instruct.Q6_K.gguf
Safe
1.27 GB
LFS
4f3d187783fc00913ea5bfadbd423ba649df4da7ad9ff024f16928e1ea2daaff
6 months ago
Qwen2-1.5B-Instruct.Q8_0.gguf
Safe
1.65 GB
LFS
da6cb90864a2fda86850409cacb7255c07acf03d6c4537f2abaa39b057cd74f3
6 months ago
Qwen2-1.5B-Instruct.fp16.gguf
Safe
3.09 GB
LFS
f53243bbbbda21fe7d5d3659a0629253e61c9a71dea47023b7b2181d4c66dc90
6 months ago
README.md
Safe
2.96 kB
da6cb90864a2fda86850409cacb7255c07acf03d6c4537f2abaa39b057cd74f3
6 months ago
