Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Sailor2-20B-Chat-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Sailor2-20B-Chat-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
a05b8a0cd1d69671fc1bfa04c4013d712748118c530756df358da7a5c60d9c40
fbb60d0
verified
about 1 month ago
.gitattributes
Safe
2.3 kB
a05b8a0cd1d69671fc1bfa04c4013d712748118c530756df358da7a5c60d9c40
about 1 month ago
README.md
Safe
2.89 kB
a05b8a0cd1d69671fc1bfa04c4013d712748118c530756df358da7a5c60d9c40
about 1 month ago
Sailor2-20B-Chat-GGUF_imatrix.dat
11.4 MB
LFS
a05b8a0cd1d69671fc1bfa04c4013d712748118c530756df358da7a5c60d9c40
about 1 month ago
Sailor2-20B-Chat.Q2_K.gguf
7.39 GB
LFS
7b5d484d3e7cf0c2765e87e7f0fcb643f5717370657a844b9e5688c6d57bb05e
about 1 month ago
Sailor2-20B-Chat.Q3_K_L.gguf
10.2 GB
LFS
64838e0b4015ec35c4847363b0c98e21e09ac428313bd21a8a3325890f6deed5
about 1 month ago
Sailor2-20B-Chat.Q3_K_M.gguf
9.46 GB
LFS
1a9fdf39b22ba15ecdb345b91a3d9be60b1de4169f6b30ce66faae9a221a2bc2
about 1 month ago
Sailor2-20B-Chat.Q3_K_S.gguf
8.55 GB
LFS
02c805dc0be145bcc094ae784b25bd5afc9daa09751e0ccb68bae3c7feccc8d5
about 1 month ago
Sailor2-20B-Chat.Q4_K_M.gguf
11.6 GB
LFS
38fce2539c9b1e997d763e16c852e4fc7c231fe53a752ca0ab4777329a455a0a
about 1 month ago
Sailor2-20B-Chat.Q4_K_S.gguf
11.1 GB
LFS
e419ed1462c58cdb34c3138f4d1146aa1f75d7805c154ce109cf97f38da2c483
about 1 month ago
Sailor2-20B-Chat.Q5_K_M.gguf
13.6 GB
LFS
c73964f833ad408dcaf59c70dde120d9a94c5c71bcd1b7d772830304498ab48f
about 1 month ago
Sailor2-20B-Chat.Q5_K_S.gguf
13.3 GB
LFS
a1f53d4968d7838f477ea36690fe4e1d28bb3d4dabb29816785c1198be122ba1
about 1 month ago
Sailor2-20B-Chat.Q6_K.gguf
15.7 GB
LFS
773f9b724eeda0e7343d3d4458f59e5fbcf10611c3c96f878aa32f6795b8892e
about 1 month ago
Sailor2-20B-Chat.Q8_0.gguf
20.4 GB
LFS
48f9a2ee9647051ea5d84cda65fb30e4232c1141c2c7ff641d392822b8e8743a
about 1 month ago
Sailor2-20B-Chat.fp16.gguf
38.4 GB
LFS
d983adce0d1d7a5ad64c2732292d1f014e86356d7fe04cb00753a7571cb11642
about 1 month ago