Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
conversational
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
MaziyarPanahi
commited on
Commit
•
29f0530
1
Parent(s):
ada0e86
Upload folder using huggingface_hub
Browse files- .gitattributes +11 -0
- README.md +1 -0
- gemma-2b-it.Q2_K.gguf +3 -0
- gemma-2b-it.Q3_K_L.gguf +3 -0
- gemma-2b-it.Q3_K_M.gguf +3 -0
- gemma-2b-it.Q3_K_S.gguf +3 -0
- gemma-2b-it.Q4_K_M.gguf +3 -0
- gemma-2b-it.Q4_K_S.gguf +3 -0
- gemma-2b-it.Q5_K_M.gguf +3 -0
- gemma-2b-it.Q5_K_S.gguf +3 -0
- gemma-2b-it.Q6_K.gguf +3 -0
- gemma-2b-it.Q8_0.gguf +3 -0
- gemma-2b-it.fp16.gguf +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
gemma-2b-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
gemma-2b-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
gemma-2b-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
gemma-2b-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
gemma-2b-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
gemma-2b-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
42 |
+
gemma-2b-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
43 |
+
gemma-2b-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
+
gemma-2b-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
+
gemma-2b-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
46 |
+
gemma-2b-it.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
@@ -40,6 +40,7 @@ tags:
|
|
40 |
- license:other
|
41 |
- autotrain_compatible
|
42 |
- endpoints_compatible
|
|
|
43 |
- text-generation-inference
|
44 |
- region:us
|
45 |
- text-generation
|
|
|
40 |
- license:other
|
41 |
- autotrain_compatible
|
42 |
- endpoints_compatible
|
43 |
+
- has_space
|
44 |
- text-generation-inference
|
45 |
- region:us
|
46 |
- text-generation
|
gemma-2b-it.Q2_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f5db4cabdd0497c2e8c37e2f8e423f7392fb2c3e39652ce8df65e8311cc8ae1b
|
3 |
+
size 899965856
|
gemma-2b-it.Q3_K_L.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:01f5b22c477092a7d48c193231497ee27cf10668f62bf0e5a81672d9c342c2ad
|
3 |
+
size 1260907424
|
gemma-2b-it.Q3_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:711c687a3b1a7dea7cafbba7f7d404e3089289cc36d3f22f58499e6acbfd1d5a
|
3 |
+
size 1179118496
|
gemma-2b-it.Q3_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9925113b1253500232bd85521a934ec89982c1f356f28917b169f2a4c19553dd
|
3 |
+
size 1083296672
|
gemma-2b-it.Q4_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:76efa7b10f0b259dc1520d9b10b229cf0c5ced0dc5a58d71070930478062ea09
|
3 |
+
size 1495245728
|
gemma-2b-it.Q4_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a5c68b20b240c3770a2a681975281672658de43e3ed8a4426172c70d68cd4970
|
3 |
+
size 1424823200
|
gemma-2b-it.Q5_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d66429c2455e7aeac1b1053d11317fbc951e0f893d7ac62b89004251702e33e9
|
3 |
+
size 1770202016
|
gemma-2b-it.Q5_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ddfd2d0485d7397fd41c980ce9ccc9e417bd2a1720da5557164df4ba29dc8230
|
3 |
+
size 1729467296
|
gemma-2b-it.Q6_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:96824073d85c708f042588af4f22c8fb3a9e1630f21f7e8bc63777b88bcf8620
|
3 |
+
size 2062343072
|
gemma-2b-it.Q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ec68b50d23469882716782da8b680402246356c3f984e9a3b9bcc5bc15273140
|
3 |
+
size 2669351840
|
gemma-2b-it.fp16.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e858f591abebb789508f8fa4f1982bb7c818d8f711050f24d6e27a66fd6794d0
|
3 |
+
size 10031780704
|