Hugging Face's logo

MaziyarPanahi
/
gemma-2b-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
1
MaziyarPanahi commited on
Commit
6fb48fd
•
1 Parent(s): 59170fb

Upload folder using huggingface_hub (#1)

Browse files

- 37048fb7cec40e5be46d6b65573022168e67899b86926923fe00caaaeb480c55 (2fecbfe1836182b7b9f7a1cf6b92979017f91c7d)
- 5e8bb6b18eaa5a499ce3d72e7c8d413dae5a5677cbb164f9ddffdca22531dc71 (c1fd65a3f81b3df7b12af1dd2e077a0a89f54170)
- df4025f83fbae5ed1801b197a4907f64a777b4dd9e961cb39233ea894bd9e35e (54f36ebf1a60438951bbf55f3691d94f9d2bbda4)
- 1e99044d5532b9108214d07951823ea5409b61a957727c245a7929b33117b99e (c1adbc5be6dd04cb02fc59a48c0a3587bbd51f49)
- fbef42315843f04c69cf63cfad77e20ecb3be175d78e6530fa9a2f0f7a38cf8c (1d02ec5ca4f70ac1ac242f26729f7f60a3c5173f)
- b2df0dbbecaf927c044f9554b90c6db5023d07eacae227b35de4cf1c2a59aefc (0c3c6593bc2069160584e2ce180ec9dcae242c61)
- 628dd8c2559bd0114514625371fc501f865b350a52927ca3df6f80acb50b5f5e (be6e085f0f43632e3408d8b66b416b9e668bac42)
- ae02bfd9706d72f54a47026af2cec9deaadfbed440d05d9beb01654ce437ec52 (af65f1c03e9fea7cd98b084199457cb771e45704)
- edfb73d3d30cc059c9ba96152f9eba64cf581e34dfb34cadf6bd9a557a84c86a (8d2e92c1290c5b30d7386f7579fd085f2481f931)
- b82459ae76c04ca76b7b62f9594869b8d5c4dd51150db5fa70ce154ec62f1adf (6011e34cc4f922af693461cb0ee64490b211a172)
- 99302b6dc99bcac1155385d70f2b63d7cdbda6fa0f1e1cade2f559422300bcd3 (85e17aa0cf548e0e5d280eff675bbe38b5b307ff)

Files changed (11) hide show
  1. gemma-2b.Q2_K.gguf +2 -2
  2. gemma-2b.Q3_K_L.gguf +2 -2
  3. gemma-2b.Q3_K_M.gguf +2 -2
  4. gemma-2b.Q3_K_S.gguf +2 -2
  5. gemma-2b.Q4_K_M.gguf +2 -2
  6. gemma-2b.Q4_K_S.gguf +2 -2
  7. gemma-2b.Q5_K_M.gguf +2 -2
  8. gemma-2b.Q5_K_S.gguf +2 -2
  9. gemma-2b.Q6_K.gguf +2 -2
  10. gemma-2b.Q8_0.gguf +2 -2
  11. gemma-2b.fp16.gguf +2 -2
gemma-2b.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21ab8f36ea9d62570612f3dd3c4945f1c6017b0e09027d326b6ffec7619fbc20
3
- size 899965856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9c186061188e90ee357773e184ed722ec88f40f5aa04eb886bbc39a2ca50620
3
+ size 1157923968
gemma-2b.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e013b2ddaefc41323b3723a72f2efa3d6d27c57a00e5005412f157d71beafeb1
3
- size 1260907424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7483357519f202ca51a51282241e895c7e5dbdfc722de9e3a24df7be70f470c6
3
+ size 1465590912
gemma-2b.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16b27e88e9676ef81f8e2614809c523be9b2517e37b7dcd1fe1516c6b5d435fe
3
- size 1179118496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1397432691e7c5c46a214f596120e016a2c3b21be73c0826a483b45042bda6af
3
+ size 1383801984
gemma-2b.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:10c20e438dd517eaa17b8ec5d54ce5b739d6124af645568b2abb16a5cafc8820
3
- size 1083296672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:891512d8b0ed8c0881ebc4f13802024d6fe11cb78622503405ebb463c1de4a32
3
+ size 1287980160
gemma-2b.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:081e46c21dc7f3d7c33ee9a0be46587419668311b40a93d634eb524692c3e15c
3
- size 1495245728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb917cb350bb415b13bcfc03af09ef18e406ce51892b815851101808b6805ad1
3
+ size 1630262400
gemma-2b.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3bc0a57500c678e69f392274f532f795866c6d554d9b8fb330b57bb401b13395
3
- size 1424823200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5187849f1db2d487789d1196412c87ba0d0c368fbfe009e8b1ddbb79d15e994
3
+ size 1559839872
gemma-2b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:706a9820271d737ab5ab2538e3d413f4ccff20f51362d4f75a4c79f64f90b583
3
- size 1770202016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d14e17221150412ac90916874e90ed9e2059e4e4ae341d77832fb720d1b6ffdc
3
+ size 1839649920
gemma-2b.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ce45b2371923975a6b26e71ec80f210086cc7af30afec4670c61b5b12453954
3
- size 1729467296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd8612e03e5817dda605efbb9a8c546ae4618dac7fba29f639a3ffbacffd1765
3
+ size 1798915200
gemma-2b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1987c4ab33037f166061830764d68dbcdec5646ad35479d2acc6e29d9154ab6b
3
- size 2062343072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68e4baa99b96c40d316740534e21b388027f4883121395da22bb070b5a3a7ce8
3
+ size 2062124160
gemma-2b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:768ccb3cf3d34111dd0e9659846dcc14b0cd2dfaf6229756b749b29b0bd1ea46
3
- size 2669351840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75bf2aa6d3879525cff58408c2d2435d8bd0594846ee5fe8b959cd991cdbb005
3
+ size 2669069440
gemma-2b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:084eb1abf609fe1735c2631f818bd24e93d29428fd2ba096852012152e37d14b
3
- size 10031780672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:781281fb4ae2f7aaa352f54adc37fd35bdb5f45567795416c8fbffdd31b20e14
3
+ size 5018534976