Hugging Face's logo

tiiuae
/
Falcon3-3B-Instruct-GGUF

GGUF
falcon3
Inference Endpoints
conversational
Model card Files Community
1

(fix): Aligning quantized models tokenizer with base models ones

#1
by ybelkada - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+18
-18
Files changed (9) hide show
  1. Falcon3-3B-Instruct-f16.gguf +2 -2
  2. Falcon3-3B-Instruct-q2_k.gguf +2 -2
  3. Falcon3-3B-Instruct-q3_k_m.gguf +2 -2
  4. Falcon3-3B-Instruct-q4_0.gguf +2 -2
  5. Falcon3-3B-Instruct-q4_k_m.gguf +2 -2
  6. Falcon3-3B-Instruct-q5_0.gguf +2 -2
  7. Falcon3-3B-Instruct-q5_k_m.gguf +2 -2
  8. Falcon3-3B-Instruct-q6_k.gguf +2 -2
  9. Falcon3-3B-Instruct-q8_0.gguf +2 -2
Falcon3-3B-Instruct-f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16cfdfa0df7f660499fdee35694c7735db3909365c60653012cea90867078661
3
- size 6460328064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63c194e19e1c5c501e96c4a3681f150575b42998cd9da29769290e506914fd62
3
+ size 6460330208
Falcon3-3B-Instruct-q2_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e2f03943cbaaeb3649f3ee39ff06668182a269862aa4df98fdb69d34b78ad3c
3
- size 1353877632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cde1a6295a1616f6821d60bd7e45978975d080724fc7212abfce6f06003ab7a9
3
+ size 1353879776
Falcon3-3B-Instruct-q3_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b1523322e752aa51e45a8bd69441807224c41ac45e4324eb043e3ab1f11e7fc
3
- size 1673218176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ce812ab9d9715ea4447d33d761dcaadea1524490d2abb5b711f5c07337e52e5
3
+ size 1673220320
Falcon3-3B-Instruct-q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd948cb66bfbf5f26bbe233077d5c5a1f903d043d8088318df0df3667cfb4941
3
- size 1924581504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5b0af6fe19a2f7b81b2a385b63d9312678fd29f9e6e694218253cfbedaeea81
3
+ size 1924583648
Falcon3-3B-Instruct-q4_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:81c6b52d221c2f0eea3db172fc74de28534f2fd15f198ecbfcc55577d20cbf8a
3
- size 2005682304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac9bc2edb58a961f77db11ae89e7f23b610d8b15c2ef603d1e7cb390c50d1aad
3
+ size 2005684448
Falcon3-3B-Instruct-q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b7efc43bb02240812e3ae85bf133e97d1300361c17838cd791bbcaaaec010782
3
- size 2277689472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:735f4ca82be2c0ed7735387ead15f1c5284f07463702352a0a263c5b4cf1663d
3
+ size 2277691616
Falcon3-3B-Instruct-q5_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c25d040042b7ceaf2d5b285cf1321452d8fe55cfc31e07ae8abc64b3707b3816
3
- size 2319468672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c639d2ecfcb9967058826be82733b3146c539d4952ca822377160121b90f71b
3
+ size 2319470816
Falcon3-3B-Instruct-q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f2ace4d71e367b99ba76e97465fdcd1d7a40c9291d4d3c0495a65b9c232afb4e
3
- size 2652866688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e60c9281e2454734599cb62f4abeea61c279c65194fb286cda5bb9d8170b55ec
3
+ size 2652868832
Falcon3-3B-Instruct-q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e077c387e9d5f2de17e14d50caaccc968c3ffc12a001f2f8d0cb7ef9e391cc0
3
- size 3434530944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2454a72660a89bdb46a447e6abbee72c35dcc666d96a8d7df695175123e6aea4
3
+ size 3434533088