Hugging Face's logo

tiiuae
/
Falcon3-7B-Instruct-GGUF

Text Generation
Transformers
GGUF
falcon3
Inference Endpoints
conversational
Model card Files Community
1

(fix): Aligning quantized models tokenizer with base models ones

#1
by ybelkada - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+18
-18
Files changed (9) hide show
  1. Falcon3-7B-Instruct-f16.gguf +2 -2
  2. Falcon3-7B-Instruct-q2_k.gguf +2 -2
  3. Falcon3-7B-Instruct-q3_k_m.gguf +2 -2
  4. Falcon3-7B-Instruct-q4_0.gguf +2 -2
  5. Falcon3-7B-Instruct-q4_k_m.gguf +2 -2
  6. Falcon3-7B-Instruct-q5_0.gguf +2 -2
  7. Falcon3-7B-Instruct-q5_k_m.gguf +2 -2
  8. Falcon3-7B-Instruct-q6_k.gguf +2 -2
  9. Falcon3-7B-Instruct-q8_0.gguf +2 -2
Falcon3-7B-Instruct-f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc5505699706300ca41a522da5d707f3f787289d71a05b48f13e46f0e2ecfb2c
3
- size 14916195744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e14276a57147d241ba720b38de18836dd083080232ac326c4b438376e10e2454
3
+ size 14916197792
Falcon3-7B-Instruct-q2_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ed0c54ab52d4909575a20fad945608ff1ff5e193adad0bb1c1c4fd6a30b87bc
3
- size 2886981024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:096c793d3e14d8c718185a35a2533515d1f65b79461913b03dd55b99cc15f8f1
3
+ size 2886983072
Falcon3-7B-Instruct-q3_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c8e9ced6f80027285a0b397bd2a70e175731e462e7b1ff313dca8d66a61c1d4b
3
- size 3685848480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cebd230eda17a91dab30704884ff46d60e456a846f07735c837b87f7e4c26fe1
3
+ size 3685850528
Falcon3-7B-Instruct-q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc7279546898a814c9de3963a017b5371e31323a6cd56960f17a99189967cb50
3
- size 4302902688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48cde1f2db2f06ea26094c3773cc1dbfed313b4f1f3439b27c30f6af1fb36b06
3
+ size 4302904736
Falcon3-7B-Instruct-q4_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:44aa1cbe5dbe89b9d8331daeb78487776ae1245020bcecd785b72c2de52f1c19
3
- size 4569724320
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17bc6e769a4248acd25fd7df934c8fa2c255c85dee88ec10a03d8655a7310cf3
3
+ size 4569726368
Falcon3-7B-Instruct-q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c65750c67bdf98ef974f67fd603b2e31ca2bbdc70f0f206553dabea9cb9bc2f
3
- size 5184492960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e90feff1cceb8dc0a505f0c6071029940a60e2f5dbbebb1892b3c57edc6a2a1d
3
+ size 5184495008
Falcon3-7B-Instruct-q5_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2534813829cd2243e06a32c3b2f27cf8644a6772d886aa5a3ce63573d7dfde7f
3
- size 5321946528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2ad17eab87358d4c57e6ce2063dff07a52367c528f0abb2fb4836ba294b3d4a
3
+ size 5321948576
Falcon3-7B-Instruct-q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2e79a89bc0a6a16ef622b4e6b3fe17d2b692400c924b5720084491f49cb0becf
3
- size 6121182624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12f1045f479c770a33067d731cf4d4373ce2f78b2afc20e17eb619a7b6c01b3c
3
+ size 6121184672
Falcon3-7B-Instruct-q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bdf1b5ae33fd9196f1eba88d675db480eb7bc7e7d8396da0e222fea6d74d0016
3
- size 7926781344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:349284391078e946c86f1da4a2165ed93458a4b3f58ae5008a9c4a4081c31dc2
3
+ size 7926783392