Hugging Face's logo

tensorblock
/
Qwen2.5-Math-7B-Instruct-GGUF

Text Generation
Transformers
GGUF
English
chat
TensorBlock
GGUF
Inference Endpoints
conversational
Model card Files Community
morriszms commited on
Commit
425505d
·
verified ·
1 Parent(s): 7e7ef1c

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Qwen2.5-Math-7B-Instruct-Q2_K.gguf +2 -2
  2. Qwen2.5-Math-7B-Instruct-Q3_K_L.gguf +2 -2
  3. Qwen2.5-Math-7B-Instruct-Q3_K_M.gguf +2 -2
  4. Qwen2.5-Math-7B-Instruct-Q3_K_S.gguf +2 -2
  5. Qwen2.5-Math-7B-Instruct-Q4_0.gguf +2 -2
  6. Qwen2.5-Math-7B-Instruct-Q4_K_M.gguf +2 -2
  7. Qwen2.5-Math-7B-Instruct-Q4_K_S.gguf +2 -2
  8. Qwen2.5-Math-7B-Instruct-Q5_0.gguf +2 -2
  9. Qwen2.5-Math-7B-Instruct-Q5_K_M.gguf +2 -2
  10. Qwen2.5-Math-7B-Instruct-Q5_K_S.gguf +2 -2
  11. Qwen2.5-Math-7B-Instruct-Q6_K.gguf +2 -2
  12. Qwen2.5-Math-7B-Instruct-Q8_0.gguf +2 -2
  13. README.md +9 -8
Qwen2.5-Math-7B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee20eaf9014337ce37801176344aed16b9afcaea5448f0f8ea29ca88355dcbd2
3
- size 3015940480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51bb31ef8aa44d83d93dc8bf7bb671aa5ddcab85156df364fe54e1246d5de50
3
+ size 3015940544
Qwen2.5-Math-7B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e25b667bf968ccb6bb566a596abb681e9326b2ad75f99d438441fdef7a4dfbcf
3
- size 4088459648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:578b8448a388727a593e6e71499f73b701bf463d44563ff5972e7020b145f7c2
3
+ size 4088459712
Qwen2.5-Math-7B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1fe4d4ea793e1d92b9853ce573cabf3becea7354d54e4455513d64b2a8fe94d0
3
- size 3808391552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0204541c2d1792436f9481d6d5f7a2f7863eac244eef0a3d47be32c2c286535
3
+ size 3808391616
Qwen2.5-Math-7B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:451911a1e24e786a84fa2796d371818243f71972b80ec0574037dd1dd4b8cf8e
3
- size 3492368768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc952a0c0745817258f06b982e6df2b8715925bba35debcdb23381e68a64ca6c
3
+ size 3492368832
Qwen2.5-Math-7B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da011599d042d748c37cea92bc9c3c88c32ffa177282f38ca9d7a0ba7be1403b
3
- size 4431391104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de46732127bf6b5c75a84f29959ecad80da2eef073e5ae0e09c71765de9e9375
3
+ size 4431391168
Qwen2.5-Math-7B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:62b4bb6e48d5606b3abf4f85b054ef3a75798f3e61e8634ea8fce7c1b31a9ad7
3
- size 4683073920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56c569c7dcb414e7ea839c7e7e0de03548a245e0c96c820a9e5c56c64b8bb3b7
3
+ size 4683073984
Qwen2.5-Math-7B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5122eeadb5b802c5cb2c8442272dfbaaf81ba77a6581f01701e1fc85e70937bf
3
- size 4457769344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8d15017cbecf0709051a676612c2e4bb3f777577a72b77da6488967119ea06f
3
+ size 4457769408
Qwen2.5-Math-7B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f49af74cfd6b4edd32693a56674af5e852f50a2671071699acfcb8b4c278f12a
3
- size 5315176832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf61f577f4a7698d42121787d82ea6035a372543e5fced8114a733fd467c9648
3
+ size 5315176896
Qwen2.5-Math-7B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b49c8699d3f54e3f3fbaf21c8e6da7170ccf2c7c569e074720d890ac93249829
3
- size 5444831616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7541f99414f9d2a21a604387910290376c4719d29791b4d4497aba27abcf9515
3
+ size 5444831680
Qwen2.5-Math-7B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:548cd34f6ebeee339d1ca13627cc5f7cfcde8ad9972ef037b28f001e47baa01e
3
- size 5315176832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:517fb358ed52740a3425ce73aa575c9915457662de38427ee59d96498ebf7bb7
3
+ size 5315176896
Qwen2.5-Math-7B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16aa7375fe470b6c907b3c4968e268edddc8948c51b0d4c27fffe3db5a9b47d2
3
- size 6254199168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf1384fe3beb0e68153a56b7aa8a9d970de08b08a68b099a6da8b483d78f97dc
3
+ size 6254199232
Qwen2.5-Math-7B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbd0dafa82e91b9b3eecd46f277ad4ae8627480e8379b4c7b837400e9d9b3977
3
- size 8098525568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95bd0084399f1975a634111fb4383084bea6fd77c0790c9f3ee2475a5d5d0a5a
3
+ size 8098525632
README.md CHANGED
@@ -1,14 +1,15 @@
1
  ---
2
- base_model: unsloth/Qwen2.5-Math-7B-Instruct
3
  language:
4
  - en
5
- library_name: transformers
6
- license: apache-2.0
7
  tags:
8
- - unsloth
9
- - transformers
10
  - TensorBlock
11
  - GGUF
 
 
 
12
  ---
13
 
14
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -22,11 +23,11 @@ tags:
22
  </div>
23
  </div>
24
 
25
- ## unsloth/Qwen2.5-Math-7B-Instruct - GGUF
26
 
27
- This repo contains GGUF format model files for [unsloth/Qwen2.5-Math-7B-Instruct](https://huggingface.co/unsloth/Qwen2.5-Math-7B-Instruct).
28
 
29
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
31
  <div style="text-align: left; margin: 20px 0;">
32
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
1
  ---
2
+ base_model: Qwen/Qwen2.5-Math-7B-Instruct
3
  language:
4
  - en
5
+ pipeline_tag: text-generation
 
6
  tags:
7
+ - chat
 
8
  - TensorBlock
9
  - GGUF
10
+ library_name: transformers
11
+ license: apache-2.0
12
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct/blob/main/LICENSE
13
  ---
14
 
15
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
23
  </div>
24
  </div>
25
 
26
+ ## Qwen/Qwen2.5-Math-7B-Instruct - GGUF
27
 
28
+ This repo contains GGUF format model files for [Qwen/Qwen2.5-Math-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct).
29
 
30
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
31
 
32
  <div style="text-align: left; margin: 20px 0;">
33
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">