Downtown-Case
commited on
Commit
•
9cc5b28
1
Parent(s):
f4930a7
Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,9 @@ pipeline_tag: text-generation
|
|
8 |
|
9 |
# Quantization
|
10 |
|
11 |
-
3.75bpw
|
|
|
|
|
12 |
|
13 |
# Qwen2.5-32B
|
14 |
|
|
|
8 |
|
9 |
# Quantization
|
10 |
|
11 |
+
3.75bpw quantization using default settings, for good amount of context on a 24GB GPU.
|
12 |
+
|
13 |
+
This is the base model, not instruct! Base models tend to be better for raw completion, especially at long context.
|
14 |
|
15 |
# Qwen2.5-32B
|
16 |
|