Downtown-Case commited on
Commit
9cc5b28
1 Parent(s): f4930a7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -8,7 +8,9 @@ pipeline_tag: text-generation
8
 
9
  # Quantization
10
 
11
- 3.75bpw quant, using default exllama parameters.
 
 
12
 
13
  # Qwen2.5-32B
14
 
 
8
 
9
  # Quantization
10
 
11
+ 3.75bpw quantization using default settings, for good amount of context on a 24GB GPU.
12
+
13
+ This is the base model, not instruct! Base models tend to be better for raw completion, especially at long context.
14
 
15
  # Qwen2.5-32B
16