TheBloke commited on
Commit
a5806ff
1 Parent(s): 1a22f0c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -17,11 +17,11 @@ It is the result of merging the deltas from the above repository with the origin
17
  ## Provided files
18
  | Name | Quant method | Bits | Size | RAM required | Use case |
19
  | ---- | ---- | ---- | ---- | ---- | ----- |
20
- `stable-vicuna-13B.ggml.q4_0.bin` | q4_0 | 4bit | 4.2GB | 6GB | Maximum compatibility |
21
- `stable-vicuna-13B.ggml.q4_2.bin` | q4_2 | 4bit | 4.2GB | 6GB | Best compromise between resources, speed and quality |
22
- `stable-vicuna-13B.ggml.q4_3.bin` | q4_3 | 4bit | 5.0GB | 7GB | Maximum quality 4bit, higher RAM requirements and slower inference |
23
- `stable-vicuna-13B.ggml.q5_0.bin` | q5_0 | 5bit | 4.63GB | 7GB | Brand new 5bit method. Potentially higher quality than 4bit, at cost of slightly higher resources. |
24
- `stable-vicuna-13B.ggml.q5_1.bin` | q5_1 | 5bit | 5.0GB | 7GB | Brand new 5bit method. Slightly higher resource usage than q5_0.|
25
 
26
  * The q4_0 file provides lower quality, but maximal compatibility. It will work with past and future versions of llama.cpp
27
  * The q4_2 file offers the best combination of performance and quality. This format is still subject to change and there may be compatibility issues, see below.
 
17
  ## Provided files
18
  | Name | Quant method | Bits | Size | RAM required | Use case |
19
  | ---- | ---- | ---- | ---- | ---- | ----- |
20
+ `stable-vicuna-13B.ggml.q4_0.bin` | q4_0 | 4bit | 8.14GB | 10.5GB | Maximum compatibility |
21
+ `stable-vicuna-13B.ggml.q4_2.bin` | q4_2 | 4bit | 8.14GB | 10.5GB | Best compromise between resources, speed and quality |
22
+ `stable-vicuna-13B.ggml.q4_3.bin` | q4_3 | 4bit | 9.76GB | 12.25GB | Maximum quality 4bit, higher RAM requirements and slower inference |
23
+ `stable-vicuna-13B.ggml.q5_0.bin` | q5_0 | 5bit | 8.95GB | 11.0GB | Brand new 5bit method. Potentially higher quality than 4bit, at cost of slightly higher resources. |
24
+ `stable-vicuna-13B.ggml.q5_1.bin` | q5_1 | 5bit | 9.76GB | 12.25GB | Brand new 5bit method. Slightly higher resource usage than q5_0.|
25
 
26
  * The q4_0 file provides lower quality, but maximal compatibility. It will work with past and future versions of llama.cpp
27
  * The q4_2 file offers the best combination of performance and quality. This format is still subject to change and there may be compatibility issues, see below.