Update README.md
Browse files
README.md
CHANGED
@@ -5,7 +5,7 @@ inference: false
|
|
5 |
|
6 |
original model [weblab-10b-instruction-sft](https://huggingface.co/matsuo-lab/weblab-10b-instruction-sft)
|
7 |
|
8 |
-
This is 4bit GPTQ Version.
|
9 |
|
10 |
The size is smaller and the execution speed is faster, but the inference performance may be a little worse.
|
11 |
|
|
|
5 |
|
6 |
original model [weblab-10b-instruction-sft](https://huggingface.co/matsuo-lab/weblab-10b-instruction-sft)
|
7 |
|
8 |
+
This is 4bit GPTQ Version.You need autoGPTQ library to use this model.
|
9 |
|
10 |
The size is smaller and the execution speed is faster, but the inference performance may be a little worse.
|
11 |
|