Update README.md
Browse files
README.md
CHANGED
@@ -71,14 +71,18 @@ So please first update text-genration-webui to the latest version.
|
|
71 |
|
72 |
## How to download and use this model in text-generation-webui
|
73 |
|
74 |
-
1. Launch text-generation-webui
|
75 |
2. Click the **Model tab**.
|
76 |
-
3.
|
77 |
-
4.
|
78 |
-
5.
|
79 |
-
6.
|
80 |
-
7.
|
81 |
-
8.
|
|
|
|
|
|
|
|
|
82 |
|
83 |
## About `trust_remote_code`
|
84 |
|
|
|
71 |
|
72 |
## How to download and use this model in text-generation-webui
|
73 |
|
74 |
+
1. Launch text-generation-webui
|
75 |
2. Click the **Model tab**.
|
76 |
+
3. Untick **Autoload model**
|
77 |
+
4. Under **Download custom model or LoRA**, enter `TheBloke/falcon-7B-instruct-GPTQ`.
|
78 |
+
5. Click **Download**.
|
79 |
+
6. Wait until it says it's finished downloading.
|
80 |
+
7. Click the **Refresh** icon next to **Model** in the top left.
|
81 |
+
8. In the **Model drop-down**: choose the model you just downloaded, `falcon-7B-instruct-GPTQ`.
|
82 |
+
9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
|
83 |
+
10. Tick **Trust Remote Code**, followed by **Save Settings**
|
84 |
+
11. Make sure Click **Reload**.
|
85 |
+
12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
|
86 |
|
87 |
## About `trust_remote_code`
|
88 |
|