TheBloke commited on
Commit
d65910c
1 Parent(s): 1f7a1f3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -7
README.md CHANGED
@@ -71,14 +71,18 @@ So please first update text-genration-webui to the latest version.
71
 
72
  ## How to download and use this model in text-generation-webui
73
 
74
- 1. Launch text-generation-webui with the following command-line arguments: `--autogptq --trust-remote-code`
75
  2. Click the **Model tab**.
76
- 3. Under **Download custom model or LoRA**, enter `TheBloke/falcon-7B-instruct-GPTQ`.
77
- 4. Click **Download**.
78
- 5. Wait until it says it's finished downloading.
79
- 6. Click the **Refresh** icon next to **Model** in the top left.
80
- 7. In the **Model drop-down**: choose the model you just downloaded, `falcon-7B-instruct-GPTQ`.
81
- 8. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 
 
 
 
82
 
83
  ## About `trust_remote_code`
84
 
 
71
 
72
  ## How to download and use this model in text-generation-webui
73
 
74
+ 1. Launch text-generation-webui
75
  2. Click the **Model tab**.
76
+ 3. Untick **Autoload model**
77
+ 4. Under **Download custom model or LoRA**, enter `TheBloke/falcon-7B-instruct-GPTQ`.
78
+ 5. Click **Download**.
79
+ 6. Wait until it says it's finished downloading.
80
+ 7. Click the **Refresh** icon next to **Model** in the top left.
81
+ 8. In the **Model drop-down**: choose the model you just downloaded, `falcon-7B-instruct-GPTQ`.
82
+ 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
83
+ 10. Tick **Trust Remote Code**, followed by **Save Settings**
84
+ 11. Make sure Click **Reload**.
85
+ 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
86
 
87
  ## About `trust_remote_code`
88