Update README.md
Browse files
README.md
CHANGED
@@ -57,6 +57,8 @@ The above commands assume you have installed all dependencies for GPTQ-for-LLaMa
|
|
57 |
If you cannot use the Triton branch of GPTQ for any reason, it should also work to use the CUDA branch instead:
|
58 |
```
|
59 |
git clone https://github.com/qwopqwop200/GPTQ-for-LLaMa -b cuda
|
|
|
|
|
60 |
```
|
61 |
Then link that into `text-generation-webui/repositories` as described above.
|
62 |
|
|
|
57 |
If you cannot use the Triton branch of GPTQ for any reason, it should also work to use the CUDA branch instead:
|
58 |
```
|
59 |
git clone https://github.com/qwopqwop200/GPTQ-for-LLaMa -b cuda
|
60 |
+
cd GPTQ-for-LLaMa
|
61 |
+
python setup_cuda.py install
|
62 |
```
|
63 |
Then link that into `text-generation-webui/repositories` as described above.
|
64 |
|