abhinavkulkarni
/

meta-llama-Llama-2-13b-chat-hf-w4-g128-awq

Text Generation

text-generation-inference

Model card Files Files and versions Community

Abhinav Kulkarni commited on Jul 19, 2023

Commit

d8b45fd

•

1 Parent(s): ecc86ee

Updated README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ For Docker users, the `nvcr.io/nvidia/pytorch:23.06-py3` image is runtime v12.1
 ```bash
 git clone https://github.com/abhinavkulkarni/llm-awq \
 && cd llm-awq \
-&& git checkout e977c5a570c5048b67a45b1eb823b81de02d0d60 \
 && pip install -e . \
 && cd awq/kernels \
 && python setup.py install

 ```bash
 git clone https://github.com/abhinavkulkarni/llm-awq \
 && cd llm-awq \
+&& git checkout ba01560f21516805fc5ceba5c2566dcbd1cf66d8 \
 && pip install -e . \
 && cd awq/kernels \
 && python setup.py install