wojtab
/

llava-13b-v0-4bit-128g

Text Generation

Inference Endpoints

Model card Files Files and versions Community

wojtab commited on Apr 24, 2023

Commit

06ddf33

•

1 Parent(s): 11188f1

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -7,8 +7,7 @@ CUDA_VISIBLE_DEVICES=0 python llama.py /workspace/LLaVA-13B-v0/ c4 --wbits 4 --t
 on https://github.com/oobabooga/GPTQ-for-LLaMa CUDA branch of GPTQ (commit `57a2629`)
-see: https://github.com/oobabooga/text-generation-webui/issues/1355#issuecomment-1518116906
-and a PR which enables inference with images in webui: https://github.com/oobabooga/text-generation-webui/pull/1487
 ---
 license: other

 on https://github.com/oobabooga/GPTQ-for-LLaMa CUDA branch of GPTQ (commit `57a2629`)
+YOU CAN NOW RUN IT IN [TEXT-GENERATION-WEBUI](https://github.com/oobabooga/text-generation-webui) with `llava` extension (see: https://github.com/oobabooga/text-generation-webui/tree/main/extensions/llava)
 ---
 license: other