TheBloke
/

VicUnlocked-30B-LoRA-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on May 17, 2023

Commit

6671e7e

•

1 Parent(s): d438224

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ datasets:
 # VicUnlocked-30B-LoRA GPTQ
-This is GPTQ format quantised 4bit models of [Neko Institute of Science's VicUnLocked 30B LoRA](https://huggingface.co/Neko-Institute-of-Science/VicUnLocked-30b-LoRA).
 The files in this repo are the result of merging the above LoRA with the original LLaMA 30B, then quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
@@ -37,7 +37,7 @@ Open the text-generation-webui UI as normal.
 **Compatible file - VicUnlocked-30B-LoRA-GPTQ-4bit.act-order.safetensors**
-In the `main` branch - the default one - you will find `VicUnlocked-30B-LoRA-GPTQ-4bit-128g.compat.no-act-order.safetensors`
 This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility

 # VicUnlocked-30B-LoRA GPTQ
+This repo contains a GPTQ format quantised 4bit model for [Neko Institute of Science's VicUnLocked 30B LoRA](https://huggingface.co/Neko-Institute-of-Science/VicUnLocked-30b-LoRA).
 The files in this repo are the result of merging the above LoRA with the original LLaMA 30B, then quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
 **Compatible file - VicUnlocked-30B-LoRA-GPTQ-4bit.act-order.safetensors**
+In the `main` branch - the default one - you will find `VicUnlocked-30B-LoRA-GPTQ-4bit.act-order.safetensors`
 This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility