TheBloke
/

Project-Baize-v2-7B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on May 24, 2023

Commit

98f7111

·

1 Parent(s): 698d2ca

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -41,7 +41,7 @@ This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility
 It was created without the `--act-order` parameter. It may have slightly lower inference quality compared to the other file, but is guaranteed to work on all versions of GPTQ-for-LLaMa and text-generation-webui.
-* `wizard-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with text-generation-webui one-click-installers
   * Parameters: Groupsize = 128g. No act-order.

 It was created without the `--act-order` parameter. It may have slightly lower inference quality compared to the other file, but is guaranteed to work on all versions of GPTQ-for-LLaMa and text-generation-webui.
+* `Baize-v2-7B-4bit-128g.no-act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with text-generation-webui one-click-installers
   * Parameters: Groupsize = 128g. No act-order.