File size: 242 Bytes
81d47ba |
1 2 3 |
quantized this [model](https://huggingface.co/ehartford/WizardLM-13B-Uncensored)
CUDA_VISIBLE_DEVICES=0 python llama.py ehartford/WizardLM-13B-Uncensored c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors |