Could you try converting AlekseyKorshuk's "ethics filtering free" Vicuna model?
#6
by
wojhoiw
- opened
Link for model(https://huggingface.co/AlekseyKorshuk/vicuna-7b)
I'm having a hard time converting it to ggml 4bit. Probably because I'm doing something stupid, since I've never done model converting before...
AlekseyKorshuk/vicuna-7b is what I used. I thought I put that in the readme.