Is this model 4 bit?

by JamesLear - opened Mar 29, 2023

Mar 29, 2023

I'm guessing from the name, this is a LoRA finetuned model, but is it 4 bit? Or is there a different model I need if I want to run a 32B param at home?
Cheers,
James

Pi3141

Owner Mar 29, 2023

4 bits. It says q4_0

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment