Spaces:

uwnlp
/

guanaco-playground-tgi

Running

Is it running in 4-bit or regular 16bit?

by gsaivinay - opened Jun 25, 2023

Jun 25, 2023

Hello,

Like the title says, I'm wondering if this is running in 16bit or 4bit.

Thanks.

adupav

Jul 3, 2023

I cannot verify what I am saying but since it is said that it was trained using QLora, it is most certainly a 4bit quantized model.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment