tiiuae
/

falcon-mamba-7b-instruct-4bit

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Cannot load quantized version of the model into a 15 GB VRAM gpu?

#3 opened 3 months ago by

PackageNotFoundError: No package metadata was found for bitsandbytes

#2 opened 3 months ago by

The checkpoint you are trying to load has model type `falcon_mamba`

#1 opened 3 months ago by