unsloth
/

Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Training with images

#6 opened 9 days ago by

AttributeError: Model MllamaForConditionalGeneration does not support BitsAndBytes quantization yet.

#5 opened 18 days ago by

How much vram needed?

#4 opened about 1 month ago by

How load this model?

#3 opened about 2 months ago by

Can you post the script that was used to quantize this model please?

#2 opened about 2 months ago by

ctranslate2-4you