YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This repo contains GGUF .mmproj files intended for use in KoboldCpp alongside other GGUF models.

Please pick the correct projector model to load for your architecture (e.g. all Mistral 7B based models should use the Mistral 7B projector.)

Load them in KoboldCpp with --mmproj or from the "Model Files" tab

When enabled, make sure you refresh KoboldAI Lite, then click Add Img and upload your image. Clicking that image should show Vision is enabled.

GGUF

Model size

322M params

Architecture

clip

4-bit

5-bit

16-bit

Inference API

Unable to determine this model's library. Check the docs .