File size: 612 Bytes
51d208e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
language:
- en
license: apache-2.0
tags:
- llava
- multimodal
- phi-mini-3
- mlx
---

# mlx-community/llava-phi-3-mini-4bit
This model was converted to MLX format from [`qnguyen3/nanoLLaVAxtuner/llava-phi-3-mini-hf`]() using mlx-vllm version **0.0.3**.
Refer to the [original model card](xtuner/llava-phi-3-mini-hf) for more details on the model.
## Use with mlx

```bash
pip install -U mlx-vlm
```

```bash
python -m mlx_vlm.generate --model mlx-community/llava-phi-3-mini-4bit \
--prompt "what are these?" --image "http://images.cocodataset.org/val2017/000000039769.jpg" \
--max-tokens 100 --temp 0.0 
```