Update README.md
Browse files
README.md
CHANGED
@@ -56,13 +56,13 @@ Resources:
|
|
56 |
|
57 |
```bash
|
58 |
# mmproj
|
59 |
-
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/mmproj-
|
60 |
|
61 |
# fp16 llm
|
62 |
-
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/
|
63 |
|
64 |
# int4 llm
|
65 |
-
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/
|
66 |
```
|
67 |
|
68 |
### Build environment
|
@@ -72,13 +72,14 @@ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model
|
|
72 |
|
73 |
### Chat by `./llava-cli`
|
74 |
|
|
|
75 |
|
76 |
```bash
|
77 |
# fp16
|
78 |
-
./llava-cli -m ./
|
79 |
|
80 |
# int4
|
81 |
-
./llava-cli -m ./
|
82 |
```
|
83 |
|
84 |
### Reproduce
|
|
|
56 |
|
57 |
```bash
|
58 |
# mmproj
|
59 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-mmproj-f16.gguf
|
60 |
|
61 |
# fp16 llm
|
62 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-f16.gguf
|
63 |
|
64 |
# int4 llm
|
65 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-int4.gguf
|
66 |
```
|
67 |
|
68 |
### Build environment
|
|
|
72 |
|
73 |
### Chat by `./llava-cli`
|
74 |
|
75 |
+
Note: llava-phi-3-mini uses the `Phi-3-instruct` chat template.
|
76 |
|
77 |
```bash
|
78 |
# fp16
|
79 |
+
./llava-cli -m ./llava-phi-3-mini-f16.gguf --mmproj ./llava-phi-3-mini-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
80 |
|
81 |
# int4
|
82 |
+
./llava-cli -m ./llava-phi-3-mini-int4.gguf --mmproj ./llava-phi-3-mini-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
83 |
```
|
84 |
|
85 |
### Reproduce
|