LZHgrla commited on
Commit
b858810
1 Parent(s): da429e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -56,13 +56,13 @@ Resources:
56
 
57
  ```bash
58
  # mmproj
59
- wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/mmproj-model-f16.gguf
60
 
61
  # fp16 llm
62
- wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model-f16.gguf
63
 
64
  # int4 llm
65
- wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model-int4.gguf
66
  ```
67
 
68
  ### Build environment
@@ -72,13 +72,14 @@ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model
72
 
73
  ### Chat by `./llava-cli`
74
 
 
75
 
76
  ```bash
77
  # fp16
78
- ./llava-cli -m ./ggml-model-f16.gguf --mmproj ./mmproj-model-f16.gguf --image YOUR_IMAGE.jpg -c 4096
79
 
80
  # int4
81
- ./llava-cli -m ./ggml-model-int4.gguf --mmproj ./mmproj-model-f16.gguf --image YOUR_IMAGE.jpg -c 4096
82
  ```
83
 
84
  ### Reproduce
 
56
 
57
  ```bash
58
  # mmproj
59
+ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-mmproj-f16.gguf
60
 
61
  # fp16 llm
62
+ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-f16.gguf
63
 
64
  # int4 llm
65
+ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-int4.gguf
66
  ```
67
 
68
  ### Build environment
 
72
 
73
  ### Chat by `./llava-cli`
74
 
75
+ Note: llava-phi-3-mini uses the `Phi-3-instruct` chat template.
76
 
77
  ```bash
78
  # fp16
79
+ ./llava-cli -m ./llava-phi-3-mini-f16.gguf --mmproj ./llava-phi-3-mini-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
80
 
81
  # int4
82
+ ./llava-cli -m ./llava-phi-3-mini-int4.gguf --mmproj ./llava-phi-3-mini-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
83
  ```
84
 
85
  ### Reproduce