Update README.md
Browse files
README.md
CHANGED
@@ -49,14 +49,14 @@ Since cloning the entire repo may be inefficient, you can manually download the
|
|
49 |
```
|
50 |
2. Download:
|
51 |
```shell
|
52 |
-
huggingface-cli download Qwen/Qwen2.5-72B-Instruct-GGUF qwen2.5-72b-instruct-
|
53 |
```
|
54 |
-
For large files, we split them into multiple segments due to the limitation of file upload. They share a prefix, with a suffix indicating its index. For examples, `qwen2.5-72b-instruct-q5_k_m-00001-of-
|
55 |
3. (Optional) Merge:
|
56 |
For split files, you need to merge them first with the command `llama-gguf-split` as shown below:
|
57 |
```bash
|
58 |
# ./llama-gguf-split --merge <first-split-file-path> <merged-file-path>
|
59 |
-
./llama-gguf-split --merge qwen2.5-72b-instruct-q5_k_m-00001-of-
|
60 |
```
|
61 |
|
62 |
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
|
|
|
49 |
```
|
50 |
2. Download:
|
51 |
```shell
|
52 |
+
huggingface-cli download Qwen/Qwen2.5-72B-Instruct-GGUF --include "qwen2.5-72b-instruct-q5_k_m*.gguf" --local-dir . --local-dir-use-symlinks False
|
53 |
```
|
54 |
+
For large files, we split them into multiple segments due to the limitation of file upload. They share a prefix, with a suffix indicating its index. For examples, `qwen2.5-72b-instruct-q5_k_m-00001-of-00014.gguf` to `qwen2.5-72b-instruct-q5_k_m-00014-of-00014.gguf`. The above command will download all of them.
|
55 |
3. (Optional) Merge:
|
56 |
For split files, you need to merge them first with the command `llama-gguf-split` as shown below:
|
57 |
```bash
|
58 |
# ./llama-gguf-split --merge <first-split-file-path> <merged-file-path>
|
59 |
+
./llama-gguf-split --merge qwen2.5-72b-instruct-q5_k_m-00001-of-00014.gguf qwen2.5-72b-instruct-q5_k_m.gguf
|
60 |
```
|
61 |
|
62 |
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
|