apepkuss79 commited on
Commit
cc37729
1 Parent(s): 9eaf127

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -16,7 +16,7 @@ quantized_by: Second State Inc.
16
  <!-- header start -->
17
  <!-- 200823 -->
18
  <div style="width: auto; margin-left: auto; margin-right: auto">
19
- <img src="https://github.com/second-state/LlamaEdge/raw/dev/assets/logo.svg" style="width: 100%; min-width: 400px; display: block; margin: auto;">
20
  </div>
21
  <hr style="margin-top: 1.0em; margin-bottom: 1.0em;">
22
  <!-- header end -->
@@ -29,7 +29,7 @@ quantized_by: Second State Inc.
29
 
30
  ## Run with LlamaEdge
31
 
32
- - LlamaEdge version: [v0.2.8](https://github.com/second-state/LlamaEdge/releases/tag/0.2.8) and above
33
 
34
  - Prompt template
35
 
@@ -47,13 +47,13 @@ quantized_by: Second State Inc.
47
  - Run as LlamaEdge service
48
 
49
  ```bash
50
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-ggml-model-q4_0.gguf llama-api-server.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
51
  ```
52
 
53
  - Run as LlamaEdge command app
54
 
55
  ```bash
56
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-ggml-model-q4_0.gguf llama-chat.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
57
  ```
58
 
59
  ## Quantized GGUF Models
 
16
  <!-- header start -->
17
  <!-- 200823 -->
18
  <div style="width: auto; margin-left: auto; margin-right: auto">
19
+ <img src="https://github.com/LlamaEdge/LlamaEdge/raw/dev/assets/logo.svg" style="width: 100%; min-width: 400px; display: block; margin: auto;">
20
  </div>
21
  <hr style="margin-top: 1.0em; margin-bottom: 1.0em;">
22
  <!-- header end -->
 
29
 
30
  ## Run with LlamaEdge
31
 
32
+ - LlamaEdge version: [v0.2.8](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.2.8) and above
33
 
34
  - Prompt template
35
 
 
47
  - Run as LlamaEdge service
48
 
49
  ```bash
50
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-api-server.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
51
  ```
52
 
53
  - Run as LlamaEdge command app
54
 
55
  ```bash
56
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-chat.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
57
  ```
58
 
59
  ## Quantized GGUF Models