apepkuss79
commited on
Commit
•
cc37729
1
Parent(s):
9eaf127
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ quantized_by: Second State Inc.
|
|
16 |
<!-- header start -->
|
17 |
<!-- 200823 -->
|
18 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
19 |
-
<img src="https://github.com/
|
20 |
</div>
|
21 |
<hr style="margin-top: 1.0em; margin-bottom: 1.0em;">
|
22 |
<!-- header end -->
|
@@ -29,7 +29,7 @@ quantized_by: Second State Inc.
|
|
29 |
|
30 |
## Run with LlamaEdge
|
31 |
|
32 |
-
- LlamaEdge version: [v0.2.8](https://github.com/
|
33 |
|
34 |
- Prompt template
|
35 |
|
@@ -47,13 +47,13 @@ quantized_by: Second State Inc.
|
|
47 |
- Run as LlamaEdge service
|
48 |
|
49 |
```bash
|
50 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-
|
51 |
```
|
52 |
|
53 |
- Run as LlamaEdge command app
|
54 |
|
55 |
```bash
|
56 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-
|
57 |
```
|
58 |
|
59 |
## Quantized GGUF Models
|
|
|
16 |
<!-- header start -->
|
17 |
<!-- 200823 -->
|
18 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
19 |
+
<img src="https://github.com/LlamaEdge/LlamaEdge/raw/dev/assets/logo.svg" style="width: 100%; min-width: 400px; display: block; margin: auto;">
|
20 |
</div>
|
21 |
<hr style="margin-top: 1.0em; margin-bottom: 1.0em;">
|
22 |
<!-- header end -->
|
|
|
29 |
|
30 |
## Run with LlamaEdge
|
31 |
|
32 |
+
- LlamaEdge version: [v0.2.8](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.2.8) and above
|
33 |
|
34 |
- Prompt template
|
35 |
|
|
|
47 |
- Run as LlamaEdge service
|
48 |
|
49 |
```bash
|
50 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-api-server.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
|
51 |
```
|
52 |
|
53 |
- Run as LlamaEdge command app
|
54 |
|
55 |
```bash
|
56 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-chat.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
|
57 |
```
|
58 |
|
59 |
## Quantized GGUF Models
|