mmnga commited on
Commit
e64167e
1 Parent(s): 2344d87

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -1,3 +1,30 @@
1
  ---
2
  license: llama3
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: llama3
3
+ language:
4
+ - en
5
+ - ja
6
+ tags:
7
+ - llama3
8
+ datasets:
9
+ - TFMC/imatrix-dataset-for-japanese-llm
10
  ---
11
+ # lightblue-suzume-llama-3-8B-japanese-gguf
12
+ [lightblueさんが公開しているsuzume-llama-3-8B-japanese](https://huggingface.co/lightblue/suzume-llama-3-8B-japanese)のggufフォーマット変換版です。
13
+
14
+ imatrixのデータは[TFMC/imatrix-dataset-for-japanese-llm](https://huggingface.co/datasets/TFMC/imatrix-dataset-for-japanese-llm)を使用して作成しました。
15
+
16
+ ## 他のモデル
17
+ [mmnga/lightblue-suzume-llama-3-8B-japanese-gguf](https://huggingface.co/mmnga/lightblue-suzume-llama-3-8B-japanese-gguf)
18
+ [mmnga/lightblue-ao-karasu-72B-gguf](https://huggingface.co/mmnga/lightblue-ao-karasu-72B-gguf)
19
+ [mmnga/lightblue-karasu-1.1B-gguf](https://huggingface.co/mmnga/lightblue-karasu-1.1B-gguf)
20
+ [mmnga/lightblue-karasu-7B-chat-plus-unleashed-gguf](https://huggingface.co/mmnga/lightblue-karasu-7B-chat-plus-unleashed-gguf)
21
+ [mmnga/lightblue-qarasu-14B-chat-plus-unleashed-gguf](https://huggingface.co/mmnga/lightblue-qarasu-14B-chat-plus-unleashed-gguf)
22
+
23
+ ## Usage
24
+
25
+ ```
26
+ git clone https://github.com/ggerganov/llama.cpp.git
27
+ cd llama.cpp
28
+ make -j
29
+ ./main -m 'lightblue-suzume-llama-3-8B-japanese-Q4_0.gguf' -p "<|begin_of_text|><|start_header_id|>user <|end_header_id|>\n\nこんにちわ<|eot_id|><|start_header_id|>assistant <|end_header_id|>\n\n" -n 128
30
+ ```