Supa-AI commited on
Commit
2431d95
1 Parent(s): ac3d87c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct
3
+ language:
4
+ - en
5
+ - id
6
+ - jv
7
+ - su
8
+ license: gemma
9
+ tags:
10
+ - llama-cpp
11
+ - gguf
12
+ ---
13
+
14
+ # Supa-AI/gemma2-9b-cpt-sahabatai-v1-instruct-q8_0-gguf
15
+ This model was converted to GGUF format from [`GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct`](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct) using llama.cpp.
16
+ Refer to the [original model card](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct) for more details on the model.
17
+
18
+ ## Use with llama.cpp
19
+
20
+ ### CLI:
21
+ ```bash
22
+ llama-cli --hf-repo Supa-AI/gemma2-9b-cpt-sahabatai-v1-instruct-q8_0-gguf --hf-file gemma2-9b-cpt-sahabatai-v1-instruct.q8_0.gguf -p "Your prompt here"
23
+ ```
24
+
25
+ ### Server:
26
+ ```bash
27
+ llama-server --hf-repo Supa-AI/gemma2-9b-cpt-sahabatai-v1-instruct-q8_0-gguf --hf-file gemma2-9b-cpt-sahabatai-v1-instruct.q8_0.gguf -c 2048
28
+ ```
29
+
30
+ ## Model Details
31
+ - **Quantization Type:** q8_0
32
+ - **Original Model:** [GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct)
33
+ - **Format:** GGUF