Text Generation
Transformers
Inference Endpoints
ProdeusUnity commited on
Commit
f58e3e2
·
verified ·
1 Parent(s): 65ce0c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -44,7 +44,24 @@ Model responds to Gemma instruct formatting, exactly like it's base model.
44
 
45
  **Training config**
46
  <details><summary>See LLaMA-Factory config</summary>
47
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
  ```yaml
49
  ### Model
50
  model_name_or_path: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
 
44
 
45
  **Training config**
46
  <details><summary>See LLaMA-Factory config</summary>
47
+
48
+ **GGUF Downloads (Don't Download Entire Tree)**
49
+
50
+ [FP16](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-FP16.GGUF?download=true)
51
+ [Q8_0](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q8_0.GGUF?download=true)
52
+ [Q6_K](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q6_K.GGUF?download=true)
53
+ [Q5_K_M](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q5_K_M.GGUF?download=true)
54
+ [Q5_K_S](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q5_K_S.GGUF?download=true)
55
+ [Q4_K_M](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q4_K_M.GGUF?download=true)
56
+ [Q4_K_S](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q4_K_S.GGUF?download=true)
57
+ [Q3_K_L](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q3_K_l.GGUF?download=true)
58
+ [Q3_K_M](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q3_K_M.GGUF?download=true)
59
+ [Q3_K_S](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q3_K_S.GGUF?download=true)
60
+ [Q2_K](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q2_K.GGUF?download=true)
61
+ [Q4_0_8_8, ARM ONLY](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q4_0_8_8.GGUF?download=true)
62
+ [Q4_0_4_8, ARM ONLY](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q4_0_4_8.GGUF?download=true)
63
+ [Q4_0_4_4, ARM ONLY](https://huggingface.co/allura-org/G2-9B-Sugarquill-v0-GGUFs/resolve/main/allura-org_G2-9B-Sugarquill-v0-Q4_0_4_4.GGUF?download=true)
64
+
65
  ```yaml
66
  ### Model
67
  model_name_or_path: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3