huihui-ai commited on
Commit
e9386cd
·
verified ·
1 Parent(s): 1b637fd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -41,6 +41,20 @@ extra_gated_button_content: Submit
41
  This is an uncensored version of [unsloth/gpt-oss-120b-BF16](https://huggingface.co/unsloth/gpt-oss-120b-BF16) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
42
 
43
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
 
45
  ## Usage
46
  You can use this model in your applications by loading it with Hugging Face's `transformers` library:
 
41
  This is an uncensored version of [unsloth/gpt-oss-120b-BF16](https://huggingface.co/unsloth/gpt-oss-120b-BF16) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
42
 
43
 
44
+ ## Download and merge
45
+
46
+ Use the [llama.cpp](https://github.com/ggml-org/llama.cpp) split program to merge model (llama-gguf-split needs to be compiled.),
47
+
48
+ [Q4_K_M-GGUF](https://huggingface.co/huihui-ai/Huihui-gpt-oss-120b-BF16-abliterated/tree/main/Q4_K_M-GGUF)
49
+
50
+
51
+ ```
52
+ huggingface-cli download huihui-ai/Huihui-gpt-oss-120b-BF16-abliterated --local-dir ./huihui-ai/Huihui-gpt-oss-120b-BF16-abliterated --token xxx
53
+
54
+ mkdir huihui-ai/Huihui-gpt-oss-120b-BF16-abliterated/Q4_K_M-GGUF
55
+
56
+ llama-gguf-split --merge huihui-ai/Huihui-gpt-oss-120b-BF16-abliterated/Q4_K_M-GGUF/Q4_K_M-GGUF-00001-of-00015.gguf huihui-ai/Huihui-gpt-oss-120b-BF16-abliterated/Q4_K_M.gguf
57
+ ```
58
 
59
  ## Usage
60
  You can use this model in your applications by loading it with Hugging Face's `transformers` library: