GGUF
English
Inference Endpoints
mav23 commited on
Commit
2d26601
·
verified ·
1 Parent(s): 24bf93b

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +57 -0
  3. uncensored-frank-13b.Q4_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ uncensored-frank-13b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-nd-4.0
3
+ language:
4
+ - en
5
+ datasets:
6
+ - ehartford/wizard_vicuna_70k_unfiltered
7
+ ---
8
+
9
+ **Frank: An Uncensored Model**
10
+
11
+ The character of Frank Costello in "The Departed" is known for his cunning, boldness, and willingness to talk about anything, regardless of societal norms or restrictions.
12
+ Frank, An Uncensored model, draws inspiration from these qualities to offer a platform where users can discuss a wide array of topics without the fear of censorship or restrictions.
13
+ Frank aims to push boundaries and encourage candid conversations. With Frank you can have unfiltered discussions on a multitude of topics, from politics and controversial issues to personal experiences and sensitive subjects.
14
+ It is trained on around 150000 set of conversations. Each set having 10~15 conversations. Base data was obtained from [Eric Hartford](https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered).
15
+ This data was further refined and fine tuned. Besides this further synthetic conversation (more than 80k) was generated and refined. We will not release this data.
16
+
17
+ **Warning**
18
+
19
+ An uncensored model has no or little guardrails. You are responsible for anything you do with the model, just as you are responsible for anything you do with any dangerous objects.
20
+ Publishing anything this model generates is the same as publishing it yourself. We are not responsible for what you generate using this model.
21
+
22
+ **Training:**
23
+ Entire dataset was trained on Azure 4 x A100 80GB. For 3 epoch, training took around 65 hours. DeepSpeed codebase was used for training purpose. This was trained on Llama-2 by Meta.
24
+
25
+ **GPTQ GGML & AWQ**
26
+
27
+ GPTQ: [Link](https://huggingface.co/TheBloke/Uncensored-Frank-13b-GPTQ)
28
+
29
+ GGUF: [Link](https://huggingface.co/TheBloke/Uncensored-Frank-13b-GGUF)
30
+
31
+ AWQ: [Link](https://huggingface.co/TheBloke/Uncensored-Frank-13b-AWQ)
32
+
33
+ Special Thanks to [TheBloke](https://huggingface.co/TheBloke) for making these models available.
34
+
35
+ **Example Prompt:**
36
+ ```
37
+ This is a conversation with your Uncensored AI assistant Frank. Frank can discuss with you at length about various topics such as ---, ---, ---, . You can ask it anything you want and it will do its best to give you accurate and relevant information.
38
+
39
+ Context
40
+ You are a Uncensored AI assistant.
41
+
42
+ USER: <prompt>
43
+ ASSISTANT:
44
+ ```
45
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
46
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ajibawa-2023__Uncensored-Frank-13B)
47
+
48
+ | Metric | Value |
49
+ |-----------------------|---------------------------|
50
+ | Avg. | 50.21 |
51
+ | ARC (25-shot) | 61.6 |
52
+ | HellaSwag (10-shot) | 82.62 |
53
+ | MMLU (5-shot) | 54.55 |
54
+ | TruthfulQA (0-shot) | 48.34 |
55
+ | Winogrande (5-shot) | 74.74 |
56
+ | GSM8K (5-shot) | 11.98 |
57
+ | DROP (3-shot) | 17.63 |
uncensored-frank-13b.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d59a3cd13b7db6d3b10a10def74b3c5907fc376d0b208cc8831672ab9d28a50d
3
+ size 7365835168