Triangle104 commited on
Commit
64935f8
1 Parent(s): 92c7d41

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -44
README.md CHANGED
@@ -111,50 +111,6 @@ model-index:
111
  This model was converted to GGUF format from [`elinas/Chronos-Gold-12B-1.0`](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
112
  Refer to the [original model card](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) for more details on the model.
113
 
114
- ---
115
- Model detaILs:
116
- -
117
- Chronos Gold 12B 1.0 is a very unique model that applies to domain areas such as general chatbot functionatliy, roleplay, and storywriting. The model has been observed to write up to 2250 tokens in a single sequence. The model was trained at a sequence length of 16384 (16k) and will still retain the apparent 128k context length from Mistral-Nemo, though it deteriorates over time like regular Nemo does based on the RULER Test
118
-
119
- As a result, is recommended to keep your sequence length max at 16384, or you will experience performance degredation.
120
-
121
- The base model is mistralai/Mistral-Nemo-Base-2407 which was heavily modified to produce a more coherent model, comparable to much larger models.
122
-
123
- Chronos Gold 12B-1.0 re-creates the uniqueness of the original Chronos with significiantly enhanced prompt adherence (following), coherence, a modern dataset, as well as supporting a majority of "character card" formats in applications like SillyTavern.
124
-
125
- It went through an iterative and objective merge process as my previous models and was further finetuned on a dataset curated for it.
126
-
127
- The specifics of the model will not be disclosed at the time due to dataset ownership.
128
-
129
- Instruct Template
130
- This model uses ChatML - below is an example. It is a preset in many frontends.
131
-
132
- <|im_start|>system
133
- A system prompt describing how you'd like your bot to act.<|im_end|>
134
- <|im_start|>user
135
- Hello there!<|im_end|>
136
- <|im_start|>assistant
137
- I can assist you or we can discuss other things?<|im_end|>
138
- <|im_start|>user
139
- I was wondering how transformers work?<|im_end|>
140
- <|im_start|>assistant
141
-
142
- Sampling Settings
143
- Nemo is a bit sensitive to high temperatures, so I use lower. Here are my settings:
144
-
145
- Temp - 0.7 (0.9 max)
146
- Presence Penalty - 1.0
147
- Repetition Penalty range - 2800
148
- Min P - 0.10
149
-
150
- Additional Details
151
- This model was created by elinas on discord. Thank you to @kalomaze for providing a model that made this merge possible.
152
-
153
- This is one of multiple models to come out in the series by size and model architecture, so look forward to it!
154
-
155
- Contact me on Discord for inquiries.
156
-
157
- ---
158
  ## Use with llama.cpp
159
  Install llama.cpp through brew (works on Mac and Linux)
160
 
 
111
  This model was converted to GGUF format from [`elinas/Chronos-Gold-12B-1.0`](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
112
  Refer to the [original model card](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) for more details on the model.
113
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
114
  ## Use with llama.cpp
115
  Install llama.cpp through brew (works on Mac and Linux)
116