Triangle104
commited on
Commit
•
64935f8
1
Parent(s):
92c7d41
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -111,50 +111,6 @@ model-index:
|
|
111 |
This model was converted to GGUF format from [`elinas/Chronos-Gold-12B-1.0`](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
112 |
Refer to the [original model card](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) for more details on the model.
|
113 |
|
114 |
-
---
|
115 |
-
Model detaILs:
|
116 |
-
-
|
117 |
-
Chronos Gold 12B 1.0 is a very unique model that applies to domain areas such as general chatbot functionatliy, roleplay, and storywriting. The model has been observed to write up to 2250 tokens in a single sequence. The model was trained at a sequence length of 16384 (16k) and will still retain the apparent 128k context length from Mistral-Nemo, though it deteriorates over time like regular Nemo does based on the RULER Test
|
118 |
-
|
119 |
-
As a result, is recommended to keep your sequence length max at 16384, or you will experience performance degredation.
|
120 |
-
|
121 |
-
The base model is mistralai/Mistral-Nemo-Base-2407 which was heavily modified to produce a more coherent model, comparable to much larger models.
|
122 |
-
|
123 |
-
Chronos Gold 12B-1.0 re-creates the uniqueness of the original Chronos with significiantly enhanced prompt adherence (following), coherence, a modern dataset, as well as supporting a majority of "character card" formats in applications like SillyTavern.
|
124 |
-
|
125 |
-
It went through an iterative and objective merge process as my previous models and was further finetuned on a dataset curated for it.
|
126 |
-
|
127 |
-
The specifics of the model will not be disclosed at the time due to dataset ownership.
|
128 |
-
|
129 |
-
Instruct Template
|
130 |
-
This model uses ChatML - below is an example. It is a preset in many frontends.
|
131 |
-
|
132 |
-
<|im_start|>system
|
133 |
-
A system prompt describing how you'd like your bot to act.<|im_end|>
|
134 |
-
<|im_start|>user
|
135 |
-
Hello there!<|im_end|>
|
136 |
-
<|im_start|>assistant
|
137 |
-
I can assist you or we can discuss other things?<|im_end|>
|
138 |
-
<|im_start|>user
|
139 |
-
I was wondering how transformers work?<|im_end|>
|
140 |
-
<|im_start|>assistant
|
141 |
-
|
142 |
-
Sampling Settings
|
143 |
-
Nemo is a bit sensitive to high temperatures, so I use lower. Here are my settings:
|
144 |
-
|
145 |
-
Temp - 0.7 (0.9 max)
|
146 |
-
Presence Penalty - 1.0
|
147 |
-
Repetition Penalty range - 2800
|
148 |
-
Min P - 0.10
|
149 |
-
|
150 |
-
Additional Details
|
151 |
-
This model was created by elinas on discord. Thank you to @kalomaze for providing a model that made this merge possible.
|
152 |
-
|
153 |
-
This is one of multiple models to come out in the series by size and model architecture, so look forward to it!
|
154 |
-
|
155 |
-
Contact me on Discord for inquiries.
|
156 |
-
|
157 |
-
---
|
158 |
## Use with llama.cpp
|
159 |
Install llama.cpp through brew (works on Mac and Linux)
|
160 |
|
|
|
111 |
This model was converted to GGUF format from [`elinas/Chronos-Gold-12B-1.0`](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
112 |
Refer to the [original model card](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) for more details on the model.
|
113 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
114 |
## Use with llama.cpp
|
115 |
Install llama.cpp through brew (works on Mac and Linux)
|
116 |
|