Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ license: apache-2.0
|
|
| 15 |
|
| 16 |
This thing was just intended as an experiment but it turned out quite good. I had it both name and prompt imagegen for itself.
|
| 17 |
|
|
|
|
|
|
|
| 18 |
## Prompting
|
| 19 |
|
| 20 |
Use the `Mistral V3-Tekken` context- and instruct-templates. Temperature at about `1.25` seems to be the sweet spot, with either MinP at `0.05` or TopP at `0.9`. DRY/Smoothing etc depending on your preference.
|
|
|
|
| 15 |
|
| 16 |
This thing was just intended as an experiment but it turned out quite good. I had it both name and prompt imagegen for itself.
|
| 17 |
|
| 18 |
+
Created by running a high-r LoRA-pass over Nemo-Base with 2 epochs of some RP data, then a low-r pass with 0.5 epochs of the c2-data, then 3 epochs of DPO using [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1).
|
| 19 |
+
|
| 20 |
## Prompting
|
| 21 |
|
| 22 |
Use the `Mistral V3-Tekken` context- and instruct-templates. Temperature at about `1.25` seems to be the sweet spot, with either MinP at `0.05` or TopP at `0.9`. DRY/Smoothing etc depending on your preference.
|