Lewdiculous
commited on
Commit
•
1c60e4a
1
Parent(s):
934ebea
att
Browse files
README.md
CHANGED
@@ -1,8 +1,11 @@
|
|
1 |
---
|
|
|
|
|
|
|
2 |
license: cc-by-nc-4.0
|
|
|
3 |
language:
|
4 |
- en
|
5 |
-
inference: false
|
6 |
tags:
|
7 |
- roleplay
|
8 |
- llama3
|
@@ -22,10 +25,6 @@ I recommend checking their page for feedback and support.
|
|
22 |
> To run this model, please use the [**latest version of KoboldCpp**](https://github.com/LostRuins/koboldcpp/releases/latest). <br>
|
23 |
> If you noticed any issues let me know in the discussions.
|
24 |
|
25 |
-
> [!NOTE]
|
26 |
-
> **General usage:** <br>
|
27 |
-
> For **8GB VRAM** GPUs, I recommend the **Q4_K_M-imat** (4.89 BPW) quant for up to 12288 context sizes. <br>
|
28 |
-
>
|
29 |
> **Presets:** <br>
|
30 |
> Some compatible SillyTavern presets can be found [**here (Virt's Roleplay Presets)**](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>
|
31 |
> Lower temperatures are recommended by the authors, so make sure to experiment. <br>
|
|
|
1 |
---
|
2 |
+
base_model: NeverSleep/Lumimaid-v0.2-12B
|
3 |
+
quantized_by: Lewdiculous
|
4 |
+
library_name: transformers
|
5 |
license: cc-by-nc-4.0
|
6 |
+
inference: false
|
7 |
language:
|
8 |
- en
|
|
|
9 |
tags:
|
10 |
- roleplay
|
11 |
- llama3
|
|
|
25 |
> To run this model, please use the [**latest version of KoboldCpp**](https://github.com/LostRuins/koboldcpp/releases/latest). <br>
|
26 |
> If you noticed any issues let me know in the discussions.
|
27 |
|
|
|
|
|
|
|
|
|
28 |
> **Presets:** <br>
|
29 |
> Some compatible SillyTavern presets can be found [**here (Virt's Roleplay Presets)**](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>
|
30 |
> Lower temperatures are recommended by the authors, so make sure to experiment. <br>
|