|
--- |
|
base_model: LakoMoor/Silicon-Alice-7B |
|
language: |
|
- en |
|
- ru |
|
library_name: transformers |
|
license: cc-by-nc-4.0 |
|
model_name: Silicon-Alice-7B |
|
tags: |
|
- not-for-all-audiences |
|
- nsfw |
|
- llama-cpp |
|
- gguf-my-repo |
|
inference: false |
|
model_creator: LakoMoor |
|
model_type: mistral |
|
--- |
|
|
|
# woofwolfy/Silicon-Alice-7B-Q4_K_M-GGUF-Imatrix |
|
This model was converted to GGUF format from [`LakoMoor/Silicon-Alice-7B`](https://huggingface.co/LakoMoor/Silicon-Alice-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space. |
|
Refer to the [original model card](https://huggingface.co/LakoMoor/Silicon-Alice-7B) for more details on the model. |
|
|
|
 |
|
|
|
## What's that? |
|
|
|
Silicon-Alice-7B-GGUF is a quantized model based on [Silicon-Masha-7B](https://huggingface.co/LakoMoor/Silicon-Alice-7B) aiming to be both strong in RP, be smart **and** understand Russian, that can follow character maps very well. This model understands Russian better than the previous one. It is suitable for RP/ERP and general use. It can be run on weak samovar using [llama.cpp](https://github.com/ggerganov/llama.cpp) or [koboldcpp](https://github.com/LostRuins/koboldcpp). |
|
|
|
## Prompt Template (Alpaca) |
|
|
|
I found the best SillyTavern results from using the Noromaid template but please try other templates! Let me know if you find anything good. |
|
|
|
SillyTavern config files: [Context](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/context.json), [Instruct](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/instruct.json). |
|
|
|
Additionally, here is my highly recommended [Text Completion preset](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/MinP.json). You can tweak this by adjusting temperature up or dropping min p to boost creativity or raise min p to increase stability. You shouldn't need to touch anything else! |
|
|
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
### Instruction: |
|
{prompt} |
|
### Response: |
|
``` |
|
|
|
|