Text Generation
GGUF
English
mixture of experts
Mixture of Experts
8x3B
Llama 3.2 MOE
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mergekit
Inference Endpoints
conversational
Update README.md
Browse files
README.md
CHANGED
@@ -105,6 +105,11 @@ This also results in many cases in higher quality instruction following too.
|
|
105 |
|
106 |
That means the power of every model is available during instruction and output generation.
|
107 |
|
|
|
|
|
|
|
|
|
|
|
108 |
CHANGING THE NUMBER OF EXPERTS:
|
109 |
|
110 |
You can set the number of experts in LMStudio (https://lmstudio.ai) at the "load" screen and via other apps/llm apps by setting "Experts" or "Number of Experts".
|
|
|
105 |
|
106 |
That means the power of every model is available during instruction and output generation.
|
107 |
|
108 |
+
NOTE:
|
109 |
+
|
110 |
+
You can use one "expert" too ; however this means the model will randomly select an expert to use EACH TIME, resulting
|
111 |
+
in very different generation for each prompt / regen of a prompt.
|
112 |
+
|
113 |
CHANGING THE NUMBER OF EXPERTS:
|
114 |
|
115 |
You can set the number of experts in LMStudio (https://lmstudio.ai) at the "load" screen and via other apps/llm apps by setting "Experts" or "Number of Experts".
|