Fizzarolli
commited on
Commit
•
e5d113f
1
Parent(s):
ecfac73
Update README.md
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ A finetune of OLMoE by AllenAI designed for roleplaying (and maybe general useca
|
|
18 |
PLEASE do not expect godliness out of this, it's a model with 1 billion active parameters. Expect something more akin to Gemma 2 2B, not Llama 3 8B.
|
19 |
|
20 |
## Quants
|
21 |
-
GGUF (requires a newish version of llama.cpp
|
22 |
- [mradermacher's imatrix quants](https://huggingface.co/mradermacher/MoE-Girl-1BA-7BT-i1-GGUF)
|
23 |
- [our static quants](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT-GGUF)
|
24 |
|
|
|
18 |
PLEASE do not expect godliness out of this, it's a model with 1 billion active parameters. Expect something more akin to Gemma 2 2B, not Llama 3 8B.
|
19 |
|
20 |
## Quants
|
21 |
+
GGUF (requires a newish version of llama.cpp or kobold.cpp 1.76):
|
22 |
- [mradermacher's imatrix quants](https://huggingface.co/mradermacher/MoE-Girl-1BA-7BT-i1-GGUF)
|
23 |
- [our static quants](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT-GGUF)
|
24 |
|