xxx777xxxASD
commited on
Commit
•
166d9bc
1
Parent(s):
5bcbe24
Update README.md
Browse files
README.md
CHANGED
@@ -52,6 +52,15 @@ experts:
|
|
52 |
- source_model: Undi95_Meta-Llama-3.1-8B-Claude-bf16
|
53 |
```
|
54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
## Models used
|
57 |
|
|
|
52 |
- source_model: Undi95_Meta-Llama-3.1-8B-Claude-bf16
|
53 |
```
|
54 |
|
55 |
+
## Usage
|
56 |
+
|
57 |
+
It seems like 1.71 koboldcpp can't run MoE llama-3.1 models yet, or perhaps im just dumb and messed something up
|
58 |
+
|
59 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/sTM3GUVMucM_AnIk8iG7H.png)
|
60 |
+
|
61 |
+
If anyone has simmilar problem - run the model directly from llama.cpp, here's simple open source GUI(Windows) you can use if the console is your worst enemy
|
62 |
+
|
63 |
+
Link
|
64 |
|
65 |
## Models used
|
66 |
|