SteelStorage
/

Lumosia-MoE-4x10.7

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Steelskull commited on Jan 20

Commit

a737a29

•

1 Parent(s): 2cbada7

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -31,11 +31,11 @@ https://huggingface.co/TheBloke/Lumosia-MoE-4x10.7-GGUF
 https://huggingface.co/TheBloke/Lumosia-MoE-4x10.7-GPTQ
-Update:
-Next model (Lumosia v2) will have the the same MoE models but with a fully trained head and gates. Sould increase performance alot.
-still debating on dataset.
-Template:
 ```
 ### System:

 https://huggingface.co/TheBloke/Lumosia-MoE-4x10.7-GPTQ
+Update: (In Progress)
+Lumosia v1.5 will have the the same MoE models but with a fully trained head and gates. Sould increase performance alot.
+Template: ChatML
 ```
 ### System: