Hugging Face's logo

Lambent
/
CosMoE-AlpacaLight-v0.6

PEFT
PyTorch
mixtral
Generated from Trainer
Model card Files Community
Lambent commited on
Commit
3a9717a
·
verified ·
1 Parent(s): 88bd542

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -39,7 +39,7 @@ Original model:
39
  |---------------------------------------------------------|------:|------:|---------:|-------:|------:|
40
  |[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)| 22.97| 52.01| 38.02| 28.73| 35.43|
41
 
42
- Overall similar to v0.3. Didn't gain too mcuh in capabilities compared to training the base model.
43
  Better than the base model at every overall capability evaluation, which is a directional improvement from v0.3 at least.
44
  Lower validation loss is also interesting.
45
 
 
39
  |---------------------------------------------------------|------:|------:|---------:|-------:|------:|
40
  |[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)| 22.97| 52.01| 38.02| 28.73| 35.43|
41
 
42
+ Overall similar to v0.3. Didn't gain too much in capabilities compared to training the base model.
43
  Better than the base model at every overall capability evaluation, which is a directional improvement from v0.3 at least.
44
  Lower validation loss is also interesting.
45