Update README.md
Browse files
README.md
CHANGED
@@ -11,10 +11,10 @@ tags:
|
|
11 |
---
|
12 |
# Model Card for una-cybertron-7b-v1 (UNA: Uniform Neural Alignment)
|
13 |
|
14 |
-
We strike back, introducing **Cybertron 7B** a
|
15 |
-
He scores **64.60
|
16 |
|
17 |
-
|
18 |
|
19 |
| Model | Average | ARC (25-s) | HellaSwag (10-s) | MMLU (5-s) | TruthfulQA (MC) (0-s) | Winogrande (5-s) | GSM8K (5-s) |
|
20 |
| --- | --- | --- | --- | --- | --- | --- | --- |
|
@@ -28,12 +28,13 @@ The model excels in mathematics, logic, reasoning, overall very smart.
|
|
28 |
|
29 |
Adiestrated with UNA: Uniform Neural Alignment technique (paper going out soon).
|
30 |
|
|
|
31 |
### Model Description
|
32 |
|
33 |
- **Developed by:** [juanako.ai](https://juanako.ai)
|
34 |
- **Author:** [Xavier M.](xavi@juanako.ai)
|
35 |
- **Model type:** MistralAI 7B
|
36 |
-
- **Funded by
|
37 |
|
38 |
### Prompt
|
39 |
The model is very good, works well on almost any prompt but ChatML format and Alpaca System gets the best
|
|
|
11 |
---
|
12 |
# Model Card for una-cybertron-7b-v1 (UNA: Uniform Neural Alignment)
|
13 |
|
14 |
+
We strike back, introducing **Cybertron 7B v1** a 7B MistralAI based model, best on it's series. Trained on SFT, DPO and UNA (Unified Neural Alignment) on multiple datasets.
|
15 |
+
He scores **64.60**+ on HF LeaderTests (without DROP for now).
|
16 |
|
17 |
+
Scoring **#1** at 2 December 2023:
|
18 |
|
19 |
| Model | Average | ARC (25-s) | HellaSwag (10-s) | MMLU (5-s) | TruthfulQA (MC) (0-s) | Winogrande (5-s) | GSM8K (5-s) |
|
20 |
| --- | --- | --- | --- | --- | --- | --- | --- |
|
|
|
28 |
|
29 |
Adiestrated with UNA: Uniform Neural Alignment technique (paper going out soon).
|
30 |
|
31 |
+
|
32 |
### Model Description
|
33 |
|
34 |
- **Developed by:** [juanako.ai](https://juanako.ai)
|
35 |
- **Author:** [Xavier M.](xavi@juanako.ai)
|
36 |
- **Model type:** MistralAI 7B
|
37 |
+
- **Funded by Cybertron's H100's**
|
38 |
|
39 |
### Prompt
|
40 |
The model is very good, works well on almost any prompt but ChatML format and Alpaca System gets the best
|