Update README.md
Browse files
README.md
CHANGED
@@ -34,7 +34,21 @@ Or actually I'll train Viking-7B again but basically the same mix of datasets as
|
|
34 |
|
35 |
Actually scratch all of that, since there was [a new actually multilingual model](https://huggingface.co/utter-project/EuroLLM-9B-Instruct) released recently I'll probably try fine-tuning that model instead.
|
36 |
|
37 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
|
39 |
- **Developed by:** mpasila
|
40 |
- **License:** apache-2.0
|
|
|
34 |
|
35 |
Actually scratch all of that, since there was [a new actually multilingual model](https://huggingface.co/utter-project/EuroLLM-9B-Instruct) released recently I'll probably try fine-tuning that model instead.
|
36 |
|
37 |
+
## Evaluation
|
38 |
+
|
39 |
+
| FIN-bench (score) | Ahma-SlimInstruct-V1-7B | [Alpacazord-Viking-7B](https://huggingface.co/mpasila/Alpacazord-Viking-7B) | [Finnish-Alpaca-Small-7B](https://huggingface.co/mpasila/Finnish-Alpaca-Small-7B) | [Finnish-Alpaca-Tiny-V2-7B](https://huggingface.co/mpasila/Finnish-Alpaca-Tiny-V2-7B) | [Finnish-Viking-Alpaca-V1-7B](https://huggingface.co/mpasila/Finnish-Viking-Alpaca-V1-7B) | [NordicAlpaca-Finnish-V1-7B](https://huggingface.co/mpasila/NordicAlpaca-Finnish-V1-7B) | [llama-7b-finnish-instruct-v0.1](https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.1) | [llama-7b-finnish-instruct-v0.2](https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.2) | [llama-7b-finnish](https://huggingface.co/Finnish-NLP/llama-7b-finnish) | [Viking-7B (1000B)](https://huggingface.co/LumiOpen/Viking-7B) | [gpt-7b-nordic-prerelease](https://huggingface.co/HPLT/gpt-7b-nordic-prerelease) |
|
40 |
+
|-------|------|------|------|------|------|------|------|------|------|------|-------|
|
41 |
+
| Average | TBA | 0.4123 | 0.3586 | **0.4654** | 0.3943 | 0.3891 | 0.4365 | 0.3993 | 0.2350 | 0.3721 | 0.3169 |
|
42 |
+
|
43 |
+
[Source](https://docs.google.com/spreadsheets/d/1rqJb9dQVihg-Z1_Ras1L_-wuzPg9xNzpdmM2x5HueeY/edit?usp=sharing)
|
44 |
+
|
45 |
+
Gonna add more stuff later.
|
46 |
+
|
47 |
+
#### FIN-bench scores:
|
48 |
+
|
49 |
+
TBA
|
50 |
+
|
51 |
+
# Uploaded Ahma-SlimInstruct-V1-7B model
|
52 |
|
53 |
- **Developed by:** mpasila
|
54 |
- **License:** apache-2.0
|