Text Generation
Transformers
PyTorch
English
Finnish
llama
text-generation-inference
unsloth
trl
sft
conversational
Inference Endpoints
mpasila commited on
Commit
3ae376b
·
verified ·
1 Parent(s): 5ab617c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -34,7 +34,21 @@ Or actually I'll train Viking-7B again but basically the same mix of datasets as
34
 
35
  Actually scratch all of that, since there was [a new actually multilingual model](https://huggingface.co/utter-project/EuroLLM-9B-Instruct) released recently I'll probably try fine-tuning that model instead.
36
 
37
- # Uploaded Ahma-SlimInstruct-LoRA-V0.1-7B model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
  - **Developed by:** mpasila
40
  - **License:** apache-2.0
 
34
 
35
  Actually scratch all of that, since there was [a new actually multilingual model](https://huggingface.co/utter-project/EuroLLM-9B-Instruct) released recently I'll probably try fine-tuning that model instead.
36
 
37
+ ## Evaluation
38
+
39
+ | FIN-bench (score) | Ahma-SlimInstruct-V1-7B | [Alpacazord-Viking-7B](https://huggingface.co/mpasila/Alpacazord-Viking-7B) | [Finnish-Alpaca-Small-7B](https://huggingface.co/mpasila/Finnish-Alpaca-Small-7B) | [Finnish-Alpaca-Tiny-V2-7B](https://huggingface.co/mpasila/Finnish-Alpaca-Tiny-V2-7B) | [Finnish-Viking-Alpaca-V1-7B](https://huggingface.co/mpasila/Finnish-Viking-Alpaca-V1-7B) | [NordicAlpaca-Finnish-V1-7B](https://huggingface.co/mpasila/NordicAlpaca-Finnish-V1-7B) | [llama-7b-finnish-instruct-v0.1](https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.1) | [llama-7b-finnish-instruct-v0.2](https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.2) | [llama-7b-finnish](https://huggingface.co/Finnish-NLP/llama-7b-finnish) | [Viking-7B (1000B)](https://huggingface.co/LumiOpen/Viking-7B) | [gpt-7b-nordic-prerelease](https://huggingface.co/HPLT/gpt-7b-nordic-prerelease) |
40
+ |-------|------|------|------|------|------|------|------|------|------|------|-------|
41
+ | Average | TBA | 0.4123 | 0.3586 | **0.4654** | 0.3943 | 0.3891 | 0.4365 | 0.3993 | 0.2350 | 0.3721 | 0.3169 |
42
+
43
+ [Source](https://docs.google.com/spreadsheets/d/1rqJb9dQVihg-Z1_Ras1L_-wuzPg9xNzpdmM2x5HueeY/edit?usp=sharing)
44
+
45
+ Gonna add more stuff later.
46
+
47
+ #### FIN-bench scores:
48
+
49
+ TBA
50
+
51
+ # Uploaded Ahma-SlimInstruct-V1-7B model
52
 
53
  - **Developed by:** mpasila
54
  - **License:** apache-2.0