Edentns
/

DataVortexS-10.7B-dpo-v1.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 21

Commit

fb033a6

•

1 Parent(s): ed6b430

Update README.md

Files changed (1) hide show

README.md +7 -9

README.md CHANGED Viewed

@@ -50,15 +50,13 @@ text = """\
 ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
-On Benchmarking ...
-| Task             |  0-shot |  5-shot | 10-shot | 50-shot |
-| :--------------- | ------: | ------: | ------: | ------: |
-| kobest_boolq     |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_copa      |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |     0.0 |     0.0 |     0.0 |     0.0 |
-| **Average**      | **0.0** | **0.0** | **0.0** | **0.0** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**

 ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |       0-shot |         5-shot |       10-shot |      50-shot |
+| :--------------- | -----------: | -------------: | ------------: | -----------: |
+| kobest_boolq     |     0.375807 |       0.822623 |      0.828582 |     0.822529 |
+| kobest_copa      |     0.539993 |       0.665979 |       0.67998 |     0.694997 |
+| kobest_hellaswag |     0.405785 |       0.401975 |      0.438219 |     0.402962 |
+| kobest_sentineg  |     0.794083 |        0.85276 |      0.883509 |     0.880932 |
+| **Average**      | **0.528917** | **0.68583425** | **0.7075725** | **0.700355** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**