Edentns
/

DataVortexS-10.7B-v0.2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 16

Commit

228ec5d

•

1 Parent(s): 7857b31

Update README.md

Files changed (1) hide show

README.md +7 -8

README.md CHANGED Viewed

@@ -57,14 +57,13 @@ text = """\
 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
-On Benchmarking ...
-| Task             | 0-shot | 5-shot | 10-shot | 50-shot |
-| :--------------- | -----: | -----: | ------: | ------: |
-| kobest_boolq     |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_copa      |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |    0.0 |    0.0 |     0.0 |     0.0 |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**

 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |        0-shot |         5-shot |        10-shot |        50-shot |
+| :--------------- | ------------: | -------------: | -------------: | -------------: |
+| kobest_boolq     |      0.501449 |       0.668845 |       0.652565 |       0.655491 |
+| kobest_copa      |      0.635474 |       0.685637 |       0.708601 |       0.725683 |
+| kobest_hellaswag |      0.417966 |       0.442942 |       0.428077 |       0.425199 |
+| kobest_sentineg  |      0.681941 |       0.880517 |       0.921754 |       0.939528 |
+| **Average**      | **0.5592075** | **0.66948525** | **0.67774925** | **0.68647525** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**