oneonlee
/

LDCC-SOLAR-gugutypus-10.7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

oneonlee commited on Feb 12

Commit

aa3fc92

•

1 Parent(s): e34cc8f

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -51,15 +51,15 @@ pipeline_tag: text-generation
 |          Tasks          |Version|Filter|n-shot|Metric|Value |   |Stderr|
 |-------------------------|-------|------|-----:|------|-----:|---|-----:|
-|KMMLU                    |N/A    |none  |     0|acc   |      |±  |      |
 |KMMLU                    |N/A    |none  |     5|acc   |0.3969|±  |0.0816|
 |KoBEST-HellaSwag         |      0|none  |     0|acc   |0.4260|±  |0.0221|
-|KoBEST-HellaSwag         |      0|none  |     5|acc   |      |±  |      |
 |KoBEST-BoolQ             |      0|none  |     0|acc   |0.7792|±  |0.0111|
 |KoBEST-BoolQ             |      0|none  |     5|acc   |0.8925|±  |0.0083|
 |KoBEST-COPA              |      0|none  |     0|acc   |0.6670|±  |0.0149|
 |KoBEST-COPA              |      0|none  |     5|acc   |0.7070|±  |0.0144|
-|KoBEST-SentiNeg          |      0|none  |     0|acc   |      |±  |      |
 |KoBEST-SentiNeg          |      0|none  |     5|acc   |0.9219|±  |0.0135|
 <br>
@@ -77,7 +77,7 @@ pipeline_tag: text-generation
 |COPA              |      1|none  |     0|acc   |0.8300|±  |0.0378|
 |COPA              |      1|none  |     5|acc   |0.9300|±  |0.0256|
 |truthfulqa        |N/A    |none  |     0|acc   |0.4249|±  |0.0023|
-|truthfulqa        |N/A    |none  |     5|acc   |      |±  |      |
 ---

 |          Tasks          |Version|Filter|n-shot|Metric|Value |   |Stderr|
 |-------------------------|-------|------|-----:|------|-----:|---|-----:|
+|KMMLU                    |N/A    |none  |     0|acc   |0.3329|±  |0.0794|
 |KMMLU                    |N/A    |none  |     5|acc   |0.3969|±  |0.0816|
 |KoBEST-HellaSwag         |      0|none  |     0|acc   |0.4260|±  |0.0221|
+|KoBEST-HellaSwag         |      0|none  |     5|acc   |0.4260|±  |0.0221|
 |KoBEST-BoolQ             |      0|none  |     0|acc   |0.7792|±  |0.0111|
 |KoBEST-BoolQ             |      0|none  |     5|acc   |0.8925|±  |0.0083|
 |KoBEST-COPA              |      0|none  |     0|acc   |0.6670|±  |0.0149|
 |KoBEST-COPA              |      0|none  |     5|acc   |0.7070|±  |0.0144|
+|KoBEST-SentiNeg          |      0|none  |     0|acc   |0.7582|±  |0.0215|
 |KoBEST-SentiNeg          |      0|none  |     5|acc   |0.9219|±  |0.0135|
 <br>
 |COPA              |      1|none  |     0|acc   |0.8300|±  |0.0378|
 |COPA              |      1|none  |     5|acc   |0.9300|±  |0.0256|
 |truthfulqa        |N/A    |none  |     0|acc   |0.4249|±  |0.0023|
+|truthfulqa        |N/A    |none  |     5|acc   |  -   |±  |   -  |
 ---