davidkim205
commited on
Commit
•
16e2101
1
Parent(s):
5bdaebe
Update README.md
Browse files
README.md
CHANGED
@@ -41,6 +41,7 @@ korean multi-task instruction dataset
|
|
41 |
Refer https://github.com/davidkim205/komt
|
42 |
|
43 |
## Evaluation
|
|
|
44 |
|
45 |
| model | score | average(0~5) | percentage |
|
46 |
| --------------------------------------- | ------- | ------------ | ---------- |
|
|
|
41 |
Refer https://github.com/davidkim205/komt
|
42 |
|
43 |
## Evaluation
|
44 |
+
For objective model evaluation, we initially used EleutherAI's lm-evaluation-harness but obtained unsatisfactory results. Consequently, we conducted evaluations using ChatGPT, a widely used model, as described in [Self-Alignment with Instruction Backtranslation](https://arxiv.org/pdf/2308.06502.pdf) and [Three Ways of Using Large Language Models to Evaluate Chat](https://arxiv.org/pdf/2308.06259.pdf) .
|
45 |
|
46 |
| model | score | average(0~5) | percentage |
|
47 |
| --------------------------------------- | ------- | ------------ | ---------- |
|