model update
Browse files
README.md
CHANGED
@@ -91,7 +91,7 @@ model-index:
|
|
91 |
metrics:
|
92 |
- name: Accuracy
|
93 |
type: accuracy
|
94 |
-
value: 0.
|
95 |
- task:
|
96 |
name: Analogy Questions (TREX Analogy)
|
97 |
type: multiple-choice-qa
|
@@ -102,7 +102,7 @@ model-index:
|
|
102 |
metrics:
|
103 |
- name: Accuracy
|
104 |
type: accuracy
|
105 |
-
value: 0.
|
106 |
- task:
|
107 |
name: Lexical Relation Classification (BLESS)
|
108 |
type: classification
|
@@ -186,8 +186,8 @@ This model achieves the following results on the relation understanding tasks:
|
|
186 |
- Accuracy on U2: 0.6710526315789473
|
187 |
- Accuracy on U4: 0.6643518518518519
|
188 |
- Accuracy on Google: 0.92
|
189 |
-
- Accuracy on ConceptNet Analogy: 0.
|
190 |
-
- Accuracy on T-Rex Analogy: 0.
|
191 |
- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-triplet-c-semeval2012/raw/main/classification.json)):
|
192 |
- Micro F1 score on BLESS: 0.9025161970769926
|
193 |
- Micro F1 score on CogALexV: 0.8798122065727699
|
|
|
91 |
metrics:
|
92 |
- name: Accuracy
|
93 |
type: accuracy
|
94 |
+
value: 0.3196308724832215
|
95 |
- task:
|
96 |
name: Analogy Questions (TREX Analogy)
|
97 |
type: multiple-choice-qa
|
|
|
102 |
metrics:
|
103 |
- name: Accuracy
|
104 |
type: accuracy
|
105 |
+
value: 0.45901639344262296
|
106 |
- task:
|
107 |
name: Lexical Relation Classification (BLESS)
|
108 |
type: classification
|
|
|
186 |
- Accuracy on U2: 0.6710526315789473
|
187 |
- Accuracy on U4: 0.6643518518518519
|
188 |
- Accuracy on Google: 0.92
|
189 |
+
- Accuracy on ConceptNet Analogy: 0.3196308724832215
|
190 |
+
- Accuracy on T-Rex Analogy: 0.45901639344262296
|
191 |
- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-triplet-c-semeval2012/raw/main/classification.json)):
|
192 |
- Micro F1 score on BLESS: 0.9025161970769926
|
193 |
- Micro F1 score on CogALexV: 0.8798122065727699
|