lingdoc commited on
Commit
f5b5398
·
verified ·
1 Parent(s): 817178e

Update README.md

Browse files

updated model results

Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -33,7 +33,7 @@ and found at [implicitmotives.com](https://implicitmotives.com). The classifier
33
  presence of implicit motive imagery in sentences, namely the three felt needs for Power, Achievement,
34
  and Affiliation.
35
 
36
- The current classifier is finetuned from ELECTRA-base and achieves > 0.91 ICC on the
37
  Winter (1994) training data (see the [OSF repo](https://osf.io/aurwb/) for the benchmark dataset).
38
  Development of this classifier is ongoing, and the current version has been trained on a larger and
39
  more diverse dataset, which means it generalizes better to unseen data.
@@ -46,16 +46,16 @@ like to use this model commercially, get in touch with us for access to our most
46
  Predictions on Winter manual dataset
47
  -----
48
  Intra-class Correlation Coefficient:
49
- | Pow (Label_0): | 0.91799 |
50
- | Ach (Label_1): | 0.92512 |
51
- | Aff (Label_2): | 0.89165 |
52
- | mean: | 0.91147 |
53
 
54
  Pearson correlations:
55
- | Pow (Label_0): 0.8485 |
56
- | Ach (Label_1): 0.86187 |
57
- | Aff (Label_2): 0.80574 |
58
- | mean: 0.83836 |
59
 
60
  ```
61
 
 
33
  presence of implicit motive imagery in sentences, namely the three felt needs for Power, Achievement,
34
  and Affiliation.
35
 
36
+ The current classifier is finetuned from ELECTRA-base and achieves > 0.90 ICC on the
37
  Winter (1994) training data (see the [OSF repo](https://osf.io/aurwb/) for the benchmark dataset).
38
  Development of this classifier is ongoing, and the current version has been trained on a larger and
39
  more diverse dataset, which means it generalizes better to unseen data.
 
46
  Predictions on Winter manual dataset
47
  -----
48
  Intra-class Correlation Coefficient:
49
+ | Pow (Label_0): | 0.90469 |
50
+ | Ach (Label_1): | 0.93134 |
51
+ | Aff (Label_2): | 0.88893 |
52
+ | mean: | 0.90815 |
53
 
54
  Pearson correlations:
55
+ | Pow (Label_0): 0.81604 |
56
+ | Ach (Label_1): 0.85726 |
57
+ | Aff (Label_2): 0.77257 |
58
+ | mean: 0.81455 |
59
 
60
  ```
61