Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,11 @@ license: mit
|
|
7 |
language:
|
8 |
- en
|
9 |
metrics:
|
10 |
-
- f1
|
|
|
|
|
|
|
|
|
11 |
pipeline_tag: text-generation
|
12 |
---
|
13 |
|
@@ -128,58 +132,44 @@ Users (both direct and downstream) should be made aware of the risks, biases and
|
|
128 |
|
129 |
## How to Get Started with the Model
|
130 |
|
|
|
131 |
|
132 |
## Training Details
|
133 |
|
134 |
### Training Data
|
135 |
|
136 |
-
|
137 |
|
138 |
-
[
|
139 |
|
140 |
-
|
141 |
|
142 |
-
|
143 |
|
144 |
-
|
145 |
-
|
146 |
-
|
147 |
|
|
|
148 |
|
149 |
#### Training Hyperparameters
|
150 |
|
151 |
-
- **Training regime:**
|
152 |
-
|
153 |
-
#### Speeds, Sizes, Times [optional]
|
154 |
-
|
155 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
156 |
-
|
157 |
-
[More Information Needed]
|
158 |
-
|
159 |
-
## Evaluation
|
160 |
-
|
161 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
162 |
-
|
163 |
-
### Testing Data, Factors & Metrics
|
164 |
-
|
165 |
-
#### Testing Data
|
166 |
-
|
167 |
-
<!-- This should link to a Dataset Card if possible. -->
|
168 |
-
|
169 |
-
[More Information Needed]
|
170 |
-
|
171 |
-
#### Factors
|
172 |
|
173 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
174 |
|
175 |
[More Information Needed]
|
176 |
|
177 |
#### Metrics
|
178 |
|
179 |
-
|
|
|
|
|
|
|
180 |
|
181 |
[More Information Needed]
|
182 |
|
183 |
### Results
|
184 |
|
|
|
185 |
|
|
|
|
7 |
language:
|
8 |
- en
|
9 |
metrics:
|
10 |
+
- f1-strict
|
11 |
+
- f1-proportional
|
12 |
+
- f1-strict-weighted
|
13 |
+
- f1-proportional-weighted
|
14 |
+
|
15 |
pipeline_tag: text-generation
|
16 |
---
|
17 |
|
|
|
132 |
|
133 |
## How to Get Started with the Model
|
134 |
|
135 |
+
Simply follow the **Direct Use** secion or proceed with the following [GoogleColab notebook](https://github.com/nicolay-r/THOR-ECAC/blob/master/SemEval_2024_Task_3_FlanT5_Finetuned_Model_Usage.ipynb).
|
136 |
|
137 |
## Training Details
|
138 |
|
139 |
### Training Data
|
140 |
|
141 |
+
We purely rely on the data provided by ECAC-2024 competition organizers.
|
142 |
|
143 |
+
Here is the [related information](https://github.com/nicolay-r/THOR-ECAC?tab=readme-ov-file#datasets) from the github repository.
|
144 |
|
145 |
+
And here is the [code related to data convesations preparation](https://github.com/nicolay-r/SemEval2024-Task3) intented for compiling input data.
|
146 |
|
147 |
+
### Training Procedure
|
148 |
|
149 |
+
Model has been fine-tuned in two stages:
|
150 |
+
1. THoR-state: The first stage aimed at Emotion states prediction
|
151 |
+
2. THoR-cause-RR: The second aimed at emotion-causes prediction with **reasoning-revision** technique.
|
152 |
|
153 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e62d11d27a8292c3637f86/RCKexEPPE_RfstMsL-PbY.png)
|
154 |
|
155 |
#### Training Hyperparameters
|
156 |
|
157 |
+
- **Training regime:** temperature 1.0, learning-rate 2*10^(-4), AdamW optimizer, batch-size 32, NVidia-A100 (40GB)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
158 |
|
|
|
159 |
|
160 |
[More Information Needed]
|
161 |
|
162 |
#### Metrics
|
163 |
|
164 |
+
- f1-strict
|
165 |
+
- f1-proportional
|
166 |
+
- f1-strict-weighted
|
167 |
+
- f1-proportional-weighted
|
168 |
|
169 |
[More Information Needed]
|
170 |
|
171 |
### Results
|
172 |
|
173 |
+
Results are depicted in image below in a **gray-highlighted row**.
|
174 |
|
175 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e62d11d27a8292c3637f86/yfbkw2iMgY5fp54Zohe32.png)
|