nicolay-r commited on
Commit
b5e059e
1 Parent(s): a55c1b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -31
README.md CHANGED
@@ -7,7 +7,11 @@ license: mit
7
  language:
8
  - en
9
  metrics:
10
- - f1
 
 
 
 
11
  pipeline_tag: text-generation
12
  ---
13
 
@@ -128,58 +132,44 @@ Users (both direct and downstream) should be made aware of the risks, biases and
128
 
129
  ## How to Get Started with the Model
130
 
 
131
 
132
  ## Training Details
133
 
134
  ### Training Data
135
 
136
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
137
 
138
- [More Information Needed]
139
 
140
- ### Training Procedure
141
 
142
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
143
 
144
- #### Preprocessing [optional]
145
-
146
- [More Information Needed]
147
 
 
148
 
149
  #### Training Hyperparameters
150
 
151
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
152
-
153
- #### Speeds, Sizes, Times [optional]
154
-
155
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
156
-
157
- [More Information Needed]
158
-
159
- ## Evaluation
160
-
161
- <!-- This section describes the evaluation protocols and provides the results. -->
162
-
163
- ### Testing Data, Factors & Metrics
164
-
165
- #### Testing Data
166
-
167
- <!-- This should link to a Dataset Card if possible. -->
168
-
169
- [More Information Needed]
170
-
171
- #### Factors
172
 
173
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
174
 
175
  [More Information Needed]
176
 
177
  #### Metrics
178
 
179
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
 
 
 
180
 
181
  [More Information Needed]
182
 
183
  ### Results
184
 
 
185
 
 
 
7
  language:
8
  - en
9
  metrics:
10
+ - f1-strict
11
+ - f1-proportional
12
+ - f1-strict-weighted
13
+ - f1-proportional-weighted
14
+
15
  pipeline_tag: text-generation
16
  ---
17
 
 
132
 
133
  ## How to Get Started with the Model
134
 
135
+ Simply follow the **Direct Use** secion or proceed with the following [GoogleColab notebook](https://github.com/nicolay-r/THOR-ECAC/blob/master/SemEval_2024_Task_3_FlanT5_Finetuned_Model_Usage.ipynb).
136
 
137
  ## Training Details
138
 
139
  ### Training Data
140
 
141
+ We purely rely on the data provided by ECAC-2024 competition organizers.
142
 
143
+ Here is the [related information](https://github.com/nicolay-r/THOR-ECAC?tab=readme-ov-file#datasets) from the github repository.
144
 
145
+ And here is the [code related to data convesations preparation](https://github.com/nicolay-r/SemEval2024-Task3) intented for compiling input data.
146
 
147
+ ### Training Procedure
148
 
149
+ Model has been fine-tuned in two stages:
150
+ 1. THoR-state: The first stage aimed at Emotion states prediction
151
+ 2. THoR-cause-RR: The second aimed at emotion-causes prediction with **reasoning-revision** technique.
152
 
153
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e62d11d27a8292c3637f86/RCKexEPPE_RfstMsL-PbY.png)
154
 
155
  #### Training Hyperparameters
156
 
157
+ - **Training regime:** temperature 1.0, learning-rate 2*10^(-4), AdamW optimizer, batch-size 32, NVidia-A100 (40GB)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
158
 
 
159
 
160
  [More Information Needed]
161
 
162
  #### Metrics
163
 
164
+ - f1-strict
165
+ - f1-proportional
166
+ - f1-strict-weighted
167
+ - f1-proportional-weighted
168
 
169
  [More Information Needed]
170
 
171
  ### Results
172
 
173
+ Results are depicted in image below in a **gray-highlighted row**.
174
 
175
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e62d11d27a8292c3637f86/yfbkw2iMgY5fp54Zohe32.png)