End of training

README.md

@@ -0,0 +1,88 @@
+---
+license: apache-2.0
+base_model: Twitter/twhin-bert-large
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- f1
+model-index:
+- name: financial-twhin-bert-large-3labels-tt
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# financial-twhin-bert-large-3labels-tt
+
+This model is a fine-tuned version of [Twitter/twhin-bert-large](https://huggingface.co/Twitter/twhin-bert-large) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4655
+- Accuracy: 0.8033
+- F1: 0.7707
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1.6446264239848265e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 2
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
+| 0.9671        | 0.08  | 100  | 0.9526          | 0.6772   | 0.5469 |
+| 0.8284        | 0.15  | 200  | 0.6263          | 0.7190   | 0.6712 |
+| 0.69          | 0.23  | 300  | 0.6105          | 0.7003   | 0.6022 |
+| 0.7725        | 0.3   | 400  | 0.5843          | 0.7774   | 0.7304 |
+| 0.7058        | 0.38  | 500  | 0.5746          | 0.7774   | 0.7422 |
+| 0.7028        | 0.46  | 600  | 0.6724          | 0.7435   | 0.7204 |
+| 0.7257        | 0.53  | 700  | 0.6853          | 0.6542   | 0.6738 |
+| 0.6422        | 0.61  | 800  | 0.5631          | 0.7702   | 0.7575 |
+| 0.5796        | 0.68  | 900  | 0.6995          | 0.6376   | 0.6359 |
+| 0.6303        | 0.76  | 1000 | 0.7513          | 0.6376   | 0.6475 |
+| 0.5102        | 0.83  | 1100 | 0.6074          | 0.7269   | 0.7073 |
+| 0.589         | 0.91  | 1200 | 0.5675          | 0.7752   | 0.7327 |
+| 0.5131        | 0.99  | 1300 | 0.6960          | 0.5901   | 0.5939 |
+| 0.4298        | 1.06  | 1400 | 0.5223          | 0.7767   | 0.7384 |
+| 0.4798        | 1.14  | 1500 | 0.4950          | 0.7968   | 0.7596 |
+| 0.4033        | 1.21  | 1600 | 0.5231          | 0.7277   | 0.7069 |
+| 0.3675        | 1.29  | 1700 | 0.4929          | 0.7702   | 0.7598 |
+| 0.3561        | 1.37  | 1800 | 0.4951          | 0.7788   | 0.7509 |
+| 0.3933        | 1.44  | 1900 | 0.4655          | 0.8033   | 0.7707 |
+| 0.3836        | 1.52  | 2000 | 0.4898          | 0.7875   | 0.7594 |
+| 0.3925        | 1.59  | 2100 | 0.5211          | 0.7687   | 0.7488 |
+| 0.3484        | 1.67  | 2200 | 0.4916          | 0.7860   | 0.7588 |
+| 0.4128        | 1.75  | 2300 | 0.4786          | 0.7968   | 0.7708 |
+| 0.3847        | 1.82  | 2400 | 0.4803          | 0.7932   | 0.7651 |
+| 0.3146        | 1.9   | 2500 | 0.4805          | 0.7932   | 0.7651 |
+| 0.4201        | 1.97  | 2600 | 0.4799          | 0.7932   | 0.7651 |
+
+
+### Framework versions
+
+- Transformers 4.37.2
+- Pytorch 2.1.0+cu121
+- Datasets 2.17.1
+- Tokenizers 0.15.2

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ed05bde77515e0280eb344618742f763058a11f085bf0b1fa99cf2766f4b55ae
+oid sha256:66441813b8d3cfbcda1cb99140f4ef48dd81b9523d3c20bbbb305bc8fdbc84a6
 size 2245906124

runs/Feb22_18-49-23_8db3dbad1879/events.out.tfevents.1708627764.8db3dbad1879.419.6

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:21ef57d47caddacf7dfe430c8c0c33733d7ed181d6ec3272a2936630148d65a6
-size 16689
+oid sha256:70b1238a318a974e3b43f927b3f7fe9e6d9bda6544a6f62d072bb0d4449f6fa6
+size 18621

runs/Feb22_18-49-23_8db3dbad1879/events.out.tfevents.1708629079.8db3dbad1879.419.7

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc44b05d1374b12811f8d2f8b76ed166859ab72ae98041089281aa6935901161
+size 457