Training in progress epoch 0

README.md

@@ -14,9 +14,9 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 5.1722
-- Validation Loss: 0.0
-- Epoch: 1
+- Train Loss: 5.7158
+- Validation Loss: 5.0214
+- Epoch: 0
 
 ## Model description
 
@@ -42,13 +42,12 @@ The following hyperparameters were used during training:
 
 | Train Loss | Validation Loss | Epoch |
 |:----------:|:---------------:|:-----:|
-| 5.9918     | 0.0             | 0     |
-| 5.1722     | 0.0             | 1     |
+| 5.7158     | 5.0214          | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.15.0
+- Transformers 4.21.0
 - TensorFlow 2.8.2
-- Datasets 2.3.2
-- Tokenizers 0.10.3
+- Datasets 2.4.0
+- Tokenizers 0.12.1

config.json

@@ -18,6 +18,6 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "transformers_version": "4.15.0",
+  "transformers_version": "4.21.0",
   "vocab_size": 30522
 }

logs/train/events.out.tfevents.1658930508.eeb9f88a7144.70.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e95f7a477f43a8e5d7c12ec7b2226a81fda753907254a25968d23734f7fa5fc
+size 181

logs/validation/events.out.tfevents.1658930514.eeb9f88a7144.70.1.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:14fc40099e78e0c3d901fb00ec38bef3c385add2d0bcd7bec96572ea8bacf90b
+size 193

special_tokens_map.json

@@ -1 +1,7 @@
-{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:75b3b09b246bee43f1ce4afd83963dd95389c7b84ec7bc3f60f5a79b4d7e394b
-size 265583656
+oid sha256:c504d0326f6b01a99a6963236cf3c21c130ef77a4e7971b36e61fb56b8cd4083
+size 265583688

tokenizer_config.json

@@ -1 +1,14 @@
-{"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "distilbert-base-uncased", "tokenizer_class": "DistilBertTokenizer"}
+{
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "name_or_path": "distilbert-base-uncased",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "special_tokens_map_file": null,
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "DistilBertTokenizer",
+  "unk_token": "[UNK]"
+}