Training in progress epoch 0

README.md

@@ -0,0 +1,54 @@
+---
+license: apache-2.0
+tags:
+- generated_from_keras_callback
+model-index:
+- name: Anthos23/distilbert-base-uncased-finetuned-sst2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information Keras had access to. You should
+probably proofread and complete it, then remove this comment. -->
+
+# Anthos23/distilbert-base-uncased-finetuned-sst2
+
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Train Loss: 0.2101
+- Validation Loss: 0.2373
+- Train Accuracy: 0.9083
+- Epoch: 0
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 21045, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
+- training_precision: float32
+
+### Training results
+
+| Train Loss | Validation Loss | Train Accuracy | Epoch |
+|:----------:|:---------------:|:--------------:|:-----:|
+| 0.2101     | 0.2373          | 0.9083         | 0     |
+
+
+### Framework versions
+
+- Transformers 4.17.0.dev0
+- TensorFlow 2.5.0
+- Datasets 1.18.3
+- Tokenizers 0.11.0

config.json

@@ -0,0 +1,23 @@
+{
+  "_name_or_path": "distilbert-base-uncased",
+  "activation": "gelu",
+  "architectures": [
+    "DistilBertForSequenceClassification"
+  ],
+  "attention_dropout": 0.1,
+  "dim": 768,
+  "dropout": 0.1,
+  "hidden_dim": 3072,
+  "initializer_range": 0.02,
+  "max_position_embeddings": 512,
+  "model_type": "distilbert",
+  "n_heads": 12,
+  "n_layers": 6,
+  "pad_token_id": 0,
+  "qa_dropout": 0.1,
+  "seq_classif_dropout": 0.2,
+  "sinusoidal_pos_embds": false,
+  "tie_weights_": true,
+  "transformers_version": "4.17.0.dev0",
+  "vocab_size": 30522
+}

logs/train/events.out.tfevents.1645460825.sentiment-analysis-tests.19711.2622.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bb9b0453dc6f974e87699bd2999c5eed9789df468a2407279642fc8e098ddbc
+size 1511299

logs/train/events.out.tfevents.1645460841.sentiment-analysis-tests.profile-empty

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64444f478c1068abd783b01f7a7383a4830525d4fcc15324f7b52c907e27175f
+size 40

logs/train/plugins/profile/2022_02_21_16_27_21/sentiment-analysis-tests.input_pipeline.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a89052c081ede4f9635e2a199ccce8c91709c2281d81bf847eeca74e945793aa
+size 3058

logs/train/plugins/profile/2022_02_21_16_27_21/sentiment-analysis-tests.memory_profile.json.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee89330712a5dd3baf5485f7e0a89fca67ecac77e3482a2b27e1a529f3e5b5d9
+size 73

logs/train/plugins/profile/2022_02_21_16_27_21/sentiment-analysis-tests.overview_page.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f8f371185a6fffed13e5c089c06849c465d15f9d49c39a1c2072c1f38111e515
+size 4114

logs/train/plugins/profile/2022_02_21_16_27_21/sentiment-analysis-tests.tensorflow_stats.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fbb3bc78c7283a65cbe5e8feb7a00a499d34a24acaca982b169d490d3823c1dd
+size 188390

logs/train/plugins/profile/2022_02_21_16_27_21/sentiment-analysis-tests.trace.json.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23443e7c6fa8655447995df3ee9ad82e22f77fd92074d31734410813a8475439
+size 49915

logs/train/plugins/profile/2022_02_21_16_27_21/sentiment-analysis-tests.xplane.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c6c58f821fbe644a2687e8711f019903b7a9047a84c2c333d7254f612022579c
+size 289008

logs/validation/events.out.tfevents.1645467599.sentiment-analysis-tests.19711.29354.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7af0257d618ae7e6073e0fc9484f1bdc0d226436223d28bfb4910385fa3a8d90
+size 154

special_tokens_map.json

@@ -0,0 +1 @@
+{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}

tf_model.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a632016ae1982c81da728bd4cb20d64237a6cd23957b4ec73910c0c03cc0ff3
+size 267951896

tokenizer_config.json

@@ -0,0 +1 @@
+{"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "distilbert-base-uncased", "tokenizer_class": "DistilBertTokenizer"}