End of training

README.md

@@ -11,14 +11,14 @@ probably proofread and complete it, then remove this comment. -->
 
 # layoutlm-funsd-sequence-tf
 
-This model is a fine-tuned version of [karthikeya55/layout_lm_fine_tune_funsd_dataset](https://huggingface.co/karthikeya55/layout_lm_fine_tune_funsd_dataset) on an unknown dataset.
+This model is a fine-tuned version of [microsoft/layoutlm-base-uncased](https://huggingface.co/microsoft/layoutlm-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 0.0611
-- Validation Loss: 0.8456
-- Train Overall Precision: 0.7485
-- Train Overall Recall: 0.8033
-- Train Overall F1: 0.7749
-- Train Overall Accuracy: 0.8185
+- Train Loss: 0.2348
+- Validation Loss: 0.6737
+- Train Overall Precision: 0.7356
+- Train Overall Recall: 0.7998
+- Train Overall F1: 0.7663
+- Train Overall Accuracy: 0.8220
 - Epoch: 7
 
 ## Model description
@@ -38,21 +38,21 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 3e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- optimizer: {'inner_optimizer': {'class_name': 'AdamWeightDecay', 'config': {'name': 'AdamWeightDecay', 'learning_rate': 3e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}}, 'dynamic': True, 'initial_scale': 32768.0, 'dynamic_growth_steps': 2000}
 - training_precision: mixed_float16
 
 ### Training results
 
 | Train Loss | Validation Loss | Train Overall Precision | Train Overall Recall | Train Overall F1 | Train Overall Accuracy | Epoch |
 |:----------:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:----------------------:|:-----:|
-| 0.2305     | 0.7086          | 0.7410                  | 0.7968               | 0.7679           | 0.8113                 | 0     |
-| 0.1870     | 0.6923          | 0.7435                  | 0.8073               | 0.7741           | 0.8140                 | 1     |
-| 0.1411     | 0.7292          | 0.7487                  | 0.8088               | 0.7776           | 0.8134                 | 2     |
-| 0.1163     | 0.7648          | 0.7588                  | 0.8144               | 0.7856           | 0.8119                 | 3     |
-| 0.1033     | 0.8033          | 0.7460                  | 0.8048               | 0.7743           | 0.8119                 | 4     |
-| 0.0805     | 0.8018          | 0.7277                  | 0.8058               | 0.7648           | 0.8082                 | 5     |
-| 0.0718     | 0.8344          | 0.7521                  | 0.8128               | 0.7813           | 0.8203                 | 6     |
-| 0.0611     | 0.8456          | 0.7485                  | 0.8033               | 0.7749           | 0.8185                 | 7     |
+| 1.7150     | 1.4139          | 0.2373                  | 0.2860               | 0.2594           | 0.4954                 | 0     |
+| 1.1803     | 0.9205          | 0.5676                  | 0.6322               | 0.5981           | 0.7008                 | 1     |
+| 0.7884     | 0.7100          | 0.6202                  | 0.7250               | 0.6685           | 0.7735                 | 2     |
+| 0.5877     | 0.6476          | 0.6689                  | 0.7662               | 0.7142           | 0.7942                 | 3     |
+| 0.4490     | 0.6179          | 0.7133                  | 0.8078               | 0.7576           | 0.8066                 | 4     |
+| 0.3746     | 0.6305          | 0.7176                  | 0.7878               | 0.7510           | 0.8129                 | 5     |
+| 0.3082     | 0.6924          | 0.7163                  | 0.8018               | 0.7566           | 0.7937                 | 6     |
+| 0.2348     | 0.6737          | 0.7356                  | 0.7998               | 0.7663           | 0.8220                 | 7     |
 
 
 ### Framework versions

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "karthikeya55/layout_lm_fine_tune_funsd_dataset",
+  "_name_or_path": "microsoft/layoutlm-base-uncased",
   "architectures": [
     "LayoutLMForTokenClassification"
   ],

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bbe85a98cda75399e901b982b0347e4079bf9d9b326734695f4a19723d518c5f
+oid sha256:e14477d5f65e179e4682116bf5eb7b6ce423a36c4ce81ad05a504fdd146f844e
 size 450829256