Push ../models/xlnet/xlnet-base-cased/biored-augmentations-only/ trained on biored-train_160_splits.pt (160 samples)

README.md

@@ -28,12 +28,12 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [xlnet-base-cased](https://huggingface.co/xlnet-base-cased) on the bigbio/biored dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1576
-- Accuracy: 0.9544
-- Precision: 0.8802
-- Recall: 0.858
-- F1: 0.8663
-- Weighted F1: 0.9546
+- Loss: 0.1566
+- Accuracy: 0.9536
+- Precision: 0.8629
+- Recall: 0.8326
+- F1: 0.8434
+- Weighted F1: 0.9537
 
 ## Model description
 
@@ -64,14 +64,15 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     | Weighted F1 |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|:-----------:|
-| No log        | 1.0   | 20   | 0.2001          | 0.9348   | 0.8286    | 0.7628 | 0.791  | 0.9332      |
-| No log        | 2.0   | 40   | 0.1961          | 0.9367   | 0.7938    | 0.8119 | 0.8015 | 0.9365      |
-| No log        | 3.0   | 60   | 0.1902          | 0.9422   | 0.8297    | 0.8124 | 0.8202 | 0.9416      |
-| No log        | 4.0   | 80   | 0.1948          | 0.9426   | 0.8323    | 0.8226 | 0.8269 | 0.9422      |
-| No log        | 5.0   | 100  | 0.1969          | 0.9429   | 0.8152    | 0.8279 | 0.8208 | 0.9431      |
-| No log        | 6.0   | 120  | 0.2071          | 0.9426   | 0.8194    | 0.8324 | 0.8257 | 0.943       |
-| No log        | 7.0   | 140  | 0.2024          | 0.9455   | 0.8244    | 0.8284 | 0.8258 | 0.9453      |
-| No log        | 8.0   | 160  | 0.2143          | 0.9451   | 0.8241    | 0.8294 | 0.8257 | 0.9449      |
+| No log        | 1.0   | 20   | 0.2106          | 0.9319   | 0.8365    | 0.7555 | 0.7918 | 0.9299      |
+| No log        | 2.0   | 40   | 0.2015          | 0.9358   | 0.8014    | 0.8012 | 0.7993 | 0.9352      |
+| No log        | 3.0   | 60   | 0.1974          | 0.9409   | 0.8459    | 0.81   | 0.8264 | 0.9401      |
+| No log        | 4.0   | 80   | 0.1952          | 0.9433   | 0.8383    | 0.8176 | 0.8272 | 0.9425      |
+| No log        | 5.0   | 100  | 0.2013          | 0.9438   | 0.8469    | 0.8162 | 0.8294 | 0.9434      |
+| No log        | 6.0   | 120  | 0.2012          | 0.9435   | 0.8362    | 0.8135 | 0.8237 | 0.9432      |
+| No log        | 7.0   | 140  | 0.2048          | 0.9459   | 0.8293    | 0.8071 | 0.8173 | 0.945       |
+| No log        | 8.0   | 160  | 0.2070          | 0.9454   | 0.8142    | 0.8132 | 0.8126 | 0.9449      |
+| No log        | 9.0   | 180  | 0.2163          | 0.9456   | 0.8528    | 0.8063 | 0.8279 | 0.9447      |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:38a73cc9e217b8b60675df8c2a4c0c5733837592ce2ce1f85fa2e0f7e71265f7
+oid sha256:a39129a1e35bd14817649d6d7f94cadd8b7fd3fefa16150ea2ebaaf1b1234ae5
 size 466917412

tokenizer_config.json

@@ -87,10 +87,7 @@
   "mask_token": "<mask>",
   "max_length": 512,
   "model_max_length": 512,
-  "pad_to_multiple_of": null,
   "pad_token": "<pad>",
-  "pad_token_type_id": 3,
-  "padding_side": "left",
   "remove_space": true,
   "sep_token": "<sep>",
   "stride": 0,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:015e17f0f2bafab9d81d61e5dfd4433b10c65c6fda6d23e857668b07ec8838d2
+oid sha256:4e5c25480ca66373a3cbd7b1912b5708cfe2e518148121dd5886d075fbab6110
 size 4219