Hugging Face's logo

CVR123
/
Muril-base-finetune-Tamil-qc

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
CVR123 commited on
Commit
651ad28
•
1 Parent(s): f7ced65

MuRIL_for_TamilQC

Browse files
Files changed (6) hide show
  1. README.md +20 -20
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. runs/Apr23_11-15-01_2a5b8b93632b/events.out.tfevents.1713870917.2a5b8b93632b.34.7 +3 -0
  5. runs/Apr23_11-28-50_2a5b8b93632b/events.out.tfevents.1713871746.2a5b8b93632b.34.8 +3 -0
  6. training_args.bin +2 -2
README.md CHANGED
@@ -18,11 +18,11 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [google/muril-large-cased](https://huggingface.co/google/muril-large-cased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6739
22
- - Precision: 0.9145
23
- - Recall: 0.9130
24
- - Accuracy: 0.9130
25
- - F1-score: 0.9135
26
 
27
  ## Model description
28
 
@@ -41,7 +41,7 @@ More information needed
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
- - learning_rate: 5e-05
45
  - train_batch_size: 32
46
  - eval_batch_size: 32
47
  - seed: 42
@@ -53,21 +53,21 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | Accuracy | F1-score |
55
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:--------:|:--------:|
56
- | 0.6155 | 1.0 | 155 | 0.3583 | 0.8905 | 0.8887 | 0.8887 | 0.8889 |
57
- | 0.2625 | 2.0 | 310 | 0.4334 | 0.8741 | 0.8623 | 0.8623 | 0.8618 |
58
- | 0.1603 | 3.0 | 465 | 0.4511 | 0.8890 | 0.8866 | 0.8866 | 0.8862 |
59
- | 0.0885 | 4.0 | 620 | 0.4819 | 0.9087 | 0.9028 | 0.9028 | 0.9034 |
60
- | 0.0541 | 5.0 | 775 | 0.6202 | 0.8934 | 0.8927 | 0.8927 | 0.8929 |
61
- | 0.0207 | 6.0 | 930 | 0.6179 | 0.9117 | 0.9089 | 0.9089 | 0.9093 |
62
- | 0.0152 | 7.0 | 1085 | 0.6444 | 0.9060 | 0.9049 | 0.9049 | 0.9053 |
63
- | 0.0057 | 8.0 | 1240 | 0.6534 | 0.9120 | 0.9109 | 0.9109 | 0.9114 |
64
- | 0.0039 | 9.0 | 1395 | 0.6734 | 0.9146 | 0.9130 | 0.9130 | 0.9136 |
65
- | 0.0039 | 10.0 | 1550 | 0.6739 | 0.9145 | 0.9130 | 0.9130 | 0.9135 |
66
 
67
 
68
  ### Framework versions
69
 
70
- - Transformers 4.40.0
71
- - Pytorch 2.2.1+cu121
72
- - Datasets 2.19.0
73
- - Tokenizers 0.19.1
 
18
 
19
  This model is a fine-tuned version of [google/muril-large-cased](https://huggingface.co/google/muril-large-cased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.7585
22
+ - Precision: 0.8899
23
+ - Recall: 0.8887
24
+ - Accuracy: 0.8887
25
+ - F1-score: 0.8892
26
 
27
  ## Model description
28
 
 
41
  ### Training hyperparameters
42
 
43
  The following hyperparameters were used during training:
44
+ - learning_rate: 2e-05
45
  - train_batch_size: 32
46
  - eval_batch_size: 32
47
  - seed: 42
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | Accuracy | F1-score |
55
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:--------:|:--------:|
56
+ | 0.7778 | 1.0 | 155 | 0.4237 | 0.8573 | 0.8664 | 0.8664 | 0.8605 |
57
+ | 0.2769 | 2.0 | 310 | 0.3965 | 0.8789 | 0.8765 | 0.8765 | 0.8769 |
58
+ | 0.1657 | 3.0 | 465 | 0.4423 | 0.8889 | 0.8866 | 0.8866 | 0.8870 |
59
+ | 0.0975 | 4.0 | 620 | 0.5887 | 0.8824 | 0.8785 | 0.8785 | 0.8798 |
60
+ | 0.067 | 5.0 | 775 | 0.6212 | 0.8882 | 0.8846 | 0.8846 | 0.8858 |
61
+ | 0.034 | 6.0 | 930 | 0.6018 | 0.8948 | 0.8927 | 0.8927 | 0.8934 |
62
+ | 0.0249 | 7.0 | 1085 | 0.7035 | 0.8902 | 0.8887 | 0.8887 | 0.8893 |
63
+ | 0.0206 | 8.0 | 1240 | 0.7113 | 0.8936 | 0.8927 | 0.8927 | 0.8931 |
64
+ | 0.0122 | 9.0 | 1395 | 0.7400 | 0.8899 | 0.8887 | 0.8887 | 0.8892 |
65
+ | 0.0043 | 10.0 | 1550 | 0.7585 | 0.8899 | 0.8887 | 0.8887 | 0.8892 |
66
 
67
 
68
  ### Framework versions
69
 
70
+ - Transformers 4.39.3
71
+ - Pytorch 2.1.2
72
+ - Datasets 2.18.0
73
+ - Tokenizers 0.15.2
config.json CHANGED
@@ -36,7 +36,7 @@
36
  "position_embedding_type": "absolute",
37
  "problem_type": "single_label_classification",
38
  "torch_dtype": "float32",
39
- "transformers_version": "4.40.0",
40
  "type_vocab_size": 2,
41
  "use_cache": true,
42
  "vocab_size": 197285
 
36
  "position_embedding_type": "absolute",
37
  "problem_type": "single_label_classification",
38
  "torch_dtype": "float32",
39
+ "transformers_version": "4.39.3",
40
  "type_vocab_size": 2,
41
  "use_cache": true,
42
  "vocab_size": 197285
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:59f90ce6358023d1894bb6b7c826df3bfc5faf79b62c2373202361ca7c5ab73e
3
  size 2023700848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d22b6b25dd26da3ea8e5ab72fd63c440f18216dfb9e8954acc7c71e317a28619
3
  size 2023700848
runs/Apr23_11-15-01_2a5b8b93632b/events.out.tfevents.1713870917.2a5b8b93632b.34.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f0ef32f7ab3433341a9c9432831055217359a990b8806153f61987e606b0d76
3
+ size 12156
runs/Apr23_11-28-50_2a5b8b93632b/events.out.tfevents.1713871746.2a5b8b93632b.34.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad1b3bdb6ec58de05cd4ddc48b30a0e0cba10ad947622bf7b8f13e14533edadc
3
+ size 12156
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96eb1ad978430a32168c7ca305381619968f45ba84a149347ec9980d10888b41
3
- size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b50e85637e210e00f646cb0557d91a774acb13116554e782fad9fc02b733386b
3
+ size 4920