Adzka commited on
Commit
c92d4d5
·
verified ·
1 Parent(s): f176c04

Adzka/reward-model-distilbert-indo

Browse files
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [w11wo/indonesian-roberta-base-sentiment-classifier](https://huggingface.co/w11wo/indonesian-roberta-base-sentiment-classifier) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.3758
21
- - Accuracy: 0.8387
22
 
23
  ## Model description
24
 
@@ -38,7 +38,7 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 1e-05
41
- - train_batch_size: 8
42
  - eval_batch_size: 8
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -50,12 +50,18 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | 0.7011 | 1.32 | 50 | 0.6762 | 0.7634 |
54
- | 0.6657 | 2.63 | 100 | 0.6092 | 0.7849 |
55
- | 0.5358 | 3.95 | 150 | 0.4786 | 0.8065 |
56
- | 0.4035 | 5.26 | 200 | 0.4114 | 0.8387 |
57
- | 0.3018 | 6.58 | 250 | 0.3800 | 0.8280 |
58
- | 0.2811 | 7.89 | 300 | 0.3771 | 0.8387 |
 
 
 
 
 
 
59
 
60
 
61
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [w11wo/indonesian-roberta-base-sentiment-classifier](https://huggingface.co/w11wo/indonesian-roberta-base-sentiment-classifier) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.3029
21
+ - Accuracy: 0.8495
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 1e-05
41
+ - train_batch_size: 4
42
  - eval_batch_size: 8
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
+ | 0.7178 | 0.67 | 50 | 0.6865 | 0.6559 |
54
+ | 0.6865 | 1.33 | 100 | 0.6697 | 0.7742 |
55
+ | 0.6619 | 2.0 | 150 | 0.6232 | 0.8172 |
56
+ | 0.558 | 2.67 | 200 | 0.4934 | 0.8387 |
57
+ | 0.4172 | 3.33 | 250 | 0.4207 | 0.8387 |
58
+ | 0.3574 | 4.0 | 300 | 0.3626 | 0.8387 |
59
+ | 0.2815 | 4.67 | 350 | 0.3869 | 0.8495 |
60
+ | 0.206 | 5.33 | 400 | 0.3372 | 0.8710 |
61
+ | 0.1772 | 6.0 | 450 | 0.3324 | 0.8387 |
62
+ | 0.1368 | 6.67 | 500 | 0.3557 | 0.8387 |
63
+ | 0.1472 | 7.33 | 550 | 0.3380 | 0.8495 |
64
+ | 0.1321 | 8.0 | 600 | 0.3029 | 0.8495 |
65
 
66
 
67
  ### Framework versions
emissions.csv CHANGED
@@ -8,4 +8,6 @@ timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_po
8
  2024-07-02T02:37:28,codecarbon,c808f9e4-e623-478b-8271-5f9ce2969515,293.3309988975525,0.0094089315258563,3.207615820086732e-05,42.5,140.369,11.946327209472656,0.0034626529071066,0.0106610163357489,0.0009721407142205,0.015095809957076,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
9
  2024-07-02T03:19:09,codecarbon,482897bf-c691-4139-8987-40f8add1dd78,1912.4737572669983,0.0001664011673996,8.70083402542768e-08,42.5,89.17500000000001,11.946327209472656,0.0225756706554028,0.0410850229362131,0.0063375658472673,0.0699982594388833,Canada,CAN,quebec,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,-71.2,46.8,31.85687255859375,machine,N,1.0
10
  2024-07-02T03:41:16,codecarbon,e060212d-0c67-42e6-ab13-f389650267ed,191.3137810230255,0.0060612998185432,3.16825049723612e-05,42.5,132.762,11.946327209472656,0.0022584162228637,0.0068320236280173,0.000634387022621,0.009724826873502,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
11
- 2024-07-02T03:53:08,codecarbon,07bdaa14-8200-4f88-a412-35d46438959b,193.9683403968811,0.006144823313460226,3.167951687830718e-05,42.5,126.86800000000001,11.946327209472656,0.0022896968733933237,0.006926212681125469,0.0006429234813995617,0.009858833035918352,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
 
 
 
8
  2024-07-02T02:37:28,codecarbon,c808f9e4-e623-478b-8271-5f9ce2969515,293.3309988975525,0.0094089315258563,3.207615820086732e-05,42.5,140.369,11.946327209472656,0.0034626529071066,0.0106610163357489,0.0009721407142205,0.015095809957076,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
9
  2024-07-02T03:19:09,codecarbon,482897bf-c691-4139-8987-40f8add1dd78,1912.4737572669983,0.0001664011673996,8.70083402542768e-08,42.5,89.17500000000001,11.946327209472656,0.0225756706554028,0.0410850229362131,0.0063375658472673,0.0699982594388833,Canada,CAN,quebec,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,-71.2,46.8,31.85687255859375,machine,N,1.0
10
  2024-07-02T03:41:16,codecarbon,e060212d-0c67-42e6-ab13-f389650267ed,191.3137810230255,0.0060612998185432,3.16825049723612e-05,42.5,132.762,11.946327209472656,0.0022584162228637,0.0068320236280173,0.000634387022621,0.009724826873502,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
11
+ 2024-07-02T03:53:08,codecarbon,07bdaa14-8200-4f88-a412-35d46438959b,193.9683403968811,0.0061448233134602,3.167951687830718e-05,42.5,126.868,11.946327209472656,0.0022896968733933,0.0069262126811254,0.0006429234813995,0.0098588330359183,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
12
+ 2024-07-02T04:03:29,codecarbon,1cb60c6b-bfa0-4343-9feb-3f4203cb7993,185.441422700882,0.0060189791103018,3.245757621268105e-05,42.5,133.076,11.946327209472656,0.0021889652694265,0.0068533990425764,0.0006145626764691,0.009656926988472,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
13
+ 2024-07-02T04:09:58,codecarbon,7fbb69fc-2168-48d7-bf3a-d15bc3dcb7e4,228.77361035346985,0.007312426914619352,3.196359450428389e-05,42.5,144.369,11.946327209472656,0.0027004526255859276,0.008273503940619166,0.0007581946057692721,0.011732151171974362,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3424cd0cc876a80f0480d7f2545c48fb1d939801d6047f9cceac2764ed53d4d1
3
  size 498615900
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54620c9f26a2fa525fef2133e879951a17f4f927b6267d71a7bd20001b88357a
3
  size 498615900
runs/Jul02_04-00-18_DESKTOP-HH0RPGN/events.out.tfevents.1719867624.DESKTOP-HH0RPGN.8452.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b44aaf4305700919bfa6bba2ba8a60bb02921569a5a73bf63fc5c6aa956b0f8e
3
+ size 8451
runs/Jul02_04-00-18_DESKTOP-HH0RPGN/events.out.tfevents.1719867811.DESKTOP-HH0RPGN.8452.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4b95acff05e4184089f18b6764fca1a33d38e68c1992123b2b68b5e5f437b76
3
+ size 411
runs/Jul02_04-06-03_DESKTOP-HH0RPGN/events.out.tfevents.1719867969.DESKTOP-HH0RPGN.11720.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a800ee72c2dcc99189f18ef113cf0e1cd34819bf712d5ffb865dff216557150
3
+ size 11655
runs/Jul02_04-06-03_DESKTOP-HH0RPGN/events.out.tfevents.1719868200.DESKTOP-HH0RPGN.11720.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1464aa27519a50e1140c391b14b3eb41ec0ad9be6dce5677f30b34925beb462e
3
+ size 411
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c580b28204255922542df88e8b3c939ace75cdaea2ba0e5d263fc8c370f8d439
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daa72564a01796b2f9b3af6866d7e4140b07a54ffea4f0523dceaaed2ec929e5
3
  size 4920