Adzka/reward-model-distilbert-indo
Browse files- README.md +15 -9
- emissions.csv +3 -1
- model.safetensors +1 -1
- runs/Jul02_04-00-18_DESKTOP-HH0RPGN/events.out.tfevents.1719867624.DESKTOP-HH0RPGN.8452.2 +3 -0
- runs/Jul02_04-00-18_DESKTOP-HH0RPGN/events.out.tfevents.1719867811.DESKTOP-HH0RPGN.8452.3 +3 -0
- runs/Jul02_04-06-03_DESKTOP-HH0RPGN/events.out.tfevents.1719867969.DESKTOP-HH0RPGN.11720.0 +3 -0
- runs/Jul02_04-06-03_DESKTOP-HH0RPGN/events.out.tfevents.1719868200.DESKTOP-HH0RPGN.11720.1 +3 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
17 |
|
18 |
This model is a fine-tuned version of [w11wo/indonesian-roberta-base-sentiment-classifier](https://huggingface.co/w11wo/indonesian-roberta-base-sentiment-classifier) on the None dataset.
|
19 |
It achieves the following results on the evaluation set:
|
20 |
-
- Loss: 0.
|
21 |
-
- Accuracy: 0.
|
22 |
|
23 |
## Model description
|
24 |
|
@@ -38,7 +38,7 @@ More information needed
|
|
38 |
|
39 |
The following hyperparameters were used during training:
|
40 |
- learning_rate: 1e-05
|
41 |
-
- train_batch_size:
|
42 |
- eval_batch_size: 8
|
43 |
- seed: 42
|
44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
@@ -50,12 +50,18 @@ The following hyperparameters were used during training:
|
|
50 |
|
51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
52 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
53 |
-
| 0.
|
54 |
-
| 0.
|
55 |
-
| 0.
|
56 |
-
| 0.
|
57 |
-
| 0.
|
58 |
-
| 0.
|
|
|
|
|
|
|
|
|
|
|
|
|
59 |
|
60 |
|
61 |
### Framework versions
|
|
|
17 |
|
18 |
This model is a fine-tuned version of [w11wo/indonesian-roberta-base-sentiment-classifier](https://huggingface.co/w11wo/indonesian-roberta-base-sentiment-classifier) on the None dataset.
|
19 |
It achieves the following results on the evaluation set:
|
20 |
+
- Loss: 0.3029
|
21 |
+
- Accuracy: 0.8495
|
22 |
|
23 |
## Model description
|
24 |
|
|
|
38 |
|
39 |
The following hyperparameters were used during training:
|
40 |
- learning_rate: 1e-05
|
41 |
+
- train_batch_size: 4
|
42 |
- eval_batch_size: 8
|
43 |
- seed: 42
|
44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
|
|
50 |
|
51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
52 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
53 |
+
| 0.7178 | 0.67 | 50 | 0.6865 | 0.6559 |
|
54 |
+
| 0.6865 | 1.33 | 100 | 0.6697 | 0.7742 |
|
55 |
+
| 0.6619 | 2.0 | 150 | 0.6232 | 0.8172 |
|
56 |
+
| 0.558 | 2.67 | 200 | 0.4934 | 0.8387 |
|
57 |
+
| 0.4172 | 3.33 | 250 | 0.4207 | 0.8387 |
|
58 |
+
| 0.3574 | 4.0 | 300 | 0.3626 | 0.8387 |
|
59 |
+
| 0.2815 | 4.67 | 350 | 0.3869 | 0.8495 |
|
60 |
+
| 0.206 | 5.33 | 400 | 0.3372 | 0.8710 |
|
61 |
+
| 0.1772 | 6.0 | 450 | 0.3324 | 0.8387 |
|
62 |
+
| 0.1368 | 6.67 | 500 | 0.3557 | 0.8387 |
|
63 |
+
| 0.1472 | 7.33 | 550 | 0.3380 | 0.8495 |
|
64 |
+
| 0.1321 | 8.0 | 600 | 0.3029 | 0.8495 |
|
65 |
|
66 |
|
67 |
### Framework versions
|
emissions.csv
CHANGED
@@ -8,4 +8,6 @@ timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_po
|
|
8 |
2024-07-02T02:37:28,codecarbon,c808f9e4-e623-478b-8271-5f9ce2969515,293.3309988975525,0.0094089315258563,3.207615820086732e-05,42.5,140.369,11.946327209472656,0.0034626529071066,0.0106610163357489,0.0009721407142205,0.015095809957076,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
9 |
2024-07-02T03:19:09,codecarbon,482897bf-c691-4139-8987-40f8add1dd78,1912.4737572669983,0.0001664011673996,8.70083402542768e-08,42.5,89.17500000000001,11.946327209472656,0.0225756706554028,0.0410850229362131,0.0063375658472673,0.0699982594388833,Canada,CAN,quebec,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,-71.2,46.8,31.85687255859375,machine,N,1.0
|
10 |
2024-07-02T03:41:16,codecarbon,e060212d-0c67-42e6-ab13-f389650267ed,191.3137810230255,0.0060612998185432,3.16825049723612e-05,42.5,132.762,11.946327209472656,0.0022584162228637,0.0068320236280173,0.000634387022621,0.009724826873502,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
11 |
-
2024-07-02T03:53:08,codecarbon,07bdaa14-8200-4f88-a412-35d46438959b,193.9683403968811,0.
|
|
|
|
|
|
8 |
2024-07-02T02:37:28,codecarbon,c808f9e4-e623-478b-8271-5f9ce2969515,293.3309988975525,0.0094089315258563,3.207615820086732e-05,42.5,140.369,11.946327209472656,0.0034626529071066,0.0106610163357489,0.0009721407142205,0.015095809957076,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
9 |
2024-07-02T03:19:09,codecarbon,482897bf-c691-4139-8987-40f8add1dd78,1912.4737572669983,0.0001664011673996,8.70083402542768e-08,42.5,89.17500000000001,11.946327209472656,0.0225756706554028,0.0410850229362131,0.0063375658472673,0.0699982594388833,Canada,CAN,quebec,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,-71.2,46.8,31.85687255859375,machine,N,1.0
|
10 |
2024-07-02T03:41:16,codecarbon,e060212d-0c67-42e6-ab13-f389650267ed,191.3137810230255,0.0060612998185432,3.16825049723612e-05,42.5,132.762,11.946327209472656,0.0022584162228637,0.0068320236280173,0.000634387022621,0.009724826873502,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
11 |
+
2024-07-02T03:53:08,codecarbon,07bdaa14-8200-4f88-a412-35d46438959b,193.9683403968811,0.0061448233134602,3.167951687830718e-05,42.5,126.868,11.946327209472656,0.0022896968733933,0.0069262126811254,0.0006429234813995,0.0098588330359183,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
12 |
+
2024-07-02T04:03:29,codecarbon,1cb60c6b-bfa0-4343-9feb-3f4203cb7993,185.441422700882,0.0060189791103018,3.245757621268105e-05,42.5,133.076,11.946327209472656,0.0021889652694265,0.0068533990425764,0.0006145626764691,0.009656926988472,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
13 |
+
2024-07-02T04:09:58,codecarbon,7fbb69fc-2168-48d7-bf3a-d15bc3dcb7e4,228.77361035346985,0.007312426914619352,3.196359450428389e-05,42.5,144.369,11.946327209472656,0.0027004526255859276,0.008273503940619166,0.0007581946057692721,0.011732151171974362,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 498615900
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:54620c9f26a2fa525fef2133e879951a17f4f927b6267d71a7bd20001b88357a
|
3 |
size 498615900
|
runs/Jul02_04-00-18_DESKTOP-HH0RPGN/events.out.tfevents.1719867624.DESKTOP-HH0RPGN.8452.2
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b44aaf4305700919bfa6bba2ba8a60bb02921569a5a73bf63fc5c6aa956b0f8e
|
3 |
+
size 8451
|
runs/Jul02_04-00-18_DESKTOP-HH0RPGN/events.out.tfevents.1719867811.DESKTOP-HH0RPGN.8452.3
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f4b95acff05e4184089f18b6764fca1a33d38e68c1992123b2b68b5e5f437b76
|
3 |
+
size 411
|
runs/Jul02_04-06-03_DESKTOP-HH0RPGN/events.out.tfevents.1719867969.DESKTOP-HH0RPGN.11720.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0a800ee72c2dcc99189f18ef113cf0e1cd34819bf712d5ffb865dff216557150
|
3 |
+
size 11655
|
runs/Jul02_04-06-03_DESKTOP-HH0RPGN/events.out.tfevents.1719868200.DESKTOP-HH0RPGN.11720.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1464aa27519a50e1140c391b14b3eb41ec0ad9be6dce5677f30b34925beb462e
|
3 |
+
size 411
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4920
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:daa72564a01796b2f9b3af6866d7e4140b07a54ffea4f0523dceaaed2ec929e5
|
3 |
size 4920
|