Hugging Face's logo

qing-yao
/
babylm-unablated_seed-42_1e-3

Text Generation
Transformers
Safetensors
opt
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
qing-yao commited on
Commit
615a9ac
•
1 Parent(s): 530e547

Model save

Browse files
Files changed (5) hide show
  1. README.md +22 -22
  2. model.safetensors +1 -1
  3. tokenizer.json +0 -0
  4. training_args.bin +1 -1
  5. vocab.json +0 -0
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model was trained from scratch on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 3.0130
20
- - Accuracy: 0.4207
21
 
22
  ## Model description
23
 
@@ -52,26 +52,26 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:-------:|:-----:|:---------------:|:--------:|
55
- | 6.173 | 0.9997 | 1802 | 4.2465 | 0.3068 |
56
- | 4.0432 | 2.0 | 3605 | 3.7284 | 0.3475 |
57
- | 3.6166 | 2.9997 | 5407 | 3.4711 | 0.3707 |
58
- | 3.3909 | 4.0 | 7210 | 3.3322 | 0.3836 |
59
- | 3.2635 | 4.9997 | 9012 | 3.2560 | 0.3913 |
60
- | 3.1946 | 6.0 | 10815 | 3.2042 | 0.3959 |
61
- | 3.1312 | 6.9997 | 12617 | 3.1730 | 0.3994 |
62
- | 3.0872 | 8.0 | 14420 | 3.1528 | 0.4014 |
63
- | 3.0554 | 8.9997 | 16222 | 3.1347 | 0.4037 |
64
- | 3.0338 | 10.0 | 18025 | 3.1247 | 0.4043 |
65
- | 2.9873 | 10.9997 | 19827 | 3.1119 | 0.4059 |
66
- | 2.9773 | 12.0 | 21630 | 3.1093 | 0.4065 |
67
- | 2.9714 | 12.9997 | 23432 | 3.1020 | 0.4077 |
68
- | 2.9667 | 14.0 | 25235 | 3.0977 | 0.4077 |
69
- | 2.9621 | 14.9997 | 27037 | 3.0944 | 0.4085 |
70
- | 2.9239 | 16.0 | 28840 | 3.0954 | 0.4082 |
71
- | 2.9295 | 16.9997 | 30642 | 3.0936 | 0.4085 |
72
- | 2.9329 | 18.0 | 32445 | 3.0771 | 0.4106 |
73
- | 2.8605 | 18.9997 | 34247 | 3.0338 | 0.4164 |
74
- | 2.7104 | 19.9945 | 36040 | 3.0130 | 0.4207 |
75
 
76
 
77
  ### Framework versions
 
16
 
17
  This model was trained from scratch on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 3.0094
20
+ - Accuracy: 0.4211
21
 
22
  ## Model description
23
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:-------:|:-----:|:---------------:|:--------:|
55
+ | 6.1639 | 0.9999 | 1779 | 4.2644 | 0.3043 |
56
+ | 4.0418 | 1.9997 | 3558 | 3.7367 | 0.3467 |
57
+ | 3.6074 | 2.9996 | 5337 | 3.4761 | 0.3701 |
58
+ | 3.3836 | 4.0 | 7117 | 3.3380 | 0.3832 |
59
+ | 3.2939 | 4.9999 | 8896 | 3.2569 | 0.3913 |
60
+ | 3.1911 | 5.9997 | 10675 | 3.2081 | 0.3959 |
61
+ | 3.1276 | 6.9996 | 12454 | 3.1743 | 0.3993 |
62
+ | 3.0834 | 8.0 | 14234 | 3.1533 | 0.4014 |
63
+ | 3.0525 | 8.9999 | 16013 | 3.1344 | 0.4033 |
64
+ | 3.0036 | 9.9997 | 17792 | 3.1221 | 0.4050 |
65
+ | 2.9901 | 10.9996 | 19571 | 3.1156 | 0.4056 |
66
+ | 2.9798 | 12.0 | 21351 | 3.1083 | 0.4069 |
67
+ | 2.9729 | 12.9999 | 23130 | 3.1015 | 0.4074 |
68
+ | 2.9356 | 13.9997 | 24909 | 3.0997 | 0.4076 |
69
+ | 2.9282 | 14.9996 | 26688 | 3.0948 | 0.4084 |
70
+ | 2.9332 | 16.0 | 28468 | 3.0928 | 0.4090 |
71
+ | 2.9346 | 16.9999 | 30247 | 3.0900 | 0.4090 |
72
+ | 2.9394 | 17.9997 | 32026 | 3.0874 | 0.4097 |
73
+ | 2.8743 | 18.9996 | 33805 | 3.0350 | 0.4163 |
74
+ | 2.729 | 19.9972 | 35580 | 3.0094 | 0.4211 |
75
 
76
 
77
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f6711a302ae57fef3d2f5630fd7fb802c9b060dd51071c5ee226573aa46f779
3
  size 441702288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e2b3f418b5bdae6c0e2fc82ea5f1213312c76d137f88a73d3a48624369e780f
3
  size 441702288
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
 
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e8acb14900e0287cde9bcb8f22bf36b41e47a3c0be6f5b74f028a999bc978491
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f284391f0cfae79adb20f66e239761463dff213a0c8a633232966366b214364
3
  size 5304
vocab.json CHANGED
The diff for this file is too large to render. See raw diff