Hugging Face's logo

flax-community
/
pino-bigbird-roberta-base

Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Dutch
big_bird
Inference Endpoints
Model card Files Metrics Community
2
dat commited on
Commit
28aa044
•
1 Parent(s): be9ccf6

update

Browse files
Files changed (4) hide show
  1. wandb/run-20210715_185845-dq8uirtg/files/output.log +132 -0
  2. wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json +1 -1
  3. wandb/run-20210715_185845-dq8uirtg/logs/debug-internal.log +288 -0
  4. wandb/run-20210715_185845-dq8uirtg/run-dq8uirtg.wandb +0 -0
wandb/run-20210715_185845-dq8uirtg/files/output.log CHANGED
@@ -4071,3 +4071,135 @@ tcmalloc: large alloc 2715181056 bytes == 0x3dd038000 @ 0x7f7011c37680 0x7f7011
4071
  [23:12:05] - INFO - absl - Saved checkpoint at checkpoint_135000
4072
  [23:12:06] - INFO - huggingface_hub.repository - git version 2.25.1
4073
  git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4071
  [23:12:05] - INFO - absl - Saved checkpoint at checkpoint_135000
4072
  [23:12:06] - INFO - huggingface_hub.repository - git version 2.25.1
4073
  git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
4074
+ [23:12:07] - DEBUG - huggingface_hub.repository - [Repository] is a valid git repo
4075
+ [23:13:15] - INFO - huggingface_hub.repository - Uploading LFS objects: 100% (2/2), 2.0 GB | 46 MB/s, done.
4076
+
4077
+
4078
+
4079
+
4080
+
4081
+ Training...: 35051it [4:09:07, 2.25s/it]
4082
+
4083
+
4084
+
4085
+
4086
+
4087
+ Training...: 35105it [4:09:28, 1.09it/s]
4088
+
4089
+
4090
+
4091
+
4092
+
4093
+ Training...: 35156it [4:09:48, 1.49it/s]
4094
+
4095
+
4096
+
4097
+
4098
+
4099
+ Training...: 35205it [4:10:08, 1.08it/s]
4100
+
4101
+
4102
+
4103
+
4104
+
4105
+ Training...: 35257it [4:10:28, 1.59it/s]
4106
+
4107
+
4108
+
4109
+
4110
+
4111
+ Training...: 35307it [4:10:48, 1.58it/s]
4112
+
4113
+
4114
+
4115
+
4116
+
4117
+ Training...: 35351it [4:11:08, 2.25s/it]
4118
+
4119
+
4120
+
4121
+
4122
+
4123
+ Training...: 35401it [4:11:28, 2.25s/it]
4124
+
4125
+
4126
+
4127
+
4128
+
4129
+ Training...: 35451it [4:11:48, 2.26s/it]
4130
+
4131
+
4132
+
4133
+
4134
+
4135
+ Training...: 35503it [4:12:08, 1.40s/it]
4136
+
4137
+
4138
+
4139
+
4140
+
4141
+ Training...: 35555it [4:12:28, 1.09it/s]
4142
+
4143
+
4144
+
4145
+
4146
+
4147
+ Training...: 35607it [4:12:48, 1.58it/s]
4148
+
4149
+
4150
+
4151
+
4152
+
4153
+ Training...: 35657it [4:13:08, 1.58it/s]
4154
+
4155
+
4156
+
4157
+
4158
+
4159
+ Training...: 35709it [4:13:28, 2.24it/s]
4160
+
4161
+
4162
+
4163
+
4164
+
4165
+ Training...: 35751it [4:13:48, 2.24s/it]
4166
+
4167
+
4168
+
4169
+
4170
+
4171
+ Training...: 35803it [4:14:08, 1.39s/it]
4172
+
4173
+
4174
+
4175
+
4176
+
4177
+ Training...: 35853it [4:14:28, 1.39s/it]
4178
+
4179
+
4180
+
4181
+
4182
+
4183
+ Training...: 35905it [4:14:48, 1.09it/s]
4184
+
4185
+
4186
+
4187
+
4188
+
4189
+ Training...: 35955it [4:15:08, 1.09it/s]
4190
+
4191
+
4192
+
4193
+
4194
+
4195
+ Training...: 36005it [4:15:28, 1.09it/s]
4196
+
4197
+
4198
+
4199
+
4200
+
4201
+ Training...: 36057it [4:15:49, 1.59it/s]
4202
+
4203
+
4204
+
4205
+
wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"training_step": 135000, "learning_rate": 2.4608441890450194e-05, "train_loss": 2.3477954864501953, "_runtime": 15192, "_timestamp": 1626390717, "_step": 705, "eval_step": 132000, "eval_accuracy": 0.5815154314041138, "eval_loss": 2.216282367706299}
 
1
+ {"training_step": 136050, "learning_rate": 2.4563154511270113e-05, "train_loss": 2.352145195007324, "_runtime": 15693, "_timestamp": 1626391218, "_step": 726, "eval_step": 132000, "eval_accuracy": 0.5815154314041138, "eval_loss": 2.216282367706299}
wandb/run-20210715_185845-dq8uirtg/logs/debug-internal.log CHANGED
@@ -9066,3 +9066,291 @@
9066
  2021-07-15 23:12:09,885 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9067
  2021-07-15 23:12:15,616 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9068
  2021-07-15 23:12:15,616 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9066
  2021-07-15 23:12:09,885 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9067
  2021-07-15 23:12:15,616 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9068
  2021-07-15 23:12:15,616 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9069
+ 2021-07-15 23:12:25,223 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9070
+ 2021-07-15 23:12:30,752 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9071
+ 2021-07-15 23:12:30,752 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9072
+ 2021-07-15 23:12:45,882 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9073
+ 2021-07-15 23:12:45,883 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9074
+ 2021-07-15 23:12:55,301 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9075
+ 2021-07-15 23:13:01,013 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9076
+ 2021-07-15 23:13:01,013 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9077
+ 2021-07-15 23:13:16,294 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9078
+ 2021-07-15 23:13:16,295 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9079
+ 2021-07-15 23:13:17,912 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9080
+ 2021-07-15 23:13:19,913 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9081
+ 2021-07-15 23:13:21,914 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9082
+ 2021-07-15 23:13:23,914 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9083
+ 2021-07-15 23:13:25,377 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9084
+ 2021-07-15 23:13:25,915 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9085
+ 2021-07-15 23:13:31,427 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9086
+ 2021-07-15 23:13:31,427 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9087
+ 2021-07-15 23:13:37,220 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9088
+ 2021-07-15 23:13:37,220 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9089
+ 2021-07-15 23:13:37,221 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9090
+ 2021-07-15 23:13:37,919 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9091
+ 2021-07-15 23:13:37,919 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9092
+ 2021-07-15 23:13:38,920 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9093
+ 2021-07-15 23:13:39,920 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9094
+ 2021-07-15 23:13:41,921 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9095
+ 2021-07-15 23:13:43,922 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9096
+ 2021-07-15 23:13:45,923 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9097
+ 2021-07-15 23:13:46,562 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9098
+ 2021-07-15 23:13:46,562 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9099
+ 2021-07-15 23:13:55,452 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9100
+ 2021-07-15 23:13:57,259 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9101
+ 2021-07-15 23:13:57,260 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9102
+ 2021-07-15 23:13:57,260 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9103
+ 2021-07-15 23:13:57,927 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9104
+ 2021-07-15 23:13:58,928 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9105
+ 2021-07-15 23:14:00,929 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9106
+ 2021-07-15 23:14:01,693 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9107
+ 2021-07-15 23:14:01,694 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9108
+ 2021-07-15 23:14:02,930 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9109
+ 2021-07-15 23:14:04,930 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9110
+ 2021-07-15 23:14:06,931 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9111
+ 2021-07-15 23:14:16,827 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9112
+ 2021-07-15 23:14:16,827 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9113
+ 2021-07-15 23:14:17,296 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9114
+ 2021-07-15 23:14:17,296 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9115
+ 2021-07-15 23:14:17,297 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9116
+ 2021-07-15 23:14:17,936 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9117
+ 2021-07-15 23:14:18,936 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9118
+ 2021-07-15 23:14:20,937 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9119
+ 2021-07-15 23:14:22,938 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9120
+ 2021-07-15 23:14:24,939 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9121
+ 2021-07-15 23:14:25,523 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9122
+ 2021-07-15 23:14:26,940 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9123
+ 2021-07-15 23:14:31,958 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9124
+ 2021-07-15 23:14:31,959 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9125
+ 2021-07-15 23:14:37,423 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9126
+ 2021-07-15 23:14:37,423 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9127
+ 2021-07-15 23:14:37,424 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9128
+ 2021-07-15 23:14:37,944 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9129
+ 2021-07-15 23:14:38,945 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9130
+ 2021-07-15 23:14:40,946 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9131
+ 2021-07-15 23:14:42,947 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9132
+ 2021-07-15 23:14:44,948 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9133
+ 2021-07-15 23:14:46,949 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9134
+ 2021-07-15 23:14:47,091 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9135
+ 2021-07-15 23:14:47,091 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9136
+ 2021-07-15 23:14:55,598 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9137
+ 2021-07-15 23:14:57,463 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9138
+ 2021-07-15 23:14:57,463 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9139
+ 2021-07-15 23:14:57,464 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9140
+ 2021-07-15 23:14:57,953 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9141
+ 2021-07-15 23:14:58,953 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9142
+ 2021-07-15 23:15:00,954 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9143
+ 2021-07-15 23:15:02,222 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9144
+ 2021-07-15 23:15:02,222 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9145
+ 2021-07-15 23:15:02,955 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9146
+ 2021-07-15 23:15:04,956 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9147
+ 2021-07-15 23:15:06,957 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9148
+ 2021-07-15 23:15:17,408 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9149
+ 2021-07-15 23:15:17,408 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9150
+ 2021-07-15 23:15:17,538 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9151
+ 2021-07-15 23:15:17,538 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9152
+ 2021-07-15 23:15:17,538 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9153
+ 2021-07-15 23:15:17,961 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9154
+ 2021-07-15 23:15:18,962 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9155
+ 2021-07-15 23:15:20,963 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9156
+ 2021-07-15 23:15:22,964 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9157
+ 2021-07-15 23:15:24,965 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9158
+ 2021-07-15 23:15:25,674 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9159
+ 2021-07-15 23:15:26,965 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9160
+ 2021-07-15 23:15:32,540 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9161
+ 2021-07-15 23:15:32,540 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9162
+ 2021-07-15 23:15:37,539 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9163
+ 2021-07-15 23:15:37,539 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9164
+ 2021-07-15 23:15:37,539 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9165
+ 2021-07-15 23:15:37,969 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9166
+ 2021-07-15 23:15:38,970 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9167
+ 2021-07-15 23:15:40,970 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9168
+ 2021-07-15 23:15:42,971 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9169
+ 2021-07-15 23:15:44,972 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9170
+ 2021-07-15 23:15:46,973 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9171
+ 2021-07-15 23:15:47,679 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9172
+ 2021-07-15 23:15:47,679 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9173
+ 2021-07-15 23:15:55,751 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9174
+ 2021-07-15 23:15:57,579 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9175
+ 2021-07-15 23:15:57,579 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9176
+ 2021-07-15 23:15:57,580 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9177
+ 2021-07-15 23:15:57,977 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9178
+ 2021-07-15 23:15:58,977 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9179
+ 2021-07-15 23:16:00,978 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9180
+ 2021-07-15 23:16:02,811 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9181
+ 2021-07-15 23:16:02,811 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9182
+ 2021-07-15 23:16:02,979 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9183
+ 2021-07-15 23:16:04,979 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9184
+ 2021-07-15 23:16:06,980 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9185
+ 2021-07-15 23:16:17,639 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9186
+ 2021-07-15 23:16:17,639 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9187
+ 2021-07-15 23:16:17,639 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9188
+ 2021-07-15 23:16:17,979 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9189
+ 2021-07-15 23:16:17,979 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9190
+ 2021-07-15 23:16:17,984 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9191
+ 2021-07-15 23:16:18,984 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9192
+ 2021-07-15 23:16:20,985 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9193
+ 2021-07-15 23:16:22,986 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9194
+ 2021-07-15 23:16:24,987 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9195
+ 2021-07-15 23:16:25,829 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9196
+ 2021-07-15 23:16:26,987 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9197
+ 2021-07-15 23:16:33,113 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9198
+ 2021-07-15 23:16:33,114 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9199
+ 2021-07-15 23:16:37,674 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9200
+ 2021-07-15 23:16:37,674 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9201
+ 2021-07-15 23:16:37,675 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9202
+ 2021-07-15 23:16:37,991 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9203
+ 2021-07-15 23:16:38,992 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9204
+ 2021-07-15 23:16:39,992 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9205
+ 2021-07-15 23:16:40,992 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9206
+ 2021-07-15 23:16:42,993 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9207
+ 2021-07-15 23:16:44,994 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9208
+ 2021-07-15 23:16:46,995 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9209
+ 2021-07-15 23:16:48,246 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9210
+ 2021-07-15 23:16:48,246 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9211
+ 2021-07-15 23:16:55,906 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9212
+ 2021-07-15 23:16:57,711 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9213
+ 2021-07-15 23:16:57,712 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9214
+ 2021-07-15 23:16:57,712 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9215
+ 2021-07-15 23:16:57,999 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9216
+ 2021-07-15 23:16:58,999 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9217
+ 2021-07-15 23:17:00,000 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9218
+ 2021-07-15 23:17:01,000 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9219
+ 2021-07-15 23:17:03,001 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9220
+ 2021-07-15 23:17:03,399 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9221
+ 2021-07-15 23:17:03,400 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9222
+ 2021-07-15 23:17:05,002 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9223
+ 2021-07-15 23:17:07,003 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9224
+ 2021-07-15 23:17:17,747 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9225
+ 2021-07-15 23:17:17,748 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9226
+ 2021-07-15 23:17:17,748 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9227
+ 2021-07-15 23:17:18,006 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9228
+ 2021-07-15 23:17:18,540 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9229
+ 2021-07-15 23:17:18,540 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9230
+ 2021-07-15 23:17:19,007 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9231
+ 2021-07-15 23:17:20,007 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9232
+ 2021-07-15 23:17:21,008 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9233
+ 2021-07-15 23:17:23,009 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9234
+ 2021-07-15 23:17:25,010 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9235
+ 2021-07-15 23:17:25,986 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9236
+ 2021-07-15 23:17:27,010 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9237
+ 2021-07-15 23:17:33,685 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9238
+ 2021-07-15 23:17:33,685 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9239
+ 2021-07-15 23:17:37,782 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9240
+ 2021-07-15 23:17:37,783 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9241
+ 2021-07-15 23:17:37,783 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9242
+ 2021-07-15 23:17:38,014 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9243
+ 2021-07-15 23:17:39,015 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9244
+ 2021-07-15 23:17:40,015 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9245
+ 2021-07-15 23:17:41,016 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9246
+ 2021-07-15 23:17:43,016 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9247
+ 2021-07-15 23:17:45,018 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9248
+ 2021-07-15 23:17:47,018 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9249
+ 2021-07-15 23:17:48,816 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9250
+ 2021-07-15 23:17:48,816 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9251
+ 2021-07-15 23:17:56,062 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9252
+ 2021-07-15 23:17:57,819 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9253
+ 2021-07-15 23:17:57,820 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9254
+ 2021-07-15 23:17:57,820 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9255
+ 2021-07-15 23:17:58,022 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9256
+ 2021-07-15 23:17:59,022 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9257
+ 2021-07-15 23:18:00,023 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9258
+ 2021-07-15 23:18:01,023 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9259
+ 2021-07-15 23:18:03,024 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9260
+ 2021-07-15 23:18:03,947 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9261
+ 2021-07-15 23:18:03,947 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9262
+ 2021-07-15 23:18:05,025 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9263
+ 2021-07-15 23:18:07,025 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9264
+ 2021-07-15 23:18:17,857 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9265
+ 2021-07-15 23:18:17,858 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9266
+ 2021-07-15 23:18:17,858 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9267
+ 2021-07-15 23:18:18,029 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9268
+ 2021-07-15 23:18:19,030 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9269
+ 2021-07-15 23:18:19,083 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9270
+ 2021-07-15 23:18:19,084 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9271
+ 2021-07-15 23:18:20,030 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9272
+ 2021-07-15 23:18:21,030 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9273
+ 2021-07-15 23:18:23,031 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9274
+ 2021-07-15 23:18:25,032 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9275
+ 2021-07-15 23:18:26,135 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9276
+ 2021-07-15 23:18:27,032 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9277
+ 2021-07-15 23:18:34,224 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9278
+ 2021-07-15 23:18:34,225 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9279
+ 2021-07-15 23:18:37,896 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9280
+ 2021-07-15 23:18:37,897 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9281
+ 2021-07-15 23:18:37,897 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9282
+ 2021-07-15 23:18:38,036 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9283
+ 2021-07-15 23:18:39,037 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9284
+ 2021-07-15 23:18:40,037 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9285
+ 2021-07-15 23:18:41,037 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9286
+ 2021-07-15 23:18:43,038 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9287
+ 2021-07-15 23:18:45,039 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9288
+ 2021-07-15 23:18:47,040 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9289
+ 2021-07-15 23:18:49,356 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9290
+ 2021-07-15 23:18:49,357 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9291
+ 2021-07-15 23:18:56,210 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9292
+ 2021-07-15 23:18:57,938 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9293
+ 2021-07-15 23:18:57,938 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9294
+ 2021-07-15 23:18:57,938 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9295
+ 2021-07-15 23:18:58,043 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9296
+ 2021-07-15 23:18:59,044 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9297
+ 2021-07-15 23:19:00,044 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9298
+ 2021-07-15 23:19:01,045 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9299
+ 2021-07-15 23:19:03,045 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9300
+ 2021-07-15 23:19:04,486 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9301
+ 2021-07-15 23:19:04,486 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9302
+ 2021-07-15 23:19:05,046 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9303
+ 2021-07-15 23:19:07,047 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9304
+ 2021-07-15 23:19:17,980 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9305
+ 2021-07-15 23:19:17,980 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9306
+ 2021-07-15 23:19:17,981 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9307
+ 2021-07-15 23:19:18,050 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9308
+ 2021-07-15 23:19:19,051 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9309
+ 2021-07-15 23:19:19,639 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9310
+ 2021-07-15 23:19:19,640 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9311
+ 2021-07-15 23:19:20,051 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9312
+ 2021-07-15 23:19:21,051 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9313
+ 2021-07-15 23:19:23,052 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9314
+ 2021-07-15 23:19:25,053 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9315
+ 2021-07-15 23:19:26,290 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9316
+ 2021-07-15 23:19:27,053 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9317
+ 2021-07-15 23:19:34,770 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9318
+ 2021-07-15 23:19:34,771 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9319
+ 2021-07-15 23:19:38,032 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9320
+ 2021-07-15 23:19:38,032 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9321
+ 2021-07-15 23:19:38,033 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9322
+ 2021-07-15 23:19:38,057 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9323
+ 2021-07-15 23:19:39,058 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9324
+ 2021-07-15 23:19:40,058 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9325
+ 2021-07-15 23:19:41,059 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9326
+ 2021-07-15 23:19:43,059 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9327
+ 2021-07-15 23:19:45,060 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9328
+ 2021-07-15 23:19:47,061 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9329
+ 2021-07-15 23:19:49,904 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9330
+ 2021-07-15 23:19:49,904 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9331
+ 2021-07-15 23:19:56,362 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9332
+ 2021-07-15 23:19:58,070 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9333
+ 2021-07-15 23:19:58,071 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9334
+ 2021-07-15 23:19:58,071 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9335
+ 2021-07-15 23:19:59,066 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9336
+ 2021-07-15 23:19:59,066 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9337
+ 2021-07-15 23:20:00,066 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9338
+ 2021-07-15 23:20:01,066 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9339
+ 2021-07-15 23:20:03,067 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9340
+ 2021-07-15 23:20:05,034 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9341
+ 2021-07-15 23:20:05,035 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9342
+ 2021-07-15 23:20:05,068 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9343
+ 2021-07-15 23:20:07,069 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9344
+ 2021-07-15 23:20:18,109 DEBUG SenderThread:735392 [sender.py:send():179] send: history
9345
+ 2021-07-15 23:20:18,110 DEBUG SenderThread:735392 [sender.py:send():179] send: summary
9346
+ 2021-07-15 23:20:18,110 INFO SenderThread:735392 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
9347
+ 2021-07-15 23:20:19,073 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/wandb-summary.json
9348
+ 2021-07-15 23:20:19,074 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9349
+ 2021-07-15 23:20:20,074 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9350
+ 2021-07-15 23:20:20,189 DEBUG HandlerThread:735392 [handler.py:handle_request():124] handle_request: stop_status
9351
+ 2021-07-15 23:20:20,189 DEBUG SenderThread:735392 [sender.py:send_request():193] send_request: stop_status
9352
+ 2021-07-15 23:20:21,074 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9353
+ 2021-07-15 23:20:23,075 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9354
+ 2021-07-15 23:20:25,076 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
9355
+ 2021-07-15 23:20:26,435 DEBUG SenderThread:735392 [sender.py:send():179] send: stats
9356
+ 2021-07-15 23:20:27,076 INFO Thread-8 :735392 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210715_185845-dq8uirtg/files/output.log
wandb/run-20210715_185845-dq8uirtg/run-dq8uirtg.wandb CHANGED
Binary files a/wandb/run-20210715_185845-dq8uirtg/run-dq8uirtg.wandb and b/wandb/run-20210715_185845-dq8uirtg/run-dq8uirtg.wandb differ