| 2021-07-13 13:27:56,612 INFO MainThread:366944 [internal.py:wandb_internal():88] W&B internal server running at pid: 366944, started at: 2021-07-13 13:27:56.612663 | |
| 2021-07-13 13:27:56,615 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: check_version | |
| 2021-07-13 13:27:56,615 INFO WriterThread:366944 [datastore.py:open_for_write():80] open: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/run-1r3np4b7.wandb | |
| 2021-07-13 13:27:56,616 DEBUG SenderThread:366944 [sender.py:send():179] send: header | |
| 2021-07-13 13:27:56,616 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: check_version | |
| 2021-07-13 13:27:56,654 DEBUG SenderThread:366944 [sender.py:send():179] send: run | |
| 2021-07-13 13:27:57,109 INFO SenderThread:366944 [dir_watcher.py:__init__():168] watching files in: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files | |
| 2021-07-13 13:27:57,109 INFO SenderThread:366944 [sender.py:_start_run_threads():716] run started: 1r3np4b7 with start time 1626182876 | |
| 2021-07-13 13:27:57,109 DEBUG SenderThread:366944 [sender.py:send():179] send: summary | |
| 2021-07-13 13:27:57,109 INFO SenderThread:366944 [sender.py:_save_file():841] saving file wandb-summary.json with policy end | |
| 2021-07-13 13:27:57,110 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: run_start | |
| 2021-07-13 13:27:58,112 INFO Thread-8 :366944 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-summary.json | |
| 2021-07-13 13:27:58,220 DEBUG HandlerThread:366944 [meta.py:__init__():39] meta init | |
| 2021-07-13 13:27:58,221 DEBUG HandlerThread:366944 [meta.py:__init__():53] meta init done | |
| 2021-07-13 13:27:58,221 DEBUG HandlerThread:366944 [meta.py:probe():210] probe | |
| 2021-07-13 13:27:58,222 DEBUG HandlerThread:366944 [meta.py:_setup_git():200] setup git | |
| 2021-07-13 13:27:58,250 DEBUG HandlerThread:366944 [meta.py:_setup_git():207] setup git done | |
| 2021-07-13 13:27:58,251 DEBUG HandlerThread:366944 [meta.py:_save_pip():57] save pip | |
| 2021-07-13 13:27:58,251 DEBUG HandlerThread:366944 [meta.py:_save_pip():71] save pip done | |
| 2021-07-13 13:27:58,251 DEBUG HandlerThread:366944 [meta.py:probe():252] probe done | |
| 2021-07-13 13:27:58,254 DEBUG SenderThread:366944 [sender.py:send():179] send: files | |
| 2021-07-13 13:27:58,254 INFO SenderThread:366944 [sender.py:_save_file():841] saving file wandb-metadata.json with policy now | |
| 2021-07-13 13:27:58,260 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:27:58,260 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:27:58,405 DEBUG SenderThread:366944 [sender.py:send():179] send: config | |
| 2021-07-13 13:27:58,406 DEBUG SenderThread:366944 [sender.py:send():179] send: config | |
| 2021-07-13 13:27:58,406 DEBUG SenderThread:366944 [sender.py:send():179] send: config | |
| 2021-07-13 13:27:58,706 INFO Thread-11 :366944 [upload_job.py:push():137] Uploaded file /tmp/tmpfr7250a8wandb/10ew9iak-wandb-metadata.json | |
| 2021-07-13 13:27:59,111 INFO Thread-8 :366944 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/requirements.txt | |
| 2021-07-13 13:27:59,111 INFO Thread-8 :366944 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-metadata.json | |
| 2021-07-13 13:27:59,111 INFO Thread-8 :366944 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:28:13,116 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:28:13,407 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:28:13,407 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:28:15,117 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:28:26,303 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:28:28,121 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/config.yaml | |
| 2021-07-13 13:28:28,538 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:28:28,538 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:28:43,683 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:28:43,684 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:28:56,380 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:28:58,816 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:28:58,816 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:29:13,951 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:29:13,952 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:29:26,449 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:29:29,085 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:29:29,085 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:29:44,237 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:29:44,238 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:29:45,148 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:29:56,523 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:29:59,394 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:29:59,395 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:30:14,547 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:30:14,548 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:30:26,603 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:30:29,680 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:30:29,680 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:30:44,813 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:30:44,813 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:30:56,683 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:30:59,946 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:30:59,946 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:31:15,079 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:31:15,079 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:31:26,754 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:31:30,210 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:31:30,210 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:31:43,194 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:45,195 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:45,361 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:31:45,362 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:31:47,196 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:49,196 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:51,197 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:53,198 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:55,199 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:56,828 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:31:57,200 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:31:59,201 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:00,495 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:32:00,495 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:32:01,201 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:03,202 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:05,203 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:07,204 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:09,205 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:11,205 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:13,206 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:15,207 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:15,675 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:32:15,675 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:32:17,208 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:19,209 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:21,209 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:23,210 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:26,211 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:26,908 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:32:28,212 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:30,213 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:30,811 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:32:30,811 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:32:32,214 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:34,215 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:36,216 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:38,217 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:40,218 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:42,219 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:44,219 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:45,946 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:32:45,946 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:32:46,220 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:48,221 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:50,222 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:52,223 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:54,223 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:56,224 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:32:56,985 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:32:58,225 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:00,226 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:01,077 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:33:01,078 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:33:02,227 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:04,228 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:06,229 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:09,230 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:11,231 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:13,232 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:15,232 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:16,210 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:33:16,210 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:33:17,233 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:19,234 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:21,235 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:23,236 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:25,237 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:27,062 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:33:27,238 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:29,239 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:31,240 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:31,341 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:33:31,341 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:33:33,241 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:35,241 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:37,242 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:39,243 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:41,244 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:43,245 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:45,246 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:46,493 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:33:46,493 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:33:47,247 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:49,248 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:51,249 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:54,250 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:56,251 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:33:57,141 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:33:58,252 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:00,253 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:01,627 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:34:01,627 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:34:02,253 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:04,254 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:06,255 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:08,256 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:10,257 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:12,258 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:14,259 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:16,260 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:16,765 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:34:16,765 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:34:18,261 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:20,262 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:22,263 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:24,264 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:26,264 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:27,217 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:34:28,265 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:30,266 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:31,898 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:34:31,898 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:34:32,267 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:34,268 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:36,268 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:38,269 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:40,270 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:42,271 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:44,272 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:46,272 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:47,034 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:34:47,034 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:34:48,273 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:50,274 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:52,275 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:54,275 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:56,276 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:34:57,294 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:34:58,277 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:00,278 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:02,164 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:35:02,165 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:35:02,279 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:05,280 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:07,281 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:09,282 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:11,283 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:13,284 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:15,285 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:17,285 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:17,306 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:35:17,306 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:35:19,286 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:21,287 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:23,288 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:25,289 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:27,290 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:27,374 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:35:29,290 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:31,291 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:32,436 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:35:32,436 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:35:33,292 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:35,292 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:37,293 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:39,294 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:41,295 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:43,296 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:45,297 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:47,569 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:35:47,569 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:35:48,298 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:50,299 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:52,300 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:54,301 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:56,302 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:35:57,450 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:35:58,303 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:00,304 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:02,305 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:02,699 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:36:02,700 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:36:04,306 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:06,307 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:08,307 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:10,308 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:12,309 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:14,311 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:16,311 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:17,829 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:36:17,830 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:36:18,312 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:20,313 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:22,314 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:24,315 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:26,316 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:27,530 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:36:28,317 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:31,318 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:32,977 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:36:32,978 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:36:33,319 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:35,320 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:37,321 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:39,322 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:41,323 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:43,323 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:45,324 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:47,325 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:48,124 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:36:48,124 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:36:49,326 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:51,327 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:53,328 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:55,329 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:57,330 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:36:57,606 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:36:59,331 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:01,332 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:03,262 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:37:03,262 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:37:18,402 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:37:18,403 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:37:23,365 DEBUG SenderThread:366944 [sender.py:send():179] send: history | |
| 2021-07-13 13:37:23,366 DEBUG SenderThread:366944 [sender.py:send():179] send: summary | |
| 2021-07-13 13:37:23,367 INFO SenderThread:366944 [sender.py:_save_file():841] saving file wandb-summary.json with policy end | |
| 2021-07-13 13:37:24,342 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-summary.json | |
| 2021-07-13 13:37:25,342 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:27,343 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:27,677 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:37:29,344 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:31,345 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:33,346 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:33,536 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:37:33,536 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:37:35,347 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:37,348 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:39,348 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:41,349 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:44,350 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:46,351 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:48,352 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:48,667 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:37:48,667 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:37:50,353 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:52,354 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:54,355 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:56,356 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:37:57,748 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:37:58,357 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:00,358 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:02,359 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:03,806 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:38:03,807 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:38:04,360 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:06,360 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:08,361 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:10,362 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:12,363 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:14,364 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:16,364 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:18,365 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:18,937 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:38:18,937 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:38:20,366 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:22,367 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:24,368 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:27,369 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:27,823 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:38:29,370 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:31,371 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:33,372 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:34,070 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:38:34,071 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:38:35,373 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:37,374 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:39,374 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:41,375 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:43,376 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:45,377 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:47,378 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:49,218 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:38:49,218 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:38:49,379 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:51,380 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:53,381 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:55,381 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:57,382 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:38:57,898 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:38:59,383 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:01,384 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:03,385 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:04,350 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:39:04,351 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:39:05,386 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:07,387 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:10,388 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:12,389 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:14,390 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:16,391 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:18,392 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:19,482 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:39:19,482 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:39:20,392 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:22,393 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:24,394 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:26,395 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:27,973 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:39:28,396 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:30,397 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:32,398 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:34,399 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:34,686 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:39:34,687 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:39:36,400 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:38,401 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:40,401 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:42,402 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:44,403 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:46,404 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:48,405 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:49,821 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:39:49,821 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:39:50,406 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:53,407 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:55,408 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:57,409 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:39:58,048 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:39:59,410 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:01,411 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:03,412 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:04,955 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:40:04,955 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:40:05,413 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:07,414 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:09,415 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:11,416 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:13,417 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:15,418 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:17,418 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:19,419 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:20,086 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:40:20,086 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:40:21,420 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:23,421 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:25,421 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:27,422 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:28,141 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:40:29,423 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:31,424 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:33,424 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:35,216 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:40:35,217 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:40:36,426 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:38,426 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:40,427 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:42,428 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:44,429 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:46,430 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:48,431 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:50,347 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:40:50,347 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:40:50,432 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:52,432 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:54,433 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:56,434 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:40:58,278 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:40:58,435 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:00,436 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:02,437 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:04,438 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:05,495 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:41:05,496 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:41:06,439 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:08,439 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:10,440 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:12,441 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:14,442 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:16,443 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:19,444 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:20,630 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:41:20,631 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:41:21,445 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:23,446 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:25,447 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:27,448 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:28,382 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:41:29,448 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:31,449 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:33,450 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:35,451 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:35,766 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:41:35,766 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:41:37,452 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:39,453 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:41,454 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:43,455 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:45,455 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:47,456 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:49,457 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:50,907 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:41:50,907 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:41:51,458 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:53,459 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:55,459 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:57,460 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:41:58,459 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:41:59,462 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:02,463 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:04,464 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:06,042 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:42:06,043 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:42:06,465 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:08,466 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:10,467 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:12,468 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:14,469 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:16,470 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:18,471 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:20,472 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:21,178 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:42:21,179 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:42:22,473 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:24,474 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:26,475 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:28,476 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:28,536 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:42:30,477 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:32,478 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:34,479 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:36,321 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:42:36,321 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:42:36,480 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:38,480 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:40,481 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:42,482 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:44,483 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:42:51,454 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:42:51,454 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:42:58,614 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:43:05,389 DEBUG SenderThread:366944 [sender.py:send():179] send: history | |
| 2021-07-13 13:43:05,389 DEBUG SenderThread:366944 [sender.py:send():179] send: summary | |
| 2021-07-13 13:43:05,390 INFO SenderThread:366944 [sender.py:_save_file():841] saving file wandb-summary.json with policy end | |
| 2021-07-13 13:43:05,491 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-summary.json | |
| 2021-07-13 13:43:06,492 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:06,584 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:43:06,584 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:43:08,492 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:10,493 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:12,494 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:14,495 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:17,496 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:19,497 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:21,498 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:21,720 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:43:21,720 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:43:23,499 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:25,500 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:27,501 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:28,692 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:43:29,502 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:31,503 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:33,504 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:35,505 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:36,852 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:43:36,853 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:43:37,506 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:39,507 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:41,508 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:43,509 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:45,509 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:47,511 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:49,511 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:51,512 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:52,044 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:43:52,044 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:43:53,513 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:55,514 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:57,515 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:43:58,770 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:44:00,516 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:02,517 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:04,518 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:06,518 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:07,176 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:44:07,176 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:44:08,519 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:10,520 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:12,521 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:14,522 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:16,523 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:18,523 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:20,524 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:22,306 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:44:22,306 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:44:22,525 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:24,526 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:26,526 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:28,527 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:28,848 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:44:30,528 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:32,529 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:34,530 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:36,531 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:37,438 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:44:37,438 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:44:38,532 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:40,533 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:43,534 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:45,535 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:47,536 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:49,537 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:51,537 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:52,569 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:44:52,569 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:44:53,539 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:55,539 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:57,540 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:44:58,927 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:44:59,541 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:01,542 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:03,543 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:05,544 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:07,545 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:07,710 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:45:07,710 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:45:09,546 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:11,546 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:13,547 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:15,548 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:17,549 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:19,550 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:21,550 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:22,868 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:45:22,868 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:45:23,551 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:26,553 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:28,553 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:29,004 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:45:30,554 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:32,555 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:34,556 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:36,557 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:38,005 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:45:38,006 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:45:38,558 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:40,559 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:42,560 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:44,561 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:46,562 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:48,563 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:50,564 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:52,565 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:53,140 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:45:53,140 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:45:54,566 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:56,567 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:58,568 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:45:59,081 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:46:00,569 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:02,570 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:04,570 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:06,571 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:08,277 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:46:08,277 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:46:09,572 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:11,573 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:13,574 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:15,575 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:17,576 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:19,577 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:21,578 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:23,412 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:46:23,412 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:46:23,579 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:25,580 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:27,581 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:29,159 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:46:29,581 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:31,582 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:33,583 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:35,584 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:37,585 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:38,551 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:46:38,552 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:46:39,586 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:41,586 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:43,587 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:45,588 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:47,589 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:49,590 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:52,591 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:53,687 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:46:53,687 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:46:54,592 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:56,593 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:58,594 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:46:59,236 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:47:00,595 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:02,596 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:04,597 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:06,598 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:08,599 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:08,821 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:47:08,822 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:47:10,600 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:12,601 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:14,602 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:16,603 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:18,604 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:20,605 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:22,606 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:23,954 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:47:23,954 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:47:24,607 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:26,608 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:28,609 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:29,313 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:47:30,610 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:32,611 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:35,612 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:37,613 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:39,165 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:47:39,166 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:47:39,614 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:41,615 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:43,616 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:45,617 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:47,618 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:49,619 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:51,620 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:53,621 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:54,299 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:47:54,299 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:47:55,622 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:57,623 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:47:59,390 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:47:59,624 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:01,624 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:03,625 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:05,626 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:07,627 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:09,439 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:48:09,440 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:48:09,628 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:11,629 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:13,630 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:15,630 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:17,631 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:20,633 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:22,634 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:24,572 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:48:24,572 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:48:24,635 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:26,636 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:29,465 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:48:39,703 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:48:39,703 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:48:47,416 DEBUG SenderThread:366944 [sender.py:send():179] send: history | |
| 2021-07-13 13:48:47,416 DEBUG SenderThread:366944 [sender.py:send():179] send: summary | |
| 2021-07-13 13:48:47,423 INFO SenderThread:366944 [sender.py:_save_file():841] saving file wandb-summary.json with policy end | |
| 2021-07-13 13:48:47,644 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-summary.json | |
| 2021-07-13 13:48:48,644 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:50,645 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:52,646 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:54,647 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:54,834 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:48:54,834 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:48:56,648 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:58,649 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:48:59,541 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:49:00,650 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:02,651 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:04,652 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:06,653 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:08,654 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:09,969 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:49:09,969 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:49:10,655 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:12,656 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:14,656 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:16,657 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:18,658 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:20,659 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:22,660 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:24,661 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:25,108 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:49:25,109 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:49:26,662 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:28,663 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:29,620 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:49:31,664 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:33,665 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:35,666 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:37,666 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:39,667 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:40,241 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:49:40,242 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:49:41,668 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:43,669 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:45,670 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:47,671 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:49,671 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:51,672 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:53,673 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:55,374 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:49:55,375 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:49:55,674 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:57,675 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:59,676 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:49:59,697 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:50:01,677 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:03,677 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:05,678 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:07,679 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:09,680 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:10,505 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:50:10,505 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:50:11,681 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:13,682 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:16,683 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:18,684 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:20,685 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:22,686 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:24,687 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:25,637 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:50:25,637 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:50:26,687 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:28,688 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:29,774 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:50:30,689 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:32,690 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:34,691 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:36,691 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:38,692 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:40,693 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:40,767 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:50:40,767 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:50:42,694 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:44,695 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:46,696 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:48,697 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:50,698 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:52,699 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:54,699 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:55,903 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:50:55,904 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:50:56,700 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:59,701 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:50:59,853 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:51:01,702 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:03,703 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:05,704 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:07,705 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:09,706 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:11,268 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:51:11,268 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:51:11,707 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:13,708 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:15,709 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:17,710 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:19,711 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:21,712 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:23,713 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:25,713 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:26,401 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:51:26,401 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:51:27,714 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:29,715 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:29,931 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:51:31,716 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:33,717 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:35,718 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:37,719 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:39,720 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:41,533 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:51:41,533 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:51:42,721 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:44,722 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:46,723 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:48,724 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:50,725 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:52,725 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:54,726 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:56,667 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:51:56,668 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:51:56,727 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:51:58,728 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:00,008 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:52:00,729 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:02,730 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:04,731 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:06,732 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:08,733 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:10,733 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:11,811 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:52:11,811 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:52:12,734 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:14,735 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:16,736 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:18,737 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:20,738 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:22,739 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:25,740 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:26,944 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:52:26,944 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:52:27,741 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:29,742 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:30,087 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:52:31,743 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:33,744 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:35,744 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:37,746 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:39,746 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:41,748 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:42,079 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:52:42,079 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:52:43,748 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:45,749 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:47,750 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:49,751 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:51,752 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:53,752 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:55,753 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:57,212 DEBUG HandlerThread:366944 [handler.py:handle_request():124] handle_request: stop_status | |
| 2021-07-13 13:52:57,212 DEBUG SenderThread:366944 [sender.py:send_request():193] send_request: stop_status | |
| 2021-07-13 13:52:57,754 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:52:59,755 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:53:00,164 DEBUG SenderThread:366944 [sender.py:send():179] send: stats | |
| 2021-07-13 13:53:01,756 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:53:03,757 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:53:05,757 INFO Thread-8 :366944 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log | |
| 2021-07-13 13:53:06,452 WARNING MainThread:366944 [internal.py:wandb_internal():147] Internal process interrupt: 1 | |
| 2021-07-13 13:53:06,630 WARNING MainThread:366944 [internal.py:wandb_internal():147] Internal process interrupt: 2 | |
| 2021-07-13 13:53:06,630 ERROR MainThread:366944 [internal.py:wandb_internal():150] Internal process interrupted. | |
| 2021-07-13 13:53:06,732 INFO SenderThread:366944 [sender.py:finish():945] shutting down sender | |
| 2021-07-13 13:53:06,733 INFO SenderThread:366944 [dir_watcher.py:finish():282] shutting down directory watcher | |
| 2021-07-13 13:53:06,733 INFO WriterThread:366944 [datastore.py:close():288] close: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/run-1r3np4b7.wandb | |
| 2021-07-13 13:53:06,733 INFO HandlerThread:366944 [handler.py:finish():638] shutting down handler | |
| 2021-07-13 13:53:06,759 INFO SenderThread:366944 [dir_watcher.py:finish():312] scan: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files | |
| 2021-07-13 13:53:06,759 INFO SenderThread:366944 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/requirements.txt requirements.txt | |
| 2021-07-13 13:53:06,759 INFO SenderThread:366944 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/output.log output.log | |
| 2021-07-13 13:53:06,759 INFO SenderThread:366944 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-metadata.json wandb-metadata.json | |
| 2021-07-13 13:53:06,760 INFO SenderThread:366944 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/config.yaml config.yaml | |
| 2021-07-13 13:53:06,760 INFO SenderThread:366944 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210713_132755-1r3np4b7/files/wandb-summary.json wandb-summary.json | |
| 2021-07-13 13:53:06,760 INFO SenderThread:366944 [file_pusher.py:finish():177] shutting down file pusher | |
| 2021-07-13 13:53:06,760 INFO SenderThread:366944 [file_pusher.py:join():182] waiting for file pusher | |
| 2021-07-13 13:53:07,101 INFO MainThread:366944 [internal.py:handle_exit():78] Internal process exited | |