Hugging Face's logo

flax-community
/
pino-bigbird-roberta-base

Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Dutch
big_bird
Inference Endpoints
Model card Files Metrics Community
2
pino-bigbird-roberta-base
File size: 16,803 Bytes 
9915204
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
 
2021-07-14 21:54:09,008 INFO    MainThread:588654 [internal.py:wandb_internal():88] W&B internal server running at pid: 588654, started at: 2021-07-14 21:54:09.008494
2021-07-14 21:54:09,011 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: check_version
2021-07-14 21:54:09,011 INFO    WriterThread:588654 [datastore.py:open_for_write():80] open: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/run-3kpvz8se.wandb
2021-07-14 21:54:09,012 DEBUG   SenderThread:588654 [sender.py:send():179] send: header
2021-07-14 21:54:09,012 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: check_version
2021-07-14 21:54:09,050 DEBUG   SenderThread:588654 [sender.py:send():179] send: run
2021-07-14 21:54:09,234 INFO    SenderThread:588654 [dir_watcher.py:__init__():168] watching files in: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files
2021-07-14 21:54:09,234 INFO    SenderThread:588654 [sender.py:_start_run_threads():716] run started: 3kpvz8se with start time 1626299648
2021-07-14 21:54:09,234 DEBUG   SenderThread:588654 [sender.py:send():179] send: summary
2021-07-14 21:54:09,234 INFO    SenderThread:588654 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-14 21:54:09,235 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: run_start
2021-07-14 21:54:10,238 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/wandb-summary.json
2021-07-14 21:54:10,349 DEBUG   HandlerThread:588654 [meta.py:__init__():39] meta init
2021-07-14 21:54:10,349 DEBUG   HandlerThread:588654 [meta.py:__init__():53] meta init done
2021-07-14 21:54:10,349 DEBUG   HandlerThread:588654 [meta.py:probe():210] probe
2021-07-14 21:54:10,351 DEBUG   HandlerThread:588654 [meta.py:_setup_git():200] setup git
2021-07-14 21:54:10,382 DEBUG   HandlerThread:588654 [meta.py:_setup_git():207] setup git done
2021-07-14 21:54:10,382 DEBUG   HandlerThread:588654 [meta.py:_save_pip():57] save pip
2021-07-14 21:54:10,382 DEBUG   HandlerThread:588654 [meta.py:_save_pip():71] save pip done
2021-07-14 21:54:10,382 DEBUG   HandlerThread:588654 [meta.py:probe():252] probe done
2021-07-14 21:54:10,386 DEBUG   SenderThread:588654 [sender.py:send():179] send: files
2021-07-14 21:54:10,387 INFO    SenderThread:588654 [sender.py:_save_file():841] saving file wandb-metadata.json with policy now
2021-07-14 21:54:10,394 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: stop_status
2021-07-14 21:54:10,394 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: stop_status
2021-07-14 21:54:10,527 DEBUG   SenderThread:588654 [sender.py:send():179] send: config
2021-07-14 21:54:10,527 DEBUG   SenderThread:588654 [sender.py:send():179] send: config
2021-07-14 21:54:10,527 DEBUG   SenderThread:588654 [sender.py:send():179] send: config
2021-07-14 21:54:11,237 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/requirements.txt
2021-07-14 21:54:11,237 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/wandb-metadata.json
2021-07-14 21:54:11,237 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_created():216] file/dir created: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/output.log
2021-07-14 21:54:11,254 INFO    Thread-11 :588654 [upload_job.py:push():137] Uploaded file /tmp/tmp43phob9nwandb/1nzximp3-wandb-metadata.json
2021-07-14 21:54:25,243 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/output.log
2021-07-14 21:54:25,572 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: stop_status
2021-07-14 21:54:25,573 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: stop_status
2021-07-14 21:54:28,245 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/output.log
2021-07-14 21:54:29,079 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:29,079 DEBUG   SenderThread:588654 [sender.py:send():179] send: telemetry
2021-07-14 21:54:29,079 DEBUG   SenderThread:588654 [sender.py:send():179] send: exit
2021-07-14 21:54:29,079 INFO    SenderThread:588654 [sender.py:send_exit():287] handling exit code: 1
2021-07-14 21:54:29,080 INFO    SenderThread:588654 [sender.py:send_exit():295] send defer
2021-07-14 21:54:29,080 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:29,081 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:29,081 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 0
2021-07-14 21:54:29,081 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:29,081 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 0
2021-07-14 21:54:29,081 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 1
2021-07-14 21:54:29,081 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:29,081 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 1
2021-07-14 21:54:29,111 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:29,111 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 1
2021-07-14 21:54:29,111 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 2
2021-07-14 21:54:29,111 DEBUG   SenderThread:588654 [sender.py:send():179] send: stats
2021-07-14 21:54:29,112 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:29,112 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 2
2021-07-14 21:54:29,112 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:29,112 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 2
2021-07-14 21:54:29,112 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 3
2021-07-14 21:54:29,112 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:29,112 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 3
2021-07-14 21:54:29,113 DEBUG   SenderThread:588654 [sender.py:send():179] send: summary
2021-07-14 21:54:29,113 INFO    SenderThread:588654 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
2021-07-14 21:54:29,113 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:29,113 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 3
2021-07-14 21:54:29,113 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 4
2021-07-14 21:54:29,113 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:29,113 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 4
2021-07-14 21:54:29,114 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:29,114 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 4
2021-07-14 21:54:29,182 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:29,245 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/wandb-summary.json
2021-07-14 21:54:29,245 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/output.log
2021-07-14 21:54:29,299 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 5
2021-07-14 21:54:29,299 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:29,300 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:29,300 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 5
2021-07-14 21:54:29,300 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:29,300 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 5
2021-07-14 21:54:29,300 INFO    SenderThread:588654 [dir_watcher.py:finish():282] shutting down directory watcher
2021-07-14 21:54:29,401 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,246 INFO    Thread-8  :588654 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/config.yaml
2021-07-14 21:54:30,246 INFO    SenderThread:588654 [dir_watcher.py:finish():312] scan: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files
2021-07-14 21:54:30,247 INFO    SenderThread:588654 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/requirements.txt requirements.txt
2021-07-14 21:54:30,247 INFO    SenderThread:588654 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/output.log output.log
2021-07-14 21:54:30,247 INFO    SenderThread:588654 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/wandb-metadata.json wandb-metadata.json
2021-07-14 21:54:30,247 INFO    SenderThread:588654 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/config.yaml config.yaml
2021-07-14 21:54:30,247 INFO    SenderThread:588654 [dir_watcher.py:finish():318] scan save: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/wandb-summary.json wandb-summary.json
2021-07-14 21:54:30,248 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 6
2021-07-14 21:54:30,248 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,252 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:30,252 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 6
2021-07-14 21:54:30,252 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:30,252 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 6
2021-07-14 21:54:30,252 INFO    SenderThread:588654 [file_pusher.py:finish():177] shutting down file pusher
2021-07-14 21:54:30,350 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,350 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,452 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,452 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,553 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,554 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,655 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,655 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,699 INFO    Thread-13 :588654 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/output.log
2021-07-14 21:54:30,707 INFO    Thread-12 :588654 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/requirements.txt
2021-07-14 21:54:30,708 INFO    Thread-15 :588654 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/wandb-summary.json
2021-07-14 21:54:30,757 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,757 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,760 INFO    Thread-14 :588654 [upload_job.py:push():137] Uploaded file /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/files/config.yaml
2021-07-14 21:54:30,858 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,858 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,960 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:30,960 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:30,960 INFO    Thread-7  :588654 [sender.py:transition_state():308] send defer: 7
2021-07-14 21:54:30,961 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:30,961 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 7
2021-07-14 21:54:30,961 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:30,961 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 7
2021-07-14 21:54:31,062 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:31,093 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 8
2021-07-14 21:54:31,093 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:31,093 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:31,093 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 8
2021-07-14 21:54:31,093 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:31,094 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 8
2021-07-14 21:54:31,094 INFO    SenderThread:588654 [sender.py:transition_state():308] send defer: 9
2021-07-14 21:54:31,094 DEBUG   SenderThread:588654 [sender.py:send():179] send: final
2021-07-14 21:54:31,094 DEBUG   SenderThread:588654 [sender.py:send():179] send: footer
2021-07-14 21:54:31,094 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: defer
2021-07-14 21:54:31,095 INFO    HandlerThread:588654 [handler.py:handle_request_defer():141] handle defer: 9
2021-07-14 21:54:31,095 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: defer
2021-07-14 21:54:31,095 INFO    SenderThread:588654 [sender.py:send_request_defer():304] handle sender defer: 9
2021-07-14 21:54:31,195 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: poll_exit
2021-07-14 21:54:31,195 DEBUG   SenderThread:588654 [sender.py:send_request():193] send_request: poll_exit
2021-07-14 21:54:31,195 INFO    SenderThread:588654 [file_pusher.py:join():182] waiting for file pusher
2021-07-14 21:54:31,196 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: get_summary
2021-07-14 21:54:31,197 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: sampled_history
2021-07-14 21:54:31,197 DEBUG   HandlerThread:588654 [handler.py:handle_request():124] handle_request: shutdown
2021-07-14 21:54:31,197 INFO    HandlerThread:588654 [handler.py:finish():638] shutting down handler
2021-07-14 21:54:32,095 INFO    WriterThread:588654 [datastore.py:close():288] close: /home/dat/pino-roberta-base/wandb/run-20210714_215408-3kpvz8se/run-3kpvz8se.wandb
2021-07-14 21:54:32,195 INFO    SenderThread:588654 [sender.py:finish():945] shutting down sender
2021-07-14 21:54:32,196 INFO    SenderThread:588654 [file_pusher.py:finish():177] shutting down file pusher
2021-07-14 21:54:32,196 INFO    SenderThread:588654 [file_pusher.py:join():182] waiting for file pusher
2021-07-14 21:54:32,198 INFO    MainThread:588654 [internal.py:handle_exit():78] Internal process exited