[2022-12-21 13:58:20,015] [WARNING] [runner.py:179:fetch_hostfile] Unable to find hostfile, will proceed with training with local resources only.
[2022-12-21 13:58:20,026] [INFO] [runner.py:508:main] cmd = /home/ubuntu/whisper-medium-is/.venv/bin/python3 -u -m deepspeed.launcher.launch --world_info=eyJsb2NhbGhvc3QiOiBbMF19 --master_addr=127.0.0.1 --master_port=29500 run_speech_recognition_seq2seq_streaming.py --deepspeed=ds_config.json --model_name_or_path=openai/whisper-medium --datasets_config_file=/home/ubuntu/whisper-medium-is/ds_config.json --language=icelandic --train_split_name=train --eval_dataset_name=language-and-voice-lab/samromur_asr --eval_split_name=validation --eval_steps=1000 --max_eval_samples=1000 --model_index_name=Whisper medium Icelandic --max_steps=20000 --output_dir=./ --per_device_train_batch_size=64 --per_device_eval_batch_size=32 --logging_steps=25 --learning_rate=1e-5 --warmup_steps=500 --evaluation_strategy=steps --save_strategy=steps --save_steps=12000 --generation_max_length=225 --length_column_name=input_length --max_duration_in_seconds=30 --text_column_name=normalized_text --freeze_feature_encoder=False --report_to=tensorboard --metric_for_best_model=wer --greater_is_better=False --load_best_model_at_end --gradient_checkpointing --fp16 --do_train --do_eval --predict_with_generate --do_normalize_eval --streaming --push_to_hub --use_auth_token --mapper=/home/ubuntu/whisper/text_mapping
[2022-12-21 13:58:21,617] [INFO] [launch.py:142:main] WORLD INFO DICT: {'localhost': [0]}
[2022-12-21 13:58:21,617] [INFO] [launch.py:148:main] nnodes=1, num_local_procs=1, node_rank=0
[2022-12-21 13:58:21,617] [INFO] [launch.py:161:main] global_rank_mapping=defaultdict(<class 'list'>, {'localhost': [0]})
[2022-12-21 13:58:21,617] [INFO] [launch.py:162:main] dist_world_size=1
[2022-12-21 13:58:21,618] [INFO] [launch.py:164:main] Setting CUDA_VISIBLE_DEVICES=0
[2022-12-21 13:58:25,878] [INFO] [comm.py:654:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
12/21/2022 13:58:26 - WARNING - __main__ - Process rank: 0, device: cuda:0, n_gpu: 1distributed training: True, 16-bits training: True
12/21/2022 13:58:26 - INFO - __main__ - Training/evaluation parameters Seq2SeqTrainingArguments(
_n_gpu=1,
adafactor=False,
adam_beta1=0.9,
adam_beta2=0.999,
adam_epsilon=1e-08,
auto_find_batch_size=False,
bf16=False,
bf16_full_eval=False,
data_seed=None,
dataloader_drop_last=False,
dataloader_num_workers=0,
dataloader_pin_memory=True,
ddp_bucket_cap_mb=None,
ddp_find_unused_parameters=None,
ddp_timeout=1800,
debug=[],
deepspeed=ds_config.json,
disable_tqdm=False,
do_eval=True,
do_predict=False,
do_train=True,
eval_accumulation_steps=None,
eval_delay=0,
eval_steps=1000,
evaluation_strategy=steps,
fp16=True,
fp16_backend=auto,
fp16_full_eval=False,
fp16_opt_level=O1,
fsdp=[],
fsdp_min_num_params=0,
fsdp_transformer_layer_cls_to_wrap=None,
full_determinism=False,
generation_max_length=225,
generation_num_beams=None,
gradient_accumulation_steps=1,
gradient_checkpointing=True,
greater_is_better=False,
group_by_length=False,
half_precision_backend=auto,
hub_model_id=None,
hub_private_repo=False,
hub_strategy=every_save,
hub_token=<HUB_TOKEN>,
ignore_data_skip=False,
include_inputs_for_metrics=False,
jit_mode_eval=False,
label_names=None,
label_smoothing_factor=0.0,
learning_rate=1e-05,
length_column_name=input_length,
load_best_model_at_end=True,
local_rank=0,
log_level=passive,
log_level_replica=passive,
log_on_each_node=True,
logging_dir=./runs/Dec21_13-58-25_129-146-65-51,
logging_first_step=False,
logging_nan_inf_filter=True,
logging_steps=25,
logging_strategy=steps,
lr_scheduler_type=linear,
max_grad_norm=1.0,
max_steps=20000,
metric_for_best_model=wer,
mp_parameters=,
no_cuda=False,
num_train_epochs=3.0,
optim=adamw_hf,
optim_args=None,
output_dir=./,
overwrite_output_dir=False,
past_index=-1,
per_device_eval_batch_size=32,
per_device_train_batch_size=64,
predict_with_generate=True,
prediction_loss_only=False,
push_to_hub=True,
push_to_hub_model_id=None,
push_to_hub_organization=None,
push_to_hub_token=<PUSH_TO_HUB_TOKEN>,
ray_scope=last,
remove_unused_columns=True,
report_to=['tensorboard'],
resume_from_checkpoint=None,
run_name=./,
save_on_each_node=False,
save_steps=12000,
save_strategy=steps,
save_total_limit=None,
seed=42,
sharded_ddp=[],
skip_memory_metrics=True,
sortish_sampler=False,
tf32=None,
torch_compile=False,
torch_compile_backend=None,
torch_compile_mode=None,
torchdynamo=None,
tpu_metrics_debug=False,
tpu_num_cores=None,
use_ipex=False,
use_legacy_prediction_loop=False,
use_mps_device=False,
warmup_ratio=0.0,
warmup_steps=500,
weight_decay=0.0,
xpu_backend=None,
)
12/21/2022 13:58:26 - INFO - __main__ - Training/evaluation parameters Seq2SeqTrainingArguments(
_n_gpu=1,
adafactor=False,
adam_beta1=0.9,
adam_beta2=0.999,
adam_epsilon=1e-08,
auto_find_batch_size=False,
bf16=False,
bf16_full_eval=False,
data_seed=None,
dataloader_drop_last=False,
dataloader_num_workers=0,
dataloader_pin_memory=True,
ddp_bucket_cap_mb=None,
ddp_find_unused_parameters=None,
ddp_timeout=1800,
debug=[],
deepspeed=ds_config.json,
disable_tqdm=False,
do_eval=True,
do_predict=False,
do_train=True,
eval_accumulation_steps=None,
eval_delay=0,
eval_steps=1000,
evaluation_strategy=steps,
fp16=True,
fp16_backend=auto,
fp16_full_eval=False,
fp16_opt_level=O1,
fsdp=[],
fsdp_min_num_params=0,
fsdp_transformer_layer_cls_to_wrap=None,
full_determinism=False,
generation_max_length=225,
generation_num_beams=None,
gradient_accumulation_steps=1,
gradient_checkpointing=True,
greater_is_better=False,
group_by_length=False,
half_precision_backend=auto,
hub_model_id=None,
hub_private_repo=False,
hub_strategy=every_save,
hub_token=<HUB_TOKEN>,
ignore_data_skip=False,
include_inputs_for_metrics=False,
jit_mode_eval=False,
label_names=None,
label_smoothing_factor=0.0,
learning_rate=1e-05,
length_column_name=input_length,
load_best_model_at_end=True,
local_rank=0,
log_level=passive,
log_level_replica=passive,
log_on_each_node=True,
logging_dir=./runs/Dec21_13-58-25_129-146-65-51,
logging_first_step=False,
logging_nan_inf_filter=True,
logging_steps=25,
logging_strategy=steps,
lr_scheduler_type=linear,
max_grad_norm=1.0,
max_steps=20000,
metric_for_best_model=wer,
mp_parameters=,
no_cuda=False,
num_train_epochs=3.0,
optim=adamw_hf,
optim_args=None,
output_dir=./,
overwrite_output_dir=False,
past_index=-1,
per_device_eval_batch_size=32,
per_device_train_batch_size=64,
predict_with_generate=True,
prediction_loss_only=False,
push_to_hub=True,
push_to_hub_model_id=None,
push_to_hub_organization=None,
push_to_hub_token=<PUSH_TO_HUB_TOKEN>,
ray_scope=last,
remove_unused_columns=True,
report_to=['tensorboard'],
resume_from_checkpoint=None,
run_name=./,
save_on_each_node=False,
save_steps=12000,
save_strategy=steps,
save_total_limit=None,
seed=42,
sharded_ddp=[],
skip_memory_metrics=True,
sortish_sampler=False,
tf32=None,
torch_compile=False,
torch_compile_backend=None,
torch_compile_mode=None,
torchdynamo=None,
tpu_metrics_debug=False,
tpu_num_cores=None,
use_ipex=False,
use_legacy_prediction_loop=False,
use_mps_device=False,
warmup_ratio=0.0,
warmup_steps=500,
weight_decay=0.0,
xpu_backend=None,
)
12/21/2022 13:58:26 - INFO - __main__ - Checkpoint detected, resuming training at ./checkpoint-6000. To avoid this behavior, change the `--output_dir` or add `--overwrite_output_dir` to train from scratch.
language-and-voice-lab/samromur_asr None train
12/21/2022 13:58:27 - INFO - datasets.builder - No config specified, defaulting to the single config: samromur_asr/samromur_asr
12/21/2022 13:58:27 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--samromur_asr/9f4b7a0674ad04192814f8e840dbdab23e8c4531498341198a39447a7e64e3b7
language-and-voice-lab/althingi_asr None train
12/21/2022 13:58:29 - INFO - datasets.builder - No config specified, defaulting to the single config: althingi_asr/althingi_asr
12/21/2022 13:58:29 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--althingi_asr/4fdbd9c08f7d073eeb89906cb5aa0e1e6bab822aa994474c639f8e8442a61bcf
language-and-voice-lab/althingi_asr None validation
12/21/2022 13:58:31 - INFO - datasets.builder - No config specified, defaulting to the single config: althingi_asr/althingi_asr
12/21/2022 13:58:31 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--althingi_asr/4fdbd9c08f7d073eeb89906cb5aa0e1e6bab822aa994474c639f8e8442a61bcf
language-and-voice-lab/malromur_asr None train
12/21/2022 13:58:33 - INFO - datasets.builder - No config specified, defaulting to the single config: malromur_asr/malromur_asr
12/21/2022 13:58:33 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--malromur_asr/5084bd18db918163bfb6f3f09550dff5c0106bfc56985978e6f682f52690816d
language-and-voice-lab/malromur_asr None validation
12/21/2022 13:58:35 - INFO - datasets.builder - No config specified, defaulting to the single config: malromur_asr/malromur_asr
12/21/2022 13:58:35 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--malromur_asr/5084bd18db918163bfb6f3f09550dff5c0106bfc56985978e6f682f52690816d
language-and-voice-lab/samromur_children None train
12/21/2022 13:58:37 - INFO - datasets.builder - No config specified, defaulting to the single config: samromur_children/samromur_children
12/21/2022 13:58:37 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--samromur_children/0cde4367323adbaea6845954c908aec8bcd001520628d49577421d0776d9939d
language-and-voice-lab/samromur_children None validation
12/21/2022 13:58:39 - INFO - datasets.builder - No config specified, defaulting to the single config: samromur_children/samromur_children
12/21/2022 13:58:39 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--samromur_children/0cde4367323adbaea6845954c908aec8bcd001520628d49577421d0776d9939d
language-and-voice-lab/raddromur_asr None train
12/21/2022 13:58:41 - INFO - datasets.builder - No config specified, defaulting to the single config: raddromur_asr/raddromur_asr
12/21/2022 13:58:41 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--raddromur_asr/ad967117dc1846f4100ee0ecfc31859ea6743068904a5ee705ebc400b10c49d7
12/21/2022 13:58:43 - INFO - datasets.builder - No config specified, defaulting to the single config: samromur_asr/samromur_asr
12/21/2022 13:58:43 - INFO - datasets.info - Loading Dataset Infos from /home/ubuntu/.cache/huggingface/modules/datasets_modules/datasets/language-and-voice-lab--samromur_asr/9f4b7a0674ad04192814f8e840dbdab23e8c4531498341198a39447a7e64e3b7
[INFO|configuration_utils.py:654] 2022-12-21 13:58:44,318 >> loading configuration file config.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/config.json
[INFO|configuration_utils.py:706] 2022-12-21 13:58:44,322 >> Model config WhisperConfig {
  "_name_or_path": "openai/whisper-medium",
  "activation_dropout": 0.0,
  "activation_function": "gelu",
  "architectures": [
    "WhisperForConditionalGeneration"
  ],
  "attention_dropout": 0.0,
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "d_model": 1024,
  "decoder_attention_heads": 16,
  "decoder_ffn_dim": 4096,
  "decoder_layerdrop": 0.0,
  "decoder_layers": 24,
  "decoder_start_token_id": 50258,
  "dropout": 0.0,
  "encoder_attention_heads": 16,
  "encoder_ffn_dim": 4096,
  "encoder_layerdrop": 0.0,
  "encoder_layers": 24,
  "eos_token_id": 50257,
  "forced_decoder_ids": [
    [
      1,
      50259
    ],
    [
      2,
      50359
    ],
    [
      3,
      50363
    ]
  ],
  "init_std": 0.02,
  "is_encoder_decoder": true,
  "max_length": 448,
  "max_source_positions": 1500,
  "max_target_positions": 448,
  "model_type": "whisper",
  "num_hidden_layers": 24,
  "num_mel_bins": 80,
  "pad_token_id": 50257,
  "scale_embedding": false,
  "suppress_tokens": [
    1,
    2,
    7,
    8,
    9,
    10,
    14,
    25,
    26,
    27,
    28,
    29,
    31,
    58,
    59,
    60,
    61,
    62,
    63,
    90,
    91,
    92,
    93,
    359,
    503,
    522,
    542,
    873,
    893,
    902,
    918,
    922,
    931,
    1350,
    1853,
    1982,
    2460,
    2627,
    3246,
    3253,
    3268,
    3536,
    3846,
    3961,
    4183,
    4667,
    6585,
    6647,
    7273,
    9061,
    9383,
    10428,
    10929,
    11938,
    12033,
    12331,
    12562,
    13793,
    14157,
    14635,
    15265,
    15618,
    16553,
    16604,
    18362,
    18956,
    20075,
    21675,
    22520,
    26130,
    26161,
    26435,
    28279,
    29464,
    31650,
    32302,
    32470,
    36865,
    42863,
    47425,
    49870,
    50254,
    50258,
    50360,
    50361,
    50362
  ],
  "torch_dtype": "float32",
  "transformers_version": "4.26.0.dev0",
  "use_cache": true,
  "vocab_size": 51865
}

[INFO|feature_extraction_utils.py:464] 2022-12-21 13:58:44,561 >> loading configuration file preprocessor_config.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/preprocessor_config.json
[INFO|feature_extraction_utils.py:501] 2022-12-21 13:58:44,575 >> Feature extractor WhisperFeatureExtractor {
  "chunk_length": 30,
  "feature_extractor_type": "WhisperFeatureExtractor",
  "feature_size": 80,
  "hop_length": 160,
  "mel_filters": [
    [
      -0.0,
      0.02486259490251541,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.001990821911022067,
      0.022871771827340126,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.003981643822044134,
      0.02088095061480999,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0059724655002355576,
      0.018890129402279854,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.007963287644088268,
      0.01689930632710457,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.009954108856618404,
      0.014908484183251858,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.011944931000471115,
      0.012917662039399147,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.013935752213001251,
      0.010926840826869011,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.015926575288176537,
      0.0089360186830163,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.017917396500706673,
      0.006945197004824877,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01990821771323681,
      0.004954374860972166,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.021899040788412094,
      0.0029635531827807426,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.02388986200094223,
      0.0009727313299663365,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.025880683213472366,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.025835324078798294,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010180906392633915,
      0.023844502866268158,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.003008912317454815,
      0.021853681653738022,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004999734461307526,
      0.019862858578562737,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.006990555673837662,
      0.0178720373660326,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.008981377817690372,
      0.015881216153502464,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.010972199961543083,
      0.013890394009649754,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01296302117407322,
      0.011899571865797043,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01495384331792593,
      0.009908749721944332,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01694466546177864,
      0.007917927578091621,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.018935488536953926,
      0.005927106365561485,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.020874010398983955,
      0.004040425643324852,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.022114217281341553,
      0.0033186059445142746,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.02173672430217266,
      0.0036109676584601402,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.020497702062129974,
      0.004762193653732538,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.018486659973859787,
      0.006592618301510811,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01585603691637516,
      0.00896277092397213,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.012738768011331558,
      0.011751330457627773,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.009250369854271412,
      0.014853144995868206,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.005490840878337622,
      0.018177473917603493,
      0.0028155462350696325,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0015463664894923568,
      0.01632951945066452,
      0.007420188747346401,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.011181050911545753,
      0.012018864043056965,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.006065350491553545,
      0.016561277210712433,
      0.004360878840088844,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010297985281795263,
      0.012770536355674267,
      0.009707189165055752,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.006986402906477451,
      0.01485429983586073,
      0.004391219466924667,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.001418047584593296,
      0.011486922390758991,
      0.010089744813740253,
      0.00040022286702878773,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.005411104764789343,
      0.014735566452145576,
      0.006518189795315266,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00827841367572546,
      0.012277561239898205,
      0.00396781275048852,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.002187808509916067,
      0.010184479877352715,
      0.00998187530785799,
      0.0022864851634949446,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00386943481862545,
      0.011274894699454308,
      0.008466221392154694,
      0.0013397691072896123,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004820294212549925,
      0.011678251437842846,
      0.007608682848513126,
      0.0010091039584949613,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.005156961735337973,
      0.011507894843816757,
      0.007301822770386934,
      0.0011901655234396458,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004982104524970055,
      0.010863498784601688,
      0.007451189681887627,
      0.001791381393559277,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004385921638458967,
      0.009832492098212242,
      0.007973956875503063,
      0.002732589840888977,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0034474546555429697,
      0.008491347543895245,
      0.008797688409686089,
      0.00394382793456316,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0022357646375894547,
      0.0069067515432834625,
      0.009859241545200348,
      0.005364237818866968,
      0.0008692338014952838,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0008110002381727099,
      0.005136650986969471,
      0.00946230161935091,
      0.0069410777650773525,
      0.0027783995028585196,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.003231203882023692,
      0.007237049750983715,
      0.00862883497029543,
      0.004773912951350212,
      0.0009189908159896731,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.001233637798577547,
      0.0049433219246566296,
      0.008653006516397,
      0.006818502210080624,
      0.003248583758249879,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0026164355222135782,
      0.006051854696124792,
      0.008880467154085636,
      0.005574479699134827,
      0.002268492942675948,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0002863667905330658,
      0.003467798000201583,
      0.0066492292098701,
      0.00787146482616663,
      0.004809896927326918,
      0.0017483289120718837,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0009245910914614797,
      0.0038708120118826628,
      0.00681703258305788,
      0.007283343467861414,
      0.004448124207556248,
      0.0016129047144204378,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0011703289346769452,
      0.003898728871718049,
      0.006627128925174475,
      0.0070473202504217625,
      0.004421714693307877,
      0.0017961094854399562,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010892992140725255,
      0.003615982597693801,
      0.006142666097730398,
      0.007102936040610075,
      0.004671447444707155,
      0.002239959081634879,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0007392280967906117,
      0.0030791081953793764,
      0.005418988410383463,
      0.007397185545414686,
      0.005145462695509195,
      0.002893739379942417,
      0.0006420162972062826,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00017068670422304422,
      0.0023375742603093386,
      0.004504461772739887,
      0.0066713495180010796,
      0.005798479542136192,
      0.003713231300935149,
      0.0016279831761494279,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0014345343224704266,
      0.0034412189852446318,
      0.005447904113680124,
      0.006591092795133591,
      0.004660011734813452,
      0.002728930441662669,
      0.0007978491485118866,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0004075043834745884,
      0.002265830524265766,
      0.004124156199395657,
      0.005982482805848122,
      0.005700822453945875,
      0.003912510350346565,
      0.0021241982467472553,
      0.0003358862304594368,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010099108330905437,
      0.002730846870690584,
      0.004451782442629337,
      0.006172718480229378,
      0.005150905344635248,
      0.0034948070533573627,
      0.0018387088784947991,
      0.0001826105872169137,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0012943691108375788,
      0.002888072282075882,
      0.004481775686144829,
      0.006075479090213776,
      0.0048866597935557365,
      0.003353001084178686,
      0.0018193417927250266,
      0.00028568264679051936,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0013131388695910573,
      0.0027890161145478487,
      0.004264893010258675,
      0.0057407706044614315,
      0.004859979264438152,
      0.0034397069830447435,
      0.0020194342359900475,
      0.0005991620710119605,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0011121684219688177,
      0.002478930866345763,
      0.0038456933107227087,
      0.0052124555222690105,
      0.005028639920055866,
      0.0037133716978132725,
      0.002398103242740035,
      0.0010828346712514758,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0007317548734135926,
      0.0019974694587290287,
      0.003263183869421482,
      0.004528898745775223,
      0.005355686880648136,
      0.004137659445405006,
      0.0029196315445005894,
      0.0017016039928421378,
      0.0004835762665607035,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00020713974663522094,
      0.0013792773243039846,
      0.0025514145381748676,
      0.003723552217707038,
      0.004895689897239208,
      0.004680895246565342,
      0.0035529187880456448,
      0.0024249425623565912,
      0.0012969663366675377,
      0.00016899015463422984,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0006545265205204487,
      0.0017400053329765797,
      0.0028254841454327106,
      0.003910962492227554,
      0.004996441304683685,
      0.0042709787376224995,
      0.003226396394893527,
      0.002181813819333911,
      0.0011372314766049385,
      9.264905384043232e-05,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.000854626705404371,
      0.001859853626228869,
      0.002865080488845706,
      0.003870307235047221,
      0.00487553421407938,
      0.00408313749358058,
      0.003115783678367734,
      0.0021484296303242445,
      0.001181075582280755,
      0.0002137213887181133,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0008483415003865957,
      0.0017792496364563704,
      0.0027101580053567886,
      0.0036410661414265633,
      0.004571974277496338,
      0.004079728852957487,
      0.003183893393725157,
      0.002288057701662183,
      0.0013922222424298525,
      0.0004963868414051831,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0006716204807162285,
      0.0015337044605985284,
      0.002395788673311472,
      0.0032578727696090937,
      0.004119956865906715,
      0.004227725323289633,
      0.0033981208689510822,
      0.0025685166474431753,
      0.0017389123095199466,
      0.0009093079133890569,
      7.970355363795534e-05,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0003559796023182571,
      0.0011543278815224767,
      0.0019526762189343572,
      0.002751024439930916,
      0.0035493727773427963,
      0.004347721114754677,
      0.0037299629766494036,
      0.002961693098768592,
      0.00219342322088778,
      0.0014251532265916467,
      0.0006568834069184959,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0006682946113869548,
      0.0014076193328946829,
      0.0021469437051564455,
      0.002886268775910139,
      0.0036255933810025454,
      0.004154576454311609,
      0.0034431067761033773,
      0.0027316368650645018,
      0.0020201667211949825,
      0.0013086966937407851,
      0.0005972267827019095,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      9.926508937496692e-05,
      0.0007839298341423273,
      0.001468594535253942,
      0.0021532592363655567,
      0.0028379240538924932,
      0.0035225888714194298,
      0.0039915177039802074,
      0.0033326479606330395,
      0.002673778682947159,
      0.002014909405261278,
      0.0013560398947447538,
      0.0006971705006435513,
      3.8301113818306476e-05,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00010181095422012731,
      0.0007358568836934865,
      0.0013699028640985489,
      0.0020039486698806286,
      0.002637994708493352,
      0.0032720407471060753,
      0.003906086552888155,
      0.0033682563807815313,
      0.0027580985333770514,
      0.002147940918803215,
      0.0015377833042293787,
      0.0009276255150325596,
      0.000317467754939571,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0005530364578589797,
      0.0011402058880776167,
      0.0017273754347115755,
      0.0023145449813455343,
      0.002901714527979493,
      0.003488884074613452,
      0.003523340215906501,
      0.002958292607218027,
      0.002393245231360197,
      0.0018281979719176888,
      0.001263150479644537,
      0.0006981031037867069,
      0.0001330557424807921,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0002608386566862464,
      0.0008045974536798894,
      0.0013483562506735325,
      0.0018921148730441928,
      0.0024358737282454967,
      0.002979632467031479,
      0.003523391205817461,
      0.003251380519941449,
      0.0027281083166599274,
      0.002204835880547762,
      0.001681563793681562,
      0.001158291706815362,
      0.0006350195035338402,
      0.00011174729297636077,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0003849811910185963,
      0.0008885387214832008,
      0.001392096164636314,
      0.0018956535495817661,
      0.00239921105094254,
      0.002902768552303314,
      0.0034063260536640882,
      0.003132763085886836,
      0.0026481777895241976,
      0.0021635922603309155,
      0.0016790067311376333,
      0.0011944210855290294,
      0.0007098356145434082,
      0.00022525011445395648,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.000366741674952209,
      0.0008330700220540166,
      0.0012993983691558242,
      0.0017657268326729536,
      0.0022320549469441175,
      0.002698383294045925,
      0.0031647118739783764,
      0.003141313325613737,
      0.002692554146051407,
      0.0022437951993197203,
      0.00179503601975739,
      0.0013462770730257034,
      0.000897518009878695,
      0.0004487590049393475,
      0.0
    ]
  ],
  "n_fft": 400,
  "n_samples": 480000,
  "nb_max_frames": 3000,
  "padding_side": "right",
  "padding_value": 0.0,
  "processor_class": "WhisperProcessor",
  "return_attention_mask": false,
  "sampling_rate": 16000
}

[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file vocab.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/vocab.json
[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file tokenizer.json from cache at None
[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file merges.txt from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/merges.txt
[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file normalizer.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/normalizer.json
[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file added_tokens.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/added_tokens.json
[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file special_tokens_map.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/special_tokens_map.json
[INFO|tokenization_utils_base.py:1799] 2022-12-21 13:58:44,815 >> loading file tokenizer_config.json from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/tokenizer_config.json
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|endoftext|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|startoftranscript|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|en|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|zh|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|de|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|es|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|ru|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|ko|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|fr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|ja|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|pt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,875 >> Adding <|tr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|pl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|ca|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|nl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|ar|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|sv|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|it|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|id|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|hi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|fi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|vi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|iw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|uk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|el|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|ms|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|cs|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|ro|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|da|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|hu|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|ta|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|no|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|th|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,876 >> Adding <|ur|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|hr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|bg|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|lt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|la|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|mi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|ml|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|cy|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|sk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|te|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|fa|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|lv|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|bn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|sr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|az|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|sl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|kn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|et|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|mk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|br|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|eu|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|is|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,877 >> Adding <|hy|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|ne|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|mn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|bs|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|kk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|sq|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|sw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|gl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|mr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|pa|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|si|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|km|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|sn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|yo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|so|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|af|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|oc|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|ka|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|be|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|tg|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|sd|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|gu|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,878 >> Adding <|am|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|yi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|lo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|uz|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|fo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|ht|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|ps|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|tk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|nn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|mt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|sa|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|lb|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|my|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|bo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|tl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|mg|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|as|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|tt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|haw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|ln|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|ha|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|ba|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,879 >> Adding <|jw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|su|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|translate|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|transcribe|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|startoflm|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|startofprev|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|nocaptions|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:44,880 >> Adding <|notimestamps|> to the vocabulary
[INFO|modeling_utils.py:2264] 2022-12-21 13:58:44,884 >> loading weights file pytorch_model.bin from cache at /home/ubuntu/.cache/huggingface/hub/models--openai--whisper-medium/snapshots/a0b3589e1034234495a1b696c28d4832cdaf8a32/pytorch_model.bin
[INFO|configuration_utils.py:523] 2022-12-21 13:58:45,879 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|modeling_utils.py:2842] 2022-12-21 13:58:53,116 >> All model checkpoint weights were used when initializing WhisperForConditionalGeneration.

[INFO|modeling_utils.py:2850] 2022-12-21 13:58:53,117 >> All the weights of WhisperForConditionalGeneration were initialized from the model checkpoint at openai/whisper-medium.
If your task is similar to the task the model of the checkpoint was trained on, you can already use WhisperForConditionalGeneration for predictions without further training.
[INFO|modeling_utils.py:2511] 2022-12-21 13:58:53,374 >> Generation config file not found, using a generation config created from the model config.
[INFO|feature_extraction_utils.py:368] 2022-12-21 13:58:55,536 >> Feature extractor saved in ./preprocessor_config.json
[INFO|tokenization_utils_base.py:2157] 2022-12-21 13:58:55,537 >> tokenizer config file saved in ./tokenizer_config.json
[INFO|tokenization_utils_base.py:2164] 2022-12-21 13:58:55,537 >> Special tokens file saved in ./special_tokens_map.json
[INFO|tokenization_utils_base.py:2210] 2022-12-21 13:58:55,537 >> added tokens file saved in ./added_tokens.json
[INFO|configuration_utils.py:447] 2022-12-21 13:58:55,618 >> Configuration saved in ./config.json
[INFO|image_processing_utils.py:294] 2022-12-21 13:58:55,619 >> loading configuration file ./preprocessor_config.json
[INFO|feature_extraction_utils.py:462] 2022-12-21 13:58:55,624 >> loading configuration file ./preprocessor_config.json
[INFO|feature_extraction_utils.py:501] 2022-12-21 13:58:55,638 >> Feature extractor WhisperFeatureExtractor {
  "chunk_length": 30,
  "feature_extractor_type": "WhisperFeatureExtractor",
  "feature_size": 80,
  "hop_length": 160,
  "mel_filters": [
    [
      -0.0,
      0.02486259490251541,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.001990821911022067,
      0.022871771827340126,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.003981643822044134,
      0.02088095061480999,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0059724655002355576,
      0.018890129402279854,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.007963287644088268,
      0.01689930632710457,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.009954108856618404,
      0.014908484183251858,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.011944931000471115,
      0.012917662039399147,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.013935752213001251,
      0.010926840826869011,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.015926575288176537,
      0.0089360186830163,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.017917396500706673,
      0.006945197004824877,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01990821771323681,
      0.004954374860972166,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.021899040788412094,
      0.0029635531827807426,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.02388986200094223,
      0.0009727313299663365,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.025880683213472366,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.025835324078798294,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010180906392633915,
      0.023844502866268158,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.003008912317454815,
      0.021853681653738022,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004999734461307526,
      0.019862858578562737,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.006990555673837662,
      0.0178720373660326,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.008981377817690372,
      0.015881216153502464,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.010972199961543083,
      0.013890394009649754,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01296302117407322,
      0.011899571865797043,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01495384331792593,
      0.009908749721944332,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01694466546177864,
      0.007917927578091621,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.018935488536953926,
      0.005927106365561485,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.020874010398983955,
      0.004040425643324852,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.022114217281341553,
      0.0033186059445142746,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.02173672430217266,
      0.0036109676584601402,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.020497702062129974,
      0.004762193653732538,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.018486659973859787,
      0.006592618301510811,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.01585603691637516,
      0.00896277092397213,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.012738768011331558,
      0.011751330457627773,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.009250369854271412,
      0.014853144995868206,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.005490840878337622,
      0.018177473917603493,
      0.0028155462350696325,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0015463664894923568,
      0.01632951945066452,
      0.007420188747346401,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.011181050911545753,
      0.012018864043056965,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.006065350491553545,
      0.016561277210712433,
      0.004360878840088844,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010297985281795263,
      0.012770536355674267,
      0.009707189165055752,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.006986402906477451,
      0.01485429983586073,
      0.004391219466924667,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.001418047584593296,
      0.011486922390758991,
      0.010089744813740253,
      0.00040022286702878773,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.005411104764789343,
      0.014735566452145576,
      0.006518189795315266,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00827841367572546,
      0.012277561239898205,
      0.00396781275048852,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.002187808509916067,
      0.010184479877352715,
      0.00998187530785799,
      0.0022864851634949446,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00386943481862545,
      0.011274894699454308,
      0.008466221392154694,
      0.0013397691072896123,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004820294212549925,
      0.011678251437842846,
      0.007608682848513126,
      0.0010091039584949613,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.005156961735337973,
      0.011507894843816757,
      0.007301822770386934,
      0.0011901655234396458,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004982104524970055,
      0.010863498784601688,
      0.007451189681887627,
      0.001791381393559277,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.004385921638458967,
      0.009832492098212242,
      0.007973956875503063,
      0.002732589840888977,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0034474546555429697,
      0.008491347543895245,
      0.008797688409686089,
      0.00394382793456316,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0022357646375894547,
      0.0069067515432834625,
      0.009859241545200348,
      0.005364237818866968,
      0.0008692338014952838,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0008110002381727099,
      0.005136650986969471,
      0.00946230161935091,
      0.0069410777650773525,
      0.0027783995028585196,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.003231203882023692,
      0.007237049750983715,
      0.00862883497029543,
      0.004773912951350212,
      0.0009189908159896731,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.001233637798577547,
      0.0049433219246566296,
      0.008653006516397,
      0.006818502210080624,
      0.003248583758249879,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0026164355222135782,
      0.006051854696124792,
      0.008880467154085636,
      0.005574479699134827,
      0.002268492942675948,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0002863667905330658,
      0.003467798000201583,
      0.0066492292098701,
      0.00787146482616663,
      0.004809896927326918,
      0.0017483289120718837,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0009245910914614797,
      0.0038708120118826628,
      0.00681703258305788,
      0.007283343467861414,
      0.004448124207556248,
      0.0016129047144204378,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0011703289346769452,
      0.003898728871718049,
      0.006627128925174475,
      0.0070473202504217625,
      0.004421714693307877,
      0.0017961094854399562,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010892992140725255,
      0.003615982597693801,
      0.006142666097730398,
      0.007102936040610075,
      0.004671447444707155,
      0.002239959081634879,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0007392280967906117,
      0.0030791081953793764,
      0.005418988410383463,
      0.007397185545414686,
      0.005145462695509195,
      0.002893739379942417,
      0.0006420162972062826,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00017068670422304422,
      0.0023375742603093386,
      0.004504461772739887,
      0.0066713495180010796,
      0.005798479542136192,
      0.003713231300935149,
      0.0016279831761494279,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0014345343224704266,
      0.0034412189852446318,
      0.005447904113680124,
      0.006591092795133591,
      0.004660011734813452,
      0.002728930441662669,
      0.0007978491485118866,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0004075043834745884,
      0.002265830524265766,
      0.004124156199395657,
      0.005982482805848122,
      0.005700822453945875,
      0.003912510350346565,
      0.0021241982467472553,
      0.0003358862304594368,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0010099108330905437,
      0.002730846870690584,
      0.004451782442629337,
      0.006172718480229378,
      0.005150905344635248,
      0.0034948070533573627,
      0.0018387088784947991,
      0.0001826105872169137,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0012943691108375788,
      0.002888072282075882,
      0.004481775686144829,
      0.006075479090213776,
      0.0048866597935557365,
      0.003353001084178686,
      0.0018193417927250266,
      0.00028568264679051936,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0013131388695910573,
      0.0027890161145478487,
      0.004264893010258675,
      0.0057407706044614315,
      0.004859979264438152,
      0.0034397069830447435,
      0.0020194342359900475,
      0.0005991620710119605,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0011121684219688177,
      0.002478930866345763,
      0.0038456933107227087,
      0.0052124555222690105,
      0.005028639920055866,
      0.0037133716978132725,
      0.002398103242740035,
      0.0010828346712514758,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0007317548734135926,
      0.0019974694587290287,
      0.003263183869421482,
      0.004528898745775223,
      0.005355686880648136,
      0.004137659445405006,
      0.0029196315445005894,
      0.0017016039928421378,
      0.0004835762665607035,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00020713974663522094,
      0.0013792773243039846,
      0.0025514145381748676,
      0.003723552217707038,
      0.004895689897239208,
      0.004680895246565342,
      0.0035529187880456448,
      0.0024249425623565912,
      0.0012969663366675377,
      0.00016899015463422984,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0006545265205204487,
      0.0017400053329765797,
      0.0028254841454327106,
      0.003910962492227554,
      0.004996441304683685,
      0.0042709787376224995,
      0.003226396394893527,
      0.002181813819333911,
      0.0011372314766049385,
      9.264905384043232e-05,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.000854626705404371,
      0.001859853626228869,
      0.002865080488845706,
      0.003870307235047221,
      0.00487553421407938,
      0.00408313749358058,
      0.003115783678367734,
      0.0021484296303242445,
      0.001181075582280755,
      0.0002137213887181133,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0008483415003865957,
      0.0017792496364563704,
      0.0027101580053567886,
      0.0036410661414265633,
      0.004571974277496338,
      0.004079728852957487,
      0.003183893393725157,
      0.002288057701662183,
      0.0013922222424298525,
      0.0004963868414051831,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0006716204807162285,
      0.0015337044605985284,
      0.002395788673311472,
      0.0032578727696090937,
      0.004119956865906715,
      0.004227725323289633,
      0.0033981208689510822,
      0.0025685166474431753,
      0.0017389123095199466,
      0.0009093079133890569,
      7.970355363795534e-05,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0003559796023182571,
      0.0011543278815224767,
      0.0019526762189343572,
      0.002751024439930916,
      0.0035493727773427963,
      0.004347721114754677,
      0.0037299629766494036,
      0.002961693098768592,
      0.00219342322088778,
      0.0014251532265916467,
      0.0006568834069184959,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0006682946113869548,
      0.0014076193328946829,
      0.0021469437051564455,
      0.002886268775910139,
      0.0036255933810025454,
      0.004154576454311609,
      0.0034431067761033773,
      0.0027316368650645018,
      0.0020201667211949825,
      0.0013086966937407851,
      0.0005972267827019095,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      9.926508937496692e-05,
      0.0007839298341423273,
      0.001468594535253942,
      0.0021532592363655567,
      0.0028379240538924932,
      0.0035225888714194298,
      0.0039915177039802074,
      0.0033326479606330395,
      0.002673778682947159,
      0.002014909405261278,
      0.0013560398947447538,
      0.0006971705006435513,
      3.8301113818306476e-05,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.00010181095422012731,
      0.0007358568836934865,
      0.0013699028640985489,
      0.0020039486698806286,
      0.002637994708493352,
      0.0032720407471060753,
      0.003906086552888155,
      0.0033682563807815313,
      0.0027580985333770514,
      0.002147940918803215,
      0.0015377833042293787,
      0.0009276255150325596,
      0.000317467754939571,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0005530364578589797,
      0.0011402058880776167,
      0.0017273754347115755,
      0.0023145449813455343,
      0.002901714527979493,
      0.003488884074613452,
      0.003523340215906501,
      0.002958292607218027,
      0.002393245231360197,
      0.0018281979719176888,
      0.001263150479644537,
      0.0006981031037867069,
      0.0001330557424807921,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0002608386566862464,
      0.0008045974536798894,
      0.0013483562506735325,
      0.0018921148730441928,
      0.0024358737282454967,
      0.002979632467031479,
      0.003523391205817461,
      0.003251380519941449,
      0.0027281083166599274,
      0.002204835880547762,
      0.001681563793681562,
      0.001158291706815362,
      0.0006350195035338402,
      0.00011174729297636077,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0003849811910185963,
      0.0008885387214832008,
      0.001392096164636314,
      0.0018956535495817661,
      0.00239921105094254,
      0.002902768552303314,
      0.0034063260536640882,
      0.003132763085886836,
      0.0026481777895241976,
      0.0021635922603309155,
      0.0016790067311376333,
      0.0011944210855290294,
      0.0007098356145434082,
      0.00022525011445395648,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0
    ],
    [
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.0,
      0.000366741674952209,
      0.0008330700220540166,
      0.0012993983691558242,
      0.0017657268326729536,
      0.0022320549469441175,
      0.002698383294045925,
      0.0031647118739783764,
      0.003141313325613737,
      0.002692554146051407,
      0.0022437951993197203,
      0.00179503601975739,
      0.0013462770730257034,
      0.000897518009878695,
      0.0004487590049393475,
      0.0
    ]
  ],
  "n_fft": 400,
  "n_samples": 480000,
  "nb_max_frames": 3000,
  "padding_side": "right",
  "padding_value": 0.0,
  "processor_class": "WhisperProcessor",
  "return_attention_mask": false,
  "sampling_rate": 16000
}

[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file vocab.json
[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file tokenizer.json
[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file merges.txt
[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file normalizer.json
[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file added_tokens.json
[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file special_tokens_map.json
[INFO|tokenization_utils_base.py:1797] 2022-12-21 13:58:55,639 >> loading file tokenizer_config.json
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|endoftext|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|startoftranscript|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|en|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|zh|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|de|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|es|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|ru|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|ko|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|fr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|ja|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|pt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|tr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|pl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|ca|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|nl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|ar|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|sv|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,694 >> Adding <|it|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|id|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|hi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|fi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|vi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|iw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|uk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|el|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|ms|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|cs|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|ro|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|da|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|hu|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|ta|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|no|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|th|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|ur|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|hr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|bg|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|lt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|la|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|mi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|ml|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,695 >> Adding <|cy|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|sk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|te|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|fa|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|lv|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|bn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|sr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|az|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|sl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|kn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|et|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|mk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|br|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|eu|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|is|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|hy|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|ne|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|mn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|bs|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|kk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|sq|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|sw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|gl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|mr|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|pa|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,696 >> Adding <|si|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|km|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|sn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|yo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|so|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|af|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|oc|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|ka|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|be|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|tg|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|sd|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|gu|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|am|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|yi|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|lo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|uz|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|fo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|ht|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|ps|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|tk|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|nn|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|mt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|sa|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,697 >> Adding <|lb|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|my|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|bo|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|tl|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|mg|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|as|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|tt|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|haw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|ln|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|ha|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|ba|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|jw|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|su|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|translate|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|transcribe|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|startoflm|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|startofprev|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|nocaptions|> to the vocabulary
[INFO|tokenization_utils.py:426] 2022-12-21 13:58:55,698 >> Adding <|notimestamps|> to the vocabulary
/home/ubuntu/whisper-medium-is/./ is already a clone of https://huggingface.co/DavidErikMollberg/whisper-medium-is. Make sure you pull the latest changes with `repo.git_pull()`.
12/21/2022 13:58:56 - WARNING - huggingface_hub.repository - /home/ubuntu/whisper-medium-is/./ is already a clone of https://huggingface.co/DavidErikMollberg/whisper-medium-is. Make sure you pull the latest changes with `repo.git_pull()`.
[INFO|trainer.py:511] 2022-12-21 13:59:00,154 >> max_steps is given, it will override any value given in num_train_epochs
[INFO|trainer.py:565] 2022-12-21 13:59:00,154 >> Using cuda_amp half precision backend
[INFO|trainer.py:1963] 2022-12-21 13:59:00,155 >> Loading model from ./checkpoint-6000.
[2022-12-21 13:59:00,159] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed info: version=0.7.7, git-hash=unknown, git-branch=unknown
[2022-12-21 13:59:00,839] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False
[2022-12-21 13:59:02,004] [WARNING] [cpu_adam.py:83:__init__] FP16 params for CPUAdam may not work on AMD CPUs
Installed CUDA version 11.6 does not match the version torch was compiled with 11.7 but since the APIs are compatible, accepting this combination
Using /home/ubuntu/.cache/torch_extensions/py39_cu117 as PyTorch extensions root...
Detected CUDA files, patching ldflags
Emitting ninja build file /home/ubuntu/.cache/torch_extensions/py39_cu117/cpu_adam/build.ninja...
Building extension module cpu_adam...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
Loading extension module cpu_adam...
Time to load cpu_adam op: 2.6949996948242188 seconds
Adam Optimizer #0 is created with AVX2 arithmetic capability.
Config: alpha=0.000010, betas=(0.900000, 0.999000), weight_decay=0.000000, adam_w=1
[2022-12-21 13:59:06,286] [INFO] [logging.py:68:log_dist] [Rank 0] Using DeepSpeed Optimizer param name adamw as basic optimizer
[2022-12-21 13:59:06,466] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed Basic Optimizer = DeepSpeedCPUAdam
[2022-12-21 13:59:06,466] [INFO] [utils.py:52:is_zero_supported_optimizer] Checking ZeRO support for optimizer=DeepSpeedCPUAdam type=<class 'deepspeed.ops.adam.cpu_adam.DeepSpeedCPUAdam'>
[2022-12-21 13:59:06,466] [INFO] [logging.py:68:log_dist] [Rank 0] Creating fp16 ZeRO stage 2 optimizer
[2022-12-21 13:59:06,467] [INFO] [stage_1_and_2.py:140:__init__] Reduce bucket size 200000000
[2022-12-21 13:59:06,467] [INFO] [stage_1_and_2.py:141:__init__] Allgather bucket size 200000000
[2022-12-21 13:59:06,467] [INFO] [stage_1_and_2.py:142:__init__] CPU Offload: True
[2022-12-21 13:59:06,467] [INFO] [stage_1_and_2.py:143:__init__] Round robin gradient partitioning: False
Using /home/ubuntu/.cache/torch_extensions/py39_cu117 as PyTorch extensions root...
Emitting ninja build file /home/ubuntu/.cache/torch_extensions/py39_cu117/utils/build.ninja...
Building extension module utils...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
Loading extension module utils...
Time to load utils op: 0.28768348693847656 seconds
Rank: 0 partition count [1] and sizes[(763857920, False)] 
[2022-12-21 13:59:08,547] [INFO] [utils.py:827:see_memory_usage] Before initializing optimizer states
[2022-12-21 13:59:08,547] [INFO] [utils.py:828:see_memory_usage] MA 1.52 GB         Max_MA 1.52 GB         CA 2.86 GB         Max_CA 3 GB 
[2022-12-21 13:59:08,547] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory:  used = 13.74 GB, percent = 7.0%
[2022-12-21 13:59:10,495] [INFO] [utils.py:827:see_memory_usage] After initializing optimizer states
[2022-12-21 13:59:10,496] [INFO] [utils.py:828:see_memory_usage] MA 1.52 GB         Max_MA 1.52 GB         CA 2.86 GB         Max_CA 3 GB 
[2022-12-21 13:59:10,496] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory:  used = 23.51 GB, percent = 12.0%
[2022-12-21 13:59:10,496] [INFO] [stage_1_and_2.py:525:__init__] optimizer state initialized
[2022-12-21 13:59:10,564] [INFO] [utils.py:827:see_memory_usage] After initializing ZeRO optimizer
[2022-12-21 13:59:10,565] [INFO] [utils.py:828:see_memory_usage] MA 1.52 GB         Max_MA 1.52 GB         CA 2.86 GB         Max_CA 3 GB 
[2022-12-21 13:59:10,565] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory:  used = 23.51 GB, percent = 12.0%
[2022-12-21 13:59:10,583] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed Final Optimizer = adamw
[2022-12-21 13:59:10,583] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed using configured LR scheduler = WarmupDecayLR
[2022-12-21 13:59:10,583] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed LR Scheduler = <deepspeed.runtime.lr_schedules.WarmupDecayLR object at 0x7fb4c667ca60>
[2022-12-21 13:59:10,583] [INFO] [logging.py:68:log_dist] [Rank 0] step=0, skipped=0, lr=[1e-05], mom=[[0.9, 0.999]]
[2022-12-21 13:59:10,585] [INFO] [config.py:1020:print] DeepSpeedEngine configuration:
[2022-12-21 13:59:10,585] [INFO] [config.py:1024:print]   activation_checkpointing_config  {
    "partition_activations": false, 
    "contiguous_memory_optimization": false, 
    "cpu_checkpointing": false, 
    "number_checkpoints": null, 
    "synchronize_checkpoint_boundary": false, 
    "profile": false
}
[2022-12-21 13:59:10,585] [INFO] [config.py:1024:print]   aio_config ................... {'block_size': 1048576, 'queue_depth': 8, 'thread_count': 1, 'single_submit': False, 'overlap_events': True}
[2022-12-21 13:59:10,585] [INFO] [config.py:1024:print]   amp_enabled .................. False
[2022-12-21 13:59:10,585] [INFO] [config.py:1024:print]   amp_params ................... False
[2022-12-21 13:59:10,585] [INFO] [config.py:1024:print]   autotuning_config ............ {
    "enabled": false, 
    "start_step": null, 
    "end_step": null, 
    "metric_path": null, 
    "arg_mappings": null, 
    "metric": "throughput", 
    "model_info": null, 
    "results_dir": "autotuning_results", 
    "exps_dir": "autotuning_exps", 
    "overwrite": true, 
    "fast": true, 
    "start_profile_step": 3, 
    "end_profile_step": 5, 
    "tuner_type": "gridsearch", 
    "tuner_early_stopping": 5, 
    "tuner_num_trials": 50, 
    "model_info_path": null, 
    "mp_size": 1, 
    "max_train_batch_size": null, 
    "min_train_batch_size": 1, 
    "max_train_micro_batch_size_per_gpu": 1.024000e+03, 
    "min_train_micro_batch_size_per_gpu": 1, 
    "num_tuning_micro_batch_sizes": 3
}
[2022-12-21 13:59:10,585] [INFO] [config.py:1024:print]   bfloat16_enabled ............. False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   checkpoint_parallel_write_pipeline  False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   checkpoint_tag_validation_enabled  True
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   checkpoint_tag_validation_fail  False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   comms_config ................. <deepspeed.comm.config.DeepSpeedCommsConfig object at 0x7fb5940b9d30>
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   communication_data_type ...... None
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   compression_config ........... {'weight_quantization': {'shared_parameters': {'enabled': False, 'quantizer_kernel': False, 'schedule_offset': 0, 'quantize_groups': 1, 'quantize_verbose': False, 'quantization_type': 'symmetric', 'quantize_weight_in_forward': False, 'rounding': 'nearest', 'fp16_mixed_quantize': False, 'quantize_change_ratio': 0.001}, 'different_groups': {}}, 'activation_quantization': {'shared_parameters': {'enabled': False, 'quantization_type': 'symmetric', 'range_calibration': 'dynamic', 'schedule_offset': 1000}, 'different_groups': {}}, 'sparse_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'row_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'head_pruning': {'shared_parameters': {'enabled': False, 'method': 'topk', 'schedule_offset': 1000}, 'different_groups': {}}, 'channel_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'layer_reduction': {'enabled': False}}
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   curriculum_enabled ........... False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   curriculum_params ............ False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   dataloader_drop_last ......... False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   disable_allgather ............ False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   dump_state ................... False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   dynamic_loss_scale_args ...... {'init_scale': 65536, 'scale_window': 1000, 'delayed_shift': 2, 'min_scale': 1}
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_enabled ........... False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_gas_boundary_resolution  1
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_layer_name ........ bert.encoder.layer
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_layer_num ......... 0
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_max_iter .......... 100
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_stability ......... 1e-06
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_tol ............... 0.01
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   eigenvalue_verbose ........... False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   elasticity_enabled ........... False
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   flops_profiler_config ........ {
    "enabled": false, 
    "profile_step": 1, 
    "module_depth": -1, 
    "top_modules": 1, 
    "detailed": true, 
    "output_file": null
}
[2022-12-21 13:59:10,586] [INFO] [config.py:1024:print]   fp16_auto_cast ............... False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   fp16_enabled ................. True
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   fp16_master_weights_and_gradients  False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   global_rank .................. 0
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   grad_accum_dtype ............. None
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   gradient_accumulation_steps .. 1
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   gradient_clipping ............ 1.0
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   gradient_predivide_factor .... 1.0
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   initial_dynamic_scale ........ 65536
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   load_universal_checkpoint .... False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   loss_scale ................... 0
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   memory_breakdown ............. False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   monitor_config ............... <deepspeed.monitor.config.DeepSpeedMonitorConfig object at 0x7fb593fc90d0>
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   nebula_config ................ {
    "enabled": false, 
    "persistent_storage_path": null, 
    "persistent_time_interval": 100, 
    "num_of_version_in_retention": 2, 
    "enable_nebula_load": true, 
    "load_path": null
}
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   optimizer_legacy_fusion ...... False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   optimizer_name ............... adamw
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   optimizer_params ............. {'lr': 1e-05, 'betas': [0.9, 0.999], 'eps': 1e-08, 'weight_decay': 0.0}
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   pipeline ..................... {'stages': 'auto', 'partition': 'best', 'seed_layers': False, 'activation_checkpoint_interval': 0}
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   pld_enabled .................. False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   pld_params ................... False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   prescale_gradients ........... False
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   scheduler_name ............... WarmupDecayLR
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   scheduler_params ............. {'last_batch_iteration': -1, 'total_num_steps': 20000, 'warmup_min_lr': 0, 'warmup_max_lr': 1e-05, 'warmup_num_steps': 500}
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   sparse_attention ............. None
[2022-12-21 13:59:10,587] [INFO] [config.py:1024:print]   sparse_gradients_enabled ..... False
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   steps_per_print .............. 10
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   train_batch_size ............. 64
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   train_micro_batch_size_per_gpu  64
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   use_node_local_storage ....... False
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   wall_clock_breakdown ......... False
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   world_size ................... 1
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   zero_allow_untested_optimizer  False
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   zero_config .................. stage=2 contiguous_gradients=True reduce_scatter=True reduce_bucket_size=200000000 allgather_partitions=True allgather_bucket_size=200000000 overlap_comm=True load_from_fp32_weights=True elastic_checkpoint=False offload_param=None offload_optimizer=DeepSpeedZeroOffloadOptimizerConfig(device='cpu', nvme_path=None, buffer_count=4, pin_memory=True, pipeline=False, pipeline_read=False, pipeline_write=False, fast_init=False) sub_group_size=1,000,000,000 cpu_offload_param=None cpu_offload_use_pin_memory=None cpu_offload=None prefetch_bucket_size=50,000,000 param_persistence_threshold=100,000 model_persistence_threshold=sys.maxsize max_live_parameters=1,000,000,000 max_reuse_distance=1,000,000,000 gather_16bit_weights_on_model_save=False stage3_gather_fp16_weights_on_model_save=False ignore_unused_parameters=True legacy_stage1=False round_robin_gradients=False
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   zero_enabled ................. True
[2022-12-21 13:59:10,588] [INFO] [config.py:1024:print]   zero_optimization_stage ...... 2
[2022-12-21 13:59:10,588] [INFO] [config.py:1009:print_user_config]   json = {
    "fp16": {
        "enabled": true, 
        "loss_scale": 0, 
        "loss_scale_window": 1000, 
        "initial_scale_power": 16, 
        "hysteresis": 2, 
        "min_loss_scale": 1
    }, 
    "optimizer": {
        "type": "AdamW", 
        "params": {
            "lr": 1e-05, 
            "betas": [0.9, 0.999], 
            "eps": 1e-08, 
            "weight_decay": 0.0
        }
    }, 
    "scheduler": {
        "type": "WarmupDecayLR", 
        "params": {
            "last_batch_iteration": -1, 
            "total_num_steps": 2.000000e+04, 
            "warmup_min_lr": 0, 
            "warmup_max_lr": 1e-05, 
            "warmup_num_steps": 500
        }
    }, 
    "zero_optimization": {
        "stage": 2, 
        "offload_optimizer": {
            "device": "cpu", 
            "pin_memory": true
        }, 
        "allgather_partitions": true, 
        "allgather_bucket_size": 2.000000e+08, 
        "overlap_comm": true, 
        "reduce_scatter": true, 
        "reduce_bucket_size": 2.000000e+08, 
        "contiguous_gradients": true
    }, 
    "gradient_accumulation_steps": 1, 
    "gradient_clipping": 1.0, 
    "train_batch_size": 64, 
    "train_micro_batch_size_per_gpu": 64
}
Using /home/ubuntu/.cache/torch_extensions/py39_cu117 as PyTorch extensions root...
No modifications detected for re-loaded extension module utils, skipping build step...
Loading extension module utils...
Time to load utils op: 0.0004253387451171875 seconds
[INFO|deepspeed.py:357] 2022-12-21 13:59:10,589 >> Attempting to resume from ./checkpoint-6000
[2022-12-21 13:59:10,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from ./checkpoint-6000/global_step6000/mp_rank_00_model_states.pt...
[2022-12-21 13:59:11,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from ./checkpoint-6000/global_step6000/mp_rank_00_model_states.pt.
[2022-12-21 13:59:11,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from ./checkpoint-6000/global_step6000/mp_rank_00_model_states.pt...
[2022-12-21 13:59:11,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from ./checkpoint-6000/global_step6000/mp_rank_00_model_states.pt.
[2022-12-21 13:59:11,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from ./checkpoint-6000/global_step6000/zero_pp_rank_0_mp_rank_00_optim_states.pt...
[2022-12-21 13:59:14,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from ./checkpoint-6000/global_step6000/zero_pp_rank_0_mp_rank_00_optim_states.pt.
[2022-12-21 13:59:14,567] [INFO] [engine.py:2900:_get_all_zero_checkpoint_state_dicts] successfully read 1 ZeRO state_dicts for rank 0
[2022-12-21 13:59:15,157] [INFO] [engine.py:2840:_load_zero_checkpoint] loading 1 zero partition checkpoints for rank 0
[INFO|trainer.py:1641] 2022-12-21 13:59:15,524 >> ***** Running training *****
[INFO|trainer.py:1642] 2022-12-21 13:59:15,524 >>   Num examples = 1280000
[INFO|trainer.py:1643] 2022-12-21 13:59:15,524 >>   Num Epochs = 9223372036854775807
[INFO|trainer.py:1644] 2022-12-21 13:59:15,525 >>   Instantaneous batch size per device = 64
[INFO|trainer.py:1645] 2022-12-21 13:59:15,525 >>   Total train batch size (w. parallel, distributed & accumulation) = 64
[INFO|trainer.py:1646] 2022-12-21 13:59:15,525 >>   Gradient Accumulation steps = 1
[INFO|trainer.py:1647] 2022-12-21 13:59:15,525 >>   Total optimization steps = 20000
[INFO|trainer.py:1648] 2022-12-21 13:59:15,527 >>   Number of trainable parameters = 763857920
[INFO|trainer.py:1670] 2022-12-21 13:59:15,528 >>   Continuing training from checkpoint, will skip to saved global_step
[INFO|trainer.py:1671] 2022-12-21 13:59:15,528 >>   Continuing training from epoch 0
[INFO|trainer.py:1672] 2022-12-21 13:59:15,528 >>   Continuing training from global step 6000
[INFO|trainer.py:1674] 2022-12-21 13:59:15,528 >>   Will skip the first 0 epochs then the first 6000 batches in the first epoch. If this takes a lot of time, you can add the `--ignore_data_skip` flag to your launch command, but you will resume the training on data already seen by your model.

  0%|          | 0/6000 [00:00<?, ?it/s]
Skipping the first batches:   0%|          | 0/6000 [00:00<?, ?it/s]

  0%|          | 0/20000 [00:00<?, ?it/s][INFO|trainer_utils.py:689] 2022-12-21 13:59:55,129 >> The following columns in the training set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.

Skipping the first batches:   0%|          | 1/6000 [00:39<66:05:21, 39.66s/it]
Skipping the first batches:   0%|          | 2/6000 [00:43<31:15:50, 18.76s/it]
Skipping the first batches:   0%|          | 3/6000 [00:47<20:01:12, 12.02s/it]
Skipping the first batches:   0%|          | 4/6000 [00:52<15:22:06,  9.23s/it]
Skipping the first batches:   0%|          | 5/6000 [00:56<12:13:36,  7.34s/it]
Skipping the first batches:   0%|          | 6/6000 [01:00<10:03:19,  6.04s/it]
Skipping the first batches:   0%|          | 7/6000 [01:03<8:29:02,  5.10s/it] 
Skipping the first batches:   0%|          | 8/6000 [01:07<7:49:12,  4.70s/it]
Skipping the first batches:   0%|          | 9/6000 [01:11<7:26:14,  4.47s/it]
Skipping the first batches:   0%|          | 10/6000 [01:14<7:01:55,  4.23s/it]
Skipping the first batches:   0%|          | 11/6000 [01:19<7:10:16,  4.31s/it]
Skipping the first batches:   0%|          | 12/6000 [01:24<7:23:30,  4.44s/it]
Skipping the first batches:   0%|          | 13/6000 [01:28<7:21:21,  4.42s/it]
Skipping the first batches:   0%|          | 14/6000 [01:32<7:17:20,  4.38s/it]
Skipping the first batches:   0%|          | 15/6000 [01:36<7:02:56,  4.24s/it]
Skipping the first batches:   0%|          | 16/6000 [01:41<7:05:25,  4.27s/it]
Skipping the first batches:   0%|          | 17/6000 [01:45<7:06:31,  4.28s/it]
Skipping the first batches:   0%|          | 18/6000 [01:48<6:31:54,  3.93s/it]
Skipping the first batches:   0%|          | 19/6000 [01:52<6:40:12,  4.01s/it]
Skipping the first batches:   0%|          | 20/6000 [01:56<6:29:33,  3.91s/it]
Skipping the first batches:   0%|          | 21/6000 [01:59<6:18:21,  3.80s/it]
Skipping the first batches:   0%|          | 22/6000 [02:02<5:56:06,  3.57s/it]
Skipping the first batches:   0%|          | 23/6000 [02:06<5:51:27,  3.53s/it]
Skipping the first batches:   0%|          | 24/6000 [02:09<5:45:39,  3.47s/it]
Skipping the first batches:   0%|          | 25/6000 [02:13<5:44:44,  3.46s/it]
Skipping the first batches:   0%|          | 26/6000 [02:16<5:55:39,  3.57s/it]
Skipping the first batches:   0%|          | 27/6000 [02:20<5:46:49,  3.48s/it]
Skipping the first batches:   0%|          | 28/6000 [02:23<5:34:16,  3.36s/it]
Skipping the first batches:   0%|          | 29/6000 [02:26<5:42:35,  3.44s/it][WARNING|tokenization_utils_base.py:3553] 2022-12-21 14:01:45,626 >> Token indices sequence length is longer than the specified maximum sequence length for this model (1057 > 1024). Running this sequence through the model will result in indexing errors

Skipping the first batches:   0%|          | 30/6000 [02:30<5:59:59,  3.62s/it]
Skipping the first batches:   1%|          | 31/6000 [02:34<5:43:09,  3.45s/it]
Skipping the first batches:   1%|          | 32/6000 [02:37<5:30:10,  3.32s/it]
Skipping the first batches:   1%|          | 33/6000 [02:40<5:26:57,  3.29s/it]
Skipping the first batches:   1%|          | 34/6000 [02:43<5:36:21,  3.38s/it]
Skipping the first batches:   1%|          | 35/6000 [02:47<5:36:21,  3.38s/it]
Skipping the first batches:   1%|          | 36/6000 [02:50<5:43:16,  3.45s/it]
Skipping the first batches:   1%|          | 37/6000 [02:54<5:43:23,  3.46s/it]
Skipping the first batches:   1%|          | 38/6000 [02:57<5:39:59,  3.42s/it]
Skipping the first batches:   1%|          | 39/6000 [03:01<5:38:32,  3.41s/it]
Skipping the first batches:   1%|          | 40/6000 [03:04<5:35:17,  3.38s/it]
Skipping the first batches:   1%|          | 41/6000 [03:07<5:29:55,  3.32s/it]
Skipping the first batches:   1%|          | 42/6000 [03:11<5:38:24,  3.41s/it]
Skipping the first batches:   1%|          | 43/6000 [03:15<5:51:47,  3.54s/it]
Skipping the first batches:   1%|          | 44/6000 [03:18<5:46:30,  3.49s/it]
Skipping the first batches:   1%|          | 45/6000 [03:21<5:39:37,  3.42s/it]
Skipping the first batches:   1%|          | 46/6000 [03:25<5:44:31,  3.47s/it]
Skipping the first batches:   1%|          | 47/6000 [03:29<5:58:45,  3.62s/it]
Skipping the first batches:   1%|          | 48/6000 [03:32<5:51:00,  3.54s/it]
Skipping the first batches:   1%|          | 49/6000 [03:35<5:45:38,  3.48s/it]
Skipping the first batches:   1%|          | 50/6000 [03:39<5:46:13,  3.49s/it]
Skipping the first batches:   1%|          | 51/6000 [03:42<5:34:00,  3.37s/it]
Skipping the first batches:   1%|          | 52/6000 [03:45<5:33:32,  3.36s/it]
Skipping the first batches:   1%|          | 53/6000 [03:49<5:33:37,  3.37s/it]
Skipping the first batches:   1%|          | 54/6000 [03:52<5:25:51,  3.29s/it]
Skipping the first batches:   1%|          | 55/6000 [03:55<5:24:02,  3.27s/it]
Skipping the first batches:   1%|          | 56/6000 [03:59<5:48:20,  3.52s/it]
Skipping the first batches:   1%|          | 57/6000 [04:03<5:48:41,  3.52s/it]
Skipping the first batches:   1%|          | 58/6000 [04:06<5:56:52,  3.60s/it]
Skipping the first batches:   1%|          | 59/6000 [04:10<5:40:06,  3.43s/it]
Skipping the first batches:   1%|          | 60/6000 [04:13<5:37:49,  3.41s/it]
Skipping the first batches:   1%|          | 61/6000 [04:17<5:44:39,  3.48s/it]
Skipping the first batches:   1%|          | 62/6000 [04:20<5:41:29,  3.45s/it]
Skipping the first batches:   1%|          | 63/6000 [04:23<5:30:21,  3.34s/it]
Skipping the first batches:   1%|          | 64/6000 [04:26<5:30:22,  3.34s/it]
Skipping the first batches:   1%|          | 65/6000 [04:30<5:35:42,  3.39s/it]
Skipping the first batches:   1%|          | 66/6000 [04:33<5:29:54,  3.34s/it]
Skipping the first batches:   1%|          | 67/6000 [04:37<5:37:58,  3.42s/it]
Skipping the first batches:   1%|          | 68/6000 [04:40<5:37:06,  3.41s/it]
Skipping the first batches:   1%|          | 69/6000 [04:43<5:31:44,  3.36s/it]
Skipping the first batches:   1%|          | 70/6000 [04:46<5:28:02,  3.32s/it]
Skipping the first batches:   1%|          | 71/6000 [04:51<5:51:35,  3.56s/it]
Skipping the first batches:   1%|          | 72/6000 [04:54<5:50:51,  3.55s/it]
Skipping the first batches:   1%|          | 73/6000 [04:57<5:36:59,  3.41s/it]
Skipping the first batches:   1%|          | 74/6000 [05:01<5:44:59,  3.49s/it]
Skipping the first batches:   1%|▏         | 75/6000 [05:04<5:40:37,  3.45s/it]
Skipping the first batches:   1%|▏         | 76/6000 [05:07<5:30:49,  3.35s/it]
Skipping the first batches:   1%|▏         | 77/6000 [05:11<5:31:59,  3.36s/it]
Skipping the first batches:   1%|▏         | 78/6000 [05:14<5:30:08,  3.34s/it]
Skipping the first batches:   1%|▏         | 79/6000 [05:17<5:26:21,  3.31s/it]
Skipping the first batches:   1%|▏         | 80/6000 [05:21<5:29:25,  3.34s/it]
Skipping the first batches:   1%|▏         | 81/6000 [05:24<5:25:08,  3.30s/it]
Skipping the first batches:   1%|▏         | 82/6000 [05:27<5:23:26,  3.28s/it]
Skipping the first batches:   1%|▏         | 83/6000 [05:31<5:32:21,  3.37s/it]
Skipping the first batches:   1%|▏         | 84/6000 [05:34<5:29:11,  3.34s/it]
Skipping the first batches:   1%|▏         | 85/6000 [05:38<5:35:38,  3.40s/it]
Skipping the first batches:   1%|▏         | 86/6000 [05:41<5:43:08,  3.48s/it]
Skipping the first batches:   1%|▏         | 87/6000 [05:45<5:47:26,  3.53s/it]
Skipping the first batches:   1%|▏         | 88/6000 [05:49<6:00:25,  3.66s/it]
Skipping the first batches:   1%|▏         | 89/6000 [05:53<6:11:17,  3.77s/it]
Skipping the first batches:   2%|▏         | 90/6000 [05:57<6:17:43,  3.83s/it]
Skipping the first batches:   2%|▏         | 91/6000 [06:01<6:19:30,  3.85s/it]
Skipping the first batches:   2%|▏         | 92/6000 [06:05<6:26:39,  3.93s/it]
Skipping the first batches:   2%|▏         | 93/6000 [06:09<6:46:46,  4.13s/it]
Skipping the first batches:   2%|▏         | 94/6000 [06:14<6:49:36,  4.16s/it]
Skipping the first batches:   2%|▏         | 95/6000 [06:17<6:21:06,  3.87s/it]
Skipping the first batches:   2%|▏         | 96/6000 [06:20<6:09:19,  3.75s/it]
Skipping the first batches:   2%|▏         | 97/6000 [06:25<6:23:02,  3.89s/it]
Skipping the first batches:   2%|▏         | 98/6000 [06:28<6:22:49,  3.89s/it]
Skipping the first batches:   2%|▏         | 99/6000 [06:33<6:36:38,  4.03s/it]
Skipping the first batches:   2%|▏         | 100/6000 [06:37<6:42:43,  4.10s/it]
Skipping the first batches:   2%|▏         | 101/6000 [06:41<6:30:40,  3.97s/it]
Skipping the first batches:   2%|▏         | 102/6000 [06:45<6:35:35,  4.02s/it]
Skipping the first batches:   2%|▏         | 103/6000 [06:48<6:09:25,  3.76s/it]
Skipping the first batches:   2%|▏         | 104/6000 [06:52<6:16:28,  3.83s/it]
Skipping the first batches:   2%|▏         | 105/6000 [06:55<5:54:45,  3.61s/it]
Skipping the first batches:   2%|▏         | 106/6000 [06:58<5:41:09,  3.47s/it]
Skipping the first batches:   2%|▏         | 107/6000 [07:01<5:32:16,  3.38s/it]
Skipping the first batches:   2%|▏         | 108/6000 [07:05<5:41:47,  3.48s/it]
Skipping the first batches:   2%|▏         | 109/6000 [07:08<5:29:41,  3.36s/it]
Skipping the first batches:   2%|▏         | 110/6000 [07:13<6:09:07,  3.76s/it]
Skipping the first batches:   2%|▏         | 111/6000 [07:16<5:50:57,  3.58s/it]
Skipping the first batches:   2%|▏         | 112/6000 [07:20<5:55:36,  3.62s/it]
Skipping the first batches:   2%|▏         | 113/6000 [07:23<5:38:55,  3.45s/it]
Skipping the first batches:   2%|▏         | 114/6000 [07:26<5:27:25,  3.34s/it]
Skipping the first batches:   2%|▏         | 115/6000 [07:29<5:27:00,  3.33s/it]
Skipping the first batches:   2%|▏         | 116/6000 [07:32<5:18:53,  3.25s/it]
Skipping the first batches:   2%|▏         | 117/6000 [07:36<5:25:29,  3.32s/it]
Skipping the first batches:   2%|▏         | 118/6000 [07:39<5:22:22,  3.29s/it]
Skipping the first batches:   2%|▏         | 119/6000 [07:42<5:19:44,  3.26s/it]
Skipping the first batches:   2%|▏         | 120/6000 [07:46<5:24:42,  3.31s/it]
Skipping the first batches:   2%|▏         | 121/6000 [07:49<5:29:57,  3.37s/it]
Skipping the first batches:   2%|▏         | 122/6000 [07:53<5:36:33,  3.44s/it]
Skipping the first batches:   2%|▏         | 123/6000 [07:56<5:30:57,  3.38s/it]
Skipping the first batches:   2%|▏         | 124/6000 [07:59<5:22:57,  3.30s/it]
Skipping the first batches:   2%|▏         | 125/6000 [08:02<5:14:39,  3.21s/it]
Skipping the first batches:   2%|▏         | 126/6000 [08:06<5:30:06,  3.37s/it]
Skipping the first batches:   2%|▏         | 127/6000 [08:09<5:20:05,  3.27s/it]
Skipping the first batches:   2%|▏         | 128/6000 [08:12<5:22:14,  3.29s/it]
Skipping the first batches:   2%|▏         | 129/6000 [08:16<5:23:30,  3.31s/it]
Skipping the first batches:   2%|▏         | 130/6000 [08:19<5:24:30,  3.32s/it]
Skipping the first batches:   2%|▏         | 131/6000 [08:22<5:19:15,  3.26s/it]
Skipping the first batches:   2%|▏         | 132/6000 [08:25<5:23:01,  3.30s/it]
Skipping the first batches:   2%|▏         | 133/6000 [08:29<5:19:56,  3.27s/it]
Skipping the first batches:   2%|▏         | 134/6000 [08:32<5:26:16,  3.34s/it]
Skipping the first batches:   2%|▏         | 135/6000 [08:35<5:17:57,  3.25s/it]
Skipping the first batches:   2%|▏         | 136/6000 [08:38<5:16:50,  3.24s/it]
Skipping the first batches:   2%|▏         | 137/6000 [08:42<5:21:29,  3.29s/it]
Skipping the first batches:   2%|▏         | 138/6000 [08:46<5:34:47,  3.43s/it]
Skipping the first batches:   2%|▏         | 139/6000 [08:49<5:37:19,  3.45s/it]
Skipping the first batches:   2%|▏         | 140/6000 [08:52<5:26:34,  3.34s/it]
Skipping the first batches:   2%|▏         | 141/6000 [08:55<5:22:05,  3.30s/it]
Skipping the first batches:   2%|▏         | 142/6000 [08:59<5:21:43,  3.30s/it]
Skipping the first batches:   2%|▏         | 143/6000 [09:03<5:40:52,  3.49s/it]
Skipping the first batches:   2%|▏         | 144/6000 [09:06<5:33:33,  3.42s/it]
Skipping the first batches:   2%|▏         | 145/6000 [09:09<5:32:12,  3.40s/it]
Skipping the first batches:   2%|▏         | 146/6000 [09:13<5:34:56,  3.43s/it]
Skipping the first batches:   2%|▏         | 147/6000 [09:16<5:32:05,  3.40s/it]
Skipping the first batches:   2%|▏         | 148/6000 [09:19<5:22:32,  3.31s/it]
Skipping the first batches:   2%|▏         | 149/6000 [09:23<5:34:29,  3.43s/it]
Skipping the first batches:   2%|▎         | 150/6000 [09:26<5:29:16,  3.38s/it]
Skipping the first batches:   3%|▎         | 151/6000 [09:29<5:23:41,  3.32s/it]
Skipping the first batches:   3%|▎         | 152/6000 [09:33<5:47:35,  3.57s/it]
Skipping the first batches:   3%|▎         | 153/6000 [09:37<5:50:20,  3.60s/it]
Skipping the first batches:   3%|▎         | 154/6000 [09:42<6:17:27,  3.87s/it]
Skipping the first batches:   3%|▎         | 155/6000 [09:46<6:28:15,  3.99s/it]
Skipping the first batches:   3%|▎         | 156/6000 [09:50<6:46:12,  4.17s/it]
Skipping the first batches:   3%|▎         | 157/6000 [09:54<6:21:34,  3.92s/it]
Skipping the first batches:   3%|▎         | 158/6000 [09:57<6:02:48,  3.73s/it]
Skipping the first batches:   3%|▎         | 159/6000 [10:00<5:46:20,  3.56s/it]
Skipping the first batches:   3%|▎         | 160/6000 [10:05<6:23:52,  3.94s/it]
Skipping the first batches:   3%|▎         | 161/6000 [10:09<6:30:01,  4.01s/it]
Skipping the first batches:   3%|▎         | 162/6000 [10:13<6:25:28,  3.96s/it]
Skipping the first batches:   3%|▎         | 163/6000 [10:18<6:53:13,  4.25s/it]
Skipping the first batches:   3%|▎         | 164/6000 [10:22<6:40:52,  4.12s/it]
Skipping the first batches:   3%|▎         | 165/6000 [10:25<6:17:26,  3.88s/it]
Skipping the first batches:   3%|▎         | 166/6000 [10:29<6:03:37,  3.74s/it]
Skipping the first batches:   3%|▎         | 167/6000 [10:32<5:56:20,  3.67s/it]
Skipping the first batches:   3%|▎         | 168/6000 [10:36<5:58:28,  3.69s/it]
Skipping the first batches:   3%|▎         | 169/6000 [10:39<5:47:22,  3.57s/it]
Skipping the first batches:   3%|▎         | 170/6000 [10:42<5:33:48,  3.44s/it]
Skipping the first batches:   3%|▎         | 171/6000 [10:46<5:36:34,  3.46s/it]
Skipping the first batches:   3%|▎         | 172/6000 [10:49<5:41:46,  3.52s/it]
Skipping the first batches:   3%|▎         | 173/6000 [10:53<5:38:43,  3.49s/it]
Skipping the first batches:   3%|▎         | 174/6000 [10:56<5:32:44,  3.43s/it]
Skipping the first batches:   3%|▎         | 175/6000 [11:00<5:49:29,  3.60s/it]
Skipping the first batches:   3%|▎         | 176/6000 [11:04<6:03:12,  3.74s/it]
Skipping the first batches:   3%|▎         | 177/6000 [11:08<5:54:50,  3.66s/it]
Skipping the first batches:   3%|▎         | 178/6000 [11:11<5:56:43,  3.68s/it]
Skipping the first batches:   3%|▎         | 179/6000 [11:15<5:48:16,  3.59s/it]
Skipping the first batches:   3%|▎         | 180/6000 [11:18<5:37:49,  3.48s/it]
Skipping the first batches:   3%|▎         | 181/6000 [11:21<5:33:37,  3.44s/it]
Skipping the first batches:   3%|▎         | 182/6000 [11:24<5:26:08,  3.36s/it]
Skipping the first batches:   3%|▎         | 183/6000 [11:28<5:22:01,  3.32s/it]
Skipping the first batches:   3%|▎         | 184/6000 [11:31<5:24:39,  3.35s/it]
Skipping the first batches:   3%|▎         | 185/6000 [11:34<5:20:35,  3.31s/it]
Skipping the first batches:   3%|▎         | 186/6000 [11:38<5:25:06,  3.36s/it]
Skipping the first batches:   3%|▎         | 187/6000 [11:41<5:25:24,  3.36s/it]
Skipping the first batches:   3%|▎         | 188/6000 [11:45<5:25:49,  3.36s/it]
Skipping the first batches:   3%|▎         | 189/6000 [11:48<5:29:27,  3.40s/it]
Skipping the first batches:   3%|▎         | 190/6000 [11:51<5:23:38,  3.34s/it]
Skipping the first batches:   3%|▎         | 191/6000 [11:54<5:18:22,  3.29s/it]
Skipping the first batches:   3%|▎         | 192/6000 [11:58<5:38:41,  3.50s/it]
Skipping the first batches:   3%|▎         | 193/6000 [12:01<5:26:59,  3.38s/it]
Skipping the first batches:   3%|▎         | 194/6000 [12:05<5:17:11,  3.28s/it]
Skipping the first batches:   3%|▎         | 195/6000 [12:08<5:24:54,  3.36s/it]
Skipping the first batches:   3%|▎         | 196/6000 [12:13<6:02:15,  3.74s/it]
Skipping the first batches:   3%|▎         | 197/6000 [12:18<6:46:20,  4.20s/it]
Skipping the first batches:   3%|▎         | 198/6000 [12:22<6:41:39,  4.15s/it]
Skipping the first batches:   3%|▎         | 199/6000 [12:26<6:29:33,  4.03s/it]
Skipping the first batches:   3%|▎         | 200/6000 [12:29<6:06:51,  3.80s/it]
Skipping the first batches:   3%|▎         | 201/6000 [12:32<5:49:13,  3.61s/it]
Skipping the first batches:   3%|▎         | 202/6000 [12:36<5:49:39,  3.62s/it]
Skipping the first batches:   3%|▎         | 203/6000 [12:39<5:37:58,  3.50s/it]
Skipping the first batches:   3%|▎         | 204/6000 [12:42<5:25:55,  3.37s/it]
Skipping the first batches:   3%|▎         | 205/6000 [12:45<5:25:55,  3.37s/it]
Skipping the first batches:   3%|▎         | 206/6000 [12:49<5:37:27,  3.49s/it]
Skipping the first batches:   3%|▎         | 207/6000 [12:52<5:28:53,  3.41s/it]
Skipping the first batches:   3%|▎         | 208/6000 [12:56<5:36:24,  3.48s/it]
Skipping the first batches:   3%|▎         | 209/6000 [12:59<5:31:18,  3.43s/it]
Skipping the first batches:   4%|▎         | 210/6000 [13:03<5:26:28,  3.38s/it]
Skipping the first batches:   4%|▎         | 211/6000 [13:06<5:21:50,  3.34s/it]
Skipping the first batches:   4%|▎         | 212/6000 [13:09<5:13:10,  3.25s/it]
Skipping the first batches:   4%|▎         | 213/6000 [13:13<5:22:36,  3.34s/it]
Skipping the first batches:   4%|▎         | 214/6000 [13:16<5:21:10,  3.33s/it]
Skipping the first batches:   4%|▎         | 215/6000 [13:19<5:14:38,  3.26s/it]
Skipping the first batches:   4%|▎         | 216/6000 [13:23<5:25:18,  3.37s/it]
Skipping the first batches:   4%|▎         | 217/6000 [13:27<5:41:46,  3.55s/it]
Skipping the first batches:   4%|▎         | 218/6000 [13:30<5:52:19,  3.66s/it]
Skipping the first batches:   4%|▎         | 219/6000 [13:33<5:34:12,  3.47s/it]
Skipping the first batches:   4%|▎         | 220/6000 [13:37<5:37:07,  3.50s/it]
Skipping the first batches:   4%|▎         | 221/6000 [13:40<5:29:06,  3.42s/it]
Skipping the first batches:   4%|▎         | 222/6000 [13:43<5:20:20,  3.33s/it]
Skipping the first batches:   4%|▎         | 223/6000 [13:47<5:17:33,  3.30s/it]
Skipping the first batches:   4%|▎         | 224/6000 [13:50<5:18:20,  3.31s/it]
Skipping the first batches:   4%|▍         | 225/6000 [13:53<5:21:40,  3.34s/it]
Skipping the first batches:   4%|▍         | 226/6000 [13:57<5:35:03,  3.48s/it]
Skipping the first batches:   4%|▍         | 227/6000 [14:02<6:21:07,  3.96s/it]
Skipping the first batches:   4%|▍         | 228/6000 [14:07<6:51:10,  4.27s/it]
Skipping the first batches:   4%|▍         | 229/6000 [14:15<8:19:19,  5.19s/it]
Skipping the first batches:   4%|▍         | 230/6000 [14:18<7:19:36,  4.57s/it]
Skipping the first batches:   4%|▍         | 231/6000 [14:21<6:35:09,  4.11s/it]
Skipping the first batches:   4%|▍         | 232/6000 [14:24<6:22:48,  3.98s/it]
Skipping the first batches:   4%|▍         | 233/6000 [14:28<6:03:09,  3.78s/it]
Skipping the first batches:   4%|▍         | 234/6000 [14:31<5:52:44,  3.67s/it]
Skipping the first batches:   4%|▍         | 235/6000 [14:35<5:43:10,  3.57s/it]
Skipping the first batches:   4%|▍         | 236/6000 [14:38<5:39:07,  3.53s/it]
Skipping the first batches:   4%|▍         | 237/6000 [14:41<5:28:44,  3.42s/it]
Skipping the first batches:   4%|▍         | 238/6000 [14:44<5:24:47,  3.38s/it]
Skipping the first batches:   4%|▍         | 239/6000 [14:48<5:24:06,  3.38s/it]
Skipping the first batches:   4%|▍         | 240/6000 [14:51<5:24:24,  3.38s/it]
Skipping the first batches:   4%|▍         | 241/6000 [14:54<5:15:51,  3.29s/it]
Skipping the first batches:   4%|▍         | 242/6000 [14:58<5:29:17,  3.43s/it]
Skipping the first batches:   4%|▍         | 243/6000 [15:01<5:22:56,  3.37s/it]
Skipping the first batches:   4%|▍         | 244/6000 [15:05<5:23:16,  3.37s/it]
Skipping the first batches:   4%|▍         | 245/6000 [15:08<5:23:58,  3.38s/it]
Skipping the first batches:   4%|▍         | 246/6000 [15:11<5:27:40,  3.42s/it]
Skipping the first batches:   4%|▍         | 247/6000 [15:15<5:20:55,  3.35s/it]
Skipping the first batches:   4%|▍         | 248/6000 [15:18<5:17:12,  3.31s/it]
Skipping the first batches:   4%|▍         | 249/6000 [15:21<5:18:25,  3.32s/it]
Skipping the first batches:   4%|▍         | 250/6000 [15:24<5:16:19,  3.30s/it]
Skipping the first batches:   4%|▍         | 251/6000 [15:28<5:14:58,  3.29s/it]
Skipping the first batches:   4%|▍         | 252/6000 [15:31<5:24:35,  3.39s/it]
Skipping the first batches:   4%|▍         | 253/6000 [15:34<5:15:27,  3.29s/it]
Skipping the first batches:   4%|▍         | 254/6000 [15:38<5:13:41,  3.28s/it]
Skipping the first batches:   4%|▍         | 255/6000 [15:41<5:18:28,  3.33s/it]
Skipping the first batches:   4%|▍         | 256/6000 [15:44<5:15:12,  3.29s/it]
Skipping the first batches:   4%|▍         | 257/6000 [15:48<5:24:01,  3.39s/it]
Skipping the first batches:   4%|▍         | 258/6000 [15:51<5:22:53,  3.37s/it]
Skipping the first batches:   4%|▍         | 259/6000 [15:54<5:17:05,  3.31s/it]
Skipping the first batches:   4%|▍         | 260/6000 [15:58<5:26:00,  3.41s/it]
Skipping the first batches:   4%|▍         | 261/6000 [16:02<5:32:33,  3.48s/it]
Skipping the first batches:   4%|▍         | 262/6000 [16:05<5:28:06,  3.43s/it]
Skipping the first batches:   4%|▍         | 263/6000 [16:09<5:30:03,  3.45s/it]
Skipping the first batches:   4%|▍         | 264/6000 [16:12<5:20:48,  3.36s/it]
Skipping the first batches:   4%|▍         | 265/6000 [16:15<5:21:22,  3.36s/it]
Skipping the first batches:   4%|▍         | 266/6000 [16:18<5:15:04,  3.30s/it]
Skipping the first batches:   4%|▍         | 267/6000 [16:22<5:34:37,  3.50s/it]
Skipping the first batches:   4%|▍         | 268/6000 [16:26<5:33:11,  3.49s/it]
Skipping the first batches:   4%|▍         | 269/6000 [16:29<5:23:56,  3.39s/it]
Skipping the first batches:   4%|▍         | 270/6000 [16:33<5:38:52,  3.55s/it]
Skipping the first batches:   5%|▍         | 271/6000 [16:36<5:34:53,  3.51s/it]
Skipping the first batches:   5%|▍         | 272/6000 [16:41<6:17:28,  3.95s/it]
Skipping the first batches:   5%|▍         | 273/6000 [16:45<6:02:28,  3.80s/it]
Skipping the first batches:   5%|▍         | 274/6000 [16:49<6:09:43,  3.87s/it]
Skipping the first batches:   5%|▍         | 275/6000 [16:52<5:59:03,  3.76s/it]
Skipping the first batches:   5%|▍         | 276/6000 [16:55<5:47:25,  3.64s/it]
Skipping the first batches:   5%|▍         | 277/6000 [16:59<5:46:57,  3.64s/it]
Skipping the first batches:   5%|▍         | 278/6000 [17:03<5:43:18,  3.60s/it]
Skipping the first batches:   5%|▍         | 279/6000 [17:07<6:05:54,  3.84s/it]
Skipping the first batches:   5%|▍         | 280/6000 [17:10<5:43:13,  3.60s/it]
Skipping the first batches:   5%|▍         | 281/6000 [17:14<5:44:41,  3.62s/it]
Skipping the first batches:   5%|▍         | 282/6000 [17:17<5:32:44,  3.49s/it]
Skipping the first batches:   5%|▍         | 283/6000 [17:20<5:27:32,  3.44s/it]
Skipping the first batches:   5%|▍         | 284/6000 [17:23<5:17:36,  3.33s/it]
Skipping the first batches:   5%|▍         | 285/6000 [17:27<5:23:46,  3.40s/it]
Skipping the first batches:   5%|▍         | 286/6000 [17:30<5:18:59,  3.35s/it]
Skipping the first batches:   5%|▍         | 287/6000 [17:33<5:15:46,  3.32s/it]
Skipping the first batches:   5%|▍         | 288/6000 [17:37<5:31:44,  3.48s/it]
Skipping the first batches:   5%|▍         | 289/6000 [17:41<5:27:35,  3.44s/it]
Skipping the first batches:   5%|▍         | 290/6000 [17:44<5:22:42,  3.39s/it]
Skipping the first batches:   5%|▍         | 291/6000 [17:47<5:17:01,  3.33s/it]
Skipping the first batches:   5%|▍         | 292/6000 [17:50<5:14:49,  3.31s/it]
Skipping the first batches:   5%|▍         | 293/6000 [17:54<5:14:04,  3.30s/it]
Skipping the first batches:   5%|▍         | 294/6000 [17:57<5:17:18,  3.34s/it]
Skipping the first batches:   5%|▍         | 295/6000 [18:00<5:19:09,  3.36s/it]
Skipping the first batches:   5%|▍         | 296/6000 [18:04<5:15:39,  3.32s/it]
Skipping the first batches:   5%|▍         | 297/6000 [18:07<5:22:33,  3.39s/it]
Skipping the first batches:   5%|▍         | 298/6000 [18:11<5:22:36,  3.39s/it]
Skipping the first batches:   5%|▍         | 299/6000 [18:14<5:12:57,  3.29s/it]
Skipping the first batches:   5%|▌         | 300/6000 [18:17<5:14:55,  3.32s/it]
Skipping the first batches:   5%|▌         | 301/6000 [18:21<5:19:55,  3.37s/it]
Skipping the first batches:   5%|▌         | 302/6000 [18:24<5:22:24,  3.39s/it]
Skipping the first batches:   5%|▌         | 303/6000 [18:27<5:21:37,  3.39s/it]
Skipping the first batches:   5%|▌         | 304/6000 [18:31<5:40:25,  3.59s/it]
Skipping the first batches:   5%|▌         | 305/6000 [18:35<5:52:51,  3.72s/it]
Skipping the first batches:   5%|▌         | 306/6000 [18:39<5:38:53,  3.57s/it]
Skipping the first batches:   5%|▌         | 307/6000 [18:42<5:34:50,  3.53s/it]
Skipping the first batches:   5%|▌         | 308/6000 [18:45<5:28:46,  3.47s/it]
Skipping the first batches:   5%|▌         | 309/6000 [18:49<5:31:21,  3.49s/it]
Skipping the first batches:   5%|▌         | 310/6000 [18:52<5:18:59,  3.36s/it]
Skipping the first batches:   5%|▌         | 311/6000 [18:55<5:13:49,  3.31s/it]
Skipping the first batches:   5%|▌         | 312/6000 [18:59<5:22:59,  3.41s/it]
Skipping the first batches:   5%|▌         | 313/6000 [19:02<5:11:50,  3.29s/it]
Skipping the first batches:   5%|▌         | 314/6000 [19:05<5:04:06,  3.21s/it]
Skipping the first batches:   5%|▌         | 315/6000 [19:08<5:07:13,  3.24s/it]
Skipping the first batches:   5%|▌         | 316/6000 [19:12<5:13:08,  3.31s/it]
Skipping the first batches:   5%|▌         | 317/6000 [19:15<5:18:50,  3.37s/it]
Skipping the first batches:   5%|▌         | 318/6000 [19:18<5:16:51,  3.35s/it]
Skipping the first batches:   5%|▌         | 319/6000 [19:22<5:09:05,  3.26s/it]
Skipping the first batches:   5%|▌         | 320/6000 [19:25<5:17:57,  3.36s/it]
Skipping the first batches:   5%|▌         | 321/6000 [19:28<5:17:53,  3.36s/it]
Skipping the first batches:   5%|▌         | 322/6000 [19:32<5:09:30,  3.27s/it]
Skipping the first batches:   5%|▌         | 323/6000 [19:35<5:02:02,  3.19s/it]
Skipping the first batches:   5%|▌         | 324/6000 [19:38<5:13:51,  3.32s/it]
Skipping the first batches:   5%|▌         | 325/6000 [19:41<5:09:56,  3.28s/it]
Skipping the first batches:   5%|▌         | 326/6000 [19:44<5:02:21,  3.20s/it]
Skipping the first batches:   5%|▌         | 327/6000 [19:48<5:02:15,  3.20s/it]
Skipping the first batches:   5%|▌         | 328/6000 [19:51<5:10:25,  3.28s/it]
Skipping the first batches:   5%|▌         | 329/6000 [19:54<5:10:45,  3.29s/it]
Skipping the first batches:   6%|▌         | 330/6000 [19:58<5:30:08,  3.49s/it]
Skipping the first batches:   6%|▌         | 331/6000 [20:02<5:27:04,  3.46s/it]
Skipping the first batches:   6%|▌         | 332/6000 [20:05<5:26:49,  3.46s/it]
Skipping the first batches:   6%|▌         | 333/6000 [20:08<5:15:01,  3.34s/it]
Skipping the first batches:   6%|▌         | 334/6000 [20:11<5:11:04,  3.29s/it]
Skipping the first batches:   6%|▌         | 335/6000 [20:15<5:10:24,  3.29s/it]
Skipping the first batches:   6%|▌         | 336/6000 [20:18<5:10:33,  3.29s/it]
Skipping the first batches:   6%|▌         | 337/6000 [20:21<5:06:29,  3.25s/it]
Skipping the first batches:   6%|▌         | 338/6000 [20:24<5:08:15,  3.27s/it]
Skipping the first batches:   6%|▌         | 339/6000 [20:28<5:12:34,  3.31s/it]
Skipping the first batches:   6%|▌         | 340/6000 [20:31<5:18:03,  3.37s/it]
Skipping the first batches:   6%|▌         | 341/6000 [20:35<5:20:53,  3.40s/it]
Skipping the first batches:   6%|▌         | 342/6000 [20:38<5:15:55,  3.35s/it]
Skipping the first batches:   6%|▌         | 343/6000 [20:41<5:16:01,  3.35s/it]
Skipping the first batches:   6%|▌         | 344/6000 [20:45<5:13:37,  3.33s/it]
Skipping the first batches:   6%|▌         | 345/6000 [20:48<5:10:22,  3.29s/it]
Skipping the first batches:   6%|▌         | 346/6000 [20:51<5:09:54,  3.29s/it]
Skipping the first batches:   6%|▌         | 347/6000 [20:55<5:18:11,  3.38s/it]
Skipping the first batches:   6%|▌         | 348/6000 [20:58<5:24:11,  3.44s/it]
Skipping the first batches:   6%|▌         | 349/6000 [21:02<5:20:00,  3.40s/it]
Skipping the first batches:   6%|▌         | 350/6000 [21:05<5:22:32,  3.43s/it]
Skipping the first batches:   6%|▌         | 351/6000 [21:09<5:24:22,  3.45s/it]
Skipping the first batches:   6%|▌         | 352/6000 [21:12<5:26:10,  3.47s/it]
Skipping the first batches:   6%|▌         | 353/6000 [21:15<5:19:32,  3.40s/it]
Skipping the first batches:   6%|▌         | 354/6000 [21:19<5:23:19,  3.44s/it]
Skipping the first batches:   6%|▌         | 355/6000 [21:22<5:28:06,  3.49s/it]
Skipping the first batches:   6%|▌         | 356/6000 [21:26<5:24:37,  3.45s/it]
Skipping the first batches:   6%|▌         | 357/6000 [21:29<5:21:52,  3.42s/it]
Skipping the first batches:   6%|▌         | 358/6000 [21:32<5:16:38,  3.37s/it]
Skipping the first batches:   6%|▌         | 359/6000 [21:36<5:08:42,  3.28s/it]
Skipping the first batches:   6%|▌         | 360/6000 [21:39<5:11:17,  3.31s/it]
Skipping the first batches:   6%|▌         | 361/6000 [21:43<5:28:03,  3.49s/it]
Skipping the first batches:   6%|▌         | 362/6000 [21:46<5:19:54,  3.40s/it]
Skipping the first batches:   6%|▌         | 363/6000 [21:49<5:21:18,  3.42s/it]
Skipping the first batches:   6%|▌         | 364/6000 [21:53<5:30:27,  3.52s/it]
Skipping the first batches:   6%|▌         | 365/6000 [21:56<5:18:50,  3.39s/it]
Skipping the first batches:   6%|▌         | 366/6000 [21:59<5:11:12,  3.31s/it]
Skipping the first batches:   6%|▌         | 367/6000 [22:03<5:19:29,  3.40s/it]
Skipping the first batches:   6%|▌         | 368/6000 [22:07<5:22:16,  3.43s/it]
Skipping the first batches:   6%|▌         | 369/6000 [22:10<5:12:06,  3.33s/it]
Skipping the first batches:   6%|▌         | 370/6000 [22:13<5:08:16,  3.29s/it]
Skipping the first batches:   6%|▌         | 371/6000 [22:16<5:14:14,  3.35s/it]
Skipping the first batches:   6%|▌         | 372/6000 [22:20<5:10:25,  3.31s/it]
Skipping the first batches:   6%|▌         | 373/6000 [22:23<5:17:10,  3.38s/it]
Skipping the first batches:   6%|▌         | 374/6000 [22:26<5:10:58,  3.32s/it]
Skipping the first batches:   6%|▋         | 375/6000 [22:30<5:11:46,  3.33s/it]
Skipping the first batches:   6%|▋         | 376/6000 [22:33<5:12:13,  3.33s/it]
Skipping the first batches:   6%|▋         | 377/6000 [22:36<5:11:21,  3.32s/it]
Skipping the first batches:   6%|▋         | 378/6000 [22:41<5:53:51,  3.78s/it]
Skipping the first batches:   6%|▋         | 379/6000 [22:44<5:42:27,  3.66s/it]
Skipping the first batches:   6%|▋         | 380/6000 [22:47<5:25:03,  3.47s/it]
Skipping the first batches:   6%|▋         | 381/6000 [22:51<5:15:02,  3.36s/it]
Skipping the first batches:   6%|▋         | 382/6000 [22:55<5:36:14,  3.59s/it]
Skipping the first batches:   6%|▋         | 383/6000 [22:59<5:43:43,  3.67s/it]
Skipping the first batches:   6%|▋         | 384/6000 [23:02<5:28:51,  3.51s/it]
Skipping the first batches:   6%|▋         | 385/6000 [23:05<5:30:05,  3.53s/it]
Skipping the first batches:   6%|▋         | 386/6000 [23:09<5:21:08,  3.43s/it]
Skipping the first batches:   6%|▋         | 387/6000 [23:12<5:14:08,  3.36s/it]
Skipping the first batches:   6%|▋         | 388/6000 [23:15<5:09:08,  3.31s/it]
Skipping the first batches:   6%|▋         | 389/6000 [23:18<5:07:40,  3.29s/it]
Skipping the first batches:   6%|▋         | 390/6000 [23:22<5:11:24,  3.33s/it]
Skipping the first batches:   7%|▋         | 391/6000 [23:25<5:16:24,  3.38s/it]
Skipping the first batches:   7%|▋         | 392/6000 [23:28<5:11:26,  3.33s/it]
Skipping the first batches:   7%|▋         | 393/6000 [23:32<5:15:44,  3.38s/it]
Skipping the first batches:   7%|▋         | 394/6000 [23:35<5:14:30,  3.37s/it]
Skipping the first batches:   7%|▋         | 395/6000 [23:38<5:05:44,  3.27s/it]
Skipping the first batches:   7%|▋         | 396/6000 [23:42<5:15:59,  3.38s/it]
Skipping the first batches:   7%|▋         | 397/6000 [23:45<5:16:40,  3.39s/it]
Skipping the first batches:   7%|▋         | 398/6000 [23:49<5:15:50,  3.38s/it]
Skipping the first batches:   7%|▋         | 399/6000 [23:52<5:11:56,  3.34s/it]
Skipping the first batches:   7%|▋         | 400/6000 [23:55<5:09:59,  3.32s/it]
Skipping the first batches:   7%|▋         | 401/6000 [23:58<5:10:03,  3.32s/it]
Skipping the first batches:   7%|▋         | 402/6000 [24:01<5:01:59,  3.24s/it]
Skipping the first batches:   7%|▋         | 403/6000 [24:05<5:09:24,  3.32s/it]
Skipping the first batches:   7%|▋         | 404/6000 [24:09<5:24:46,  3.48s/it]
Skipping the first batches:   7%|▋         | 405/6000 [24:12<5:12:34,  3.35s/it]
Skipping the first batches:   7%|▋         | 406/6000 [24:15<5:10:54,  3.33s/it]
Skipping the first batches:   7%|▋         | 407/6000 [24:19<5:16:25,  3.39s/it]
Skipping the first batches:   7%|▋         | 408/6000 [24:22<5:19:15,  3.43s/it]
Skipping the first batches:   7%|▋         | 409/6000 [24:25<5:13:35,  3.37s/it]
Skipping the first batches:   7%|▋         | 410/6000 [24:29<5:19:13,  3.43s/it]
Skipping the first batches:   7%|▋         | 411/6000 [24:32<5:14:16,  3.37s/it]
Skipping the first batches:   7%|▋         | 412/6000 [24:35<5:04:40,  3.27s/it]
Skipping the first batches:   7%|▋         | 413/6000 [24:39<5:07:06,  3.30s/it]
Skipping the first batches:   7%|▋         | 414/6000 [24:42<5:20:17,  3.44s/it]
Skipping the first batches:   7%|▋         | 415/6000 [24:46<5:18:34,  3.42s/it]
Skipping the first batches:   7%|▋         | 416/6000 [24:49<5:21:32,  3.46s/it]
Skipping the first batches:   7%|▋         | 417/6000 [24:53<5:19:22,  3.43s/it]
Skipping the first batches:   7%|▋         | 418/6000 [24:56<5:14:45,  3.38s/it]
Skipping the first batches:   7%|▋         | 419/6000 [24:59<5:10:20,  3.34s/it]
Skipping the first batches:   7%|▋         | 420/6000 [25:03<5:17:18,  3.41s/it]
Skipping the first batches:   7%|▋         | 421/6000 [25:06<5:17:02,  3.41s/it]
Skipping the first batches:   7%|▋         | 422/6000 [25:09<5:07:34,  3.31s/it]
Skipping the first batches:   7%|▋         | 423/6000 [25:13<5:27:26,  3.52s/it]
Skipping the first batches:   7%|▋         | 424/6000 [25:17<5:21:19,  3.46s/it]
Skipping the first batches:   7%|▋         | 425/6000 [25:20<5:18:32,  3.43s/it]
Skipping the first batches:   7%|▋         | 426/6000 [25:24<5:25:32,  3.50s/it]
Skipping the first batches:   7%|▋         | 427/6000 [25:27<5:19:32,  3.44s/it]
Skipping the first batches:   7%|▋         | 428/6000 [25:30<5:18:25,  3.43s/it]
Skipping the first batches:   7%|▋         | 429/6000 [25:34<5:31:51,  3.57s/it]
Skipping the first batches:   7%|▋         | 430/6000 [25:38<5:23:41,  3.49s/it]
Skipping the first batches:   7%|▋         | 431/6000 [25:41<5:15:08,  3.40s/it]
Skipping the first batches:   7%|▋         | 432/6000 [25:44<5:10:41,  3.35s/it]
Skipping the first batches:   7%|▋         | 433/6000 [25:48<5:20:01,  3.45s/it]
Skipping the first batches:   7%|▋         | 434/6000 [25:51<5:07:53,  3.32s/it]
Skipping the first batches:   7%|▋         | 435/6000 [25:54<5:11:48,  3.36s/it]
Skipping the first batches:   7%|▋         | 436/6000 [25:58<5:16:21,  3.41s/it]
Skipping the first batches:   7%|▋         | 437/6000 [26:01<5:12:45,  3.37s/it]
Skipping the first batches:   7%|▋         | 438/6000 [26:04<5:12:46,  3.37s/it]
Skipping the first batches:   7%|▋         | 439/6000 [26:08<5:12:36,  3.37s/it]
Skipping the first batches:   7%|▋         | 440/6000 [26:11<5:13:33,  3.38s/it]
Skipping the first batches:   7%|▋         | 441/6000 [26:14<5:08:12,  3.33s/it]
Skipping the first batches:   7%|▋         | 442/6000 [26:18<5:14:12,  3.39s/it]
Skipping the first batches:   7%|▋         | 443/6000 [26:21<5:14:48,  3.40s/it]
Skipping the first batches:   7%|▋         | 444/6000 [26:24<5:10:58,  3.36s/it]
Skipping the first batches:   7%|▋         | 445/6000 [26:28<5:08:06,  3.33s/it]
Skipping the first batches:   7%|▋         | 446/6000 [26:31<5:07:35,  3.32s/it]
Skipping the first batches:   7%|▋         | 447/6000 [26:35<5:18:01,  3.44s/it]
Skipping the first batches:   7%|▋         | 448/6000 [26:38<5:21:50,  3.48s/it]
Skipping the first batches:   7%|▋         | 449/6000 [26:42<5:17:29,  3.43s/it]
Skipping the first batches:   8%|▊         | 450/6000 [26:45<5:14:01,  3.39s/it]
Skipping the first batches:   8%|▊         | 451/6000 [26:48<5:04:39,  3.29s/it]
Skipping the first batches:   8%|▊         | 452/6000 [26:52<5:12:10,  3.38s/it]
Skipping the first batches:   8%|▊         | 453/6000 [26:55<5:12:09,  3.38s/it]
Skipping the first batches:   8%|▊         | 454/6000 [26:58<5:10:16,  3.36s/it]
Skipping the first batches:   8%|▊         | 455/6000 [27:02<5:14:55,  3.41s/it]
Skipping the first batches:   8%|▊         | 456/6000 [27:06<5:41:30,  3.70s/it]
Skipping the first batches:   8%|▊         | 457/6000 [27:09<5:25:52,  3.53s/it]
Skipping the first batches:   8%|▊         | 458/6000 [27:13<5:27:34,  3.55s/it]
Skipping the first batches:   8%|▊         | 459/6000 [27:18<6:00:47,  3.91s/it]
Skipping the first batches:   8%|▊         | 460/6000 [27:22<6:20:50,  4.12s/it]
Skipping the first batches:   8%|▊         | 461/6000 [27:27<6:31:26,  4.24s/it]
Skipping the first batches:   8%|▊         | 462/6000 [27:31<6:38:48,  4.32s/it]
Skipping the first batches:   8%|▊         | 463/6000 [27:35<6:12:32,  4.04s/it]
Skipping the first batches:   8%|▊         | 464/6000 [27:38<6:02:21,  3.93s/it]
Skipping the first batches:   8%|▊         | 465/6000 [27:43<6:21:58,  4.14s/it]
Skipping the first batches:   8%|▊         | 466/6000 [27:47<6:16:47,  4.09s/it]
Skipping the first batches:   8%|▊         | 467/6000 [27:50<5:57:25,  3.88s/it]
Skipping the first batches:   8%|▊         | 468/6000 [27:53<5:35:56,  3.64s/it]
Skipping the first batches:   8%|▊         | 469/6000 [27:57<5:37:23,  3.66s/it]
Skipping the first batches:   8%|▊         | 470/6000 [28:01<5:40:36,  3.70s/it]
Skipping the first batches:   8%|▊         | 471/6000 [28:04<5:35:12,  3.64s/it]
Skipping the first batches:   8%|▊         | 472/6000 [28:08<5:23:36,  3.51s/it]
Skipping the first batches:   8%|▊         | 473/6000 [28:11<5:28:52,  3.57s/it]
Skipping the first batches:   8%|▊         | 474/6000 [28:15<5:19:34,  3.47s/it]
Skipping the first batches:   8%|▊         | 475/6000 [28:18<5:09:15,  3.36s/it]
Skipping the first batches:   8%|▊         | 476/6000 [28:22<5:25:28,  3.54s/it]
Skipping the first batches:   8%|▊         | 477/6000 [28:26<5:55:15,  3.86s/it]
Skipping the first batches:   8%|▊         | 478/6000 [28:30<6:03:00,  3.94s/it]
Skipping the first batches:   8%|▊         | 479/6000 [28:35<6:15:26,  4.08s/it]
Skipping the first batches:   8%|▊         | 480/6000 [28:39<6:17:36,  4.10s/it]
Skipping the first batches:   8%|▊         | 481/6000 [28:42<6:01:27,  3.93s/it]
Skipping the first batches:   8%|▊         | 482/6000 [28:46<5:45:26,  3.76s/it]
Skipping the first batches:   8%|▊         | 483/6000 [28:49<5:33:54,  3.63s/it]
Skipping the first batches:   8%|▊         | 484/6000 [28:53<5:43:11,  3.73s/it]
Skipping the first batches:   8%|▊         | 485/6000 [28:57<5:52:31,  3.84s/it]
Skipping the first batches:   8%|▊         | 486/6000 [29:01<5:42:23,  3.73s/it]
Skipping the first batches:   8%|▊         | 487/6000 [29:05<5:56:29,  3.88s/it]
Skipping the first batches:   8%|▊         | 488/6000 [29:09<5:52:18,  3.84s/it]
Skipping the first batches:   8%|▊         | 489/6000 [29:12<5:48:23,  3.79s/it]
Skipping the first batches:   8%|▊         | 490/6000 [29:17<6:03:03,  3.95s/it]
Skipping the first batches:   8%|▊         | 491/6000 [29:20<5:46:27,  3.77s/it]
Skipping the first batches:   8%|▊         | 492/6000 [29:24<5:53:24,  3.85s/it]
Skipping the first batches:   8%|▊         | 493/6000 [29:29<6:12:39,  4.06s/it]
Skipping the first batches:   8%|▊         | 494/6000 [29:33<6:23:33,  4.18s/it]
Skipping the first batches:   8%|▊         | 495/6000 [29:38<6:36:45,  4.32s/it]
Skipping the first batches:   8%|▊         | 496/6000 [29:42<6:45:13,  4.42s/it]
Skipping the first batches:   8%|▊         | 497/6000 [29:47<6:41:44,  4.38s/it]
Skipping the first batches:   8%|▊         | 498/6000 [29:51<6:49:24,  4.46s/it]
Skipping the first batches:   8%|▊         | 499/6000 [29:55<6:41:26,  4.38s/it]
Skipping the first batches:   8%|▊         | 500/6000 [30:00<6:38:00,  4.34s/it]
Skipping the first batches:   8%|▊         | 501/6000 [30:04<6:30:49,  4.26s/it]
Skipping the first batches:   8%|▊         | 502/6000 [30:08<6:26:27,  4.22s/it]
Skipping the first batches:   8%|▊         | 503/6000 [30:12<6:09:19,  4.03s/it]
Skipping the first batches:   8%|▊         | 504/6000 [30:16<6:16:23,  4.11s/it]
Skipping the first batches:   8%|▊         | 505/6000 [30:20<6:17:58,  4.13s/it]
Skipping the first batches:   8%|▊         | 506/6000 [30:23<5:57:19,  3.90s/it]
Skipping the first batches:   8%|▊         | 507/6000 [30:27<5:40:59,  3.72s/it]
Skipping the first batches:   8%|▊         | 508/6000 [30:30<5:29:24,  3.60s/it]
Skipping the first batches:   8%|▊         | 509/6000 [30:33<5:26:39,  3.57s/it]
Skipping the first batches:   8%|▊         | 510/6000 [30:37<5:16:49,  3.46s/it]
Skipping the first batches:   9%|▊         | 511/6000 [30:40<5:12:45,  3.42s/it]
Skipping the first batches:   9%|▊         | 512/6000 [30:43<5:12:24,  3.42s/it]
Skipping the first batches:   9%|▊         | 513/6000 [30:47<5:09:14,  3.38s/it]
Skipping the first batches:   9%|▊         | 514/6000 [30:50<5:04:58,  3.34s/it]
Skipping the first batches:   9%|▊         | 515/6000 [30:53<5:01:31,  3.30s/it]
Skipping the first batches:   9%|▊         | 516/6000 [30:56<4:57:49,  3.26s/it]
Skipping the first batches:   9%|▊         | 517/6000 [31:00<4:57:11,  3.25s/it]
Skipping the first batches:   9%|▊         | 518/6000 [31:03<5:08:43,  3.38s/it]
Skipping the first batches:   9%|▊         | 519/6000 [31:07<5:26:22,  3.57s/it]
Skipping the first batches:   9%|▊         | 520/6000 [31:10<5:15:41,  3.46s/it]
Skipping the first batches:   9%|▊         | 521/6000 [31:14<5:15:38,  3.46s/it]
Skipping the first batches:   9%|▊         | 522/6000 [31:18<5:25:43,  3.57s/it]
Skipping the first batches:   9%|▊         | 523/6000 [31:21<5:17:13,  3.48s/it]
Skipping the first batches:   9%|▊         | 524/6000 [31:24<5:14:29,  3.45s/it]
Skipping the first batches:   9%|▉         | 525/6000 [31:28<5:24:11,  3.55s/it]
Skipping the first batches:   9%|▉         | 526/6000 [31:32<5:38:37,  3.71s/it]
Skipping the first batches:   9%|▉         | 527/6000 [31:37<5:54:31,  3.89s/it]
Skipping the first batches:   9%|▉         | 528/6000 [31:41<6:05:47,  4.01s/it]
Skipping the first batches:   9%|▉         | 529/6000 [31:44<5:40:24,  3.73s/it]
Skipping the first batches:   9%|▉         | 530/6000 [31:48<5:38:51,  3.72s/it]
Skipping the first batches:   9%|▉         | 531/6000 [31:51<5:32:57,  3.65s/it]
Skipping the first batches:   9%|▉         | 532/6000 [31:55<5:39:54,  3.73s/it]
Skipping the first batches:   9%|▉         | 533/6000 [32:00<6:10:32,  4.07s/it]
Skipping the first batches:   9%|▉         | 534/6000 [32:04<6:17:32,  4.14s/it]
Skipping the first batches:   9%|▉         | 535/6000 [32:09<6:34:21,  4.33s/it]
Skipping the first batches:   9%|▉         | 536/6000 [32:13<6:39:19,  4.38s/it]
Skipping the first batches:   9%|▉         | 537/6000 [32:17<6:24:51,  4.23s/it]
Skipping the first batches:   9%|▉         | 538/6000 [32:22<6:29:24,  4.28s/it]
Skipping the first batches:   9%|▉         | 539/6000 [32:25<6:10:55,  4.08s/it]
Skipping the first batches:   9%|▉         | 540/6000 [32:30<6:20:20,  4.18s/it]
Skipping the first batches:   9%|▉         | 541/6000 [32:35<6:37:07,  4.36s/it]
Skipping the first batches:   9%|▉         | 542/6000 [32:39<6:40:49,  4.41s/it]
Skipping the first batches:   9%|▉         | 543/6000 [32:42<6:12:21,  4.09s/it]
Skipping the first batches:   9%|▉         | 544/6000 [32:47<6:16:27,  4.14s/it]
Skipping the first batches:   9%|▉         | 545/6000 [32:51<6:15:52,  4.13s/it]
Skipping the first batches:   9%|▉         | 546/6000 [32:54<5:57:54,  3.94s/it]
Skipping the first batches:   9%|▉         | 547/6000 [32:58<5:58:24,  3.94s/it]
Skipping the first batches:   9%|▉         | 548/6000 [33:02<5:47:56,  3.83s/it]
Skipping the first batches:   9%|▉         | 549/6000 [33:05<5:28:36,  3.62s/it]
Skipping the first batches:   9%|▉         | 550/6000 [33:09<5:36:05,  3.70s/it]
Skipping the first batches:   9%|▉         | 551/6000 [33:13<5:39:46,  3.74s/it]
Skipping the first batches:   9%|▉         | 552/6000 [33:16<5:38:01,  3.72s/it]
Skipping the first batches:   9%|▉         | 553/6000 [33:20<5:36:11,  3.70s/it]
Skipping the first batches:   9%|▉         | 554/6000 [33:24<5:38:23,  3.73s/it]
Skipping the first batches:   9%|▉         | 555/6000 [33:27<5:36:00,  3.70s/it]
Skipping the first batches:   9%|▉         | 556/6000 [33:30<5:18:42,  3.51s/it]
Skipping the first batches:   9%|▉         | 557/6000 [33:34<5:13:18,  3.45s/it]
Skipping the first batches:   9%|▉         | 558/6000 [33:38<5:39:59,  3.75s/it]
Skipping the first batches:   9%|▉         | 559/6000 [33:44<6:31:27,  4.32s/it]
Skipping the first batches:   9%|▉         | 560/6000 [33:48<6:19:32,  4.19s/it]
Skipping the first batches:   9%|▉         | 561/6000 [33:51<6:04:51,  4.02s/it]
Skipping the first batches:   9%|▉         | 562/6000 [33:55<5:48:21,  3.84s/it]
Skipping the first batches:   9%|▉         | 563/6000 [33:58<5:32:36,  3.67s/it]
Skipping the first batches:   9%|▉         | 564/6000 [34:01<5:19:58,  3.53s/it]
Skipping the first batches:   9%|▉         | 565/6000 [34:05<5:13:48,  3.46s/it]
Skipping the first batches:   9%|▉         | 566/6000 [34:08<5:16:09,  3.49s/it]
Skipping the first batches:   9%|▉         | 567/6000 [34:11<5:04:03,  3.36s/it]
Skipping the first batches:   9%|▉         | 568/6000 [34:14<4:59:28,  3.31s/it]
Skipping the first batches:   9%|▉         | 569/6000 [34:18<4:59:05,  3.30s/it]
Skipping the first batches:  10%|▉         | 570/6000 [34:21<4:56:28,  3.28s/it]
Skipping the first batches:  10%|▉         | 571/6000 [34:24<4:55:31,  3.27s/it]
Skipping the first batches:  10%|▉         | 572/6000 [34:28<5:08:17,  3.41s/it]
Skipping the first batches:  10%|▉         | 573/6000 [34:31<5:03:14,  3.35s/it]
Skipping the first batches:  10%|▉         | 574/6000 [34:34<5:03:34,  3.36s/it]
Skipping the first batches:  10%|▉         | 575/6000 [34:38<4:58:04,  3.30s/it]
Skipping the first batches:  10%|▉         | 576/6000 [34:41<5:05:31,  3.38s/it]
Skipping the first batches:  10%|▉         | 577/6000 [34:45<5:09:00,  3.42s/it]
Skipping the first batches:  10%|▉         | 578/6000 [34:48<5:10:02,  3.43s/it]
Skipping the first batches:  10%|▉         | 579/6000 [34:51<5:00:42,  3.33s/it]
Skipping the first batches:  10%|▉         | 580/6000 [34:55<5:08:36,  3.42s/it]
Skipping the first batches:  10%|▉         | 581/6000 [34:58<5:09:00,  3.42s/it]
Skipping the first batches:  10%|▉         | 582/6000 [35:01<5:00:13,  3.32s/it]
Skipping the first batches:  10%|▉         | 583/6000 [35:05<4:59:04,  3.31s/it]
Skipping the first batches:  10%|▉         | 584/6000 [35:08<5:06:37,  3.40s/it]
Skipping the first batches:  10%|▉         | 585/6000 [35:12<5:03:31,  3.36s/it]
Skipping the first batches:  10%|▉         | 586/6000 [35:15<4:57:16,  3.29s/it]
Skipping the first batches:  10%|▉         | 587/6000 [35:18<5:09:03,  3.43s/it]
Skipping the first batches:  10%|▉         | 588/6000 [35:23<5:30:59,  3.67s/it]
Skipping the first batches:  10%|▉         | 589/6000 [35:26<5:30:39,  3.67s/it]
Skipping the first batches:  10%|▉         | 590/6000 [35:30<5:36:01,  3.73s/it]
Skipping the first batches:  10%|▉         | 591/6000 [35:34<5:25:54,  3.62s/it]
Skipping the first batches:  10%|▉         | 592/6000 [35:37<5:15:57,  3.51s/it]
Skipping the first batches:  10%|▉         | 593/6000 [35:40<5:11:25,  3.46s/it]
Skipping the first batches:  10%|▉         | 594/6000 [35:44<5:23:10,  3.59s/it]
Skipping the first batches:  10%|▉         | 595/6000 [35:47<5:16:33,  3.51s/it]
Skipping the first batches:  10%|▉         | 596/6000 [35:50<5:04:57,  3.39s/it]
Skipping the first batches:  10%|▉         | 597/6000 [35:54<5:09:23,  3.44s/it]
Skipping the first batches:  10%|▉         | 598/6000 [35:58<5:23:10,  3.59s/it]
Skipping the first batches:  10%|▉         | 599/6000 [36:01<5:13:06,  3.48s/it]
Skipping the first batches:  10%|█         | 600/6000 [36:04<5:05:57,  3.40s/it]
Skipping the first batches:  10%|█         | 601/6000 [36:08<5:00:09,  3.34s/it]
Skipping the first batches:  10%|█         | 602/6000 [36:11<5:01:13,  3.35s/it]
Skipping the first batches:  10%|█         | 603/6000 [36:14<5:01:55,  3.36s/it]
Skipping the first batches:  10%|█         | 604/6000 [36:18<5:03:22,  3.37s/it]
Skipping the first batches:  10%|█         | 605/6000 [36:21<5:00:02,  3.34s/it]
Skipping the first batches:  10%|█         | 606/6000 [36:25<5:11:43,  3.47s/it]
Skipping the first batches:  10%|█         | 607/6000 [36:28<5:06:10,  3.41s/it]
Skipping the first batches:  10%|█         | 608/6000 [36:31<5:03:41,  3.38s/it]
Skipping the first batches:  10%|█         | 609/6000 [36:35<5:01:21,  3.35s/it]
Skipping the first batches:  10%|█         | 610/6000 [36:38<5:05:34,  3.40s/it]
Skipping the first batches:  10%|█         | 611/6000 [36:41<4:56:45,  3.30s/it]
Skipping the first batches:  10%|█         | 612/6000 [36:45<4:59:28,  3.33s/it]
Skipping the first batches:  10%|█         | 613/6000 [36:48<5:02:15,  3.37s/it]
Skipping the first batches:  10%|█         | 614/6000 [36:51<5:01:29,  3.36s/it]
Skipping the first batches:  10%|█         | 615/6000 [36:55<5:03:26,  3.38s/it]
Skipping the first batches:  10%|█         | 616/6000 [36:58<5:02:09,  3.37s/it]
Skipping the first batches:  10%|█         | 617/6000 [37:01<4:59:20,  3.34s/it]
Skipping the first batches:  10%|█         | 618/6000 [37:05<4:55:08,  3.29s/it]
Skipping the first batches:  10%|█         | 619/6000 [37:08<4:59:22,  3.34s/it]
Skipping the first batches:  10%|█         | 620/6000 [37:12<5:04:34,  3.40s/it]
Skipping the first batches:  10%|█         | 621/6000 [37:15<5:03:34,  3.39s/it]
Skipping the first batches:  10%|█         | 622/6000 [37:18<4:59:57,  3.35s/it]
Skipping the first batches:  10%|█         | 623/6000 [37:22<5:02:40,  3.38s/it]
Skipping the first batches:  10%|█         | 624/6000 [37:26<5:16:26,  3.53s/it]
Skipping the first batches:  10%|█         | 625/6000 [37:29<5:10:22,  3.46s/it]
Skipping the first batches:  10%|█         | 626/6000 [37:32<5:01:51,  3.37s/it]
Skipping the first batches:  10%|█         | 627/6000 [37:36<5:04:18,  3.40s/it]
Skipping the first batches:  10%|█         | 628/6000 [37:39<4:56:56,  3.32s/it]
Skipping the first batches:  10%|█         | 629/6000 [37:42<4:49:23,  3.23s/it]
Skipping the first batches:  10%|█         | 630/6000 [37:45<5:00:15,  3.35s/it]
Skipping the first batches:  11%|█         | 631/6000 [37:49<5:06:40,  3.43s/it]
Skipping the first batches:  11%|█         | 632/6000 [37:52<5:04:30,  3.40s/it]
Skipping the first batches:  11%|█         | 633/6000 [37:56<5:06:46,  3.43s/it]
Skipping the first batches:  11%|█         | 634/6000 [37:59<5:02:15,  3.38s/it]
Skipping the first batches:  11%|█         | 635/6000 [38:02<5:04:37,  3.41s/it]
Skipping the first batches:  11%|█         | 636/6000 [38:06<4:59:19,  3.35s/it]
Skipping the first batches:  11%|█         | 637/6000 [38:09<5:02:15,  3.38s/it]
Skipping the first batches:  11%|█         | 638/6000 [38:13<5:05:12,  3.42s/it]
Skipping the first batches:  11%|█         | 639/6000 [38:16<5:02:56,  3.39s/it]
Skipping the first batches:  11%|█         | 640/6000 [38:20<5:07:47,  3.45s/it]
Skipping the first batches:  11%|█         | 641/6000 [38:23<5:02:55,  3.39s/it]
Skipping the first batches:  11%|█         | 642/6000 [38:26<5:03:45,  3.40s/it]
Skipping the first batches:  11%|█         | 643/6000 [38:29<4:54:29,  3.30s/it]
Skipping the first batches:  11%|█         | 644/6000 [38:33<5:06:21,  3.43s/it]
Skipping the first batches:  11%|█         | 645/6000 [38:36<5:01:15,  3.38s/it]
Skipping the first batches:  11%|█         | 646/6000 [38:40<5:06:04,  3.43s/it]
Skipping the first batches:  11%|█         | 647/6000 [38:43<4:58:59,  3.35s/it]
Skipping the first batches:  11%|█         | 648/6000 [38:47<5:03:20,  3.40s/it]
Skipping the first batches:  11%|█         | 649/6000 [38:50<5:02:25,  3.39s/it]
Skipping the first batches:  11%|█         | 650/6000 [38:53<4:52:32,  3.28s/it]
Skipping the first batches:  11%|█         | 651/6000 [38:56<4:58:54,  3.35s/it]
Skipping the first batches:  11%|█         | 652/6000 [39:00<4:58:41,  3.35s/it]
Skipping the first batches:  11%|█         | 653/6000 [39:03<4:54:38,  3.31s/it]
Skipping the first batches:  11%|█         | 654/6000 [39:07<5:02:27,  3.39s/it]
Skipping the first batches:  11%|█         | 655/6000 [39:10<5:00:54,  3.38s/it]
Skipping the first batches:  11%|█         | 656/6000 [39:13<4:59:55,  3.37s/it]
Skipping the first batches:  11%|█         | 657/6000 [39:17<4:58:49,  3.36s/it]
Skipping the first batches:  11%|█         | 658/6000 [39:20<4:55:21,  3.32s/it]
Skipping the first batches:  11%|█         | 659/6000 [39:23<4:51:10,  3.27s/it]
Skipping the first batches:  11%|█         | 660/6000 [39:28<5:48:45,  3.92s/it]
Skipping the first batches:  11%|█         | 661/6000 [39:32<5:28:25,  3.69s/it]
Skipping the first batches:  11%|█         | 662/6000 [39:35<5:16:22,  3.56s/it]
Skipping the first batches:  11%|█         | 663/6000 [39:38<5:09:28,  3.48s/it]
Skipping the first batches:  11%|█         | 664/6000 [39:42<5:09:11,  3.48s/it]
Skipping the first batches:  11%|█         | 665/6000 [39:45<5:02:52,  3.41s/it]
Skipping the first batches:  11%|█         | 666/6000 [39:49<5:11:35,  3.51s/it]
Skipping the first batches:  11%|█         | 667/6000 [39:52<5:20:00,  3.60s/it]
Skipping the first batches:  11%|█         | 668/6000 [39:56<5:32:31,  3.74s/it]
Skipping the first batches:  11%|█         | 669/6000 [40:01<5:47:38,  3.91s/it]
Skipping the first batches:  11%|█         | 670/6000 [40:06<6:11:03,  4.18s/it]
Skipping the first batches:  11%|█         | 671/6000 [40:09<5:45:45,  3.89s/it]
Skipping the first batches:  11%|█         | 672/6000 [40:12<5:24:34,  3.66s/it]
Skipping the first batches:  11%|█         | 673/6000 [40:15<5:20:25,  3.61s/it]
Skipping the first batches:  11%|█         | 674/6000 [40:19<5:15:40,  3.56s/it]
Skipping the first batches:  11%|█▏        | 675/6000 [40:22<5:11:35,  3.51s/it]
Skipping the first batches:  11%|█▏        | 676/6000 [40:28<6:16:40,  4.25s/it]
Skipping the first batches:  11%|█▏        | 677/6000 [40:32<6:07:08,  4.14s/it]
Skipping the first batches:  11%|█▏        | 678/6000 [40:35<5:47:42,  3.92s/it]
Skipping the first batches:  11%|█▏        | 679/6000 [40:39<5:33:32,  3.76s/it]
Skipping the first batches:  11%|█▏        | 680/6000 [40:42<5:24:26,  3.66s/it]
Skipping the first batches:  11%|█▏        | 681/6000 [40:46<5:17:52,  3.59s/it]
Skipping the first batches:  11%|█▏        | 682/6000 [40:49<5:13:41,  3.54s/it]
Skipping the first batches:  11%|█▏        | 683/6000 [40:52<5:02:03,  3.41s/it]
Skipping the first batches:  11%|█▏        | 684/6000 [40:56<4:59:11,  3.38s/it]
Skipping the first batches:  11%|█▏        | 685/6000 [40:59<4:55:46,  3.34s/it]
Skipping the first batches:  11%|█▏        | 686/6000 [41:02<5:02:11,  3.41s/it]
Skipping the first batches:  11%|█▏        | 687/6000 [41:06<5:06:36,  3.46s/it]
Skipping the first batches:  11%|█▏        | 688/6000 [41:10<5:09:28,  3.50s/it]
Skipping the first batches:  11%|█▏        | 689/6000 [41:13<5:19:32,  3.61s/it]
Skipping the first batches:  12%|█▏        | 690/6000 [41:17<5:06:33,  3.46s/it]
Skipping the first batches:  12%|█▏        | 691/6000 [41:20<5:02:16,  3.42s/it]
Skipping the first batches:  12%|█▏        | 692/6000 [41:24<5:10:30,  3.51s/it]
Skipping the first batches:  12%|█▏        | 693/6000 [41:27<5:08:27,  3.49s/it]
Skipping the first batches:  12%|█▏        | 694/6000 [41:30<5:00:47,  3.40s/it]
Skipping the first batches:  12%|█▏        | 695/6000 [41:34<5:07:01,  3.47s/it]
Skipping the first batches:  12%|█▏        | 696/6000 [41:37<5:03:10,  3.43s/it]
Skipping the first batches:  12%|█▏        | 697/6000 [41:40<4:55:57,  3.35s/it]
Skipping the first batches:  12%|█▏        | 698/6000 [41:44<5:00:01,  3.40s/it]
Skipping the first batches:  12%|█▏        | 699/6000 [41:47<5:01:19,  3.41s/it]
Skipping the first batches:  12%|█▏        | 700/6000 [41:51<5:00:16,  3.40s/it]
Skipping the first batches:  12%|█▏        | 701/6000 [41:54<4:56:45,  3.36s/it]
Skipping the first batches:  12%|█▏        | 702/6000 [41:57<4:59:08,  3.39s/it]
Skipping the first batches:  12%|█▏        | 703/6000 [42:01<4:57:33,  3.37s/it]
Skipping the first batches:  12%|█▏        | 704/6000 [42:05<5:10:07,  3.51s/it]
Skipping the first batches:  12%|█▏        | 705/6000 [42:08<5:03:53,  3.44s/it]
Skipping the first batches:  12%|█▏        | 706/6000 [42:11<5:07:51,  3.49s/it]
Skipping the first batches:  12%|█▏        | 707/6000 [42:16<5:27:14,  3.71s/it]
Skipping the first batches:  12%|█▏        | 708/6000 [42:20<5:52:12,  3.99s/it]
Skipping the first batches:  12%|█▏        | 709/6000 [42:24<5:55:29,  4.03s/it]
Skipping the first batches:  12%|█▏        | 710/6000 [42:29<6:00:59,  4.09s/it]
Skipping the first batches:  12%|█▏        | 711/6000 [42:32<5:44:08,  3.90s/it]
Skipping the first batches:  12%|█▏        | 712/6000 [42:36<5:32:39,  3.77s/it]
Skipping the first batches:  12%|█▏        | 713/6000 [42:39<5:18:48,  3.62s/it]
Skipping the first batches:  12%|█▏        | 714/6000 [42:42<5:15:45,  3.58s/it]
Skipping the first batches:  12%|█▏        | 715/6000 [42:46<5:04:39,  3.46s/it]
Skipping the first batches:  12%|█▏        | 716/6000 [42:49<5:07:35,  3.49s/it]
Skipping the first batches:  12%|█▏        | 717/6000 [42:52<5:00:09,  3.41s/it]
Skipping the first batches:  12%|█▏        | 718/6000 [42:55<4:50:57,  3.31s/it]
Skipping the first batches:  12%|█▏        | 719/6000 [42:59<5:02:29,  3.44s/it]
Skipping the first batches:  12%|█▏        | 720/6000 [43:03<5:09:19,  3.52s/it]
Skipping the first batches:  12%|█▏        | 721/6000 [43:06<4:58:04,  3.39s/it]
Skipping the first batches:  12%|█▏        | 722/6000 [43:09<5:01:22,  3.43s/it]
Skipping the first batches:  12%|█▏        | 723/6000 [43:13<5:07:12,  3.49s/it]
Skipping the first batches:  12%|█▏        | 724/6000 [43:16<5:01:52,  3.43s/it]
Skipping the first batches:  12%|█▏        | 725/6000 [43:20<5:00:53,  3.42s/it]
Skipping the first batches:  12%|█▏        | 726/6000 [43:23<5:06:10,  3.48s/it]
Skipping the first batches:  12%|█▏        | 727/6000 [43:27<5:08:33,  3.51s/it]
Skipping the first batches:  12%|█▏        | 728/6000 [43:30<5:06:32,  3.49s/it]
Skipping the first batches:  12%|█▏        | 729/6000 [43:34<5:03:55,  3.46s/it]
Skipping the first batches:  12%|█▏        | 730/6000 [43:37<5:06:11,  3.49s/it]
Skipping the first batches:  12%|█▏        | 731/6000 [43:41<5:08:02,  3.51s/it]
Skipping the first batches:  12%|█▏        | 732/6000 [43:45<5:15:19,  3.59s/it]
Skipping the first batches:  12%|█▏        | 733/6000 [43:48<5:06:18,  3.49s/it]
Skipping the first batches:  12%|█▏        | 734/6000 [43:52<5:17:08,  3.61s/it]
Skipping the first batches:  12%|█▏        | 735/6000 [43:55<5:15:47,  3.60s/it]
Skipping the first batches:  12%|█▏        | 736/6000 [43:59<5:16:23,  3.61s/it]
Skipping the first batches:  12%|█▏        | 737/6000 [44:02<5:04:30,  3.47s/it]
Skipping the first batches:  12%|█▏        | 738/6000 [44:05<4:53:17,  3.34s/it]
Skipping the first batches:  12%|█▏        | 739/6000 [44:09<5:15:01,  3.59s/it]
Skipping the first batches:  12%|█▏        | 740/6000 [44:13<5:04:41,  3.48s/it]
Skipping the first batches:  12%|█▏        | 741/6000 [44:16<5:04:23,  3.47s/it]
Skipping the first batches:  12%|█▏        | 742/6000 [44:20<5:10:37,  3.54s/it]
Skipping the first batches:  12%|█▏        | 743/6000 [44:23<5:02:07,  3.45s/it]
Skipping the first batches:  12%|█▏        | 744/6000 [44:26<5:02:46,  3.46s/it]
Skipping the first batches:  12%|█▏        | 745/6000 [44:30<5:01:39,  3.44s/it]
Skipping the first batches:  12%|█▏        | 746/6000 [44:33<4:52:41,  3.34s/it]
Skipping the first batches:  12%|█▏        | 747/6000 [44:37<5:09:49,  3.54s/it]
Skipping the first batches:  12%|█▏        | 748/6000 [44:41<5:26:56,  3.73s/it]
Skipping the first batches:  12%|█▏        | 749/6000 [44:44<5:12:38,  3.57s/it]
Skipping the first batches:  12%|█▎        | 750/6000 [44:48<5:10:07,  3.54s/it]
Skipping the first batches:  13%|█▎        | 751/6000 [44:51<5:10:42,  3.55s/it]
Skipping the first batches:  13%|█▎        | 752/6000 [44:55<5:01:51,  3.45s/it]
Skipping the first batches:  13%|█▎        | 753/6000 [44:58<4:58:01,  3.41s/it]
Skipping the first batches:  13%|█▎        | 754/6000 [45:01<4:57:14,  3.40s/it]
Skipping the first batches:  13%|█▎        | 755/6000 [45:05<4:51:34,  3.34s/it]
Skipping the first batches:  13%|█▎        | 756/6000 [45:08<4:48:06,  3.30s/it]
Skipping the first batches:  13%|█▎        | 757/6000 [45:11<4:46:53,  3.28s/it]
Skipping the first batches:  13%|█▎        | 758/6000 [45:15<4:53:04,  3.35s/it]
Skipping the first batches:  13%|█▎        | 759/6000 [45:18<4:54:43,  3.37s/it]
Skipping the first batches:  13%|█▎        | 760/6000 [45:21<4:52:32,  3.35s/it]
Skipping the first batches:  13%|█▎        | 761/6000 [45:24<4:45:10,  3.27s/it]
Skipping the first batches:  13%|█▎        | 762/6000 [45:28<4:49:47,  3.32s/it]
Skipping the first batches:  13%|█▎        | 763/6000 [45:32<5:01:34,  3.46s/it]
Skipping the first batches:  13%|█▎        | 764/6000 [45:35<4:52:10,  3.35s/it]
Skipping the first batches:  13%|█▎        | 765/6000 [45:38<4:53:15,  3.36s/it]
Skipping the first batches:  13%|█▎        | 766/6000 [45:41<4:50:29,  3.33s/it]
Skipping the first batches:  13%|█▎        | 767/6000 [45:45<4:55:38,  3.39s/it]
Skipping the first batches:  13%|█▎        | 768/6000 [45:48<4:54:15,  3.37s/it]
Skipping the first batches:  13%|█▎        | 769/6000 [45:51<4:49:07,  3.32s/it]
Skipping the first batches:  13%|█▎        | 770/6000 [45:55<4:52:17,  3.35s/it]
Skipping the first batches:  13%|█▎        | 771/6000 [45:58<4:50:03,  3.33s/it]
Skipping the first batches:  13%|█▎        | 772/6000 [46:01<4:42:32,  3.24s/it]
Skipping the first batches:  13%|█▎        | 773/6000 [46:05<4:48:48,  3.32s/it]
Skipping the first batches:  13%|█▎        | 774/6000 [46:08<4:55:59,  3.40s/it]
Skipping the first batches:  13%|█▎        | 775/6000 [46:11<4:48:37,  3.31s/it]
Skipping the first batches:  13%|█▎        | 776/6000 [46:15<4:52:43,  3.36s/it]
Skipping the first batches:  13%|█▎        | 777/6000 [46:18<4:59:46,  3.44s/it]
Skipping the first batches:  13%|█▎        | 778/6000 [46:22<4:55:48,  3.40s/it]
Skipping the first batches:  13%|█▎        | 779/6000 [46:25<5:00:25,  3.45s/it]
Skipping the first batches:  13%|█▎        | 780/6000 [46:28<4:52:37,  3.36s/it]
Skipping the first batches:  13%|█▎        | 781/6000 [46:32<4:59:51,  3.45s/it]
Skipping the first batches:  13%|█▎        | 782/6000 [46:35<4:50:57,  3.35s/it]
Skipping the first batches:  13%|█▎        | 783/6000 [46:38<4:43:20,  3.26s/it]
Skipping the first batches:  13%|█▎        | 784/6000 [46:42<5:03:22,  3.49s/it]
Skipping the first batches:  13%|█▎        | 785/6000 [46:45<4:55:37,  3.40s/it]
Skipping the first batches:  13%|█▎        | 786/6000 [46:48<4:46:27,  3.30s/it]
Skipping the first batches:  13%|█▎        | 787/6000 [46:52<4:54:03,  3.38s/it]
Skipping the first batches:  13%|█▎        | 788/6000 [46:55<4:45:36,  3.29s/it]
Skipping the first batches:  13%|█▎        | 789/6000 [46:58<4:40:15,  3.23s/it]
Skipping the first batches:  13%|█▎        | 790/6000 [47:02<4:42:46,  3.26s/it]
Skipping the first batches:  13%|█▎        | 791/6000 [47:05<4:45:45,  3.29s/it]
Skipping the first batches:  13%|█▎        | 792/6000 [47:08<4:42:30,  3.25s/it]
Skipping the first batches:  13%|█▎        | 793/6000 [47:12<4:51:45,  3.36s/it]
Skipping the first batches:  13%|█▎        | 794/6000 [47:15<4:44:34,  3.28s/it]
Skipping the first batches:  13%|█▎        | 795/6000 [47:19<4:58:12,  3.44s/it]
Skipping the first batches:  13%|█▎        | 796/6000 [47:22<4:50:22,  3.35s/it]
Skipping the first batches:  13%|█▎        | 797/6000 [47:25<4:42:36,  3.26s/it]
Skipping the first batches:  13%|█▎        | 798/6000 [47:29<4:54:54,  3.40s/it]
Skipping the first batches:  13%|█▎        | 799/6000 [47:32<4:46:21,  3.30s/it]
Skipping the first batches:  13%|█▎        | 800/6000 [47:35<4:44:01,  3.28s/it]
Skipping the first batches:  13%|█▎        | 801/6000 [47:38<4:37:56,  3.21s/it]
Skipping the first batches:  13%|█▎        | 802/6000 [47:41<4:43:46,  3.28s/it]
Skipping the first batches:  13%|█▎        | 803/6000 [47:45<4:47:04,  3.31s/it]
Skipping the first batches:  13%|█▎        | 804/6000 [47:48<4:39:32,  3.23s/it]
Skipping the first batches:  13%|█▎        | 805/6000 [47:52<5:00:06,  3.47s/it]
Skipping the first batches:  13%|█▎        | 806/6000 [47:56<5:29:15,  3.80s/it]
Skipping the first batches:  13%|█▎        | 807/6000 [47:59<5:08:32,  3.56s/it]
Skipping the first batches:  13%|█▎        | 808/6000 [48:03<5:01:31,  3.48s/it]
Skipping the first batches:  13%|█▎        | 809/6000 [48:06<4:52:41,  3.38s/it]
Skipping the first batches:  14%|█▎        | 810/6000 [48:09<4:53:03,  3.39s/it]
Skipping the first batches:  14%|█▎        | 811/6000 [48:13<4:54:58,  3.41s/it]
Skipping the first batches:  14%|█▎        | 812/6000 [48:16<4:53:14,  3.39s/it]
Skipping the first batches:  14%|█▎        | 813/6000 [48:19<4:43:38,  3.28s/it]
Skipping the first batches:  14%|█▎        | 814/6000 [48:23<5:05:50,  3.54s/it]
Skipping the first batches:  14%|█▎        | 815/6000 [48:28<5:39:20,  3.93s/it]
Skipping the first batches:  14%|█▎        | 816/6000 [48:33<5:57:34,  4.14s/it]
Skipping the first batches:  14%|█▎        | 817/6000 [48:37<6:07:58,  4.26s/it]
Skipping the first batches:  14%|█▎        | 818/6000 [48:41<6:08:02,  4.26s/it]
Skipping the first batches:  14%|█▎        | 819/6000 [48:46<6:08:11,  4.26s/it]
Skipping the first batches:  14%|█▎        | 820/6000 [48:50<6:12:40,  4.32s/it]
Skipping the first batches:  14%|█▎        | 821/6000 [48:55<6:18:43,  4.39s/it]
Skipping the first batches:  14%|█▎        | 822/6000 [48:59<6:15:27,  4.35s/it]
Skipping the first batches:  14%|█▎        | 823/6000 [49:03<6:18:48,  4.39s/it]
Skipping the first batches:  14%|█▎        | 824/6000 [49:08<6:13:46,  4.33s/it]
Skipping the first batches:  14%|█▍        | 825/6000 [49:11<5:59:09,  4.16s/it]
Skipping the first batches:  14%|█▍        | 826/6000 [49:16<6:05:16,  4.24s/it]
Skipping the first batches:  14%|█▍        | 827/6000 [49:19<5:42:43,  3.98s/it]
Skipping the first batches:  14%|█▍        | 828/6000 [49:23<5:32:16,  3.85s/it]
Skipping the first batches:  14%|█▍        | 829/6000 [49:26<5:17:32,  3.68s/it]
Skipping the first batches:  14%|█▍        | 830/6000 [49:29<5:10:44,  3.61s/it]
Skipping the first batches:  14%|█▍        | 831/6000 [49:33<4:56:41,  3.44s/it]
Skipping the first batches:  14%|█▍        | 832/6000 [49:36<4:53:06,  3.40s/it]
Skipping the first batches:  14%|█▍        | 833/6000 [49:39<4:57:11,  3.45s/it]
Skipping the first batches:  14%|█▍        | 834/6000 [49:42<4:47:04,  3.33s/it]
Skipping the first batches:  14%|█▍        | 835/6000 [49:46<4:47:40,  3.34s/it]
Skipping the first batches:  14%|█▍        | 836/6000 [49:49<4:52:43,  3.40s/it]
Skipping the first batches:  14%|█▍        | 837/6000 [49:53<4:58:25,  3.47s/it]
Skipping the first batches:  14%|█▍        | 838/6000 [49:56<4:55:11,  3.43s/it]
Skipping the first batches:  14%|█▍        | 839/6000 [50:00<4:49:04,  3.36s/it]
Skipping the first batches:  14%|█▍        | 840/6000 [50:03<4:51:03,  3.38s/it]
Skipping the first batches:  14%|█▍        | 841/6000 [50:06<4:43:53,  3.30s/it]
Skipping the first batches:  14%|█▍        | 842/6000 [50:09<4:44:20,  3.31s/it]
Skipping the first batches:  14%|█▍        | 843/6000 [50:13<4:45:06,  3.32s/it]
Skipping the first batches:  14%|█▍        | 844/6000 [50:16<4:41:33,  3.28s/it]
Skipping the first batches:  14%|█▍        | 845/6000 [50:19<4:38:19,  3.24s/it]
Skipping the first batches:  14%|█▍        | 846/6000 [50:22<4:42:34,  3.29s/it]
Skipping the first batches:  14%|█▍        | 847/6000 [50:26<4:39:22,  3.25s/it]
Skipping the first batches:  14%|█▍        | 848/6000 [50:29<4:45:17,  3.32s/it]
Skipping the first batches:  14%|█▍        | 849/6000 [50:32<4:40:03,  3.26s/it]
Skipping the first batches:  14%|█▍        | 850/6000 [50:35<4:38:34,  3.25s/it]
Skipping the first batches:  14%|█▍        | 851/6000 [50:39<4:47:58,  3.36s/it]
Skipping the first batches:  14%|█▍        | 852/6000 [50:42<4:41:00,  3.28s/it]
Skipping the first batches:  14%|█▍        | 853/6000 [50:45<4:34:02,  3.19s/it]
Skipping the first batches:  14%|█▍        | 854/6000 [50:49<4:55:19,  3.44s/it]
Skipping the first batches:  14%|█▍        | 855/6000 [50:53<4:54:07,  3.43s/it]
Skipping the first batches:  14%|█▍        | 856/6000 [50:56<5:00:08,  3.50s/it]
Skipping the first batches:  14%|█▍        | 857/6000 [51:00<4:57:01,  3.47s/it]
Skipping the first batches:  14%|█▍        | 858/6000 [51:03<4:53:35,  3.43s/it]
Skipping the first batches:  14%|█▍        | 859/6000 [51:06<4:48:42,  3.37s/it]
Skipping the first batches:  14%|█▍        | 860/6000 [51:10<4:54:56,  3.44s/it]
Skipping the first batches:  14%|█▍        | 861/6000 [51:13<4:58:51,  3.49s/it]
Skipping the first batches:  14%|█▍        | 862/6000 [51:17<4:48:48,  3.37s/it]
Skipping the first batches:  14%|█▍        | 863/6000 [51:20<4:57:58,  3.48s/it]
Skipping the first batches:  14%|█▍        | 864/6000 [51:23<4:52:13,  3.41s/it]
Skipping the first batches:  14%|█▍        | 865/6000 [51:27<4:42:39,  3.30s/it]
Skipping the first batches:  14%|█▍        | 866/6000 [51:30<4:41:39,  3.29s/it]
Skipping the first batches:  14%|█▍        | 867/6000 [51:34<4:57:25,  3.48s/it]
Skipping the first batches:  14%|█▍        | 868/6000 [51:37<4:48:10,  3.37s/it]
Skipping the first batches:  14%|█▍        | 869/6000 [51:40<4:53:49,  3.44s/it]
Skipping the first batches:  14%|█▍        | 870/6000 [51:44<5:02:04,  3.53s/it]
Skipping the first batches:  15%|█▍        | 871/6000 [51:48<5:10:42,  3.63s/it]
Skipping the first batches:  15%|█▍        | 872/6000 [51:51<5:03:53,  3.56s/it]
Skipping the first batches:  15%|█▍        | 873/6000 [51:55<5:04:18,  3.56s/it]
Skipping the first batches:  15%|█▍        | 874/6000 [51:58<4:53:42,  3.44s/it]
Skipping the first batches:  15%|█▍        | 875/6000 [52:02<4:51:41,  3.42s/it]
Skipping the first batches:  15%|█▍        | 876/6000 [52:05<4:45:53,  3.35s/it]
Skipping the first batches:  15%|█▍        | 877/6000 [52:08<4:38:38,  3.26s/it]
Skipping the first batches:  15%|█▍        | 878/6000 [52:11<4:43:41,  3.32s/it]
Skipping the first batches:  15%|█▍        | 879/6000 [52:15<5:06:28,  3.59s/it]
Skipping the first batches:  15%|█▍        | 880/6000 [52:19<5:01:48,  3.54s/it]
Skipping the first batches:  15%|█▍        | 881/6000 [52:22<4:56:56,  3.48s/it]
Skipping the first batches:  15%|█▍        | 882/6000 [52:26<4:54:49,  3.46s/it]
Skipping the first batches:  15%|█▍        | 883/6000 [52:29<5:00:43,  3.53s/it]
Skipping the first batches:  15%|█▍        | 884/6000 [52:32<4:50:07,  3.40s/it]
Skipping the first batches:  15%|█▍        | 885/6000 [52:36<4:50:29,  3.41s/it]
Skipping the first batches:  15%|█▍        | 886/6000 [52:39<4:46:06,  3.36s/it]
Skipping the first batches:  15%|█▍        | 887/6000 [52:42<4:39:47,  3.28s/it]
Skipping the first batches:  15%|█▍        | 888/6000 [52:46<4:42:32,  3.32s/it]
Skipping the first batches:  15%|█▍        | 889/6000 [52:49<4:41:58,  3.31s/it]
Skipping the first batches:  15%|█▍        | 890/6000 [52:52<4:38:08,  3.27s/it]
Skipping the first batches:  15%|█▍        | 891/6000 [52:56<4:48:02,  3.38s/it]
Skipping the first batches:  15%|█▍        | 892/6000 [52:59<4:40:40,  3.30s/it]
Skipping the first batches:  15%|█▍        | 893/6000 [53:02<4:40:34,  3.30s/it]
Skipping the first batches:  15%|█▍        | 894/6000 [53:05<4:38:36,  3.27s/it]
Skipping the first batches:  15%|█▍        | 895/6000 [53:09<4:37:54,  3.27s/it]
Skipping the first batches:  15%|█▍        | 896/6000 [53:12<4:47:16,  3.38s/it]
Skipping the first batches:  15%|█▍        | 897/6000 [53:15<4:44:08,  3.34s/it]
Skipping the first batches:  15%|█▍        | 898/6000 [53:18<4:35:33,  3.24s/it]
Skipping the first batches:  15%|█▍        | 899/6000 [53:22<4:47:56,  3.39s/it]
Skipping the first batches:  15%|█▌        | 900/6000 [53:26<4:49:06,  3.40s/it]
Skipping the first batches:  15%|█▌        | 901/6000 [53:29<4:48:09,  3.39s/it]
Skipping the first batches:  15%|█▌        | 902/6000 [53:33<4:56:34,  3.49s/it]
Skipping the first batches:  15%|█▌        | 903/6000 [53:36<4:53:19,  3.45s/it]
Skipping the first batches:  15%|█▌        | 904/6000 [53:39<4:48:45,  3.40s/it]
Skipping the first batches:  15%|█▌        | 905/6000 [53:43<4:43:48,  3.34s/it]
Skipping the first batches:  15%|█▌        | 906/6000 [53:46<4:50:25,  3.42s/it]
Skipping the first batches:  15%|█▌        | 907/6000 [53:49<4:39:48,  3.30s/it]
Skipping the first batches:  15%|█▌        | 908/6000 [53:52<4:38:59,  3.29s/it]
Skipping the first batches:  15%|█▌        | 909/6000 [53:56<4:41:19,  3.32s/it]
Skipping the first batches:  15%|█▌        | 910/6000 [53:59<4:43:08,  3.34s/it]
Skipping the first batches:  15%|█▌        | 911/6000 [54:03<4:42:40,  3.33s/it]
Skipping the first batches:  15%|█▌        | 912/6000 [54:06<4:51:25,  3.44s/it]
Skipping the first batches:  15%|█▌        | 913/6000 [54:09<4:45:51,  3.37s/it]
Skipping the first batches:  15%|█▌        | 914/6000 [54:13<4:46:51,  3.38s/it]
Skipping the first batches:  15%|█▌        | 915/6000 [54:16<4:49:57,  3.42s/it]
Skipping the first batches:  15%|█▌        | 916/6000 [54:19<4:42:04,  3.33s/it]
Skipping the first batches:  15%|█▌        | 917/6000 [54:24<5:05:19,  3.60s/it]
Skipping the first batches:  15%|█▌        | 918/6000 [54:27<5:00:10,  3.54s/it]
Skipping the first batches:  15%|█▌        | 919/6000 [54:30<4:52:33,  3.45s/it]
Skipping the first batches:  15%|█▌        | 920/6000 [54:34<4:45:20,  3.37s/it]
Skipping the first batches:  15%|█▌        | 921/6000 [54:37<4:44:25,  3.36s/it]
Skipping the first batches:  15%|█▌        | 922/6000 [54:40<4:40:54,  3.32s/it]
Skipping the first batches:  15%|█▌        | 923/6000 [54:44<4:57:07,  3.51s/it]
Skipping the first batches:  15%|█▌        | 924/6000 [54:47<4:54:41,  3.48s/it]
Skipping the first batches:  15%|█▌        | 925/6000 [54:51<4:54:42,  3.48s/it]
Skipping the first batches:  15%|█▌        | 926/6000 [54:55<4:59:31,  3.54s/it]
Skipping the first batches:  15%|█▌        | 927/6000 [54:58<4:59:49,  3.55s/it]
Skipping the first batches:  15%|█▌        | 928/6000 [55:02<4:56:34,  3.51s/it]
Skipping the first batches:  15%|█▌        | 929/6000 [55:05<4:56:42,  3.51s/it]
Skipping the first batches:  16%|█▌        | 930/6000 [55:08<4:50:41,  3.44s/it]
Skipping the first batches:  16%|█▌        | 931/6000 [55:12<4:54:37,  3.49s/it]
Skipping the first batches:  16%|█▌        | 932/6000 [55:15<4:54:37,  3.49s/it]
Skipping the first batches:  16%|█▌        | 933/6000 [55:19<4:48:04,  3.41s/it]
Skipping the first batches:  16%|█▌        | 934/6000 [55:22<4:51:05,  3.45s/it]
Skipping the first batches:  16%|█▌        | 935/6000 [55:25<4:45:57,  3.39s/it]
Skipping the first batches:  16%|█▌        | 936/6000 [55:29<4:50:27,  3.44s/it]
Skipping the first batches:  16%|█▌        | 937/6000 [55:32<4:48:30,  3.42s/it]
Skipping the first batches:  16%|█▌        | 938/6000 [55:36<4:46:44,  3.40s/it]
Skipping the first batches:  16%|█▌        | 939/6000 [55:39<4:42:45,  3.35s/it]
Skipping the first batches:  16%|█▌        | 940/6000 [55:42<4:43:35,  3.36s/it]
Skipping the first batches:  16%|█▌        | 941/6000 [55:46<4:42:09,  3.35s/it]
Skipping the first batches:  16%|█▌        | 942/6000 [55:49<4:39:24,  3.31s/it]
Skipping the first batches:  16%|█▌        | 943/6000 [55:52<4:43:02,  3.36s/it]
Skipping the first batches:  16%|█▌        | 944/6000 [55:56<4:51:11,  3.46s/it]
Skipping the first batches:  16%|█▌        | 945/6000 [56:00<4:53:45,  3.49s/it]
Skipping the first batches:  16%|█▌        | 946/6000 [56:03<4:44:03,  3.37s/it]
Skipping the first batches:  16%|█▌        | 947/6000 [56:06<4:40:27,  3.33s/it]
Skipping the first batches:  16%|█▌        | 948/6000 [56:09<4:42:32,  3.36s/it]
Skipping the first batches:  16%|█▌        | 949/6000 [56:13<4:37:41,  3.30s/it]
Skipping the first batches:  16%|█▌        | 950/6000 [56:16<4:34:07,  3.26s/it]
Skipping the first batches:  16%|█▌        | 951/6000 [56:20<4:48:35,  3.43s/it]
Skipping the first batches:  16%|█▌        | 952/6000 [56:23<4:49:29,  3.44s/it]
Skipping the first batches:  16%|█▌        | 953/6000 [56:26<4:46:29,  3.41s/it]
Skipping the first batches:  16%|█▌        | 954/6000 [56:31<5:08:39,  3.67s/it]
Skipping the first batches:  16%|█▌        | 955/6000 [56:34<5:03:20,  3.61s/it]
Skipping the first batches:  16%|█▌        | 956/6000 [56:38<5:04:53,  3.63s/it]
Skipping the first batches:  16%|█▌        | 957/6000 [56:41<4:52:03,  3.47s/it]
Skipping the first batches:  16%|█▌        | 958/6000 [56:44<4:43:27,  3.37s/it]
Skipping the first batches:  16%|█▌        | 959/6000 [56:48<4:55:34,  3.52s/it]
Skipping the first batches:  16%|█▌        | 960/6000 [56:51<4:51:19,  3.47s/it]
Skipping the first batches:  16%|█▌        | 961/6000 [56:54<4:42:05,  3.36s/it]
Skipping the first batches:  16%|█▌        | 962/6000 [56:58<4:48:52,  3.44s/it]
Skipping the first batches:  16%|█▌        | 963/6000 [57:01<4:49:40,  3.45s/it]
Skipping the first batches:  16%|█▌        | 964/6000 [57:05<4:42:06,  3.36s/it]
Skipping the first batches:  16%|█▌        | 965/6000 [57:08<4:46:01,  3.41s/it]
Skipping the first batches:  16%|█▌        | 966/6000 [57:12<4:50:14,  3.46s/it]
Skipping the first batches:  16%|█▌        | 967/6000 [57:15<4:48:32,  3.44s/it]
Skipping the first batches:  16%|█▌        | 968/6000 [57:19<4:52:20,  3.49s/it]
Skipping the first batches:  16%|█▌        | 969/6000 [57:22<4:48:25,  3.44s/it]
Skipping the first batches:  16%|█▌        | 970/6000 [57:25<4:38:59,  3.33s/it]
Skipping the first batches:  16%|█▌        | 971/6000 [57:29<4:57:21,  3.55s/it]
Skipping the first batches:  16%|█▌        | 972/6000 [57:33<4:54:15,  3.51s/it]
Skipping the first batches:  16%|█▌        | 973/6000 [57:36<4:45:03,  3.40s/it]
Skipping the first batches:  16%|█▌        | 974/6000 [57:40<5:04:01,  3.63s/it]
Skipping the first batches:  16%|█▋        | 975/6000 [57:43<4:53:52,  3.51s/it]
Skipping the first batches:  16%|█▋        | 976/6000 [57:47<4:52:50,  3.50s/it]
Skipping the first batches:  16%|█▋        | 977/6000 [57:50<4:54:44,  3.52s/it]
Skipping the first batches:  16%|█▋        | 978/6000 [57:53<4:48:44,  3.45s/it]
Skipping the first batches:  16%|█▋        | 979/6000 [57:57<4:54:03,  3.51s/it]
Skipping the first batches:  16%|█▋        | 980/6000 [58:01<4:53:09,  3.50s/it]
Skipping the first batches:  16%|█▋        | 981/6000 [58:04<4:49:03,  3.46s/it]
Skipping the first batches:  16%|█▋        | 982/6000 [58:07<4:44:26,  3.40s/it]
Skipping the first batches:  16%|█▋        | 983/6000 [58:11<4:55:14,  3.53s/it]
Skipping the first batches:  16%|█▋        | 984/6000 [58:14<4:45:32,  3.42s/it]
Skipping the first batches:  16%|█▋        | 985/6000 [58:18<4:44:21,  3.40s/it]
Skipping the first batches:  16%|█▋        | 986/6000 [58:21<4:57:49,  3.56s/it]
Skipping the first batches:  16%|█▋        | 987/6000 [58:25<5:06:16,  3.67s/it]
Skipping the first batches:  16%|█▋        | 988/6000 [58:29<5:06:09,  3.67s/it]
Skipping the first batches:  16%|█▋        | 989/6000 [58:33<5:07:16,  3.68s/it]
Skipping the first batches:  16%|█▋        | 990/6000 [58:36<4:58:11,  3.57s/it]
Skipping the first batches:  17%|█▋        | 991/6000 [58:39<4:52:50,  3.51s/it]
Skipping the first batches:  17%|█▋        | 992/6000 [58:43<4:48:03,  3.45s/it]
Skipping the first batches:  17%|█▋        | 993/6000 [58:46<4:41:33,  3.37s/it]
Skipping the first batches:  17%|█▋        | 994/6000 [58:50<4:46:50,  3.44s/it]
Skipping the first batches:  17%|█▋        | 995/6000 [58:53<4:43:19,  3.40s/it]
Skipping the first batches:  17%|█▋        | 996/6000 [58:57<4:50:22,  3.48s/it]
Skipping the first batches:  17%|█▋        | 997/6000 [59:00<4:56:31,  3.56s/it]
Skipping the first batches:  17%|█▋        | 998/6000 [59:04<5:02:14,  3.63s/it]
Skipping the first batches:  17%|█▋        | 999/6000 [59:08<5:00:25,  3.60s/it]
Skipping the first batches:  17%|█▋        | 1000/6000 [59:11<4:56:05,  3.55s/it]
Skipping the first batches:  17%|█▋        | 1001/6000 [59:14<4:47:09,  3.45s/it]
Skipping the first batches:  17%|█▋        | 1002/6000 [59:18<4:44:07,  3.41s/it]
Skipping the first batches:  17%|█▋        | 1003/6000 [59:21<4:56:51,  3.56s/it]
Skipping the first batches:  17%|█▋        | 1004/6000 [59:25<4:51:20,  3.50s/it]
Skipping the first batches:  17%|█▋        | 1005/6000 [59:28<4:39:43,  3.36s/it]
Skipping the first batches:  17%|█▋        | 1006/6000 [59:31<4:42:50,  3.40s/it]
Skipping the first batches:  17%|█▋        | 1007/6000 [59:35<4:39:25,  3.36s/it]
Skipping the first batches:  17%|█▋        | 1008/6000 [59:38<4:49:25,  3.48s/it]
Skipping the first batches:  17%|█▋        | 1009/6000 [59:42<4:40:48,  3.38s/it]
Skipping the first batches:  17%|█▋        | 1010/6000 [59:45<4:39:31,  3.36s/it]
Skipping the first batches:  17%|█▋        | 1011/6000 [59:48<4:41:42,  3.39s/it]
Skipping the first batches:  17%|█▋        | 1012/6000 [59:52<4:44:01,  3.42s/it]
Skipping the first batches:  17%|█▋        | 1013/6000 [59:55<4:45:45,  3.44s/it]
Skipping the first batches:  17%|█▋        | 1014/6000 [59:59<4:47:51,  3.46s/it]
Skipping the first batches:  17%|█▋        | 1015/6000 [1:00:02<4:41:12,  3.38s/it]
Skipping the first batches:  17%|█▋        | 1016/6000 [1:00:05<4:32:49,  3.28s/it]
Skipping the first batches:  17%|█▋        | 1017/6000 [1:00:09<4:52:49,  3.53s/it]
Skipping the first batches:  17%|█▋        | 1018/6000 [1:00:12<4:41:13,  3.39s/it]
Skipping the first batches:  17%|█▋        | 1019/6000 [1:00:16<4:44:21,  3.43s/it]
Skipping the first batches:  17%|█▋        | 1020/6000 [1:00:19<4:38:38,  3.36s/it]
Skipping the first batches:  17%|█▋        | 1021/6000 [1:00:22<4:38:22,  3.35s/it]
Skipping the first batches:  17%|█▋        | 1022/6000 [1:00:26<4:48:43,  3.48s/it]
Skipping the first batches:  17%|█▋        | 1023/6000 [1:00:29<4:43:53,  3.42s/it]
Skipping the first batches:  17%|█▋        | 1024/6000 [1:00:33<4:49:19,  3.49s/it]
Skipping the first batches:  17%|█▋        | 1025/6000 [1:00:36<4:48:39,  3.48s/it]
Skipping the first batches:  17%|█▋        | 1026/6000 [1:00:40<4:40:57,  3.39s/it]
Skipping the first batches:  17%|█▋        | 1027/6000 [1:00:43<4:38:38,  3.36s/it]
Skipping the first batches:  17%|█▋        | 1028/6000 [1:00:46<4:34:34,  3.31s/it]
Skipping the first batches:  17%|█▋        | 1029/6000 [1:00:49<4:34:33,  3.31s/it]
Skipping the first batches:  17%|█▋        | 1030/6000 [1:00:53<4:39:30,  3.37s/it]
Skipping the first batches:  17%|█▋        | 1031/6000 [1:00:56<4:35:37,  3.33s/it]
Skipping the first batches:  17%|█▋        | 1032/6000 [1:00:59<4:32:32,  3.29s/it]
Skipping the first batches:  17%|█▋        | 1033/6000 [1:01:03<4:37:08,  3.35s/it]
Skipping the first batches:  17%|█▋        | 1034/6000 [1:01:06<4:29:02,  3.25s/it]
Skipping the first batches:  17%|█▋        | 1035/6000 [1:01:10<4:46:11,  3.46s/it]
Skipping the first batches:  17%|█▋        | 1036/6000 [1:01:14<4:55:46,  3.57s/it]
Skipping the first batches:  17%|█▋        | 1037/6000 [1:01:18<5:04:13,  3.68s/it]
Skipping the first batches:  17%|█▋        | 1038/6000 [1:01:21<5:01:31,  3.65s/it]
Skipping the first batches:  17%|█▋        | 1039/6000 [1:01:25<4:55:14,  3.57s/it]
Skipping the first batches:  17%|█▋        | 1040/6000 [1:01:29<5:09:52,  3.75s/it]
Skipping the first batches:  17%|█▋        | 1041/6000 [1:01:32<4:59:07,  3.62s/it]
Skipping the first batches:  17%|█▋        | 1042/6000 [1:01:36<4:56:08,  3.58s/it]
Skipping the first batches:  17%|█▋        | 1043/6000 [1:01:39<4:49:27,  3.50s/it]
Skipping the first batches:  17%|█▋        | 1044/6000 [1:01:42<4:42:45,  3.42s/it]
Skipping the first batches:  17%|█▋        | 1045/6000 [1:01:46<4:44:20,  3.44s/it]
Skipping the first batches:  17%|█▋        | 1046/6000 [1:01:49<4:47:19,  3.48s/it]
Skipping the first batches:  17%|█▋        | 1047/6000 [1:01:53<4:59:30,  3.63s/it]
Skipping the first batches:  17%|█▋        | 1048/6000 [1:01:56<4:50:07,  3.52s/it]
Skipping the first batches:  17%|█▋        | 1049/6000 [1:02:00<4:45:56,  3.47s/it]
Skipping the first batches:  18%|█▊        | 1050/6000 [1:02:03<4:45:09,  3.46s/it]
Skipping the first batches:  18%|█▊        | 1051/6000 [1:02:06<4:38:16,  3.37s/it]
Skipping the first batches:  18%|█▊        | 1052/6000 [1:02:10<4:37:31,  3.37s/it]
Skipping the first batches:  18%|█▊        | 1053/6000 [1:02:13<4:29:34,  3.27s/it]
Skipping the first batches:  18%|█▊        | 1054/6000 [1:02:16<4:35:23,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1055/6000 [1:02:19<4:28:52,  3.26s/it]
Skipping the first batches:  18%|█▊        | 1056/6000 [1:02:23<4:31:44,  3.30s/it]
Skipping the first batches:  18%|█▊        | 1057/6000 [1:02:26<4:36:39,  3.36s/it]
Skipping the first batches:  18%|█▊        | 1058/6000 [1:02:29<4:35:30,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1059/6000 [1:02:33<4:27:31,  3.25s/it]
Skipping the first batches:  18%|█▊        | 1060/6000 [1:02:36<4:35:17,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1061/6000 [1:02:39<4:28:23,  3.26s/it]
Skipping the first batches:  18%|█▊        | 1062/6000 [1:02:43<4:34:51,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1063/6000 [1:02:46<4:27:43,  3.25s/it]
Skipping the first batches:  18%|█▊        | 1064/6000 [1:02:50<4:42:59,  3.44s/it]
Skipping the first batches:  18%|█▊        | 1065/6000 [1:02:53<4:52:08,  3.55s/it]
Skipping the first batches:  18%|█▊        | 1066/6000 [1:02:57<4:44:07,  3.46s/it]
Skipping the first batches:  18%|█▊        | 1067/6000 [1:03:00<4:52:20,  3.56s/it]
Skipping the first batches:  18%|█▊        | 1068/6000 [1:03:04<4:44:05,  3.46s/it]
Skipping the first batches:  18%|█▊        | 1069/6000 [1:03:07<4:37:51,  3.38s/it]
Skipping the first batches:  18%|█▊        | 1070/6000 [1:03:10<4:39:40,  3.40s/it]
Skipping the first batches:  18%|█▊        | 1071/6000 [1:03:14<4:42:02,  3.43s/it]
Skipping the first batches:  18%|█▊        | 1072/6000 [1:03:17<4:38:10,  3.39s/it]
Skipping the first batches:  18%|█▊        | 1073/6000 [1:03:21<4:43:22,  3.45s/it]
Skipping the first batches:  18%|█▊        | 1074/6000 [1:03:24<4:37:36,  3.38s/it]
Skipping the first batches:  18%|█▊        | 1075/6000 [1:03:27<4:32:15,  3.32s/it]
Skipping the first batches:  18%|█▊        | 1076/6000 [1:03:30<4:33:49,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1077/6000 [1:03:34<4:34:02,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1078/6000 [1:03:37<4:31:15,  3.31s/it]
Skipping the first batches:  18%|█▊        | 1079/6000 [1:03:41<4:36:19,  3.37s/it]
Skipping the first batches:  18%|█▊        | 1080/6000 [1:03:44<4:30:01,  3.29s/it]
Skipping the first batches:  18%|█▊        | 1081/6000 [1:03:47<4:34:57,  3.35s/it]
Skipping the first batches:  18%|█▊        | 1082/6000 [1:03:50<4:33:20,  3.33s/it]
Skipping the first batches:  18%|█▊        | 1083/6000 [1:03:53<4:26:03,  3.25s/it]
Skipping the first batches:  18%|█▊        | 1084/6000 [1:03:57<4:24:25,  3.23s/it]
Skipping the first batches:  18%|█▊        | 1085/6000 [1:04:01<4:43:15,  3.46s/it]
Skipping the first batches:  18%|█▊        | 1086/6000 [1:04:04<4:46:31,  3.50s/it]
Skipping the first batches:  18%|█▊        | 1087/6000 [1:04:08<4:46:49,  3.50s/it]
Skipping the first batches:  18%|█▊        | 1088/6000 [1:04:12<5:10:42,  3.80s/it]
Skipping the first batches:  18%|█▊        | 1089/6000 [1:04:17<5:28:55,  4.02s/it]
Skipping the first batches:  18%|█▊        | 1090/6000 [1:04:20<5:13:23,  3.83s/it]
Skipping the first batches:  18%|█▊        | 1091/6000 [1:04:23<4:54:13,  3.60s/it]
Skipping the first batches:  18%|█▊        | 1092/6000 [1:04:27<4:48:01,  3.52s/it]
Skipping the first batches:  18%|█▊        | 1093/6000 [1:04:31<5:17:42,  3.88s/it]
Skipping the first batches:  18%|█▊        | 1094/6000 [1:04:35<5:06:00,  3.74s/it]
Skipping the first batches:  18%|█▊        | 1095/6000 [1:04:38<4:54:00,  3.60s/it]
Skipping the first batches:  18%|█▊        | 1096/6000 [1:04:42<4:52:46,  3.58s/it]
Skipping the first batches:  18%|█▊        | 1097/6000 [1:04:45<4:43:38,  3.47s/it]
Skipping the first batches:  18%|█▊        | 1098/6000 [1:04:48<4:36:38,  3.39s/it]
Skipping the first batches:  18%|█▊        | 1099/6000 [1:04:51<4:36:46,  3.39s/it]
Skipping the first batches:  18%|█▊        | 1100/6000 [1:04:55<4:32:59,  3.34s/it]
Skipping the first batches:  18%|█▊        | 1101/6000 [1:04:58<4:39:34,  3.42s/it]
Skipping the first batches:  18%|█▊        | 1102/6000 [1:05:02<4:45:50,  3.50s/it]
Skipping the first batches:  18%|█▊        | 1103/6000 [1:05:05<4:46:55,  3.52s/it]
Skipping the first batches:  18%|█▊        | 1104/6000 [1:05:08<4:35:28,  3.38s/it]
Skipping the first batches:  18%|█▊        | 1105/6000 [1:05:12<4:30:56,  3.32s/it]
Skipping the first batches:  18%|█▊        | 1106/6000 [1:05:15<4:34:58,  3.37s/it]
Skipping the first batches:  18%|█▊        | 1107/6000 [1:05:18<4:27:16,  3.28s/it]
Skipping the first batches:  18%|█▊        | 1108/6000 [1:05:22<4:34:49,  3.37s/it]
Skipping the first batches:  18%|█▊        | 1109/6000 [1:05:25<4:29:50,  3.31s/it]
Skipping the first batches:  18%|█▊        | 1110/6000 [1:05:28<4:27:04,  3.28s/it]
Skipping the first batches:  19%|█▊        | 1111/6000 [1:05:32<4:40:36,  3.44s/it]
Skipping the first batches:  19%|█▊        | 1112/6000 [1:05:35<4:34:23,  3.37s/it]
Skipping the first batches:  19%|█▊        | 1113/6000 [1:05:38<4:30:48,  3.32s/it]
Skipping the first batches:  19%|█▊        | 1114/6000 [1:05:42<4:31:14,  3.33s/it]
Skipping the first batches:  19%|█▊        | 1115/6000 [1:05:45<4:31:52,  3.34s/it]
Skipping the first batches:  19%|█▊        | 1116/6000 [1:05:48<4:25:13,  3.26s/it]
Skipping the first batches:  19%|█▊        | 1117/6000 [1:05:51<4:26:26,  3.27s/it]
Skipping the first batches:  19%|█▊        | 1118/6000 [1:05:55<4:36:24,  3.40s/it]
Skipping the first batches:  19%|█▊        | 1119/6000 [1:05:59<4:45:18,  3.51s/it]
Skipping the first batches:  19%|█▊        | 1120/6000 [1:06:03<4:49:38,  3.56s/it]
Skipping the first batches:  19%|█▊        | 1121/6000 [1:06:06<4:46:33,  3.52s/it]
Skipping the first batches:  19%|█▊        | 1122/6000 [1:06:09<4:44:21,  3.50s/it]
Skipping the first batches:  19%|█▊        | 1123/6000 [1:06:13<4:40:01,  3.44s/it]
Skipping the first batches:  19%|█▊        | 1124/6000 [1:06:16<4:44:08,  3.50s/it]
Skipping the first batches:  19%|█▉        | 1125/6000 [1:06:20<4:48:26,  3.55s/it]
Skipping the first batches:  19%|█▉        | 1126/6000 [1:06:23<4:40:09,  3.45s/it]
Skipping the first batches:  19%|█▉        | 1127/6000 [1:06:27<4:44:36,  3.50s/it]
Skipping the first batches:  19%|█▉        | 1128/6000 [1:06:30<4:45:29,  3.52s/it]
Skipping the first batches:  19%|█▉        | 1129/6000 [1:06:34<4:46:14,  3.53s/it]
Skipping the first batches:  19%|█▉        | 1130/6000 [1:06:38<4:49:18,  3.56s/it]
Skipping the first batches:  19%|█▉        | 1131/6000 [1:06:41<4:47:27,  3.54s/it]
Skipping the first batches:  19%|█▉        | 1132/6000 [1:06:44<4:37:40,  3.42s/it]
Skipping the first batches:  19%|█▉        | 1133/6000 [1:06:48<4:33:27,  3.37s/it]
Skipping the first batches:  19%|█▉        | 1134/6000 [1:06:51<4:28:40,  3.31s/it]
Skipping the first batches:  19%|█▉        | 1135/6000 [1:06:54<4:34:12,  3.38s/it]
Skipping the first batches:  19%|█▉        | 1136/6000 [1:06:58<4:40:04,  3.45s/it]
Skipping the first batches:  19%|█▉        | 1137/6000 [1:07:01<4:30:57,  3.34s/it]
Skipping the first batches:  19%|█▉        | 1138/6000 [1:07:05<4:38:03,  3.43s/it]
Skipping the first batches:  19%|█▉        | 1139/6000 [1:07:08<4:35:06,  3.40s/it]
Skipping the first batches:  19%|█▉        | 1140/6000 [1:07:11<4:34:22,  3.39s/it]
Skipping the first batches:  19%|█▉        | 1141/6000 [1:07:15<4:35:12,  3.40s/it]
Skipping the first batches:  19%|█▉        | 1142/6000 [1:07:19<4:44:46,  3.52s/it]
Skipping the first batches:  19%|█▉        | 1143/6000 [1:07:22<4:38:08,  3.44s/it]
Skipping the first batches:  19%|█▉        | 1144/6000 [1:07:25<4:29:02,  3.32s/it]
Skipping the first batches:  19%|█▉        | 1145/6000 [1:07:29<4:49:39,  3.58s/it]
Skipping the first batches:  19%|█▉        | 1146/6000 [1:07:32<4:38:05,  3.44s/it]
Skipping the first batches:  19%|█▉        | 1147/6000 [1:07:35<4:35:49,  3.41s/it]
Skipping the first batches:  19%|█▉        | 1148/6000 [1:07:39<4:33:40,  3.38s/it]
Skipping the first batches:  19%|█▉        | 1149/6000 [1:07:42<4:30:11,  3.34s/it]
Skipping the first batches:  19%|█▉        | 1150/6000 [1:07:45<4:28:39,  3.32s/it]
Skipping the first batches:  19%|█▉        | 1151/6000 [1:07:48<4:22:55,  3.25s/it]
Skipping the first batches:  19%|█▉        | 1152/6000 [1:07:52<4:23:47,  3.26s/it]
Skipping the first batches:  19%|█▉        | 1153/6000 [1:07:55<4:33:37,  3.39s/it]
Skipping the first batches:  19%|█▉        | 1154/6000 [1:07:59<4:28:11,  3.32s/it]
Skipping the first batches:  19%|█▉        | 1155/6000 [1:08:02<4:25:08,  3.28s/it]
Skipping the first batches:  19%|█▉        | 1156/6000 [1:08:05<4:29:49,  3.34s/it]
Skipping the first batches:  19%|█▉        | 1157/6000 [1:08:09<4:41:10,  3.48s/it]
Skipping the first batches:  19%|█▉        | 1158/6000 [1:08:12<4:38:09,  3.45s/it]
Skipping the first batches:  19%|█▉        | 1159/6000 [1:08:15<4:28:46,  3.33s/it]
Skipping the first batches:  19%|█▉        | 1160/6000 [1:08:19<4:34:53,  3.41s/it]
Skipping the first batches:  19%|█▉        | 1161/6000 [1:08:22<4:33:45,  3.39s/it]
Skipping the first batches:  19%|█▉        | 1162/6000 [1:08:26<4:27:02,  3.31s/it]
Skipping the first batches:  19%|█▉        | 1163/6000 [1:08:29<4:28:24,  3.33s/it]
Skipping the first batches:  19%|█▉        | 1164/6000 [1:08:32<4:32:30,  3.38s/it]
Skipping the first batches:  19%|█▉        | 1165/6000 [1:08:35<4:25:27,  3.29s/it]
Skipping the first batches:  19%|█▉        | 1166/6000 [1:08:39<4:29:51,  3.35s/it]
Skipping the first batches:  19%|█▉        | 1167/6000 [1:08:42<4:32:55,  3.39s/it]
Skipping the first batches:  19%|█▉        | 1168/6000 [1:08:46<4:27:16,  3.32s/it]
Skipping the first batches:  19%|█▉        | 1169/6000 [1:08:49<4:31:27,  3.37s/it]
Skipping the first batches:  20%|█▉        | 1170/6000 [1:08:52<4:31:26,  3.37s/it]
Skipping the first batches:  20%|█▉        | 1171/6000 [1:08:56<4:24:20,  3.28s/it]
Skipping the first batches:  20%|█▉        | 1172/6000 [1:08:59<4:36:38,  3.44s/it]
Skipping the first batches:  20%|█▉        | 1173/6000 [1:09:03<4:30:00,  3.36s/it]
Skipping the first batches:  20%|█▉        | 1174/6000 [1:09:06<4:31:09,  3.37s/it]
Skipping the first batches:  20%|█▉        | 1175/6000 [1:09:10<4:38:18,  3.46s/it]
Skipping the first batches:  20%|█▉        | 1176/6000 [1:09:13<4:32:00,  3.38s/it]
Skipping the first batches:  20%|█▉        | 1177/6000 [1:09:16<4:37:55,  3.46s/it]
Skipping the first batches:  20%|█▉        | 1178/6000 [1:09:19<4:28:11,  3.34s/it]
Skipping the first batches:  20%|█▉        | 1179/6000 [1:09:23<4:24:20,  3.29s/it]
Skipping the first batches:  20%|█▉        | 1180/6000 [1:09:26<4:30:07,  3.36s/it]
Skipping the first batches:  20%|█▉        | 1181/6000 [1:09:29<4:26:55,  3.32s/it]
Skipping the first batches:  20%|█▉        | 1182/6000 [1:09:33<4:28:06,  3.34s/it]
Skipping the first batches:  20%|█▉        | 1183/6000 [1:09:36<4:26:57,  3.33s/it]
Skipping the first batches:  20%|█▉        | 1184/6000 [1:09:39<4:22:16,  3.27s/it]
Skipping the first batches:  20%|█▉        | 1185/6000 [1:09:43<4:46:04,  3.56s/it]
Skipping the first batches:  20%|█▉        | 1186/6000 [1:09:47<4:37:16,  3.46s/it]
Skipping the first batches:  20%|█▉        | 1187/6000 [1:09:50<4:40:57,  3.50s/it]
Skipping the first batches:  20%|█▉        | 1188/6000 [1:09:54<4:38:08,  3.47s/it]
Skipping the first batches:  20%|█▉        | 1189/6000 [1:09:57<4:32:49,  3.40s/it]
Skipping the first batches:  20%|█▉        | 1190/6000 [1:10:01<4:36:47,  3.45s/it]
Skipping the first batches:  20%|█▉        | 1191/6000 [1:10:04<4:31:29,  3.39s/it]
Skipping the first batches:  20%|█▉        | 1192/6000 [1:10:07<4:26:55,  3.33s/it]
Skipping the first batches:  20%|█▉        | 1193/6000 [1:10:10<4:32:16,  3.40s/it]
Skipping the first batches:  20%|█▉        | 1194/6000 [1:10:14<4:30:36,  3.38s/it]
Skipping the first batches:  20%|█▉        | 1195/6000 [1:10:17<4:26:54,  3.33s/it]
Skipping the first batches:  20%|█▉        | 1196/6000 [1:10:20<4:27:03,  3.34s/it]
Skipping the first batches:  20%|█▉        | 1197/6000 [1:10:24<4:38:42,  3.48s/it]
Skipping the first batches:  20%|█▉        | 1198/6000 [1:10:28<4:40:50,  3.51s/it]
Skipping the first batches:  20%|█▉        | 1199/6000 [1:10:31<4:32:30,  3.41s/it]
Skipping the first batches:  20%|██        | 1200/6000 [1:10:35<4:37:51,  3.47s/it]
Skipping the first batches:  20%|██        | 1201/6000 [1:10:38<4:32:59,  3.41s/it]
Skipping the first batches:  20%|██        | 1202/6000 [1:10:42<4:42:18,  3.53s/it]
Skipping the first batches:  20%|██        | 1203/6000 [1:10:45<4:42:17,  3.53s/it]
Skipping the first batches:  20%|██        | 1204/6000 [1:10:49<4:41:31,  3.52s/it]
Skipping the first batches:  20%|██        | 1205/6000 [1:10:52<4:38:54,  3.49s/it]
Skipping the first batches:  20%|██        | 1206/6000 [1:10:55<4:35:36,  3.45s/it]
Skipping the first batches:  20%|██        | 1207/6000 [1:10:59<4:37:32,  3.47s/it]
Skipping the first batches:  20%|██        | 1208/6000 [1:11:03<4:38:31,  3.49s/it]
Skipping the first batches:  20%|██        | 1209/6000 [1:11:06<4:31:56,  3.41s/it]
Skipping the first batches:  20%|██        | 1210/6000 [1:11:09<4:34:37,  3.44s/it]
Skipping the first batches:  20%|██        | 1211/6000 [1:11:13<4:38:51,  3.49s/it]
Skipping the first batches:  20%|██        | 1212/6000 [1:11:16<4:39:36,  3.50s/it]
Skipping the first batches:  20%|██        | 1213/6000 [1:11:19<4:29:07,  3.37s/it]
Skipping the first batches:  20%|██        | 1214/6000 [1:11:23<4:26:32,  3.34s/it]
Skipping the first batches:  20%|██        | 1215/6000 [1:11:27<4:39:41,  3.51s/it]
Skipping the first batches:  20%|██        | 1216/6000 [1:11:30<4:39:47,  3.51s/it]
Skipping the first batches:  20%|██        | 1217/6000 [1:11:34<4:39:11,  3.50s/it]
Skipping the first batches:  20%|██        | 1218/6000 [1:11:37<4:47:13,  3.60s/it]
Skipping the first batches:  20%|██        | 1219/6000 [1:11:41<4:45:07,  3.58s/it]
Skipping the first batches:  20%|██        | 1220/6000 [1:11:44<4:36:06,  3.47s/it]
Skipping the first batches:  20%|██        | 1221/6000 [1:11:48<4:37:05,  3.48s/it]
Skipping the first batches:  20%|██        | 1222/6000 [1:11:51<4:29:29,  3.38s/it]
Skipping the first batches:  20%|██        | 1223/6000 [1:11:54<4:30:00,  3.39s/it]
Skipping the first batches:  20%|██        | 1224/6000 [1:11:58<4:37:11,  3.48s/it]
Skipping the first batches:  20%|██        | 1225/6000 [1:12:01<4:36:58,  3.48s/it]
Skipping the first batches:  20%|██        | 1226/6000 [1:12:05<4:33:36,  3.44s/it]
Skipping the first batches:  20%|██        | 1227/6000 [1:12:08<4:35:17,  3.46s/it]
Skipping the first batches:  20%|██        | 1228/6000 [1:12:12<4:33:08,  3.43s/it]
Skipping the first batches:  20%|██        | 1229/6000 [1:12:15<4:32:51,  3.43s/it]
Skipping the first batches:  20%|██        | 1230/6000 [1:12:18<4:27:03,  3.36s/it]
Skipping the first batches:  21%|██        | 1231/6000 [1:12:21<4:23:27,  3.31s/it]
Skipping the first batches:  21%|██        | 1232/6000 [1:12:25<4:24:05,  3.32s/it]
Skipping the first batches:  21%|██        | 1233/6000 [1:12:28<4:30:21,  3.40s/it]
Skipping the first batches:  21%|██        | 1234/6000 [1:12:33<4:52:08,  3.68s/it]
Skipping the first batches:  21%|██        | 1235/6000 [1:12:36<4:37:48,  3.50s/it]
Skipping the first batches:  21%|██        | 1236/6000 [1:12:40<4:42:56,  3.56s/it]
Skipping the first batches:  21%|██        | 1237/6000 [1:12:43<4:36:04,  3.48s/it]
Skipping the first batches:  21%|██        | 1238/6000 [1:12:46<4:33:14,  3.44s/it]
Skipping the first batches:  21%|██        | 1239/6000 [1:12:50<4:32:08,  3.43s/it]
Skipping the first batches:  21%|██        | 1240/6000 [1:12:53<4:24:44,  3.34s/it]
Skipping the first batches:  21%|██        | 1241/6000 [1:12:56<4:24:22,  3.33s/it]
Skipping the first batches:  21%|██        | 1242/6000 [1:13:00<4:45:36,  3.60s/it]
Skipping the first batches:  21%|██        | 1243/6000 [1:13:07<5:49:01,  4.40s/it]
Skipping the first batches:  21%|██        | 1244/6000 [1:13:10<5:21:26,  4.06s/it]
Skipping the first batches:  21%|██        | 1245/6000 [1:13:14<5:15:27,  3.98s/it]
Skipping the first batches:  21%|██        | 1246/6000 [1:13:17<5:03:11,  3.83s/it]
Skipping the first batches:  21%|██        | 1247/6000 [1:13:20<4:48:26,  3.64s/it]
Skipping the first batches:  21%|██        | 1248/6000 [1:13:24<4:44:13,  3.59s/it]
Skipping the first batches:  21%|██        | 1249/6000 [1:13:27<4:42:20,  3.57s/it]
Skipping the first batches:  21%|██        | 1250/6000 [1:13:31<4:39:50,  3.53s/it]
Skipping the first batches:  21%|██        | 1251/6000 [1:13:34<4:36:59,  3.50s/it]
Skipping the first batches:  21%|██        | 1252/6000 [1:13:38<4:37:35,  3.51s/it]
Skipping the first batches:  21%|██        | 1253/6000 [1:13:41<4:26:53,  3.37s/it]
Skipping the first batches:  21%|██        | 1254/6000 [1:13:45<4:37:38,  3.51s/it]
Skipping the first batches:  21%|██        | 1255/6000 [1:13:48<4:30:53,  3.43s/it]
Skipping the first batches:  21%|██        | 1256/6000 [1:13:51<4:26:07,  3.37s/it]
Skipping the first batches:  21%|██        | 1257/6000 [1:13:54<4:26:03,  3.37s/it]
Skipping the first batches:  21%|██        | 1258/6000 [1:13:58<4:21:39,  3.31s/it]
Skipping the first batches:  21%|██        | 1259/6000 [1:14:01<4:15:28,  3.23s/it]
Skipping the first batches:  21%|██        | 1260/6000 [1:14:04<4:29:59,  3.42s/it]
Skipping the first batches:  21%|██        | 1261/6000 [1:14:08<4:25:14,  3.36s/it]
Skipping the first batches:  21%|██        | 1262/6000 [1:14:11<4:28:50,  3.40s/it]
Skipping the first batches:  21%|██        | 1263/6000 [1:14:15<4:33:36,  3.47s/it]
Skipping the first batches:  21%|██        | 1264/6000 [1:14:18<4:35:35,  3.49s/it]
Skipping the first batches:  21%|██        | 1265/6000 [1:14:22<4:31:51,  3.44s/it]
Skipping the first batches:  21%|██        | 1266/6000 [1:14:25<4:27:01,  3.38s/it]
Skipping the first batches:  21%|██        | 1267/6000 [1:14:28<4:22:37,  3.33s/it]
Skipping the first batches:  21%|██        | 1268/6000 [1:14:32<4:26:57,  3.39s/it]
Skipping the first batches:  21%|██        | 1269/6000 [1:14:35<4:24:02,  3.35s/it]
Skipping the first batches:  21%|██        | 1270/6000 [1:14:38<4:27:56,  3.40s/it]
Skipping the first batches:  21%|██        | 1271/6000 [1:14:42<4:28:12,  3.40s/it]
Skipping the first batches:  21%|██        | 1272/6000 [1:14:46<4:57:01,  3.77s/it]
Skipping the first batches:  21%|██        | 1273/6000 [1:14:50<4:59:58,  3.81s/it]
Skipping the first batches:  21%|██        | 1274/6000 [1:14:54<5:07:05,  3.90s/it]
Skipping the first batches:  21%|██▏       | 1275/6000 [1:14:58<5:06:29,  3.89s/it]
Skipping the first batches:  21%|██▏       | 1276/6000 [1:15:03<5:18:52,  4.05s/it]
Skipping the first batches:  21%|██▏       | 1277/6000 [1:15:07<5:21:09,  4.08s/it]
Skipping the first batches:  21%|██▏       | 1278/6000 [1:15:11<5:25:00,  4.13s/it]
Skipping the first batches:  21%|██▏       | 1279/6000 [1:15:14<5:05:19,  3.88s/it]
Skipping the first batches:  21%|██▏       | 1280/6000 [1:15:18<4:46:19,  3.64s/it]
Skipping the first batches:  21%|██▏       | 1281/6000 [1:15:21<4:43:31,  3.60s/it]
Skipping the first batches:  21%|██▏       | 1282/6000 [1:15:24<4:33:48,  3.48s/it]
Skipping the first batches:  21%|██▏       | 1283/6000 [1:15:28<4:34:44,  3.49s/it]
Skipping the first batches:  21%|██▏       | 1284/6000 [1:15:31<4:24:02,  3.36s/it]
Skipping the first batches:  21%|██▏       | 1285/6000 [1:15:36<5:04:34,  3.88s/it]
Skipping the first batches:  21%|██▏       | 1286/6000 [1:15:41<5:42:47,  4.36s/it]
Skipping the first batches:  21%|██▏       | 1287/6000 [1:15:46<5:43:51,  4.38s/it]
Skipping the first batches:  21%|██▏       | 1288/6000 [1:15:49<5:28:01,  4.18s/it]
Skipping the first batches:  21%|██▏       | 1289/6000 [1:15:53<5:19:38,  4.07s/it]
Skipping the first batches:  22%|██▏       | 1290/6000 [1:15:56<4:57:09,  3.79s/it]
Skipping the first batches:  22%|██▏       | 1291/6000 [1:16:00<4:45:54,  3.64s/it]
Skipping the first batches:  22%|██▏       | 1292/6000 [1:16:03<4:43:10,  3.61s/it]
Skipping the first batches:  22%|██▏       | 1293/6000 [1:16:07<4:41:06,  3.58s/it]
Skipping the first batches:  22%|██▏       | 1294/6000 [1:16:11<4:55:21,  3.77s/it]
Skipping the first batches:  22%|██▏       | 1295/6000 [1:16:15<5:04:50,  3.89s/it]
Skipping the first batches:  22%|██▏       | 1296/6000 [1:16:19<5:01:56,  3.85s/it]
Skipping the first batches:  22%|██▏       | 1297/6000 [1:16:22<4:43:49,  3.62s/it]
Skipping the first batches:  22%|██▏       | 1298/6000 [1:16:25<4:31:42,  3.47s/it]
Skipping the first batches:  22%|██▏       | 1299/6000 [1:16:30<5:02:27,  3.86s/it]
Skipping the first batches:  22%|██▏       | 1300/6000 [1:16:34<5:14:56,  4.02s/it]
Skipping the first batches:  22%|██▏       | 1301/6000 [1:16:38<5:08:55,  3.94s/it]
Skipping the first batches:  22%|██▏       | 1302/6000 [1:16:42<5:12:40,  3.99s/it]
Skipping the first batches:  22%|██▏       | 1303/6000 [1:16:47<5:31:23,  4.23s/it]
Skipping the first batches:  22%|██▏       | 1304/6000 [1:16:52<5:42:19,  4.37s/it]
Skipping the first batches:  22%|██▏       | 1305/6000 [1:16:56<5:50:53,  4.48s/it]
Skipping the first batches:  22%|██▏       | 1306/6000 [1:17:00<5:20:06,  4.09s/it]
Skipping the first batches:  22%|██▏       | 1307/6000 [1:17:03<5:08:35,  3.95s/it]
Skipping the first batches:  22%|██▏       | 1308/6000 [1:17:07<4:54:17,  3.76s/it]
Skipping the first batches:  22%|██▏       | 1309/6000 [1:17:10<4:40:09,  3.58s/it]
Skipping the first batches:  22%|██▏       | 1310/6000 [1:17:13<4:36:51,  3.54s/it]
Skipping the first batches:  22%|██▏       | 1311/6000 [1:17:16<4:31:30,  3.47s/it]
Skipping the first batches:  22%|██▏       | 1312/6000 [1:17:20<4:27:59,  3.43s/it]
Skipping the first batches:  22%|██▏       | 1313/6000 [1:17:23<4:26:32,  3.41s/it]
Skipping the first batches:  22%|██▏       | 1314/6000 [1:17:27<4:39:29,  3.58s/it]
Skipping the first batches:  22%|██▏       | 1315/6000 [1:17:31<4:37:25,  3.55s/it]
Skipping the first batches:  22%|██▏       | 1316/6000 [1:17:34<4:26:14,  3.41s/it]
Skipping the first batches:  22%|██▏       | 1317/6000 [1:17:37<4:23:02,  3.37s/it]
Skipping the first batches:  22%|██▏       | 1318/6000 [1:17:41<4:48:27,  3.70s/it]
Skipping the first batches:  22%|██▏       | 1319/6000 [1:17:45<4:34:43,  3.52s/it]
Skipping the first batches:  22%|██▏       | 1320/6000 [1:17:48<4:29:20,  3.45s/it]
Skipping the first batches:  22%|██▏       | 1321/6000 [1:17:51<4:30:03,  3.46s/it]
Skipping the first batches:  22%|██▏       | 1322/6000 [1:17:55<4:27:00,  3.42s/it]
Skipping the first batches:  22%|██▏       | 1323/6000 [1:17:58<4:24:37,  3.39s/it]
Skipping the first batches:  22%|██▏       | 1324/6000 [1:18:02<4:30:16,  3.47s/it]
Skipping the first batches:  22%|██▏       | 1325/6000 [1:18:05<4:20:58,  3.35s/it]
Skipping the first batches:  22%|██▏       | 1326/6000 [1:18:08<4:18:02,  3.31s/it]
Skipping the first batches:  22%|██▏       | 1327/6000 [1:18:12<4:27:10,  3.43s/it]
Skipping the first batches:  22%|██▏       | 1328/6000 [1:18:15<4:22:12,  3.37s/it]
Skipping the first batches:  22%|██▏       | 1329/6000 [1:18:18<4:22:07,  3.37s/it]
Skipping the first batches:  22%|██▏       | 1330/6000 [1:18:22<4:28:58,  3.46s/it]
Skipping the first batches:  22%|██▏       | 1331/6000 [1:18:25<4:27:04,  3.43s/it]
Skipping the first batches:  22%|██▏       | 1332/6000 [1:18:29<4:26:05,  3.42s/it]
Skipping the first batches:  22%|██▏       | 1333/6000 [1:18:32<4:22:51,  3.38s/it]
Skipping the first batches:  22%|██▏       | 1334/6000 [1:18:36<4:36:40,  3.56s/it]
Skipping the first batches:  22%|██▏       | 1335/6000 [1:18:40<4:50:12,  3.73s/it]
Skipping the first batches:  22%|██▏       | 1336/6000 [1:18:43<4:37:27,  3.57s/it]
Skipping the first batches:  22%|██▏       | 1337/6000 [1:18:47<4:32:24,  3.51s/it]
Skipping the first batches:  22%|██▏       | 1338/6000 [1:18:50<4:33:14,  3.52s/it]
Skipping the first batches:  22%|██▏       | 1339/6000 [1:18:53<4:23:12,  3.39s/it]
Skipping the first batches:  22%|██▏       | 1340/6000 [1:18:58<4:50:30,  3.74s/it]
Skipping the first batches:  22%|██▏       | 1341/6000 [1:19:02<4:55:37,  3.81s/it]
Skipping the first batches:  22%|██▏       | 1342/6000 [1:19:06<4:57:52,  3.84s/it]
Skipping the first batches:  22%|██▏       | 1343/6000 [1:19:09<4:44:05,  3.66s/it]
Skipping the first batches:  22%|██▏       | 1344/6000 [1:19:14<5:10:23,  4.00s/it]
Skipping the first batches:  22%|██▏       | 1345/6000 [1:19:17<4:56:43,  3.82s/it]
Skipping the first batches:  22%|██▏       | 1346/6000 [1:19:20<4:44:43,  3.67s/it]
Skipping the first batches:  22%|██▏       | 1347/6000 [1:19:24<4:35:11,  3.55s/it]
Skipping the first batches:  22%|██▏       | 1348/6000 [1:19:27<4:34:47,  3.54s/it]
Skipping the first batches:  22%|██▏       | 1349/6000 [1:19:31<4:33:51,  3.53s/it]
Skipping the first batches:  22%|██▎       | 1350/6000 [1:19:34<4:35:09,  3.55s/it]
Skipping the first batches:  23%|██▎       | 1351/6000 [1:19:38<4:33:04,  3.52s/it]
Skipping the first batches:  23%|██▎       | 1352/6000 [1:19:41<4:30:53,  3.50s/it]
Skipping the first batches:  23%|██▎       | 1353/6000 [1:19:45<4:32:32,  3.52s/it]
Skipping the first batches:  23%|██▎       | 1354/6000 [1:19:48<4:33:28,  3.53s/it]
Skipping the first batches:  23%|██▎       | 1355/6000 [1:19:52<4:32:46,  3.52s/it]
Skipping the first batches:  23%|██▎       | 1356/6000 [1:19:55<4:26:06,  3.44s/it]
Skipping the first batches:  23%|██▎       | 1357/6000 [1:19:59<4:29:45,  3.49s/it]
Skipping the first batches:  23%|██▎       | 1358/6000 [1:20:02<4:23:39,  3.41s/it]
Skipping the first batches:  23%|██▎       | 1359/6000 [1:20:06<4:51:00,  3.76s/it]
Skipping the first batches:  23%|██▎       | 1360/6000 [1:20:10<4:37:33,  3.59s/it]
Skipping the first batches:  23%|██▎       | 1361/6000 [1:20:13<4:39:06,  3.61s/it]
Skipping the first batches:  23%|██▎       | 1362/6000 [1:20:17<4:37:04,  3.58s/it]
Skipping the first batches:  23%|██▎       | 1363/6000 [1:20:20<4:26:31,  3.45s/it]
Skipping the first batches:  23%|██▎       | 1364/6000 [1:20:24<4:29:47,  3.49s/it]
Skipping the first batches:  23%|██▎       | 1365/6000 [1:20:27<4:30:01,  3.50s/it]
Skipping the first batches:  23%|██▎       | 1366/6000 [1:20:30<4:26:23,  3.45s/it]
Skipping the first batches:  23%|██▎       | 1367/6000 [1:20:34<4:26:02,  3.45s/it]
Skipping the first batches:  23%|██▎       | 1368/6000 [1:20:37<4:24:43,  3.43s/it]
Skipping the first batches:  23%|██▎       | 1369/6000 [1:20:41<4:27:44,  3.47s/it]
Skipping the first batches:  23%|██▎       | 1370/6000 [1:20:44<4:23:08,  3.41s/it]
Skipping the first batches:  23%|██▎       | 1371/6000 [1:20:48<4:25:43,  3.44s/it]
Skipping the first batches:  23%|██▎       | 1372/6000 [1:20:51<4:21:19,  3.39s/it]
Skipping the first batches:  23%|██▎       | 1373/6000 [1:20:54<4:17:27,  3.34s/it]
Skipping the first batches:  23%|██▎       | 1374/6000 [1:20:57<4:13:46,  3.29s/it]
Skipping the first batches:  23%|██▎       | 1375/6000 [1:21:01<4:14:54,  3.31s/it]
Skipping the first batches:  23%|██▎       | 1376/6000 [1:21:04<4:19:37,  3.37s/it]
Skipping the first batches:  23%|██▎       | 1377/6000 [1:21:07<4:14:31,  3.30s/it]
Skipping the first batches:  23%|██▎       | 1378/6000 [1:21:11<4:16:01,  3.32s/it]
Skipping the first batches:  23%|██▎       | 1379/6000 [1:21:14<4:13:12,  3.29s/it]
Skipping the first batches:  23%|██▎       | 1380/6000 [1:21:17<4:12:26,  3.28s/it]
Skipping the first batches:  23%|██▎       | 1381/6000 [1:21:20<4:12:16,  3.28s/it]
Skipping the first batches:  23%|██▎       | 1382/6000 [1:21:24<4:18:28,  3.36s/it]
Skipping the first batches:  23%|██▎       | 1383/6000 [1:21:27<4:18:21,  3.36s/it]
Skipping the first batches:  23%|██▎       | 1384/6000 [1:21:31<4:21:31,  3.40s/it]
Skipping the first batches:  23%|██▎       | 1385/6000 [1:21:34<4:22:17,  3.41s/it]
Skipping the first batches:  23%|██▎       | 1386/6000 [1:21:38<4:21:48,  3.40s/it]
Skipping the first batches:  23%|██▎       | 1387/6000 [1:21:41<4:21:32,  3.40s/it]
Skipping the first batches:  23%|██▎       | 1388/6000 [1:21:44<4:18:24,  3.36s/it]
Skipping the first batches:  23%|██▎       | 1389/6000 [1:21:48<4:15:58,  3.33s/it]
Skipping the first batches:  23%|██▎       | 1390/6000 [1:21:51<4:19:50,  3.38s/it]
Skipping the first batches:  23%|██▎       | 1391/6000 [1:21:54<4:17:36,  3.35s/it]
Skipping the first batches:  23%|██▎       | 1392/6000 [1:21:58<4:15:19,  3.32s/it]
Skipping the first batches:  23%|██▎       | 1393/6000 [1:22:01<4:18:18,  3.36s/it]
Skipping the first batches:  23%|██▎       | 1394/6000 [1:22:04<4:20:00,  3.39s/it]
Skipping the first batches:  23%|██▎       | 1395/6000 [1:22:08<4:27:03,  3.48s/it]
Skipping the first batches:  23%|██▎       | 1396/6000 [1:22:12<4:32:43,  3.55s/it]
Skipping the first batches:  23%|██▎       | 1397/6000 [1:22:16<4:34:50,  3.58s/it]
Skipping the first batches:  23%|██▎       | 1398/6000 [1:22:19<4:24:12,  3.44s/it]
Skipping the first batches:  23%|██▎       | 1399/6000 [1:22:22<4:20:25,  3.40s/it]
Skipping the first batches:  23%|██▎       | 1400/6000 [1:22:26<4:30:30,  3.53s/it]
Skipping the first batches:  23%|██▎       | 1401/6000 [1:22:29<4:24:06,  3.45s/it]
Skipping the first batches:  23%|██▎       | 1402/6000 [1:22:33<4:25:15,  3.46s/it]
Skipping the first batches:  23%|██▎       | 1403/6000 [1:22:36<4:30:29,  3.53s/it]
Skipping the first batches:  23%|██▎       | 1404/6000 [1:22:40<4:45:19,  3.72s/it]
Skipping the first batches:  23%|██▎       | 1405/6000 [1:22:44<4:32:27,  3.56s/it]
Skipping the first batches:  23%|██▎       | 1406/6000 [1:22:48<4:43:53,  3.71s/it]
Skipping the first batches:  23%|██▎       | 1407/6000 [1:22:51<4:36:58,  3.62s/it]
Skipping the first batches:  23%|██▎       | 1408/6000 [1:22:54<4:30:42,  3.54s/it]
Skipping the first batches:  23%|██▎       | 1409/6000 [1:22:58<4:24:17,  3.45s/it]
Skipping the first batches:  24%|██▎       | 1410/6000 [1:23:01<4:18:29,  3.38s/it]
Skipping the first batches:  24%|██▎       | 1411/6000 [1:23:05<4:24:40,  3.46s/it]
Skipping the first batches:  24%|██▎       | 1412/6000 [1:23:08<4:20:33,  3.41s/it]
Skipping the first batches:  24%|██▎       | 1413/6000 [1:23:11<4:20:11,  3.40s/it]
Skipping the first batches:  24%|██▎       | 1414/6000 [1:23:15<4:23:59,  3.45s/it]
Skipping the first batches:  24%|██▎       | 1415/6000 [1:23:18<4:17:27,  3.37s/it]
Skipping the first batches:  24%|██▎       | 1416/6000 [1:23:21<4:19:33,  3.40s/it]
Skipping the first batches:  24%|██▎       | 1417/6000 [1:23:25<4:16:27,  3.36s/it]
Skipping the first batches:  24%|██▎       | 1418/6000 [1:23:28<4:12:53,  3.31s/it]
Skipping the first batches:  24%|██▎       | 1419/6000 [1:23:31<4:20:21,  3.41s/it]
Skipping the first batches:  24%|██▎       | 1420/6000 [1:23:35<4:20:59,  3.42s/it]
Skipping the first batches:  24%|██▎       | 1421/6000 [1:23:38<4:19:23,  3.40s/it]
Skipping the first batches:  24%|██▎       | 1422/6000 [1:23:42<4:18:11,  3.38s/it]
Skipping the first batches:  24%|██▎       | 1423/6000 [1:23:45<4:14:30,  3.34s/it]
Skipping the first batches:  24%|██▎       | 1424/6000 [1:23:48<4:19:59,  3.41s/it]
Skipping the first batches:  24%|██▍       | 1425/6000 [1:23:52<4:16:46,  3.37s/it]
Skipping the first batches:  24%|██▍       | 1426/6000 [1:23:55<4:15:09,  3.35s/it]
Skipping the first batches:  24%|██▍       | 1427/6000 [1:23:59<4:21:22,  3.43s/it]
Skipping the first batches:  24%|██▍       | 1428/6000 [1:24:02<4:22:32,  3.45s/it]
Skipping the first batches:  24%|██▍       | 1429/6000 [1:24:06<4:27:16,  3.51s/it]
Skipping the first batches:  24%|██▍       | 1430/6000 [1:24:09<4:21:04,  3.43s/it]
Skipping the first batches:  24%|██▍       | 1431/6000 [1:24:12<4:13:07,  3.32s/it]
Skipping the first batches:  24%|██▍       | 1432/6000 [1:24:16<4:15:29,  3.36s/it]
Skipping the first batches:  24%|██▍       | 1433/6000 [1:24:19<4:10:38,  3.29s/it]
Skipping the first batches:  24%|██▍       | 1434/6000 [1:24:22<4:11:12,  3.30s/it]
Skipping the first batches:  24%|██▍       | 1435/6000 [1:24:25<4:07:16,  3.25s/it]
Skipping the first batches:  24%|██▍       | 1436/6000 [1:24:29<4:12:27,  3.32s/it]
Skipping the first batches:  24%|██▍       | 1437/6000 [1:24:32<4:16:18,  3.37s/it]
Skipping the first batches:  24%|██▍       | 1438/6000 [1:24:36<4:24:02,  3.47s/it]
Skipping the first batches:  24%|██▍       | 1439/6000 [1:24:39<4:16:40,  3.38s/it]
Skipping the first batches:  24%|██▍       | 1440/6000 [1:24:43<4:30:44,  3.56s/it]
Skipping the first batches:  24%|██▍       | 1441/6000 [1:24:46<4:27:55,  3.53s/it]
Skipping the first batches:  24%|██▍       | 1442/6000 [1:24:50<4:25:44,  3.50s/it]
Skipping the first batches:  24%|██▍       | 1443/6000 [1:24:53<4:20:11,  3.43s/it]
Skipping the first batches:  24%|██▍       | 1444/6000 [1:24:56<4:13:59,  3.34s/it]
Skipping the first batches:  24%|██▍       | 1445/6000 [1:25:00<4:16:16,  3.38s/it]
Skipping the first batches:  24%|██▍       | 1446/6000 [1:25:03<4:14:17,  3.35s/it]
Skipping the first batches:  24%|██▍       | 1447/6000 [1:25:07<4:20:04,  3.43s/it]
Skipping the first batches:  24%|██▍       | 1448/6000 [1:25:10<4:14:43,  3.36s/it]
Skipping the first batches:  24%|██▍       | 1449/6000 [1:25:13<4:17:30,  3.39s/it]
Skipping the first batches:  24%|██▍       | 1450/6000 [1:25:17<4:18:38,  3.41s/it]
Skipping the first batches:  24%|██▍       | 1451/6000 [1:25:20<4:11:12,  3.31s/it]
Skipping the first batches:  24%|██▍       | 1452/6000 [1:25:23<4:07:48,  3.27s/it]
Skipping the first batches:  24%|██▍       | 1453/6000 [1:25:27<4:15:38,  3.37s/it]
Skipping the first batches:  24%|██▍       | 1454/6000 [1:25:30<4:10:51,  3.31s/it]
Skipping the first batches:  24%|██▍       | 1455/6000 [1:25:33<4:04:06,  3.22s/it]
Skipping the first batches:  24%|██▍       | 1456/6000 [1:25:36<4:12:51,  3.34s/it]
Skipping the first batches:  24%|██▍       | 1457/6000 [1:25:40<4:20:23,  3.44s/it]
Skipping the first batches:  24%|██▍       | 1458/6000 [1:25:43<4:10:44,  3.31s/it]
Skipping the first batches:  24%|██▍       | 1459/6000 [1:25:46<4:11:18,  3.32s/it]
Skipping the first batches:  24%|██▍       | 1460/6000 [1:25:50<4:25:12,  3.51s/it]
Skipping the first batches:  24%|██▍       | 1461/6000 [1:25:53<4:14:52,  3.37s/it]
Skipping the first batches:  24%|██▍       | 1462/6000 [1:25:57<4:12:53,  3.34s/it]
Skipping the first batches:  24%|██▍       | 1463/6000 [1:26:00<4:14:44,  3.37s/it]
Skipping the first batches:  24%|██▍       | 1464/6000 [1:26:04<4:34:19,  3.63s/it]
Skipping the first batches:  24%|██▍       | 1465/6000 [1:26:08<4:27:44,  3.54s/it]
Skipping the first batches:  24%|██▍       | 1466/6000 [1:26:11<4:16:20,  3.39s/it]
Skipping the first batches:  24%|██▍       | 1467/6000 [1:26:14<4:22:02,  3.47s/it]
Skipping the first batches:  24%|██▍       | 1468/6000 [1:26:18<4:26:17,  3.53s/it]
Skipping the first batches:  24%|██▍       | 1469/6000 [1:26:21<4:20:29,  3.45s/it]
Skipping the first batches:  24%|██▍       | 1470/6000 [1:26:25<4:24:04,  3.50s/it]
Skipping the first batches:  25%|██▍       | 1471/6000 [1:26:30<4:51:29,  3.86s/it]
Skipping the first batches:  25%|██▍       | 1472/6000 [1:26:33<4:43:14,  3.75s/it]
Skipping the first batches:  25%|██▍       | 1473/6000 [1:26:37<4:38:36,  3.69s/it]
Skipping the first batches:  25%|██▍       | 1474/6000 [1:26:40<4:29:40,  3.57s/it]
Skipping the first batches:  25%|██▍       | 1475/6000 [1:26:44<4:28:56,  3.57s/it]
Skipping the first batches:  25%|██▍       | 1476/6000 [1:26:47<4:20:34,  3.46s/it]
Skipping the first batches:  25%|██▍       | 1477/6000 [1:26:50<4:17:37,  3.42s/it]
Skipping the first batches:  25%|██▍       | 1478/6000 [1:26:54<4:20:15,  3.45s/it]
Skipping the first batches:  25%|██▍       | 1479/6000 [1:26:57<4:26:38,  3.54s/it]
Skipping the first batches:  25%|██▍       | 1480/6000 [1:27:01<4:20:53,  3.46s/it]
Skipping the first batches:  25%|██▍       | 1481/6000 [1:27:04<4:19:12,  3.44s/it]
Skipping the first batches:  25%|██▍       | 1482/6000 [1:27:08<4:21:02,  3.47s/it]
Skipping the first batches:  25%|██▍       | 1483/6000 [1:27:11<4:23:28,  3.50s/it]
Skipping the first batches:  25%|██▍       | 1484/6000 [1:27:15<4:22:44,  3.49s/it]
Skipping the first batches:  25%|██▍       | 1485/6000 [1:27:18<4:19:20,  3.45s/it]
Skipping the first batches:  25%|██▍       | 1486/6000 [1:27:21<4:16:18,  3.41s/it]
Skipping the first batches:  25%|██▍       | 1487/6000 [1:27:25<4:14:18,  3.38s/it]
Skipping the first batches:  25%|██▍       | 1488/6000 [1:27:28<4:14:58,  3.39s/it]
Skipping the first batches:  25%|██▍       | 1489/6000 [1:27:31<4:15:34,  3.40s/it]
Skipping the first batches:  25%|██▍       | 1490/6000 [1:27:35<4:18:46,  3.44s/it]
Skipping the first batches:  25%|██▍       | 1491/6000 [1:27:38<4:18:02,  3.43s/it]
Skipping the first batches:  25%|██▍       | 1492/6000 [1:27:42<4:14:17,  3.38s/it]
Skipping the first batches:  25%|██▍       | 1493/6000 [1:27:45<4:18:52,  3.45s/it]
Skipping the first batches:  25%|██▍       | 1494/6000 [1:27:48<4:10:33,  3.34s/it]
Skipping the first batches:  25%|██▍       | 1495/6000 [1:27:51<4:07:30,  3.30s/it]
Skipping the first batches:  25%|██▍       | 1496/6000 [1:27:55<4:05:22,  3.27s/it]
Skipping the first batches:  25%|██▍       | 1497/6000 [1:27:58<4:08:15,  3.31s/it]
Skipping the first batches:  25%|██▍       | 1498/6000 [1:28:01<4:04:48,  3.26s/it]
Skipping the first batches:  25%|██▍       | 1499/6000 [1:28:05<4:16:56,  3.43s/it]
Skipping the first batches:  25%|██▌       | 1500/6000 [1:28:09<4:20:16,  3.47s/it]
Skipping the first batches:  25%|██▌       | 1501/6000 [1:28:12<4:26:16,  3.55s/it]
Skipping the first batches:  25%|██▌       | 1502/6000 [1:28:16<4:30:24,  3.61s/it]
Skipping the first batches:  25%|██▌       | 1503/6000 [1:28:20<4:44:24,  3.79s/it]
Skipping the first batches:  25%|██▌       | 1504/6000 [1:28:24<4:31:49,  3.63s/it]
Skipping the first batches:  25%|██▌       | 1505/6000 [1:28:27<4:27:33,  3.57s/it]
Skipping the first batches:  25%|██▌       | 1506/6000 [1:28:30<4:19:52,  3.47s/it]
Skipping the first batches:  25%|██▌       | 1507/6000 [1:28:33<4:13:07,  3.38s/it]
Skipping the first batches:  25%|██▌       | 1508/6000 [1:28:37<4:16:59,  3.43s/it]
Skipping the first batches:  25%|██▌       | 1509/6000 [1:28:41<4:22:44,  3.51s/it]
Skipping the first batches:  25%|██▌       | 1510/6000 [1:28:44<4:17:29,  3.44s/it]
Skipping the first batches:  25%|██▌       | 1511/6000 [1:28:48<4:20:33,  3.48s/it]
Skipping the first batches:  25%|██▌       | 1512/6000 [1:28:51<4:15:43,  3.42s/it]
Skipping the first batches:  25%|██▌       | 1513/6000 [1:28:55<4:35:36,  3.69s/it]
Skipping the first batches:  25%|██▌       | 1514/6000 [1:28:59<4:31:30,  3.63s/it]
Skipping the first batches:  25%|██▌       | 1515/6000 [1:29:02<4:25:11,  3.55s/it]
Skipping the first batches:  25%|██▌       | 1516/6000 [1:29:05<4:19:02,  3.47s/it]
Skipping the first batches:  25%|██▌       | 1517/6000 [1:29:09<4:30:07,  3.62s/it]
Skipping the first batches:  25%|██▌       | 1518/6000 [1:29:13<4:25:39,  3.56s/it]
Skipping the first batches:  25%|██▌       | 1519/6000 [1:29:16<4:13:52,  3.40s/it]
Skipping the first batches:  25%|██▌       | 1520/6000 [1:29:19<4:08:43,  3.33s/it]
Skipping the first batches:  25%|██▌       | 1521/6000 [1:29:22<4:05:21,  3.29s/it]
Skipping the first batches:  25%|██▌       | 1522/6000 [1:29:26<4:13:07,  3.39s/it]
Skipping the first batches:  25%|██▌       | 1523/6000 [1:29:29<4:14:12,  3.41s/it]
Skipping the first batches:  25%|██▌       | 1524/6000 [1:29:32<4:12:17,  3.38s/it]
Skipping the first batches:  25%|██▌       | 1525/6000 [1:29:36<4:07:55,  3.32s/it]
Skipping the first batches:  25%|██▌       | 1526/6000 [1:29:39<4:12:27,  3.39s/it]
Skipping the first batches:  25%|██▌       | 1527/6000 [1:29:42<4:12:00,  3.38s/it]
Skipping the first batches:  25%|██▌       | 1528/6000 [1:29:46<4:11:24,  3.37s/it]
Skipping the first batches:  25%|██▌       | 1529/6000 [1:29:49<4:06:18,  3.31s/it]
Skipping the first batches:  26%|██▌       | 1530/6000 [1:29:52<4:05:03,  3.29s/it]
Skipping the first batches:  26%|██▌       | 1531/6000 [1:29:56<4:10:46,  3.37s/it]
Skipping the first batches:  26%|██▌       | 1532/6000 [1:29:59<4:10:34,  3.36s/it]
Skipping the first batches:  26%|██▌       | 1533/6000 [1:30:02<4:08:02,  3.33s/it]
Skipping the first batches:  26%|██▌       | 1534/6000 [1:30:08<4:48:47,  3.88s/it]
Skipping the first batches:  26%|██▌       | 1535/6000 [1:30:11<4:39:23,  3.75s/it]
Skipping the first batches:  26%|██▌       | 1536/6000 [1:30:14<4:22:36,  3.53s/it]
Skipping the first batches:  26%|██▌       | 1537/6000 [1:30:17<4:15:28,  3.43s/it]
Skipping the first batches:  26%|██▌       | 1538/6000 [1:30:21<4:15:00,  3.43s/it]
Skipping the first batches:  26%|██▌       | 1539/6000 [1:30:24<4:14:18,  3.42s/it]
Skipping the first batches:  26%|██▌       | 1540/6000 [1:30:27<4:05:18,  3.30s/it]
Skipping the first batches:  26%|██▌       | 1541/6000 [1:30:30<3:59:22,  3.22s/it]
Skipping the first batches:  26%|██▌       | 1542/6000 [1:30:34<4:06:39,  3.32s/it]
Skipping the first batches:  26%|██▌       | 1543/6000 [1:30:38<4:40:07,  3.77s/it]
Skipping the first batches:  26%|██▌       | 1544/6000 [1:30:42<4:38:50,  3.75s/it]
Skipping the first batches:  26%|██▌       | 1545/6000 [1:30:45<4:24:39,  3.56s/it]
Skipping the first batches:  26%|██▌       | 1546/6000 [1:30:49<4:20:28,  3.51s/it]
Skipping the first batches:  26%|██▌       | 1547/6000 [1:30:52<4:10:37,  3.38s/it]
Skipping the first batches:  26%|██▌       | 1548/6000 [1:30:55<4:08:57,  3.36s/it]
Skipping the first batches:  26%|██▌       | 1549/6000 [1:30:58<4:10:10,  3.37s/it]
Skipping the first batches:  26%|██▌       | 1550/6000 [1:31:02<4:11:20,  3.39s/it]
Skipping the first batches:  26%|██▌       | 1551/6000 [1:31:05<4:11:42,  3.39s/it]
Skipping the first batches:  26%|██▌       | 1552/6000 [1:31:09<4:09:45,  3.37s/it]
Skipping the first batches:  26%|██▌       | 1553/6000 [1:31:12<4:04:53,  3.30s/it]
Skipping the first batches:  26%|██▌       | 1554/6000 [1:31:15<4:08:40,  3.36s/it]
Skipping the first batches:  26%|██▌       | 1555/6000 [1:31:19<4:11:14,  3.39s/it]
Skipping the first batches:  26%|██▌       | 1556/6000 [1:31:22<4:02:40,  3.28s/it]
Skipping the first batches:  26%|██▌       | 1557/6000 [1:31:25<3:55:30,  3.18s/it]
Skipping the first batches:  26%|██▌       | 1558/6000 [1:31:29<4:10:11,  3.38s/it]
Skipping the first batches:  26%|██▌       | 1559/6000 [1:31:32<4:10:56,  3.39s/it]
Skipping the first batches:  26%|██▌       | 1560/6000 [1:31:35<4:11:02,  3.39s/it]
Skipping the first batches:  26%|██▌       | 1561/6000 [1:31:39<4:25:37,  3.59s/it]
Skipping the first batches:  26%|██▌       | 1562/6000 [1:31:43<4:25:38,  3.59s/it]
Skipping the first batches:  26%|██▌       | 1563/6000 [1:31:46<4:17:58,  3.49s/it]
Skipping the first batches:  26%|██▌       | 1564/6000 [1:31:50<4:33:44,  3.70s/it]
Skipping the first batches:  26%|██▌       | 1565/6000 [1:31:54<4:36:24,  3.74s/it]
Skipping the first batches:  26%|██▌       | 1566/6000 [1:31:57<4:23:51,  3.57s/it]
Skipping the first batches:  26%|██▌       | 1567/6000 [1:32:01<4:19:02,  3.51s/it]
Skipping the first batches:  26%|██▌       | 1568/6000 [1:32:04<4:12:22,  3.42s/it]
Skipping the first batches:  26%|██▌       | 1569/6000 [1:32:07<4:07:41,  3.35s/it]
Skipping the first batches:  26%|██▌       | 1570/6000 [1:32:11<4:08:22,  3.36s/it]
Skipping the first batches:  26%|██▌       | 1571/6000 [1:32:14<4:08:34,  3.37s/it]
Skipping the first batches:  26%|██▌       | 1572/6000 [1:32:17<4:08:12,  3.36s/it]
Skipping the first batches:  26%|██▌       | 1573/6000 [1:32:20<4:01:55,  3.28s/it]
Skipping the first batches:  26%|██▌       | 1574/6000 [1:32:24<4:05:46,  3.33s/it]
Skipping the first batches:  26%|██▋       | 1575/6000 [1:32:27<4:06:23,  3.34s/it]
Skipping the first batches:  26%|██▋       | 1576/6000 [1:32:31<4:10:55,  3.40s/it]
Skipping the first batches:  26%|██▋       | 1577/6000 [1:32:34<4:06:44,  3.35s/it]
Skipping the first batches:  26%|██▋       | 1578/6000 [1:32:37<3:59:26,  3.25s/it]
Skipping the first batches:  26%|██▋       | 1579/6000 [1:32:40<4:01:44,  3.28s/it]
Skipping the first batches:  26%|██▋       | 1580/6000 [1:32:44<4:07:24,  3.36s/it]
Skipping the first batches:  26%|██▋       | 1581/6000 [1:32:47<4:02:54,  3.30s/it]
Skipping the first batches:  26%|██▋       | 1582/6000 [1:32:50<4:01:43,  3.28s/it]
Skipping the first batches:  26%|██▋       | 1583/6000 [1:32:54<4:02:54,  3.30s/it]
Skipping the first batches:  26%|██▋       | 1584/6000 [1:32:57<4:00:29,  3.27s/it]
Skipping the first batches:  26%|██▋       | 1585/6000 [1:33:00<3:58:54,  3.25s/it]
Skipping the first batches:  26%|██▋       | 1586/6000 [1:33:04<4:09:12,  3.39s/it]
Skipping the first batches:  26%|██▋       | 1587/6000 [1:33:07<4:04:47,  3.33s/it]
Skipping the first batches:  26%|██▋       | 1588/6000 [1:33:10<4:05:12,  3.33s/it]
Skipping the first batches:  26%|██▋       | 1589/6000 [1:33:14<4:22:11,  3.57s/it]
Skipping the first batches:  26%|██▋       | 1590/6000 [1:33:18<4:12:37,  3.44s/it]
Skipping the first batches:  27%|██▋       | 1591/6000 [1:33:21<4:03:32,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1592/6000 [1:33:24<4:07:16,  3.37s/it]
Skipping the first batches:  27%|██▋       | 1593/6000 [1:33:27<4:02:31,  3.30s/it]
Skipping the first batches:  27%|██▋       | 1594/6000 [1:33:30<3:56:42,  3.22s/it]
Skipping the first batches:  27%|██▋       | 1595/6000 [1:33:34<4:06:00,  3.35s/it]
Skipping the first batches:  27%|██▋       | 1596/6000 [1:33:37<4:06:13,  3.35s/it]
Skipping the first batches:  27%|██▋       | 1597/6000 [1:33:40<4:02:48,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1598/6000 [1:33:44<4:11:23,  3.43s/it]
Skipping the first batches:  27%|██▋       | 1599/6000 [1:33:47<4:02:36,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1600/6000 [1:33:50<4:01:49,  3.30s/it]
Skipping the first batches:  27%|██▋       | 1601/6000 [1:33:54<4:06:53,  3.37s/it]
Skipping the first batches:  27%|██▋       | 1602/6000 [1:33:57<3:59:39,  3.27s/it]
Skipping the first batches:  27%|██▋       | 1603/6000 [1:34:00<3:55:05,  3.21s/it]
Skipping the first batches:  27%|██▋       | 1604/6000 [1:34:04<4:00:44,  3.29s/it]
Skipping the first batches:  27%|██▋       | 1605/6000 [1:34:07<4:02:25,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1606/6000 [1:34:10<4:03:46,  3.33s/it]
Skipping the first batches:  27%|██▋       | 1607/6000 [1:34:13<3:57:43,  3.25s/it]
Skipping the first batches:  27%|██▋       | 1608/6000 [1:34:17<4:02:09,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1609/6000 [1:34:20<4:00:04,  3.28s/it]
Skipping the first batches:  27%|██▋       | 1610/6000 [1:34:25<4:36:36,  3.78s/it]
Skipping the first batches:  27%|██▋       | 1611/6000 [1:34:29<4:34:25,  3.75s/it]
Skipping the first batches:  27%|██▋       | 1612/6000 [1:34:33<4:40:04,  3.83s/it]
Skipping the first batches:  27%|██▋       | 1613/6000 [1:34:36<4:26:43,  3.65s/it]
Skipping the first batches:  27%|██▋       | 1614/6000 [1:34:39<4:18:05,  3.53s/it]
Skipping the first batches:  27%|██▋       | 1615/6000 [1:34:42<4:13:14,  3.47s/it]
Skipping the first batches:  27%|██▋       | 1616/6000 [1:34:46<4:12:37,  3.46s/it]
Skipping the first batches:  27%|██▋       | 1617/6000 [1:34:49<4:03:43,  3.34s/it]
Skipping the first batches:  27%|██▋       | 1618/6000 [1:34:52<4:02:17,  3.32s/it]
Skipping the first batches:  27%|██▋       | 1619/6000 [1:34:56<4:06:48,  3.38s/it]
Skipping the first batches:  27%|██▋       | 1620/6000 [1:34:59<4:01:41,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1621/6000 [1:35:03<4:07:34,  3.39s/it]
Skipping the first batches:  27%|██▋       | 1622/6000 [1:35:06<4:06:38,  3.38s/it]
Skipping the first batches:  27%|██▋       | 1623/6000 [1:35:09<4:02:53,  3.33s/it]
Skipping the first batches:  27%|██▋       | 1624/6000 [1:35:12<4:01:05,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1625/6000 [1:35:16<4:07:02,  3.39s/it]
Skipping the first batches:  27%|██▋       | 1626/6000 [1:35:19<4:00:47,  3.30s/it]
Skipping the first batches:  27%|██▋       | 1627/6000 [1:35:25<4:57:22,  4.08s/it]
Skipping the first batches:  27%|██▋       | 1628/6000 [1:35:29<4:55:08,  4.05s/it]
Skipping the first batches:  27%|██▋       | 1629/6000 [1:35:32<4:34:37,  3.77s/it]
Skipping the first batches:  27%|██▋       | 1630/6000 [1:35:35<4:23:04,  3.61s/it]
Skipping the first batches:  27%|██▋       | 1631/6000 [1:35:39<4:27:20,  3.67s/it]
Skipping the first batches:  27%|██▋       | 1632/6000 [1:35:42<4:19:31,  3.56s/it]
Skipping the first batches:  27%|██▋       | 1633/6000 [1:35:46<4:11:30,  3.46s/it]
Skipping the first batches:  27%|██▋       | 1634/6000 [1:35:49<4:12:35,  3.47s/it]
Skipping the first batches:  27%|██▋       | 1635/6000 [1:35:52<4:06:51,  3.39s/it]
Skipping the first batches:  27%|██▋       | 1636/6000 [1:35:56<4:03:56,  3.35s/it]
Skipping the first batches:  27%|██▋       | 1637/6000 [1:35:59<4:02:08,  3.33s/it]
Skipping the first batches:  27%|██▋       | 1638/6000 [1:36:02<4:05:00,  3.37s/it]
Skipping the first batches:  27%|██▋       | 1639/6000 [1:36:06<4:06:59,  3.40s/it]
Skipping the first batches:  27%|██▋       | 1640/6000 [1:36:09<4:00:26,  3.31s/it]
Skipping the first batches:  27%|██▋       | 1641/6000 [1:36:13<4:09:03,  3.43s/it]
Skipping the first batches:  27%|██▋       | 1642/6000 [1:36:16<4:05:27,  3.38s/it]
Skipping the first batches:  27%|██▋       | 1643/6000 [1:36:19<4:02:21,  3.34s/it]
Skipping the first batches:  27%|██▋       | 1644/6000 [1:36:22<4:01:02,  3.32s/it]
Skipping the first batches:  27%|██▋       | 1645/6000 [1:36:26<3:58:43,  3.29s/it]
Skipping the first batches:  27%|██▋       | 1646/6000 [1:36:29<4:00:55,  3.32s/it]
Skipping the first batches:  27%|██▋       | 1647/6000 [1:36:32<4:03:29,  3.36s/it]
Skipping the first batches:  27%|██▋       | 1648/6000 [1:36:36<4:06:59,  3.41s/it]
Skipping the first batches:  27%|██▋       | 1649/6000 [1:36:39<4:03:10,  3.35s/it]
Skipping the first batches:  28%|██▊       | 1650/6000 [1:36:43<4:06:47,  3.40s/it]
Skipping the first batches:  28%|██▊       | 1651/6000 [1:36:46<4:08:47,  3.43s/it]
Skipping the first batches:  28%|██▊       | 1652/6000 [1:36:49<4:05:33,  3.39s/it]
Skipping the first batches:  28%|██▊       | 1653/6000 [1:36:53<4:07:09,  3.41s/it]
Skipping the first batches:  28%|██▊       | 1654/6000 [1:36:56<4:03:28,  3.36s/it]
Skipping the first batches:  28%|██▊       | 1655/6000 [1:36:59<4:00:13,  3.32s/it]
Skipping the first batches:  28%|██▊       | 1656/6000 [1:37:04<4:25:14,  3.66s/it]
Skipping the first batches:  28%|██▊       | 1657/6000 [1:37:08<4:28:30,  3.71s/it]
Skipping the first batches:  28%|██▊       | 1658/6000 [1:37:11<4:16:07,  3.54s/it]
Skipping the first batches:  28%|██▊       | 1659/6000 [1:37:14<4:14:38,  3.52s/it]
Skipping the first batches:  28%|██▊       | 1660/6000 [1:37:18<4:20:04,  3.60s/it]
Skipping the first batches:  28%|██▊       | 1661/6000 [1:37:21<4:10:23,  3.46s/it]
Skipping the first batches:  28%|██▊       | 1662/6000 [1:37:24<4:05:49,  3.40s/it]
Skipping the first batches:  28%|██▊       | 1663/6000 [1:37:29<4:37:15,  3.84s/it]
Skipping the first batches:  28%|██▊       | 1664/6000 [1:37:32<4:21:31,  3.62s/it]
Skipping the first batches:  28%|██▊       | 1665/6000 [1:37:36<4:15:38,  3.54s/it]
Skipping the first batches:  28%|██▊       | 1666/6000 [1:37:41<4:55:13,  4.09s/it]
Skipping the first batches:  28%|██▊       | 1667/6000 [1:37:45<4:51:08,  4.03s/it]
Skipping the first batches:  28%|██▊       | 1668/6000 [1:37:48<4:32:42,  3.78s/it]
Skipping the first batches:  28%|██▊       | 1669/6000 [1:37:53<4:45:55,  3.96s/it]
Skipping the first batches:  28%|██▊       | 1670/6000 [1:37:56<4:32:41,  3.78s/it]
Skipping the first batches:  28%|██▊       | 1671/6000 [1:37:59<4:23:35,  3.65s/it]
Skipping the first batches:  28%|██▊       | 1672/6000 [1:38:03<4:18:18,  3.58s/it]
Skipping the first batches:  28%|██▊       | 1673/6000 [1:38:06<4:17:21,  3.57s/it]
Skipping the first batches:  28%|██▊       | 1674/6000 [1:38:10<4:18:31,  3.59s/it]
Skipping the first batches:  28%|██▊       | 1675/6000 [1:38:14<4:23:18,  3.65s/it]
Skipping the first batches:  28%|██▊       | 1676/6000 [1:38:17<4:13:04,  3.51s/it]
Skipping the first batches:  28%|██▊       | 1677/6000 [1:38:21<4:30:22,  3.75s/it]
Skipping the first batches:  28%|██▊       | 1678/6000 [1:38:25<4:27:42,  3.72s/it]
Skipping the first batches:  28%|██▊       | 1679/6000 [1:38:28<4:21:44,  3.63s/it]
Skipping the first batches:  28%|██▊       | 1680/6000 [1:38:32<4:13:04,  3.51s/it]
Skipping the first batches:  28%|██▊       | 1681/6000 [1:38:35<4:08:17,  3.45s/it]
Skipping the first batches:  28%|██▊       | 1682/6000 [1:38:38<4:10:25,  3.48s/it]
Skipping the first batches:  28%|██▊       | 1683/6000 [1:38:42<4:04:22,  3.40s/it]
Skipping the first batches:  28%|██▊       | 1684/6000 [1:38:45<4:10:04,  3.48s/it]
Skipping the first batches:  28%|██▊       | 1685/6000 [1:38:48<4:02:44,  3.38s/it]
Skipping the first batches:  28%|██▊       | 1686/6000 [1:38:52<4:01:09,  3.35s/it]
Skipping the first batches:  28%|██▊       | 1687/6000 [1:38:55<4:09:13,  3.47s/it]
Skipping the first batches:  28%|██▊       | 1688/6000 [1:38:59<4:11:48,  3.50s/it]
Skipping the first batches:  28%|██▊       | 1689/6000 [1:39:02<4:11:24,  3.50s/it]
Skipping the first batches:  28%|██▊       | 1690/6000 [1:39:06<4:06:58,  3.44s/it]
Skipping the first batches:  28%|██▊       | 1691/6000 [1:39:09<4:09:12,  3.47s/it]
Skipping the first batches:  28%|██▊       | 1692/6000 [1:39:13<4:03:53,  3.40s/it]
Skipping the first batches:  28%|██▊       | 1693/6000 [1:39:16<4:11:26,  3.50s/it]
Skipping the first batches:  28%|██▊       | 1694/6000 [1:39:20<4:13:05,  3.53s/it]
Skipping the first batches:  28%|██▊       | 1695/6000 [1:39:24<4:17:48,  3.59s/it]
Skipping the first batches:  28%|██▊       | 1696/6000 [1:39:28<4:24:54,  3.69s/it]
Skipping the first batches:  28%|██▊       | 1697/6000 [1:39:31<4:22:44,  3.66s/it]
Skipping the first batches:  28%|██▊       | 1698/6000 [1:39:35<4:18:55,  3.61s/it]
Skipping the first batches:  28%|██▊       | 1699/6000 [1:39:38<4:16:38,  3.58s/it]
Skipping the first batches:  28%|██▊       | 1700/6000 [1:39:42<4:12:59,  3.53s/it]
Skipping the first batches:  28%|██▊       | 1701/6000 [1:39:45<4:05:55,  3.43s/it]
Skipping the first batches:  28%|██▊       | 1702/6000 [1:39:49<4:14:23,  3.55s/it]
Skipping the first batches:  28%|██▊       | 1703/6000 [1:39:52<4:08:30,  3.47s/it]
Skipping the first batches:  28%|██▊       | 1704/6000 [1:39:55<4:01:34,  3.37s/it]
Skipping the first batches:  28%|██▊       | 1705/6000 [1:39:59<4:05:10,  3.43s/it]
Skipping the first batches:  28%|██▊       | 1706/6000 [1:40:02<4:02:11,  3.38s/it]
Skipping the first batches:  28%|██▊       | 1707/6000 [1:40:05<3:59:04,  3.34s/it]
Skipping the first batches:  28%|██▊       | 1708/6000 [1:40:09<4:18:29,  3.61s/it]
Skipping the first batches:  28%|██▊       | 1709/6000 [1:40:12<4:06:38,  3.45s/it]
Skipping the first batches:  28%|██▊       | 1710/6000 [1:40:16<4:09:41,  3.49s/it]
Skipping the first batches:  29%|██▊       | 1711/6000 [1:40:19<4:06:50,  3.45s/it]
Skipping the first batches:  29%|██▊       | 1712/6000 [1:40:23<4:04:01,  3.41s/it]
Skipping the first batches:  29%|██▊       | 1713/6000 [1:40:26<4:07:24,  3.46s/it]
Skipping the first batches:  29%|██▊       | 1714/6000 [1:40:29<4:01:58,  3.39s/it]
Skipping the first batches:  29%|██▊       | 1715/6000 [1:40:33<4:05:15,  3.43s/it]
Skipping the first batches:  29%|██▊       | 1716/6000 [1:40:36<4:05:13,  3.43s/it]
Skipping the first batches:  29%|██▊       | 1717/6000 [1:40:40<3:57:12,  3.32s/it]
Skipping the first batches:  29%|██▊       | 1718/6000 [1:40:43<3:59:33,  3.36s/it]
Skipping the first batches:  29%|██▊       | 1719/6000 [1:40:47<4:10:42,  3.51s/it]
Skipping the first batches:  29%|██▊       | 1720/6000 [1:40:50<4:04:06,  3.42s/it]
Skipping the first batches:  29%|██▊       | 1721/6000 [1:40:53<4:00:20,  3.37s/it]
Skipping the first batches:  29%|██▊       | 1722/6000 [1:40:57<3:57:43,  3.33s/it]
Skipping the first batches:  29%|██▊       | 1723/6000 [1:41:00<3:55:46,  3.31s/it]
Skipping the first batches:  29%|██▊       | 1724/6000 [1:41:03<4:01:36,  3.39s/it]
Skipping the first batches:  29%|██▉       | 1725/6000 [1:41:07<4:00:06,  3.37s/it]
Skipping the first batches:  29%|██▉       | 1726/6000 [1:41:10<4:01:33,  3.39s/it]
Skipping the first batches:  29%|██▉       | 1727/6000 [1:41:14<4:02:47,  3.41s/it]
Skipping the first batches:  29%|██▉       | 1728/6000 [1:41:17<3:56:00,  3.31s/it]
Skipping the first batches:  29%|██▉       | 1729/6000 [1:41:20<3:54:28,  3.29s/it]
Skipping the first batches:  29%|██▉       | 1730/6000 [1:41:24<4:05:40,  3.45s/it]
Skipping the first batches:  29%|██▉       | 1731/6000 [1:41:27<4:00:53,  3.39s/it]
Skipping the first batches:  29%|██▉       | 1732/6000 [1:41:30<3:57:19,  3.34s/it]
Skipping the first batches:  29%|██▉       | 1733/6000 [1:41:34<4:00:19,  3.38s/it]
Skipping the first batches:  29%|██▉       | 1734/6000 [1:41:37<4:03:36,  3.43s/it]
Skipping the first batches:  29%|██▉       | 1735/6000 [1:41:41<4:02:47,  3.42s/it]
Skipping the first batches:  29%|██▉       | 1736/6000 [1:41:44<3:57:24,  3.34s/it]
Skipping the first batches:  29%|██▉       | 1737/6000 [1:41:47<3:58:57,  3.36s/it]
Skipping the first batches:  29%|██▉       | 1738/6000 [1:41:51<4:09:39,  3.51s/it]
Skipping the first batches:  29%|██▉       | 1739/6000 [1:41:54<3:59:43,  3.38s/it]
Skipping the first batches:  29%|██▉       | 1740/6000 [1:41:57<3:56:38,  3.33s/it]
Skipping the first batches:  29%|██▉       | 1741/6000 [1:42:01<4:03:48,  3.43s/it]
Skipping the first batches:  29%|██▉       | 1742/6000 [1:42:05<4:08:37,  3.50s/it]
Skipping the first batches:  29%|██▉       | 1743/6000 [1:42:09<4:16:32,  3.62s/it]
Skipping the first batches:  29%|██▉       | 1744/6000 [1:42:12<4:23:24,  3.71s/it]
Skipping the first batches:  29%|██▉       | 1745/6000 [1:42:16<4:29:26,  3.80s/it]
Skipping the first batches:  29%|██▉       | 1746/6000 [1:42:20<4:20:38,  3.68s/it]
Skipping the first batches:  29%|██▉       | 1747/6000 [1:42:23<4:12:47,  3.57s/it]
Skipping the first batches:  29%|██▉       | 1748/6000 [1:42:27<4:16:46,  3.62s/it]
Skipping the first batches:  29%|██▉       | 1749/6000 [1:42:30<4:07:55,  3.50s/it]
Skipping the first batches:  29%|██▉       | 1750/6000 [1:42:33<3:58:02,  3.36s/it]
Skipping the first batches:  29%|██▉       | 1751/6000 [1:42:38<4:30:40,  3.82s/it]
Skipping the first batches:  29%|██▉       | 1752/6000 [1:42:41<4:14:57,  3.60s/it]
Skipping the first batches:  29%|██▉       | 1753/6000 [1:42:45<4:15:51,  3.61s/it]
Skipping the first batches:  29%|██▉       | 1754/6000 [1:42:48<4:12:03,  3.56s/it]
Skipping the first batches:  29%|██▉       | 1755/6000 [1:42:52<4:11:03,  3.55s/it]
Skipping the first batches:  29%|██▉       | 1756/6000 [1:42:56<4:27:47,  3.79s/it]
Skipping the first batches:  29%|██▉       | 1757/6000 [1:43:01<4:42:06,  3.99s/it]
Skipping the first batches:  29%|██▉       | 1758/6000 [1:43:04<4:26:36,  3.77s/it]
Skipping the first batches:  29%|██▉       | 1759/6000 [1:43:07<4:21:56,  3.71s/it]
Skipping the first batches:  29%|██▉       | 1760/6000 [1:43:11<4:14:45,  3.61s/it]
Skipping the first batches:  29%|██▉       | 1761/6000 [1:43:14<4:07:04,  3.50s/it]
Skipping the first batches:  29%|██▉       | 1762/6000 [1:43:18<4:13:00,  3.58s/it]
Skipping the first batches:  29%|██▉       | 1763/6000 [1:43:21<4:04:55,  3.47s/it]
Skipping the first batches:  29%|██▉       | 1764/6000 [1:43:25<4:08:13,  3.52s/it]
Skipping the first batches:  29%|██▉       | 1765/6000 [1:43:28<3:58:13,  3.38s/it]
Skipping the first batches:  29%|██▉       | 1766/6000 [1:43:32<4:20:32,  3.69s/it]
Skipping the first batches:  29%|██▉       | 1767/6000 [1:43:36<4:16:46,  3.64s/it]
Skipping the first batches:  29%|██▉       | 1768/6000 [1:43:39<4:09:47,  3.54s/it]
Skipping the first batches:  29%|██▉       | 1769/6000 [1:43:42<4:05:12,  3.48s/it]
Skipping the first batches:  30%|██▉       | 1770/6000 [1:43:46<4:03:52,  3.46s/it]
Skipping the first batches:  30%|██▉       | 1771/6000 [1:43:49<3:58:07,  3.38s/it]
Skipping the first batches:  30%|██▉       | 1772/6000 [1:43:52<3:52:11,  3.30s/it]
Skipping the first batches:  30%|██▉       | 1773/6000 [1:43:56<4:03:17,  3.45s/it]
Skipping the first batches:  30%|██▉       | 1774/6000 [1:43:59<3:59:35,  3.40s/it]
Skipping the first batches:  30%|██▉       | 1775/6000 [1:44:02<3:58:28,  3.39s/it]
Skipping the first batches:  30%|██▉       | 1776/6000 [1:44:06<4:03:05,  3.45s/it]
Skipping the first batches:  30%|██▉       | 1777/6000 [1:44:10<4:03:37,  3.46s/it]
Skipping the first batches:  30%|██▉       | 1778/6000 [1:44:13<3:59:43,  3.41s/it]
Skipping the first batches:  30%|██▉       | 1779/6000 [1:44:17<4:06:21,  3.50s/it]
Skipping the first batches:  30%|██▉       | 1780/6000 [1:44:20<4:01:01,  3.43s/it]
Skipping the first batches:  30%|██▉       | 1781/6000 [1:44:23<3:53:19,  3.32s/it]
Skipping the first batches:  30%|██▉       | 1782/6000 [1:44:26<3:55:28,  3.35s/it]
Skipping the first batches:  30%|██▉       | 1783/6000 [1:44:30<3:57:26,  3.38s/it]
Skipping the first batches:  30%|██▉       | 1784/6000 [1:44:33<3:54:02,  3.33s/it]
Skipping the first batches:  30%|██▉       | 1785/6000 [1:44:37<4:03:02,  3.46s/it]
Skipping the first batches:  30%|██▉       | 1786/6000 [1:44:40<4:08:01,  3.53s/it]
Skipping the first batches:  30%|██▉       | 1787/6000 [1:44:44<4:00:54,  3.43s/it]
Skipping the first batches:  30%|██▉       | 1788/6000 [1:44:47<4:00:42,  3.43s/it]
Skipping the first batches:  30%|██▉       | 1789/6000 [1:44:50<3:57:25,  3.38s/it]
Skipping the first batches:  30%|██▉       | 1790/6000 [1:44:54<3:58:55,  3.41s/it]
Skipping the first batches:  30%|██▉       | 1791/6000 [1:44:57<3:54:02,  3.34s/it]
Skipping the first batches:  30%|██▉       | 1792/6000 [1:45:01<4:05:33,  3.50s/it]
Skipping the first batches:  30%|██▉       | 1793/6000 [1:45:04<4:03:37,  3.47s/it]
Skipping the first batches:  30%|██▉       | 1794/6000 [1:45:08<4:01:35,  3.45s/it]
Skipping the first batches:  30%|██▉       | 1795/6000 [1:45:11<4:05:27,  3.50s/it]
Skipping the first batches:  30%|██▉       | 1796/6000 [1:45:14<3:59:42,  3.42s/it]
Skipping the first batches:  30%|██▉       | 1797/6000 [1:45:18<4:05:10,  3.50s/it]
Skipping the first batches:  30%|██▉       | 1798/6000 [1:45:22<4:04:47,  3.50s/it]
Skipping the first batches:  30%|██▉       | 1799/6000 [1:45:25<4:08:35,  3.55s/it]
Skipping the first batches:  30%|███       | 1800/6000 [1:45:28<3:59:49,  3.43s/it]
Skipping the first batches:  30%|███       | 1801/6000 [1:45:32<4:02:15,  3.46s/it]
Skipping the first batches:  30%|███       | 1802/6000 [1:45:35<3:55:02,  3.36s/it]
Skipping the first batches:  30%|███       | 1803/6000 [1:45:40<4:36:22,  3.95s/it]
Skipping the first batches:  30%|███       | 1804/6000 [1:45:46<5:12:24,  4.47s/it]
Skipping the first batches:  30%|███       | 1805/6000 [1:45:50<4:53:38,  4.20s/it]
Skipping the first batches:  30%|███       | 1806/6000 [1:45:53<4:29:59,  3.86s/it]
Skipping the first batches:  30%|███       | 1807/6000 [1:45:56<4:22:19,  3.75s/it]
Skipping the first batches:  30%|███       | 1808/6000 [1:46:00<4:19:53,  3.72s/it]
Skipping the first batches:  30%|███       | 1809/6000 [1:46:03<4:10:41,  3.59s/it]
Skipping the first batches:  30%|███       | 1810/6000 [1:46:06<4:04:09,  3.50s/it]
Skipping the first batches:  30%|███       | 1811/6000 [1:46:10<4:05:01,  3.51s/it]
Skipping the first batches:  30%|███       | 1812/6000 [1:46:13<4:02:59,  3.48s/it]
Skipping the first batches:  30%|███       | 1813/6000 [1:46:17<3:55:01,  3.37s/it]
Skipping the first batches:  30%|███       | 1814/6000 [1:46:20<3:58:20,  3.42s/it]
Skipping the first batches:  30%|███       | 1815/6000 [1:46:24<4:03:37,  3.49s/it]
Skipping the first batches:  30%|███       | 1816/6000 [1:46:27<4:04:09,  3.50s/it]
Skipping the first batches:  30%|███       | 1817/6000 [1:46:31<4:06:59,  3.54s/it]
Skipping the first batches:  30%|███       | 1818/6000 [1:46:34<4:00:59,  3.46s/it]
Skipping the first batches:  30%|███       | 1819/6000 [1:46:38<4:12:29,  3.62s/it]
Skipping the first batches:  30%|███       | 1820/6000 [1:46:42<4:11:47,  3.61s/it]
Skipping the first batches:  30%|███       | 1821/6000 [1:46:46<4:16:35,  3.68s/it]
Skipping the first batches:  30%|███       | 1822/6000 [1:46:50<4:21:16,  3.75s/it]
Skipping the first batches:  30%|███       | 1823/6000 [1:46:53<4:11:11,  3.61s/it]
Skipping the first batches:  30%|███       | 1824/6000 [1:46:57<4:23:08,  3.78s/it]
Skipping the first batches:  30%|███       | 1825/6000 [1:47:01<4:25:26,  3.81s/it]
Skipping the first batches:  30%|███       | 1826/6000 [1:47:04<4:13:02,  3.64s/it]
Skipping the first batches:  30%|███       | 1827/6000 [1:47:08<4:09:53,  3.59s/it]
Skipping the first batches:  30%|███       | 1828/6000 [1:47:11<4:16:39,  3.69s/it]
Skipping the first batches:  30%|███       | 1829/6000 [1:47:16<4:31:52,  3.91s/it]
Skipping the first batches:  30%|███       | 1830/6000 [1:47:19<4:14:11,  3.66s/it]
Skipping the first batches:  31%|███       | 1831/6000 [1:47:22<4:06:09,  3.54s/it]
Skipping the first batches:  31%|███       | 1832/6000 [1:47:26<4:12:02,  3.63s/it]
Skipping the first batches:  31%|███       | 1833/6000 [1:47:29<4:03:17,  3.50s/it]
Skipping the first batches:  31%|███       | 1834/6000 [1:47:33<4:09:46,  3.60s/it]
Skipping the first batches:  31%|███       | 1835/6000 [1:47:36<4:00:36,  3.47s/it]
Skipping the first batches:  31%|███       | 1836/6000 [1:47:40<3:56:06,  3.40s/it]
Skipping the first batches:  31%|███       | 1837/6000 [1:47:43<4:02:54,  3.50s/it]
Skipping the first batches:  31%|███       | 1838/6000 [1:47:47<4:02:34,  3.50s/it]
Skipping the first batches:  31%|███       | 1839/6000 [1:47:50<3:56:50,  3.42s/it]
Skipping the first batches:  31%|███       | 1840/6000 [1:47:53<3:58:28,  3.44s/it]
Skipping the first batches:  31%|███       | 1841/6000 [1:47:58<4:14:23,  3.67s/it]
Skipping the first batches:  31%|███       | 1842/6000 [1:48:01<4:01:27,  3.48s/it]
Skipping the first batches:  31%|███       | 1843/6000 [1:48:04<4:00:54,  3.48s/it]
Skipping the first batches:  31%|███       | 1844/6000 [1:48:07<3:54:47,  3.39s/it]
Skipping the first batches:  31%|███       | 1845/6000 [1:48:11<4:00:09,  3.47s/it]
Skipping the first batches:  31%|███       | 1846/6000 [1:48:15<4:04:20,  3.53s/it]
Skipping the first batches:  31%|███       | 1847/6000 [1:48:18<3:58:56,  3.45s/it]
Skipping the first batches:  31%|███       | 1848/6000 [1:48:21<3:59:56,  3.47s/it]
Skipping the first batches:  31%|███       | 1849/6000 [1:48:25<4:03:15,  3.52s/it]
Skipping the first batches:  31%|███       | 1850/6000 [1:48:29<4:02:10,  3.50s/it]
Skipping the first batches:  31%|███       | 1851/6000 [1:48:32<4:06:00,  3.56s/it]
Skipping the first batches:  31%|███       | 1852/6000 [1:48:36<4:06:37,  3.57s/it]
Skipping the first batches:  31%|███       | 1853/6000 [1:48:39<4:03:42,  3.53s/it]
Skipping the first batches:  31%|███       | 1854/6000 [1:48:43<4:02:27,  3.51s/it]
Skipping the first batches:  31%|███       | 1855/6000 [1:48:47<4:09:33,  3.61s/it]
Skipping the first batches:  31%|███       | 1856/6000 [1:48:50<4:03:42,  3.53s/it]
Skipping the first batches:  31%|███       | 1857/6000 [1:48:53<3:58:26,  3.45s/it]
Skipping the first batches:  31%|███       | 1858/6000 [1:48:57<3:56:30,  3.43s/it]
Skipping the first batches:  31%|███       | 1859/6000 [1:49:00<3:57:41,  3.44s/it]
Skipping the first batches:  31%|███       | 1860/6000 [1:49:03<3:53:25,  3.38s/it]
Skipping the first batches:  31%|███       | 1861/6000 [1:49:07<3:55:33,  3.41s/it]
Skipping the first batches:  31%|███       | 1862/6000 [1:49:10<3:56:33,  3.43s/it]
Skipping the first batches:  31%|███       | 1863/6000 [1:49:13<3:51:23,  3.36s/it]
Skipping the first batches:  31%|███       | 1864/6000 [1:49:17<3:50:59,  3.35s/it]
Skipping the first batches:  31%|███       | 1865/6000 [1:49:20<3:53:21,  3.39s/it]
Skipping the first batches:  31%|███       | 1866/6000 [1:49:24<3:53:49,  3.39s/it]
Skipping the first batches:  31%|███       | 1867/6000 [1:49:27<3:47:57,  3.31s/it]
Skipping the first batches:  31%|███       | 1868/6000 [1:49:30<3:46:36,  3.29s/it]
Skipping the first batches:  31%|███       | 1869/6000 [1:49:34<4:04:41,  3.55s/it]
Skipping the first batches:  31%|███       | 1870/6000 [1:49:38<4:02:08,  3.52s/it]
Skipping the first batches:  31%|███       | 1871/6000 [1:49:41<3:58:27,  3.47s/it]
Skipping the first batches:  31%|███       | 1872/6000 [1:49:44<4:00:03,  3.49s/it]
Skipping the first batches:  31%|███       | 1873/6000 [1:49:49<4:11:49,  3.66s/it]
Skipping the first batches:  31%|███       | 1874/6000 [1:49:52<3:59:06,  3.48s/it]
Skipping the first batches:  31%|███▏      | 1875/6000 [1:49:55<3:59:22,  3.48s/it]
Skipping the first batches:  31%|███▏      | 1876/6000 [1:49:58<3:52:23,  3.38s/it]
Skipping the first batches:  31%|███▏      | 1877/6000 [1:50:02<3:58:14,  3.47s/it]
Skipping the first batches:  31%|███▏      | 1878/6000 [1:50:05<4:00:20,  3.50s/it]
Skipping the first batches:  31%|███▏      | 1879/6000 [1:50:09<3:52:09,  3.38s/it]
Skipping the first batches:  31%|███▏      | 1880/6000 [1:50:12<3:59:14,  3.48s/it]
Skipping the first batches:  31%|███▏      | 1881/6000 [1:50:16<3:55:24,  3.43s/it]
Skipping the first batches:  31%|███▏      | 1882/6000 [1:50:19<3:57:08,  3.46s/it]
Skipping the first batches:  31%|███▏      | 1883/6000 [1:50:23<3:57:56,  3.47s/it]
Skipping the first batches:  31%|███▏      | 1884/6000 [1:50:27<4:12:43,  3.68s/it]
Skipping the first batches:  31%|███▏      | 1885/6000 [1:50:30<4:03:39,  3.55s/it]
Skipping the first batches:  31%|███▏      | 1886/6000 [1:50:33<4:01:04,  3.52s/it]
Skipping the first batches:  31%|███▏      | 1887/6000 [1:50:37<4:08:41,  3.63s/it]
Skipping the first batches:  31%|███▏      | 1888/6000 [1:50:41<4:03:13,  3.55s/it]
Skipping the first batches:  31%|███▏      | 1889/6000 [1:50:44<4:02:14,  3.54s/it]
Skipping the first batches:  32%|███▏      | 1890/6000 [1:50:48<3:59:19,  3.49s/it]
Skipping the first batches:  32%|███▏      | 1891/6000 [1:50:52<4:06:58,  3.61s/it]
Skipping the first batches:  32%|███▏      | 1892/6000 [1:50:55<4:06:25,  3.60s/it]
Skipping the first batches:  32%|███▏      | 1893/6000 [1:50:59<4:09:44,  3.65s/it]
Skipping the first batches:  32%|███▏      | 1894/6000 [1:51:02<4:06:08,  3.60s/it]
Skipping the first batches:  32%|███▏      | 1895/6000 [1:51:06<4:06:20,  3.60s/it]
Skipping the first batches:  32%|███▏      | 1896/6000 [1:51:09<4:03:01,  3.55s/it]
Skipping the first batches:  32%|███▏      | 1897/6000 [1:51:13<3:54:31,  3.43s/it]
Skipping the first batches:  32%|███▏      | 1898/6000 [1:51:17<4:15:29,  3.74s/it]
Skipping the first batches:  32%|███▏      | 1899/6000 [1:51:20<4:08:35,  3.64s/it]
Skipping the first batches:  32%|███▏      | 1900/6000 [1:51:24<4:07:33,  3.62s/it]
Skipping the first batches:  32%|███▏      | 1901/6000 [1:51:28<4:08:13,  3.63s/it]
Skipping the first batches:  32%|███▏      | 1902/6000 [1:51:31<4:07:49,  3.63s/it]
Skipping the first batches:  32%|███▏      | 1903/6000 [1:51:34<3:57:37,  3.48s/it]
Skipping the first batches:  32%|███▏      | 1904/6000 [1:51:38<3:55:42,  3.45s/it]
Skipping the first batches:  32%|███▏      | 1905/6000 [1:51:41<3:59:34,  3.51s/it]
Skipping the first batches:  32%|███▏      | 1906/6000 [1:51:45<3:54:44,  3.44s/it]
Skipping the first batches:  32%|███▏      | 1907/6000 [1:51:48<3:51:47,  3.40s/it]
Skipping the first batches:  32%|███▏      | 1908/6000 [1:51:51<3:53:45,  3.43s/it]
Skipping the first batches:  32%|███▏      | 1909/6000 [1:51:55<3:53:18,  3.42s/it]
Skipping the first batches:  32%|███▏      | 1910/6000 [1:51:58<3:53:07,  3.42s/it]
Skipping the first batches:  32%|███▏      | 1911/6000 [1:52:02<3:55:34,  3.46s/it]
Skipping the first batches:  32%|███▏      | 1912/6000 [1:52:06<4:11:14,  3.69s/it]
Skipping the first batches:  32%|███▏      | 1913/6000 [1:52:09<4:01:46,  3.55s/it]
Skipping the first batches:  32%|███▏      | 1914/6000 [1:52:12<3:53:05,  3.42s/it]
Skipping the first batches:  32%|███▏      | 1915/6000 [1:52:16<3:58:02,  3.50s/it]
Skipping the first batches:  32%|███▏      | 1916/6000 [1:52:20<4:00:28,  3.53s/it]
Skipping the first batches:  32%|███▏      | 1917/6000 [1:52:23<3:57:10,  3.49s/it]
Skipping the first batches:  32%|███▏      | 1918/6000 [1:52:26<3:51:00,  3.40s/it]
Skipping the first batches:  32%|███▏      | 1919/6000 [1:52:30<3:59:41,  3.52s/it]
Skipping the first batches:  32%|███▏      | 1920/6000 [1:52:33<3:52:59,  3.43s/it]
Skipping the first batches:  32%|███▏      | 1921/6000 [1:52:37<3:50:03,  3.38s/it]
Skipping the first batches:  32%|███▏      | 1922/6000 [1:52:40<3:46:04,  3.33s/it]
Skipping the first batches:  32%|███▏      | 1923/6000 [1:52:44<3:59:21,  3.52s/it]
Skipping the first batches:  32%|███▏      | 1924/6000 [1:52:47<3:59:35,  3.53s/it]
Skipping the first batches:  32%|███▏      | 1925/6000 [1:52:51<3:57:59,  3.50s/it]
Skipping the first batches:  32%|███▏      | 1926/6000 [1:52:54<4:01:17,  3.55s/it]
Skipping the first batches:  32%|███▏      | 1927/6000 [1:52:58<3:59:10,  3.52s/it]
Skipping the first batches:  32%|███▏      | 1928/6000 [1:53:01<3:54:24,  3.45s/it]
Skipping the first batches:  32%|███▏      | 1929/6000 [1:53:05<4:02:30,  3.57s/it]
Skipping the first batches:  32%|███▏      | 1930/6000 [1:53:09<4:11:06,  3.70s/it]
Skipping the first batches:  32%|███▏      | 1931/6000 [1:53:12<4:02:05,  3.57s/it]
Skipping the first batches:  32%|███▏      | 1932/6000 [1:53:16<4:10:18,  3.69s/it]
Skipping the first batches:  32%|███▏      | 1933/6000 [1:53:20<4:09:31,  3.68s/it]
Skipping the first batches:  32%|███▏      | 1934/6000 [1:53:23<3:59:30,  3.53s/it]
Skipping the first batches:  32%|███▏      | 1935/6000 [1:53:27<4:04:53,  3.61s/it]
Skipping the first batches:  32%|███▏      | 1936/6000 [1:53:30<3:53:49,  3.45s/it]
Skipping the first batches:  32%|███▏      | 1937/6000 [1:53:34<3:57:36,  3.51s/it]
Skipping the first batches:  32%|███▏      | 1938/6000 [1:53:37<3:51:23,  3.42s/it]
Skipping the first batches:  32%|███▏      | 1939/6000 [1:53:40<3:48:26,  3.38s/it]
Skipping the first batches:  32%|███▏      | 1940/6000 [1:53:43<3:41:48,  3.28s/it]
Skipping the first batches:  32%|███▏      | 1941/6000 [1:53:47<3:47:37,  3.36s/it]
Skipping the first batches:  32%|███▏      | 1942/6000 [1:53:50<3:47:41,  3.37s/it]
Skipping the first batches:  32%|███▏      | 1943/6000 [1:53:53<3:45:55,  3.34s/it]
Skipping the first batches:  32%|███▏      | 1944/6000 [1:53:57<3:58:58,  3.54s/it]
Skipping the first batches:  32%|███▏      | 1945/6000 [1:54:01<4:05:04,  3.63s/it]
Skipping the first batches:  32%|███▏      | 1946/6000 [1:54:05<4:02:19,  3.59s/it]
Skipping the first batches:  32%|███▏      | 1947/6000 [1:54:08<4:01:38,  3.58s/it]
Skipping the first batches:  32%|███▏      | 1948/6000 [1:54:12<3:57:39,  3.52s/it]
Skipping the first batches:  32%|███▏      | 1949/6000 [1:54:15<3:48:32,  3.38s/it]
Skipping the first batches:  32%|███▎      | 1950/6000 [1:54:18<3:54:52,  3.48s/it]
Skipping the first batches:  33%|███▎      | 1951/6000 [1:54:22<3:51:54,  3.44s/it]
Skipping the first batches:  33%|███▎      | 1952/6000 [1:54:25<3:44:57,  3.33s/it]
Skipping the first batches:  33%|███▎      | 1953/6000 [1:54:28<3:49:32,  3.40s/it]
Skipping the first batches:  33%|███▎      | 1954/6000 [1:54:32<3:49:59,  3.41s/it]
Skipping the first batches:  33%|███▎      | 1955/6000 [1:54:35<3:49:00,  3.40s/it]
Skipping the first batches:  33%|███▎      | 1956/6000 [1:54:39<3:54:54,  3.49s/it]
Skipping the first batches:  33%|███▎      | 1957/6000 [1:54:42<3:55:03,  3.49s/it]
Skipping the first batches:  33%|███▎      | 1958/6000 [1:54:46<3:54:06,  3.48s/it]
Skipping the first batches:  33%|███▎      | 1959/6000 [1:54:49<3:47:07,  3.37s/it]
Skipping the first batches:  33%|███▎      | 1960/6000 [1:54:53<3:56:38,  3.51s/it]
Skipping the first batches:  33%|███▎      | 1961/6000 [1:54:56<3:54:04,  3.48s/it]
Skipping the first batches:  33%|███▎      | 1962/6000 [1:54:59<3:49:04,  3.40s/it]
Skipping the first batches:  33%|███▎      | 1963/6000 [1:55:03<3:52:34,  3.46s/it]
Skipping the first batches:  33%|███▎      | 1964/6000 [1:55:07<3:55:00,  3.49s/it]
Skipping the first batches:  33%|███▎      | 1965/6000 [1:55:10<3:56:16,  3.51s/it]
Skipping the first batches:  33%|███▎      | 1966/6000 [1:55:13<3:51:11,  3.44s/it]
Skipping the first batches:  33%|███▎      | 1967/6000 [1:55:17<3:55:21,  3.50s/it]
Skipping the first batches:  33%|███▎      | 1968/6000 [1:55:20<3:53:01,  3.47s/it]
Skipping the first batches:  33%|███▎      | 1969/6000 [1:55:24<3:48:07,  3.40s/it]
Skipping the first batches:  33%|███▎      | 1970/6000 [1:55:27<3:54:21,  3.49s/it]
Skipping the first batches:  33%|███▎      | 1971/6000 [1:55:31<3:57:24,  3.54s/it]
Skipping the first batches:  33%|███▎      | 1972/6000 [1:55:34<3:52:46,  3.47s/it]
Skipping the first batches:  33%|███▎      | 1973/6000 [1:55:38<3:48:30,  3.40s/it]
Skipping the first batches:  33%|███▎      | 1974/6000 [1:55:42<4:14:03,  3.79s/it]
Skipping the first batches:  33%|███▎      | 1975/6000 [1:55:46<4:04:18,  3.64s/it]
Skipping the first batches:  33%|███▎      | 1976/6000 [1:55:49<3:57:38,  3.54s/it]
Skipping the first batches:  33%|███▎      | 1977/6000 [1:55:52<3:50:04,  3.43s/it]
Skipping the first batches:  33%|███▎      | 1978/6000 [1:55:56<3:56:50,  3.53s/it]
Skipping the first batches:  33%|███▎      | 1979/6000 [1:55:59<3:50:05,  3.43s/it]
Skipping the first batches:  33%|███▎      | 1980/6000 [1:56:02<3:49:12,  3.42s/it]
Skipping the first batches:  33%|███▎      | 1981/6000 [1:56:06<3:52:12,  3.47s/it]
Skipping the first batches:  33%|███▎      | 1982/6000 [1:56:09<3:50:07,  3.44s/it]
Skipping the first batches:  33%|███▎      | 1983/6000 [1:56:13<3:45:41,  3.37s/it]
Skipping the first batches:  33%|███▎      | 1984/6000 [1:56:16<3:46:50,  3.39s/it]
Skipping the first batches:  33%|███▎      | 1985/6000 [1:56:19<3:40:48,  3.30s/it]
Skipping the first batches:  33%|███▎      | 1986/6000 [1:56:22<3:42:24,  3.32s/it]
Skipping the first batches:  33%|███▎      | 1987/6000 [1:56:26<3:39:50,  3.29s/it]
Skipping the first batches:  33%|███▎      | 1988/6000 [1:56:29<3:38:22,  3.27s/it]
Skipping the first batches:  33%|███▎      | 1989/6000 [1:56:32<3:42:45,  3.33s/it]
Skipping the first batches:  33%|███▎      | 1990/6000 [1:56:36<3:40:31,  3.30s/it]
Skipping the first batches:  33%|███▎      | 1991/6000 [1:56:39<3:45:06,  3.37s/it]
Skipping the first batches:  33%|███▎      | 1992/6000 [1:56:42<3:41:21,  3.31s/it]
Skipping the first batches:  33%|███▎      | 1993/6000 [1:56:46<3:41:48,  3.32s/it]
Skipping the first batches:  33%|███▎      | 1994/6000 [1:56:49<3:42:51,  3.34s/it]
Skipping the first batches:  33%|███▎      | 1995/6000 [1:56:53<3:48:16,  3.42s/it]
Skipping the first batches:  33%|███▎      | 1996/6000 [1:56:56<3:46:17,  3.39s/it]
Skipping the first batches:  33%|███▎      | 1997/6000 [1:57:00<3:50:00,  3.45s/it]
Skipping the first batches:  33%|███▎      | 1998/6000 [1:57:03<3:45:33,  3.38s/it]
Skipping the first batches:  33%|███▎      | 1999/6000 [1:57:07<3:52:46,  3.49s/it]
Skipping the first batches:  33%|███▎      | 2000/6000 [1:57:10<3:59:11,  3.59s/it]
Skipping the first batches:  33%|███▎      | 2001/6000 [1:57:14<3:56:09,  3.54s/it]
Skipping the first batches:  33%|███▎      | 2002/6000 [1:57:17<3:50:43,  3.46s/it]
Skipping the first batches:  33%|███▎      | 2003/6000 [1:57:20<3:47:36,  3.42s/it]
Skipping the first batches:  33%|███▎      | 2004/6000 [1:57:24<3:50:41,  3.46s/it]
Skipping the first batches:  33%|███▎      | 2005/6000 [1:57:27<3:45:45,  3.39s/it]
Skipping the first batches:  33%|███▎      | 2006/6000 [1:57:31<3:51:00,  3.47s/it]
Skipping the first batches:  33%|███▎      | 2007/6000 [1:57:34<3:47:37,  3.42s/it]
Skipping the first batches:  33%|███▎      | 2008/6000 [1:57:38<3:51:00,  3.47s/it]
Skipping the first batches:  33%|███▎      | 2009/6000 [1:57:41<3:50:53,  3.47s/it]
Skipping the first batches:  34%|███▎      | 2010/6000 [1:57:45<3:54:58,  3.53s/it]
Skipping the first batches:  34%|███▎      | 2011/6000 [1:57:48<3:49:33,  3.45s/it]
Skipping the first batches:  34%|███▎      | 2012/6000 [1:57:51<3:43:19,  3.36s/it]
Skipping the first batches:  34%|███▎      | 2013/6000 [1:57:56<4:03:56,  3.67s/it]
Skipping the first batches:  34%|███▎      | 2014/6000 [1:58:01<4:31:28,  4.09s/it]
Skipping the first batches:  34%|███▎      | 2015/6000 [1:58:04<4:11:55,  3.79s/it]
Skipping the first batches:  34%|███▎      | 2016/6000 [1:58:08<4:19:52,  3.91s/it]
Skipping the first batches:  34%|███▎      | 2017/6000 [1:58:13<4:38:39,  4.20s/it]
Skipping the first batches:  34%|███▎      | 2018/6000 [1:58:17<4:26:58,  4.02s/it]
Skipping the first batches:  34%|███▎      | 2019/6000 [1:58:20<4:12:33,  3.81s/it]
Skipping the first batches:  34%|███▎      | 2020/6000 [1:58:23<4:08:27,  3.75s/it]
Skipping the first batches:  34%|███▎      | 2021/6000 [1:58:27<4:02:09,  3.65s/it]
Skipping the first batches:  34%|███▎      | 2022/6000 [1:58:30<4:00:00,  3.62s/it]
Skipping the first batches:  34%|███▎      | 2023/6000 [1:58:34<3:58:03,  3.59s/it]
Skipping the first batches:  34%|███▎      | 2024/6000 [1:58:38<4:13:02,  3.82s/it]
Skipping the first batches:  34%|███▍      | 2025/6000 [1:58:42<4:04:32,  3.69s/it]
Skipping the first batches:  34%|███▍      | 2026/6000 [1:58:45<4:01:16,  3.64s/it]
Skipping the first batches:  34%|███▍      | 2027/6000 [1:58:48<3:52:43,  3.51s/it]
Skipping the first batches:  34%|███▍      | 2028/6000 [1:58:52<3:54:01,  3.54s/it]
Skipping the first batches:  34%|███▍      | 2029/6000 [1:58:55<3:44:58,  3.40s/it]
Skipping the first batches:  34%|███▍      | 2030/6000 [1:58:58<3:42:18,  3.36s/it]
Skipping the first batches:  34%|███▍      | 2031/6000 [1:59:02<3:43:31,  3.38s/it]
Skipping the first batches:  34%|███▍      | 2032/6000 [1:59:05<3:37:53,  3.29s/it]
Skipping the first batches:  34%|███▍      | 2033/6000 [1:59:08<3:40:27,  3.33s/it]
Skipping the first batches:  34%|███▍      | 2034/6000 [1:59:12<3:52:46,  3.52s/it]
Skipping the first batches:  34%|███▍      | 2035/6000 [1:59:17<4:15:59,  3.87s/it]
Skipping the first batches:  34%|███▍      | 2036/6000 [1:59:20<4:01:15,  3.65s/it]
Skipping the first batches:  34%|███▍      | 2037/6000 [1:59:24<4:00:11,  3.64s/it]
Skipping the first batches:  34%|███▍      | 2038/6000 [1:59:27<3:49:21,  3.47s/it]
Skipping the first batches:  34%|███▍      | 2039/6000 [1:59:30<3:49:00,  3.47s/it]
Skipping the first batches:  34%|███▍      | 2040/6000 [1:59:33<3:44:41,  3.40s/it]
Skipping the first batches:  34%|███▍      | 2041/6000 [1:59:37<3:41:28,  3.36s/it]
Skipping the first batches:  34%|███▍      | 2042/6000 [1:59:41<3:50:41,  3.50s/it]
Skipping the first batches:  34%|███▍      | 2043/6000 [1:59:45<4:00:52,  3.65s/it]
Skipping the first batches:  34%|███▍      | 2044/6000 [1:59:49<4:20:20,  3.95s/it]
Skipping the first batches:  34%|███▍      | 2045/6000 [1:59:55<4:48:30,  4.38s/it]
Skipping the first batches:  34%|███▍      | 2046/6000 [1:59:59<4:51:38,  4.43s/it]
Skipping the first batches:  34%|███▍      | 2047/6000 [2:00:03<4:43:36,  4.30s/it]
Skipping the first batches:  34%|███▍      | 2048/6000 [2:00:07<4:26:00,  4.04s/it]
Skipping the first batches:  34%|███▍      | 2049/6000 [2:00:10<4:18:41,  3.93s/it]
Skipping the first batches:  34%|███▍      | 2050/6000 [2:00:14<4:08:20,  3.77s/it]
Skipping the first batches:  34%|███▍      | 2051/6000 [2:00:17<4:01:04,  3.66s/it]
Skipping the first batches:  34%|███▍      | 2052/6000 [2:00:21<3:58:29,  3.62s/it]
Skipping the first batches:  34%|███▍      | 2053/6000 [2:00:25<4:18:40,  3.93s/it]
Skipping the first batches:  34%|███▍      | 2054/6000 [2:00:30<4:33:20,  4.16s/it]
Skipping the first batches:  34%|███▍      | 2055/6000 [2:00:34<4:26:54,  4.06s/it]
Skipping the first batches:  34%|███▍      | 2056/6000 [2:00:37<4:16:01,  3.89s/it]
Skipping the first batches:  34%|███▍      | 2057/6000 [2:00:41<4:08:40,  3.78s/it]
Skipping the first batches:  34%|███▍      | 2058/6000 [2:00:45<4:14:34,  3.87s/it]
Skipping the first batches:  34%|███▍      | 2059/6000 [2:00:48<4:02:45,  3.70s/it]
Skipping the first batches:  34%|███▍      | 2060/6000 [2:00:52<3:59:23,  3.65s/it]
Skipping the first batches:  34%|███▍      | 2061/6000 [2:00:55<3:54:40,  3.57s/it]
Skipping the first batches:  34%|███▍      | 2062/6000 [2:00:58<3:47:40,  3.47s/it]
Skipping the first batches:  34%|███▍      | 2063/6000 [2:01:02<3:50:19,  3.51s/it]
Skipping the first batches:  34%|███▍      | 2064/6000 [2:01:07<4:15:54,  3.90s/it]
Skipping the first batches:  34%|███▍      | 2065/6000 [2:01:10<3:59:55,  3.66s/it]
Skipping the first batches:  34%|███▍      | 2066/6000 [2:01:13<3:58:22,  3.64s/it]
Skipping the first batches:  34%|███▍      | 2067/6000 [2:01:18<4:08:15,  3.79s/it]
Skipping the first batches:  34%|███▍      | 2068/6000 [2:01:21<3:55:22,  3.59s/it]
Skipping the first batches:  34%|███▍      | 2069/6000 [2:01:24<3:45:35,  3.44s/it]
Skipping the first batches:  34%|███▍      | 2070/6000 [2:01:28<3:52:14,  3.55s/it]
Skipping the first batches:  35%|███▍      | 2071/6000 [2:01:31<3:45:40,  3.45s/it]
Skipping the first batches:  35%|███▍      | 2072/6000 [2:01:34<3:47:28,  3.47s/it]
Skipping the first batches:  35%|███▍      | 2073/6000 [2:01:38<3:55:15,  3.59s/it]
Skipping the first batches:  35%|███▍      | 2074/6000 [2:01:42<3:54:39,  3.59s/it]
Skipping the first batches:  35%|███▍      | 2075/6000 [2:01:45<3:49:44,  3.51s/it]
Skipping the first batches:  35%|███▍      | 2076/6000 [2:01:49<3:49:06,  3.50s/it]
Skipping the first batches:  35%|███▍      | 2077/6000 [2:01:52<3:42:19,  3.40s/it]
Skipping the first batches:  35%|███▍      | 2078/6000 [2:01:56<3:53:06,  3.57s/it]
Skipping the first batches:  35%|███▍      | 2079/6000 [2:01:59<3:46:15,  3.46s/it]
Skipping the first batches:  35%|███▍      | 2080/6000 [2:02:02<3:42:20,  3.40s/it]
Skipping the first batches:  35%|███▍      | 2081/6000 [2:02:06<3:45:12,  3.45s/it]
Skipping the first batches:  35%|███▍      | 2082/6000 [2:02:09<3:49:46,  3.52s/it]
Skipping the first batches:  35%|███▍      | 2083/6000 [2:02:13<3:42:34,  3.41s/it]
Skipping the first batches:  35%|███▍      | 2084/6000 [2:02:16<3:46:58,  3.48s/it]
Skipping the first batches:  35%|███▍      | 2085/6000 [2:02:20<3:47:15,  3.48s/it]
Skipping the first batches:  35%|███▍      | 2086/6000 [2:02:23<3:49:19,  3.52s/it]
Skipping the first batches:  35%|███▍      | 2087/6000 [2:02:27<3:44:14,  3.44s/it]
Skipping the first batches:  35%|███▍      | 2088/6000 [2:02:30<3:40:03,  3.38s/it]
Skipping the first batches:  35%|███▍      | 2089/6000 [2:02:33<3:42:50,  3.42s/it]
Skipping the first batches:  35%|███▍      | 2090/6000 [2:02:37<3:48:25,  3.51s/it]
Skipping the first batches:  35%|███▍      | 2091/6000 [2:02:40<3:47:08,  3.49s/it]
Skipping the first batches:  35%|███▍      | 2092/6000 [2:02:44<3:39:24,  3.37s/it]
Skipping the first batches:  35%|███▍      | 2093/6000 [2:02:48<3:55:07,  3.61s/it]
Skipping the first batches:  35%|███▍      | 2094/6000 [2:02:51<3:46:01,  3.47s/it]
Skipping the first batches:  35%|███▍      | 2095/6000 [2:02:54<3:44:55,  3.46s/it]
Skipping the first batches:  35%|███▍      | 2096/6000 [2:02:58<3:47:02,  3.49s/it]
Skipping the first batches:  35%|███▍      | 2097/6000 [2:03:01<3:42:24,  3.42s/it]
Skipping the first batches:  35%|███▍      | 2098/6000 [2:03:05<3:43:20,  3.43s/it]
Skipping the first batches:  35%|███▍      | 2099/6000 [2:03:08<3:52:27,  3.58s/it]
Skipping the first batches:  35%|███▌      | 2100/6000 [2:03:12<3:46:48,  3.49s/it]
Skipping the first batches:  35%|███▌      | 2101/6000 [2:03:15<3:46:42,  3.49s/it]
Skipping the first batches:  35%|███▌      | 2102/6000 [2:03:19<3:49:36,  3.53s/it]
Skipping the first batches:  35%|███▌      | 2103/6000 [2:03:22<3:41:06,  3.40s/it]
Skipping the first batches:  35%|███▌      | 2104/6000 [2:03:26<3:43:43,  3.45s/it]
Skipping the first batches:  35%|███▌      | 2105/6000 [2:03:29<3:43:52,  3.45s/it]
Skipping the first batches:  35%|███▌      | 2106/6000 [2:03:32<3:36:18,  3.33s/it]
Skipping the first batches:  35%|███▌      | 2107/6000 [2:03:36<3:41:43,  3.42s/it]
Skipping the first batches:  35%|███▌      | 2108/6000 [2:03:39<3:41:23,  3.41s/it]
Skipping the first batches:  35%|███▌      | 2109/6000 [2:03:42<3:34:30,  3.31s/it]
Skipping the first batches:  35%|███▌      | 2110/6000 [2:03:46<3:43:41,  3.45s/it]
Skipping the first batches:  35%|███▌      | 2111/6000 [2:03:49<3:44:11,  3.46s/it]
Skipping the first batches:  35%|███▌      | 2112/6000 [2:03:52<3:36:56,  3.35s/it]
Skipping the first batches:  35%|███▌      | 2113/6000 [2:03:56<3:45:10,  3.48s/it]
Skipping the first batches:  35%|███▌      | 2114/6000 [2:04:00<3:42:09,  3.43s/it]
Skipping the first batches:  35%|███▌      | 2115/6000 [2:04:03<3:38:27,  3.37s/it]
Skipping the first batches:  35%|███▌      | 2116/6000 [2:04:07<3:51:11,  3.57s/it]
Skipping the first batches:  35%|███▌      | 2117/6000 [2:04:11<3:52:50,  3.60s/it]
Skipping the first batches:  35%|███▌      | 2118/6000 [2:04:14<3:46:22,  3.50s/it]
Skipping the first batches:  35%|███▌      | 2119/6000 [2:04:17<3:46:53,  3.51s/it]
Skipping the first batches:  35%|███▌      | 2120/6000 [2:04:21<3:48:51,  3.54s/it]
Skipping the first batches:  35%|███▌      | 2121/6000 [2:04:24<3:48:33,  3.54s/it]
Skipping the first batches:  35%|███▌      | 2122/6000 [2:04:28<3:46:12,  3.50s/it]
Skipping the first batches:  35%|███▌      | 2123/6000 [2:04:31<3:42:59,  3.45s/it]
Skipping the first batches:  35%|███▌      | 2124/6000 [2:04:35<3:49:12,  3.55s/it]
Skipping the first batches:  35%|███▌      | 2125/6000 [2:04:38<3:46:15,  3.50s/it]
Skipping the first batches:  35%|███▌      | 2126/6000 [2:04:42<3:44:59,  3.48s/it]
Skipping the first batches:  35%|███▌      | 2127/6000 [2:04:45<3:45:17,  3.49s/it]
Skipping the first batches:  35%|███▌      | 2128/6000 [2:04:49<3:41:15,  3.43s/it]
Skipping the first batches:  35%|███▌      | 2129/6000 [2:04:52<3:38:09,  3.38s/it]
Skipping the first batches:  36%|███▌      | 2130/6000 [2:04:55<3:39:17,  3.40s/it]
Skipping the first batches:  36%|███▌      | 2131/6000 [2:04:59<3:42:07,  3.44s/it]
Skipping the first batches:  36%|███▌      | 2132/6000 [2:05:03<3:45:50,  3.50s/it]
Skipping the first batches:  36%|███▌      | 2133/6000 [2:05:07<4:07:50,  3.85s/it]
Skipping the first batches:  36%|███▌      | 2134/6000 [2:05:10<3:53:45,  3.63s/it]
Skipping the first batches:  36%|███▌      | 2135/6000 [2:05:13<3:45:42,  3.50s/it]
Skipping the first batches:  36%|███▌      | 2136/6000 [2:05:17<3:47:39,  3.54s/it]
Skipping the first batches:  36%|███▌      | 2137/6000 [2:05:20<3:44:47,  3.49s/it]
Skipping the first batches:  36%|███▌      | 2138/6000 [2:05:24<3:44:42,  3.49s/it]
Skipping the first batches:  36%|███▌      | 2139/6000 [2:05:27<3:40:02,  3.42s/it]
Skipping the first batches:  36%|███▌      | 2140/6000 [2:05:30<3:34:14,  3.33s/it]
Skipping the first batches:  36%|███▌      | 2141/6000 [2:05:34<3:43:23,  3.47s/it]
Skipping the first batches:  36%|███▌      | 2142/6000 [2:05:38<3:41:06,  3.44s/it]
Skipping the first batches:  36%|███▌      | 2143/6000 [2:05:41<3:38:25,  3.40s/it]
Skipping the first batches:  36%|███▌      | 2144/6000 [2:05:44<3:37:52,  3.39s/it]
Skipping the first batches:  36%|███▌      | 2145/6000 [2:05:48<3:40:19,  3.43s/it]
Skipping the first batches:  36%|███▌      | 2146/6000 [2:05:51<3:40:37,  3.43s/it]
Skipping the first batches:  36%|███▌      | 2147/6000 [2:05:54<3:34:31,  3.34s/it]
Skipping the first batches:  36%|███▌      | 2148/6000 [2:05:58<3:43:20,  3.48s/it]
Skipping the first batches:  36%|███▌      | 2149/6000 [2:06:01<3:35:18,  3.35s/it]
Skipping the first batches:  36%|███▌      | 2150/6000 [2:06:05<3:37:27,  3.39s/it]
Skipping the first batches:  36%|███▌      | 2151/6000 [2:06:09<3:53:13,  3.64s/it]
Skipping the first batches:  36%|███▌      | 2152/6000 [2:06:12<3:53:11,  3.64s/it]
Skipping the first batches:  36%|███▌      | 2153/6000 [2:06:17<4:01:30,  3.77s/it]
Skipping the first batches:  36%|███▌      | 2154/6000 [2:06:20<3:52:41,  3.63s/it]
Skipping the first batches:  36%|███▌      | 2155/6000 [2:06:24<3:56:59,  3.70s/it]
Skipping the first batches:  36%|███▌      | 2156/6000 [2:06:27<3:47:21,  3.55s/it]
Skipping the first batches:  36%|███▌      | 2157/6000 [2:06:31<3:49:07,  3.58s/it]
Skipping the first batches:  36%|███▌      | 2158/6000 [2:06:35<4:02:10,  3.78s/it]
Skipping the first batches:  36%|███▌      | 2159/6000 [2:06:39<4:02:19,  3.79s/it]
Skipping the first batches:  36%|███▌      | 2160/6000 [2:06:42<3:48:15,  3.57s/it]
Skipping the first batches:  36%|███▌      | 2161/6000 [2:06:45<3:44:39,  3.51s/it]
Skipping the first batches:  36%|███▌      | 2162/6000 [2:06:48<3:41:49,  3.47s/it]
Skipping the first batches:  36%|███▌      | 2163/6000 [2:06:52<3:38:57,  3.42s/it]
Skipping the first batches:  36%|███▌      | 2164/6000 [2:06:55<3:38:32,  3.42s/it]
Skipping the first batches:  36%|███▌      | 2165/6000 [2:06:59<3:39:05,  3.43s/it]
Skipping the first batches:  36%|███▌      | 2166/6000 [2:07:02<3:40:56,  3.46s/it]
Skipping the first batches:  36%|███▌      | 2167/6000 [2:07:07<4:00:09,  3.76s/it]
Skipping the first batches:  36%|███▌      | 2168/6000 [2:07:10<3:53:07,  3.65s/it]
Skipping the first batches:  36%|███▌      | 2169/6000 [2:07:13<3:48:21,  3.58s/it]
Skipping the first batches:  36%|███▌      | 2170/6000 [2:07:17<3:41:30,  3.47s/it]
Skipping the first batches:  36%|███▌      | 2171/6000 [2:07:21<3:50:12,  3.61s/it]
Skipping the first batches:  36%|███▌      | 2172/6000 [2:07:24<3:46:08,  3.54s/it]
Skipping the first batches:  36%|███▌      | 2173/6000 [2:07:27<3:39:42,  3.44s/it]
Skipping the first batches:  36%|███▌      | 2174/6000 [2:07:30<3:34:38,  3.37s/it]
Skipping the first batches:  36%|███▋      | 2175/6000 [2:07:34<3:38:50,  3.43s/it]
Skipping the first batches:  36%|███▋      | 2176/6000 [2:07:37<3:37:59,  3.42s/it]
Skipping the first batches:  36%|███▋      | 2177/6000 [2:07:41<3:36:21,  3.40s/it]
Skipping the first batches:  36%|███▋      | 2178/6000 [2:07:44<3:39:39,  3.45s/it]
Skipping the first batches:  36%|███▋      | 2179/6000 [2:07:47<3:32:51,  3.34s/it]
Skipping the first batches:  36%|███▋      | 2180/6000 [2:07:50<3:29:47,  3.30s/it]
Skipping the first batches:  36%|███▋      | 2181/6000 [2:07:54<3:29:48,  3.30s/it]
Skipping the first batches:  36%|███▋      | 2182/6000 [2:07:57<3:28:00,  3.27s/it]
Skipping the first batches:  36%|███▋      | 2183/6000 [2:08:00<3:31:36,  3.33s/it]
Skipping the first batches:  36%|███▋      | 2184/6000 [2:08:04<3:26:59,  3.25s/it]
Skipping the first batches:  36%|███▋      | 2185/6000 [2:08:07<3:30:34,  3.31s/it]
Skipping the first batches:  36%|███▋      | 2186/6000 [2:08:10<3:32:50,  3.35s/it]
Skipping the first batches:  36%|███▋      | 2187/6000 [2:08:14<3:33:25,  3.36s/it]
Skipping the first batches:  36%|███▋      | 2188/6000 [2:08:17<3:36:55,  3.41s/it]
Skipping the first batches:  36%|███▋      | 2189/6000 [2:08:21<3:37:43,  3.43s/it]
Skipping the first batches:  36%|███▋      | 2190/6000 [2:08:24<3:34:00,  3.37s/it]
Skipping the first batches:  37%|███▋      | 2191/6000 [2:08:27<3:31:37,  3.33s/it]
Skipping the first batches:  37%|███▋      | 2192/6000 [2:08:31<3:35:30,  3.40s/it]
Skipping the first batches:  37%|███▋      | 2193/6000 [2:08:34<3:35:17,  3.39s/it]
Skipping the first batches:  37%|███▋      | 2194/6000 [2:08:37<3:29:30,  3.30s/it]
Skipping the first batches:  37%|███▋      | 2195/6000 [2:08:41<3:40:06,  3.47s/it]
Skipping the first batches:  37%|███▋      | 2196/6000 [2:08:45<3:45:02,  3.55s/it]
Skipping the first batches:  37%|███▋      | 2197/6000 [2:08:48<3:39:47,  3.47s/it]
Skipping the first batches:  37%|███▋      | 2198/6000 [2:08:51<3:32:26,  3.35s/it]
Skipping the first batches:  37%|███▋      | 2199/6000 [2:08:55<3:38:31,  3.45s/it]
Skipping the first batches:  37%|███▋      | 2200/6000 [2:08:58<3:39:17,  3.46s/it]
Skipping the first batches:  37%|███▋      | 2201/6000 [2:09:02<3:44:26,  3.54s/it]
Skipping the first batches:  37%|███▋      | 2202/6000 [2:09:06<3:50:41,  3.64s/it]
Skipping the first batches:  37%|███▋      | 2203/6000 [2:09:10<3:47:23,  3.59s/it]
Skipping the first batches:  37%|███▋      | 2204/6000 [2:09:13<3:46:59,  3.59s/it]
Skipping the first batches:  37%|███▋      | 2205/6000 [2:09:16<3:38:42,  3.46s/it]
Skipping the first batches:  37%|███▋      | 2206/6000 [2:09:20<3:52:34,  3.68s/it]
Skipping the first batches:  37%|███▋      | 2207/6000 [2:09:24<3:42:57,  3.53s/it]
Skipping the first batches:  37%|███▋      | 2208/6000 [2:09:27<3:35:00,  3.40s/it]
Skipping the first batches:  37%|███▋      | 2209/6000 [2:09:31<3:43:21,  3.54s/it]
Skipping the first batches:  37%|███▋      | 2210/6000 [2:09:34<3:48:55,  3.62s/it]
Skipping the first batches:  37%|███▋      | 2211/6000 [2:09:38<3:46:21,  3.58s/it]
Skipping the first batches:  37%|███▋      | 2212/6000 [2:09:41<3:44:30,  3.56s/it]
Skipping the first batches:  37%|███▋      | 2213/6000 [2:09:45<3:39:13,  3.47s/it]
Skipping the first batches:  37%|███▋      | 2214/6000 [2:09:48<3:34:50,  3.40s/it]
Skipping the first batches:  37%|███▋      | 2215/6000 [2:09:51<3:30:35,  3.34s/it]
Skipping the first batches:  37%|███▋      | 2216/6000 [2:09:54<3:25:49,  3.26s/it]
Skipping the first batches:  37%|███▋      | 2217/6000 [2:09:58<3:32:45,  3.37s/it]
Skipping the first batches:  37%|███▋      | 2218/6000 [2:10:01<3:32:42,  3.37s/it]
Skipping the first batches:  37%|███▋      | 2219/6000 [2:10:04<3:28:05,  3.30s/it]
Skipping the first batches:  37%|███▋      | 2220/6000 [2:10:09<3:47:34,  3.61s/it]
Skipping the first batches:  37%|███▋      | 2221/6000 [2:10:12<3:41:22,  3.51s/it]
Skipping the first batches:  37%|███▋      | 2222/6000 [2:10:15<3:36:10,  3.43s/it]
Skipping the first batches:  37%|███▋      | 2223/6000 [2:10:19<3:38:37,  3.47s/it]
Skipping the first batches:  37%|███▋      | 2224/6000 [2:10:22<3:35:02,  3.42s/it]
Skipping the first batches:  37%|███▋      | 2225/6000 [2:10:25<3:30:28,  3.35s/it]
Skipping the first batches:  37%|███▋      | 2226/6000 [2:10:29<3:36:05,  3.44s/it]
Skipping the first batches:  37%|███▋      | 2227/6000 [2:10:32<3:33:10,  3.39s/it]
Skipping the first batches:  37%|███▋      | 2228/6000 [2:10:36<3:33:21,  3.39s/it]
Skipping the first batches:  37%|███▋      | 2229/6000 [2:10:39<3:38:38,  3.48s/it]
Skipping the first batches:  37%|███▋      | 2230/6000 [2:10:43<3:35:24,  3.43s/it]
Skipping the first batches:  37%|███▋      | 2231/6000 [2:10:46<3:30:19,  3.35s/it]
Skipping the first batches:  37%|███▋      | 2232/6000 [2:10:50<3:56:58,  3.77s/it]
Skipping the first batches:  37%|███▋      | 2233/6000 [2:10:57<4:46:10,  4.56s/it]
Skipping the first batches:  37%|███▋      | 2234/6000 [2:11:00<4:26:58,  4.25s/it]
Skipping the first batches:  37%|███▋      | 2235/6000 [2:11:04<4:11:21,  4.01s/it]
Skipping the first batches:  37%|███▋      | 2236/6000 [2:11:07<3:56:55,  3.78s/it]
Skipping the first batches:  37%|███▋      | 2237/6000 [2:11:10<3:50:04,  3.67s/it]
Skipping the first batches:  37%|███▋      | 2238/6000 [2:11:15<3:57:09,  3.78s/it]
Skipping the first batches:  37%|███▋      | 2239/6000 [2:11:18<3:44:17,  3.58s/it]
Skipping the first batches:  37%|███▋      | 2240/6000 [2:11:21<3:42:32,  3.55s/it]
Skipping the first batches:  37%|███▋      | 2241/6000 [2:11:25<3:45:52,  3.61s/it]
Skipping the first batches:  37%|███▋      | 2242/6000 [2:11:28<3:43:02,  3.56s/it]
Skipping the first batches:  37%|███▋      | 2243/6000 [2:11:32<3:41:28,  3.54s/it]
Skipping the first batches:  37%|███▋      | 2244/6000 [2:11:35<3:39:01,  3.50s/it]
Skipping the first batches:  37%|███▋      | 2245/6000 [2:11:38<3:31:42,  3.38s/it]
Skipping the first batches:  37%|███▋      | 2246/6000 [2:11:42<3:35:42,  3.45s/it]
Skipping the first batches:  37%|███▋      | 2247/6000 [2:11:45<3:31:55,  3.39s/it]
Skipping the first batches:  37%|███▋      | 2248/6000 [2:11:48<3:29:22,  3.35s/it]
Skipping the first batches:  37%|███▋      | 2249/6000 [2:11:53<3:50:12,  3.68s/it]
Skipping the first batches:  38%|███▊      | 2250/6000 [2:11:56<3:46:47,  3.63s/it]
Skipping the first batches:  38%|███▊      | 2251/6000 [2:12:00<3:41:23,  3.54s/it]
Skipping the first batches:  38%|███▊      | 2252/6000 [2:12:03<3:45:25,  3.61s/it]
Skipping the first batches:  38%|███▊      | 2253/6000 [2:12:07<3:36:06,  3.46s/it]
Skipping the first batches:  38%|███▊      | 2254/6000 [2:12:10<3:32:49,  3.41s/it]
Skipping the first batches:  38%|███▊      | 2255/6000 [2:12:14<3:41:29,  3.55s/it]
Skipping the first batches:  38%|███▊      | 2256/6000 [2:12:17<3:34:39,  3.44s/it]
Skipping the first batches:  38%|███▊      | 2257/6000 [2:12:20<3:34:55,  3.45s/it]
Skipping the first batches:  38%|███▊      | 2258/6000 [2:12:24<3:36:05,  3.46s/it]
Skipping the first batches:  38%|███▊      | 2259/6000 [2:12:27<3:34:23,  3.44s/it]
Skipping the first batches:  38%|███▊      | 2260/6000 [2:12:33<4:22:04,  4.20s/it]
Skipping the first batches:  38%|███▊      | 2261/6000 [2:12:37<4:04:00,  3.92s/it]
Skipping the first batches:  38%|███▊      | 2262/6000 [2:12:40<3:48:13,  3.66s/it]
Skipping the first batches:  38%|███▊      | 2263/6000 [2:12:44<3:56:59,  3.80s/it]
Skipping the first batches:  38%|███▊      | 2264/6000 [2:12:47<3:48:21,  3.67s/it]
Skipping the first batches:  38%|███▊      | 2265/6000 [2:12:50<3:37:57,  3.50s/it]
Skipping the first batches:  38%|███▊      | 2266/6000 [2:12:54<3:47:08,  3.65s/it]
Skipping the first batches:  38%|███▊      | 2267/6000 [2:12:57<3:38:00,  3.50s/it]
Skipping the first batches:  38%|███▊      | 2268/6000 [2:13:01<3:32:16,  3.41s/it]
Skipping the first batches:  38%|███▊      | 2269/6000 [2:13:04<3:34:02,  3.44s/it]
Skipping the first batches:  38%|███▊      | 2270/6000 [2:13:08<3:43:48,  3.60s/it]
Skipping the first batches:  38%|███▊      | 2271/6000 [2:13:13<4:09:32,  4.02s/it]
Skipping the first batches:  38%|███▊      | 2272/6000 [2:13:18<4:19:43,  4.18s/it]
Skipping the first batches:  38%|███▊      | 2273/6000 [2:13:23<4:40:25,  4.51s/it]
Skipping the first batches:  38%|███▊      | 2274/6000 [2:13:27<4:29:49,  4.35s/it]
Skipping the first batches:  38%|███▊      | 2275/6000 [2:13:31<4:21:32,  4.21s/it]
Skipping the first batches:  38%|███▊      | 2276/6000 [2:13:34<4:04:45,  3.94s/it]
Skipping the first batches:  38%|███▊      | 2277/6000 [2:13:37<3:51:54,  3.74s/it]
Skipping the first batches:  38%|███▊      | 2278/6000 [2:13:41<3:50:19,  3.71s/it]
Skipping the first batches:  38%|███▊      | 2279/6000 [2:13:45<3:48:01,  3.68s/it]
Skipping the first batches:  38%|███▊      | 2280/6000 [2:13:48<3:36:29,  3.49s/it]
Skipping the first batches:  38%|███▊      | 2281/6000 [2:13:51<3:34:14,  3.46s/it]
Skipping the first batches:  38%|███▊      | 2282/6000 [2:13:55<3:37:19,  3.51s/it]
Skipping the first batches:  38%|███▊      | 2283/6000 [2:13:58<3:29:32,  3.38s/it]
Skipping the first batches:  38%|███▊      | 2284/6000 [2:14:02<3:38:27,  3.53s/it]
Skipping the first batches:  38%|███▊      | 2285/6000 [2:14:05<3:30:17,  3.40s/it]
Skipping the first batches:  38%|███▊      | 2286/6000 [2:14:08<3:26:37,  3.34s/it]
Skipping the first batches:  38%|███▊      | 2287/6000 [2:14:11<3:25:20,  3.32s/it]
Skipping the first batches:  38%|███▊      | 2288/6000 [2:14:14<3:23:50,  3.29s/it]
Skipping the first batches:  38%|███▊      | 2289/6000 [2:14:18<3:23:38,  3.29s/it]
Skipping the first batches:  38%|███▊      | 2290/6000 [2:14:21<3:21:58,  3.27s/it]
Skipping the first batches:  38%|███▊      | 2291/6000 [2:14:24<3:26:22,  3.34s/it]
Skipping the first batches:  38%|███▊      | 2292/6000 [2:14:28<3:25:09,  3.32s/it]
Skipping the first batches:  38%|███▊      | 2293/6000 [2:14:32<3:35:07,  3.48s/it]
Skipping the first batches:  38%|███▊      | 2294/6000 [2:14:35<3:38:48,  3.54s/it]
Skipping the first batches:  38%|███▊      | 2295/6000 [2:14:38<3:34:06,  3.47s/it]
Skipping the first batches:  38%|███▊      | 2296/6000 [2:14:42<3:26:13,  3.34s/it]
Skipping the first batches:  38%|███▊      | 2297/6000 [2:14:45<3:27:22,  3.36s/it]
Skipping the first batches:  38%|███▊      | 2298/6000 [2:14:49<3:32:44,  3.45s/it]
Skipping the first batches:  38%|███▊      | 2299/6000 [2:14:52<3:30:50,  3.42s/it]
Skipping the first batches:  38%|███▊      | 2300/6000 [2:14:55<3:24:08,  3.31s/it]
Skipping the first batches:  38%|███▊      | 2301/6000 [2:14:58<3:26:33,  3.35s/it]
Skipping the first batches:  38%|███▊      | 2302/6000 [2:15:02<3:22:46,  3.29s/it]
Skipping the first batches:  38%|███▊      | 2303/6000 [2:15:05<3:20:13,  3.25s/it]
Skipping the first batches:  38%|███▊      | 2304/6000 [2:15:09<3:30:57,  3.42s/it]
Skipping the first batches:  38%|███▊      | 2305/6000 [2:15:12<3:29:43,  3.41s/it]
Skipping the first batches:  38%|███▊      | 2306/6000 [2:15:15<3:30:20,  3.42s/it]
Skipping the first batches:  38%|███▊      | 2307/6000 [2:15:19<3:37:26,  3.53s/it]
Skipping the first batches:  38%|███▊      | 2308/6000 [2:15:23<3:36:34,  3.52s/it]
Skipping the first batches:  38%|███▊      | 2309/6000 [2:15:26<3:30:01,  3.41s/it]
Skipping the first batches:  38%|███▊      | 2310/6000 [2:15:30<3:40:34,  3.59s/it]
Skipping the first batches:  39%|███▊      | 2311/6000 [2:15:33<3:34:09,  3.48s/it]
Skipping the first batches:  39%|███▊      | 2312/6000 [2:15:36<3:30:03,  3.42s/it]
Skipping the first batches:  39%|███▊      | 2313/6000 [2:15:40<3:25:17,  3.34s/it]
Skipping the first batches:  39%|███▊      | 2314/6000 [2:15:44<3:52:37,  3.79s/it]
Skipping the first batches:  39%|███▊      | 2315/6000 [2:15:49<4:07:18,  4.03s/it]
Skipping the first batches:  39%|███▊      | 2316/6000 [2:15:54<4:17:54,  4.20s/it]
Skipping the first batches:  39%|███▊      | 2317/6000 [2:15:58<4:14:43,  4.15s/it]
Skipping the first batches:  39%|███▊      | 2318/6000 [2:16:01<3:58:27,  3.89s/it]
Skipping the first batches:  39%|███▊      | 2319/6000 [2:16:05<3:55:16,  3.83s/it]
Skipping the first batches:  39%|███▊      | 2320/6000 [2:16:09<4:04:43,  3.99s/it]
Skipping the first batches:  39%|███▊      | 2321/6000 [2:16:12<3:50:49,  3.76s/it]
Skipping the first batches:  39%|███▊      | 2322/6000 [2:16:15<3:41:48,  3.62s/it]
Skipping the first batches:  39%|███▊      | 2323/6000 [2:16:19<3:38:14,  3.56s/it]
Skipping the first batches:  39%|███▊      | 2324/6000 [2:16:22<3:33:59,  3.49s/it]
Skipping the first batches:  39%|███▉      | 2325/6000 [2:16:26<3:32:05,  3.46s/it]
Skipping the first batches:  39%|███▉      | 2326/6000 [2:16:29<3:35:24,  3.52s/it]
Skipping the first batches:  39%|███▉      | 2327/6000 [2:16:32<3:26:34,  3.37s/it]
Skipping the first batches:  39%|███▉      | 2328/6000 [2:16:35<3:23:50,  3.33s/it]
Skipping the first batches:  39%|███▉      | 2329/6000 [2:16:39<3:27:23,  3.39s/it]
Skipping the first batches:  39%|███▉      | 2330/6000 [2:16:42<3:24:11,  3.34s/it]
Skipping the first batches:  39%|███▉      | 2331/6000 [2:16:46<3:24:40,  3.35s/it]
Skipping the first batches:  39%|███▉      | 2332/6000 [2:16:49<3:24:28,  3.34s/it]
Skipping the first batches:  39%|███▉      | 2333/6000 [2:16:52<3:25:22,  3.36s/it]
Skipping the first batches:  39%|███▉      | 2334/6000 [2:16:56<3:25:58,  3.37s/it]
Skipping the first batches:  39%|███▉      | 2335/6000 [2:16:59<3:20:41,  3.29s/it]
Skipping the first batches:  39%|███▉      | 2336/6000 [2:17:03<3:29:25,  3.43s/it]
Skipping the first batches:  39%|███▉      | 2337/6000 [2:17:06<3:28:52,  3.42s/it]
Skipping the first batches:  39%|███▉      | 2338/6000 [2:17:09<3:25:05,  3.36s/it]
Skipping the first batches:  39%|███▉      | 2339/6000 [2:17:13<3:25:52,  3.37s/it]
Skipping the first batches:  39%|███▉      | 2340/6000 [2:17:16<3:26:54,  3.39s/it]
Skipping the first batches:  39%|███▉      | 2341/6000 [2:17:19<3:22:47,  3.33s/it]
Skipping the first batches:  39%|███▉      | 2342/6000 [2:17:23<3:25:05,  3.36s/it]
Skipping the first batches:  39%|███▉      | 2343/6000 [2:17:26<3:24:52,  3.36s/it]
Skipping the first batches:  39%|███▉      | 2344/6000 [2:17:29<3:22:58,  3.33s/it]
Skipping the first batches:  39%|███▉      | 2345/6000 [2:17:32<3:20:31,  3.29s/it]
Skipping the first batches:  39%|███▉      | 2346/6000 [2:17:36<3:26:07,  3.38s/it]
Skipping the first batches:  39%|███▉      | 2347/6000 [2:17:39<3:22:22,  3.32s/it]
Skipping the first batches:  39%|███▉      | 2348/6000 [2:17:43<3:21:42,  3.31s/it]
Skipping the first batches:  39%|███▉      | 2349/6000 [2:17:46<3:25:52,  3.38s/it]
Skipping the first batches:  39%|███▉      | 2350/6000 [2:17:50<3:32:11,  3.49s/it]
Skipping the first batches:  39%|███▉      | 2351/6000 [2:17:53<3:32:07,  3.49s/it]
Skipping the first batches:  39%|███▉      | 2352/6000 [2:17:57<3:31:25,  3.48s/it]
Skipping the first batches:  39%|███▉      | 2353/6000 [2:18:00<3:26:49,  3.40s/it]
Skipping the first batches:  39%|███▉      | 2354/6000 [2:18:03<3:21:57,  3.32s/it]
Skipping the first batches:  39%|███▉      | 2355/6000 [2:18:07<3:27:56,  3.42s/it]
Skipping the first batches:  39%|███▉      | 2356/6000 [2:18:10<3:26:18,  3.40s/it]
Skipping the first batches:  39%|███▉      | 2357/6000 [2:18:13<3:21:14,  3.31s/it]
Skipping the first batches:  39%|███▉      | 2358/6000 [2:18:17<3:25:13,  3.38s/it]
Skipping the first batches:  39%|███▉      | 2359/6000 [2:18:20<3:31:10,  3.48s/it]
Skipping the first batches:  39%|███▉      | 2360/6000 [2:18:24<3:35:12,  3.55s/it]
Skipping the first batches:  39%|███▉      | 2361/6000 [2:18:28<3:43:32,  3.69s/it]
Skipping the first batches:  39%|███▉      | 2362/6000 [2:18:32<3:40:08,  3.63s/it]
Skipping the first batches:  39%|███▉      | 2363/6000 [2:18:35<3:33:24,  3.52s/it]
Skipping the first batches:  39%|███▉      | 2364/6000 [2:18:38<3:25:04,  3.38s/it]
Skipping the first batches:  39%|███▉      | 2365/6000 [2:18:42<3:29:21,  3.46s/it]
Skipping the first batches:  39%|███▉      | 2366/6000 [2:18:45<3:26:24,  3.41s/it]
Skipping the first batches:  39%|███▉      | 2367/6000 [2:18:48<3:23:58,  3.37s/it]
Skipping the first batches:  39%|███▉      | 2368/6000 [2:18:51<3:18:57,  3.29s/it]
Skipping the first batches:  39%|███▉      | 2369/6000 [2:18:55<3:26:39,  3.41s/it]
Skipping the first batches:  40%|███▉      | 2370/6000 [2:18:58<3:26:17,  3.41s/it]
Skipping the first batches:  40%|███▉      | 2371/6000 [2:19:02<3:26:51,  3.42s/it]
Skipping the first batches:  40%|███▉      | 2372/6000 [2:19:05<3:27:36,  3.43s/it]
Skipping the first batches:  40%|███▉      | 2373/6000 [2:19:09<3:33:48,  3.54s/it]
Skipping the first batches:  40%|███▉      | 2374/6000 [2:19:12<3:28:12,  3.45s/it]
Skipping the first batches:  40%|███▉      | 2375/6000 [2:19:15<3:21:28,  3.33s/it]
Skipping the first batches:  40%|███▉      | 2376/6000 [2:19:19<3:25:42,  3.41s/it]
Skipping the first batches:  40%|███▉      | 2377/6000 [2:19:22<3:20:23,  3.32s/it]
Skipping the first batches:  40%|███▉      | 2378/6000 [2:19:26<3:22:25,  3.35s/it]
Skipping the first batches:  40%|███▉      | 2379/6000 [2:19:29<3:21:15,  3.33s/it]
Skipping the first batches:  40%|███▉      | 2380/6000 [2:19:33<3:27:03,  3.43s/it]
Skipping the first batches:  40%|███▉      | 2381/6000 [2:19:36<3:24:10,  3.39s/it]
Skipping the first batches:  40%|███▉      | 2382/6000 [2:19:39<3:20:30,  3.33s/it]
Skipping the first batches:  40%|███▉      | 2383/6000 [2:19:42<3:23:10,  3.37s/it]
Skipping the first batches:  40%|███▉      | 2384/6000 [2:19:46<3:22:51,  3.37s/it]
Skipping the first batches:  40%|███▉      | 2385/6000 [2:19:49<3:22:19,  3.36s/it]
Skipping the first batches:  40%|███▉      | 2386/6000 [2:19:52<3:21:35,  3.35s/it]
Skipping the first batches:  40%|███▉      | 2387/6000 [2:19:56<3:27:36,  3.45s/it]
Skipping the first batches:  40%|███▉      | 2388/6000 [2:19:59<3:25:28,  3.41s/it]
Skipping the first batches:  40%|███▉      | 2389/6000 [2:20:03<3:19:41,  3.32s/it]
Skipping the first batches:  40%|███▉      | 2390/6000 [2:20:06<3:24:59,  3.41s/it]
Skipping the first batches:  40%|███▉      | 2391/6000 [2:20:10<3:23:23,  3.38s/it]
Skipping the first batches:  40%|███▉      | 2392/6000 [2:20:13<3:17:40,  3.29s/it]
Skipping the first batches:  40%|███▉      | 2393/6000 [2:20:16<3:20:05,  3.33s/it]
Skipping the first batches:  40%|███▉      | 2394/6000 [2:20:19<3:21:23,  3.35s/it]
Skipping the first batches:  40%|███▉      | 2395/6000 [2:20:23<3:25:41,  3.42s/it]
Skipping the first batches:  40%|███▉      | 2396/6000 [2:20:26<3:22:33,  3.37s/it]
Skipping the first batches:  40%|███▉      | 2397/6000 [2:20:29<3:17:10,  3.28s/it]
Skipping the first batches:  40%|███▉      | 2398/6000 [2:20:33<3:22:25,  3.37s/it]
Skipping the first batches:  40%|███▉      | 2399/6000 [2:20:37<3:29:34,  3.49s/it]
Skipping the first batches:  40%|████      | 2400/6000 [2:20:40<3:22:02,  3.37s/it]
Skipping the first batches:  40%|████      | 2401/6000 [2:20:43<3:25:23,  3.42s/it]
Skipping the first batches:  40%|████      | 2402/6000 [2:20:46<3:18:42,  3.31s/it]
Skipping the first batches:  40%|████      | 2403/6000 [2:20:50<3:19:37,  3.33s/it]
Skipping the first batches:  40%|████      | 2404/6000 [2:20:53<3:22:20,  3.38s/it]
Skipping the first batches:  40%|████      | 2405/6000 [2:20:57<3:28:43,  3.48s/it]
Skipping the first batches:  40%|████      | 2406/6000 [2:21:00<3:22:21,  3.38s/it]
Skipping the first batches:  40%|████      | 2407/6000 [2:21:04<3:24:50,  3.42s/it]
Skipping the first batches:  40%|████      | 2408/6000 [2:21:07<3:19:23,  3.33s/it]
Skipping the first batches:  40%|████      | 2409/6000 [2:21:10<3:19:47,  3.34s/it]
Skipping the first batches:  40%|████      | 2410/6000 [2:21:13<3:20:06,  3.34s/it]
Skipping the first batches:  40%|████      | 2411/6000 [2:21:17<3:22:53,  3.39s/it]
Skipping the first batches:  40%|████      | 2412/6000 [2:21:21<3:27:23,  3.47s/it]
Skipping the first batches:  40%|████      | 2413/6000 [2:21:24<3:27:11,  3.47s/it]
Skipping the first batches:  40%|████      | 2414/6000 [2:21:28<3:31:30,  3.54s/it]
Skipping the first batches:  40%|████      | 2415/6000 [2:21:31<3:24:11,  3.42s/it]
Skipping the first batches:  40%|████      | 2416/6000 [2:21:34<3:24:54,  3.43s/it]
Skipping the first batches:  40%|████      | 2417/6000 [2:21:38<3:30:20,  3.52s/it]
Skipping the first batches:  40%|████      | 2418/6000 [2:21:41<3:22:38,  3.39s/it]
Skipping the first batches:  40%|████      | 2419/6000 [2:21:44<3:20:36,  3.36s/it]
Skipping the first batches:  40%|████      | 2420/6000 [2:21:48<3:26:11,  3.46s/it]
Skipping the first batches:  40%|████      | 2421/6000 [2:21:52<3:24:42,  3.43s/it]
Skipping the first batches:  40%|████      | 2422/6000 [2:21:55<3:22:45,  3.40s/it]
Skipping the first batches:  40%|████      | 2423/6000 [2:21:58<3:21:36,  3.38s/it]
Skipping the first batches:  40%|████      | 2424/6000 [2:22:01<3:19:28,  3.35s/it]
Skipping the first batches:  40%|████      | 2425/6000 [2:22:05<3:22:47,  3.40s/it]
Skipping the first batches:  40%|████      | 2426/6000 [2:22:08<3:17:33,  3.32s/it]
Skipping the first batches:  40%|████      | 2427/6000 [2:22:12<3:21:31,  3.38s/it]
Skipping the first batches:  40%|████      | 2428/6000 [2:22:15<3:21:28,  3.38s/it]
Skipping the first batches:  40%|████      | 2429/6000 [2:22:18<3:15:52,  3.29s/it]
Skipping the first batches:  40%|████      | 2430/6000 [2:22:21<3:17:36,  3.32s/it]
Skipping the first batches:  41%|████      | 2431/6000 [2:22:26<3:32:31,  3.57s/it]
Skipping the first batches:  41%|████      | 2432/6000 [2:22:29<3:28:09,  3.50s/it]
Skipping the first batches:  41%|████      | 2433/6000 [2:22:33<3:28:44,  3.51s/it]
Skipping the first batches:  41%|████      | 2434/6000 [2:22:36<3:34:33,  3.61s/it]
Skipping the first batches:  41%|████      | 2435/6000 [2:22:40<3:32:56,  3.58s/it]
Skipping the first batches:  41%|████      | 2436/6000 [2:22:43<3:26:29,  3.48s/it]
Skipping the first batches:  41%|████      | 2437/6000 [2:22:47<3:31:51,  3.57s/it]
Skipping the first batches:  41%|████      | 2438/6000 [2:22:50<3:23:45,  3.43s/it]
Skipping the first batches:  41%|████      | 2439/6000 [2:22:53<3:24:20,  3.44s/it]
Skipping the first batches:  41%|████      | 2440/6000 [2:22:57<3:31:53,  3.57s/it]
Skipping the first batches:  41%|████      | 2441/6000 [2:23:01<3:27:23,  3.50s/it]
Skipping the first batches:  41%|████      | 2442/6000 [2:23:04<3:25:39,  3.47s/it]
Skipping the first batches:  41%|████      | 2443/6000 [2:23:08<3:25:01,  3.46s/it]
Skipping the first batches:  41%|████      | 2444/6000 [2:23:11<3:20:31,  3.38s/it]
Skipping the first batches:  41%|████      | 2445/6000 [2:23:14<3:18:34,  3.35s/it]
Skipping the first batches:  41%|████      | 2446/6000 [2:23:17<3:15:35,  3.30s/it]
Skipping the first batches:  41%|████      | 2447/6000 [2:23:21<3:19:05,  3.36s/it]
Skipping the first batches:  41%|████      | 2448/6000 [2:23:24<3:18:11,  3.35s/it]
Skipping the first batches:  41%|████      | 2449/6000 [2:23:27<3:13:13,  3.26s/it]
Skipping the first batches:  41%|████      | 2450/6000 [2:23:31<3:29:44,  3.54s/it]
Skipping the first batches:  41%|████      | 2451/6000 [2:23:35<3:26:39,  3.49s/it]
Skipping the first batches:  41%|████      | 2452/6000 [2:23:40<3:52:34,  3.93s/it]
Skipping the first batches:  41%|████      | 2453/6000 [2:23:45<4:17:41,  4.36s/it]
Skipping the first batches:  41%|████      | 2454/6000 [2:23:50<4:34:00,  4.64s/it]
Skipping the first batches:  41%|████      | 2455/6000 [2:23:56<4:48:35,  4.88s/it]
Skipping the first batches:  41%|████      | 2456/6000 [2:24:00<4:44:54,  4.82s/it]
Skipping the first batches:  41%|████      | 2457/6000 [2:24:04<4:20:32,  4.41s/it]
Skipping the first batches:  41%|████      | 2458/6000 [2:24:08<4:21:21,  4.43s/it]
Skipping the first batches:  41%|████      | 2459/6000 [2:24:13<4:26:23,  4.51s/it]
Skipping the first batches:  41%|████      | 2460/6000 [2:24:18<4:36:00,  4.68s/it]
Skipping the first batches:  41%|████      | 2461/6000 [2:24:22<4:18:52,  4.39s/it]
Skipping the first batches:  41%|████      | 2462/6000 [2:24:26<4:09:09,  4.23s/it]
Skipping the first batches:  41%|████      | 2463/6000 [2:24:29<3:53:38,  3.96s/it]
Skipping the first batches:  41%|████      | 2464/6000 [2:24:32<3:39:39,  3.73s/it]
Skipping the first batches:  41%|████      | 2465/6000 [2:24:36<3:38:29,  3.71s/it]
Skipping the first batches:  41%|████      | 2466/6000 [2:24:40<3:38:07,  3.70s/it]
Skipping the first batches:  41%|████      | 2467/6000 [2:24:43<3:28:36,  3.54s/it]
Skipping the first batches:  41%|████      | 2468/6000 [2:24:46<3:29:38,  3.56s/it]
Skipping the first batches:  41%|████      | 2469/6000 [2:24:50<3:29:43,  3.56s/it]
Skipping the first batches:  41%|████      | 2470/6000 [2:24:53<3:21:49,  3.43s/it]
Skipping the first batches:  41%|████      | 2471/6000 [2:24:56<3:20:09,  3.40s/it]
Skipping the first batches:  41%|████      | 2472/6000 [2:25:00<3:26:57,  3.52s/it]
Skipping the first batches:  41%|████      | 2473/6000 [2:25:03<3:23:15,  3.46s/it]
Skipping the first batches:  41%|████      | 2474/6000 [2:25:07<3:17:44,  3.36s/it]
Skipping the first batches:  41%|████▏     | 2475/6000 [2:25:10<3:24:03,  3.47s/it]
Skipping the first batches:  41%|████▏     | 2476/6000 [2:25:13<3:18:42,  3.38s/it]
Skipping the first batches:  41%|████▏     | 2477/6000 [2:25:17<3:20:21,  3.41s/it]
Skipping the first batches:  41%|████▏     | 2478/6000 [2:25:20<3:19:37,  3.40s/it]
Skipping the first batches:  41%|████▏     | 2479/6000 [2:25:24<3:28:22,  3.55s/it]
Skipping the first batches:  41%|████▏     | 2480/6000 [2:25:27<3:23:12,  3.46s/it]
Skipping the first batches:  41%|████▏     | 2481/6000 [2:25:31<3:24:14,  3.48s/it]
Skipping the first batches:  41%|████▏     | 2482/6000 [2:25:35<3:25:23,  3.50s/it]
Skipping the first batches:  41%|████▏     | 2483/6000 [2:25:38<3:22:14,  3.45s/it]
Skipping the first batches:  41%|████▏     | 2484/6000 [2:25:43<3:49:11,  3.91s/it]
Skipping the first batches:  41%|████▏     | 2485/6000 [2:25:48<4:06:06,  4.20s/it]
Skipping the first batches:  41%|████▏     | 2486/6000 [2:25:53<4:26:18,  4.55s/it]
Skipping the first batches:  41%|████▏     | 2487/6000 [2:25:59<4:43:13,  4.84s/it]
Skipping the first batches:  41%|████▏     | 2488/6000 [2:26:02<4:15:47,  4.37s/it]
Skipping the first batches:  41%|████▏     | 2489/6000 [2:26:05<3:56:33,  4.04s/it]
Skipping the first batches:  42%|████▏     | 2490/6000 [2:26:08<3:42:57,  3.81s/it]
Skipping the first batches:  42%|████▏     | 2491/6000 [2:26:12<3:42:59,  3.81s/it]
Skipping the first batches:  42%|████▏     | 2492/6000 [2:26:16<3:37:01,  3.71s/it]
Skipping the first batches:  42%|████▏     | 2493/6000 [2:26:22<4:24:14,  4.52s/it]
Skipping the first batches:  42%|████▏     | 2494/6000 [2:26:25<3:59:44,  4.10s/it]
Skipping the first batches:  42%|████▏     | 2495/6000 [2:26:29<3:53:28,  4.00s/it]
Skipping the first batches:  42%|████▏     | 2496/6000 [2:26:32<3:42:34,  3.81s/it]
Skipping the first batches:  42%|████▏     | 2497/6000 [2:26:36<3:38:42,  3.75s/it]
Skipping the first batches:  42%|████▏     | 2498/6000 [2:26:40<3:34:52,  3.68s/it]
Skipping the first batches:  42%|████▏     | 2499/6000 [2:26:43<3:27:46,  3.56s/it]
Skipping the first batches:  42%|████▏     | 2500/6000 [2:26:46<3:22:10,  3.47s/it]
Skipping the first batches:  42%|████▏     | 2501/6000 [2:26:50<3:24:03,  3.50s/it]
Skipping the first batches:  42%|████▏     | 2502/6000 [2:26:54<3:41:08,  3.79s/it]
Skipping the first batches:  42%|████▏     | 2503/6000 [2:26:58<3:37:31,  3.73s/it]
Skipping the first batches:  42%|████▏     | 2504/6000 [2:27:01<3:33:36,  3.67s/it]
Skipping the first batches:  42%|████▏     | 2505/6000 [2:27:07<4:08:59,  4.27s/it]
Skipping the first batches:  42%|████▏     | 2506/6000 [2:27:12<4:24:39,  4.54s/it]
Skipping the first batches:  42%|████▏     | 2507/6000 [2:27:16<4:19:46,  4.46s/it]
Skipping the first batches:  42%|████▏     | 2508/6000 [2:27:20<4:01:40,  4.15s/it]
Skipping the first batches:  42%|████▏     | 2509/6000 [2:27:23<3:45:16,  3.87s/it]
Skipping the first batches:  42%|████▏     | 2510/6000 [2:27:26<3:37:35,  3.74s/it]
Skipping the first batches:  42%|████▏     | 2511/6000 [2:27:31<3:49:26,  3.95s/it]
Skipping the first batches:  42%|████▏     | 2512/6000 [2:27:34<3:35:22,  3.70s/it]
Skipping the first batches:  42%|████▏     | 2513/6000 [2:27:38<3:32:04,  3.65s/it]
Skipping the first batches:  42%|████▏     | 2514/6000 [2:27:41<3:29:18,  3.60s/it]
Skipping the first batches:  42%|████▏     | 2515/6000 [2:27:44<3:26:37,  3.56s/it]
Skipping the first batches:  42%|████▏     | 2516/6000 [2:27:48<3:23:40,  3.51s/it]
Skipping the first batches:  42%|████▏     | 2517/6000 [2:27:51<3:17:10,  3.40s/it]
Skipping the first batches:  42%|████▏     | 2518/6000 [2:27:55<3:21:51,  3.48s/it]
Skipping the first batches:  42%|████▏     | 2519/6000 [2:27:58<3:18:25,  3.42s/it]
Skipping the first batches:  42%|████▏     | 2520/6000 [2:28:01<3:11:58,  3.31s/it]
Skipping the first batches:  42%|████▏     | 2521/6000 [2:28:05<3:22:37,  3.49s/it]
Skipping the first batches:  42%|████▏     | 2522/6000 [2:28:09<3:25:15,  3.54s/it]
Skipping the first batches:  42%|████▏     | 2523/6000 [2:28:12<3:25:10,  3.54s/it]
Skipping the first batches:  42%|████▏     | 2524/6000 [2:28:16<3:26:05,  3.56s/it]
Skipping the first batches:  42%|████▏     | 2525/6000 [2:28:19<3:21:33,  3.48s/it]
Skipping the first batches:  42%|████▏     | 2526/6000 [2:28:23<3:24:04,  3.52s/it]
Skipping the first batches:  42%|████▏     | 2527/6000 [2:28:26<3:28:08,  3.60s/it]
Skipping the first batches:  42%|████▏     | 2528/6000 [2:28:30<3:27:00,  3.58s/it]
Skipping the first batches:  42%|████▏     | 2529/6000 [2:28:33<3:22:08,  3.49s/it]
Skipping the first batches:  42%|████▏     | 2530/6000 [2:28:37<3:19:57,  3.46s/it]
Skipping the first batches:  42%|████▏     | 2531/6000 [2:28:40<3:17:10,  3.41s/it]
Skipping the first batches:  42%|████▏     | 2532/6000 [2:28:43<3:19:49,  3.46s/it]
Skipping the first batches:  42%|████▏     | 2533/6000 [2:28:47<3:22:09,  3.50s/it]
Skipping the first batches:  42%|████▏     | 2534/6000 [2:28:50<3:20:04,  3.46s/it]
Skipping the first batches:  42%|████▏     | 2535/6000 [2:28:54<3:14:32,  3.37s/it]
Skipping the first batches:  42%|████▏     | 2536/6000 [2:28:58<3:28:21,  3.61s/it]
Skipping the first batches:  42%|████▏     | 2537/6000 [2:29:01<3:25:30,  3.56s/it]
Skipping the first batches:  42%|████▏     | 2538/6000 [2:29:05<3:22:10,  3.50s/it]
Skipping the first batches:  42%|████▏     | 2539/6000 [2:29:08<3:20:22,  3.47s/it]
Skipping the first batches:  42%|████▏     | 2540/6000 [2:29:11<3:17:20,  3.42s/it]
Skipping the first batches:  42%|████▏     | 2541/6000 [2:29:14<3:12:21,  3.34s/it]
Skipping the first batches:  42%|████▏     | 2542/6000 [2:29:18<3:12:55,  3.35s/it]
Skipping the first batches:  42%|████▏     | 2543/6000 [2:29:21<3:13:53,  3.37s/it]
Skipping the first batches:  42%|████▏     | 2544/6000 [2:29:24<3:09:51,  3.30s/it]
Skipping the first batches:  42%|████▏     | 2545/6000 [2:29:28<3:18:57,  3.46s/it]
Skipping the first batches:  42%|████▏     | 2546/6000 [2:29:33<3:37:41,  3.78s/it]
Skipping the first batches:  42%|████▏     | 2547/6000 [2:29:36<3:27:05,  3.60s/it]
Skipping the first batches:  42%|████▏     | 2548/6000 [2:29:41<3:50:57,  4.01s/it]
Skipping the first batches:  42%|████▏     | 2549/6000 [2:29:44<3:35:27,  3.75s/it]
Skipping the first batches:  42%|████▎     | 2550/6000 [2:29:47<3:25:38,  3.58s/it]
Skipping the first batches:  43%|████▎     | 2551/6000 [2:29:51<3:35:43,  3.75s/it]
Skipping the first batches:  43%|████▎     | 2552/6000 [2:29:54<3:24:19,  3.56s/it]
Skipping the first batches:  43%|████▎     | 2553/6000 [2:29:58<3:18:11,  3.45s/it]
Skipping the first batches:  43%|████▎     | 2554/6000 [2:30:02<3:28:43,  3.63s/it]
Skipping the first batches:  43%|████▎     | 2555/6000 [2:30:05<3:23:33,  3.55s/it]
Skipping the first batches:  43%|████▎     | 2556/6000 [2:30:08<3:17:12,  3.44s/it]
Skipping the first batches:  43%|████▎     | 2557/6000 [2:30:11<3:13:29,  3.37s/it]
Skipping the first batches:  43%|████▎     | 2558/6000 [2:30:15<3:22:06,  3.52s/it]
Skipping the first batches:  43%|████▎     | 2559/6000 [2:30:18<3:14:04,  3.38s/it]
Skipping the first batches:  43%|████▎     | 2560/6000 [2:30:22<3:18:02,  3.45s/it]
Skipping the first batches:  43%|████▎     | 2561/6000 [2:30:25<3:14:02,  3.39s/it]
Skipping the first batches:  43%|████▎     | 2562/6000 [2:30:29<3:14:17,  3.39s/it]
Skipping the first batches:  43%|████▎     | 2563/6000 [2:30:32<3:13:32,  3.38s/it]
Skipping the first batches:  43%|████▎     | 2564/6000 [2:30:35<3:13:40,  3.38s/it]
Skipping the first batches:  43%|████▎     | 2565/6000 [2:30:39<3:10:51,  3.33s/it]
Skipping the first batches:  43%|████▎     | 2566/6000 [2:30:42<3:15:13,  3.41s/it]
Skipping the first batches:  43%|████▎     | 2567/6000 [2:30:45<3:11:11,  3.34s/it]
Skipping the first batches:  43%|████▎     | 2568/6000 [2:30:49<3:09:45,  3.32s/it]
Skipping the first batches:  43%|████▎     | 2569/6000 [2:30:52<3:10:22,  3.33s/it]
Skipping the first batches:  43%|████▎     | 2570/6000 [2:30:56<3:15:27,  3.42s/it]
Skipping the first batches:  43%|████▎     | 2571/6000 [2:30:59<3:09:15,  3.31s/it]
Skipping the first batches:  43%|████▎     | 2572/6000 [2:31:02<3:10:10,  3.33s/it]
Skipping the first batches:  43%|████▎     | 2573/6000 [2:31:05<3:12:23,  3.37s/it]
Skipping the first batches:  43%|████▎     | 2574/6000 [2:31:09<3:10:53,  3.34s/it]
Skipping the first batches:  43%|████▎     | 2575/6000 [2:31:12<3:10:17,  3.33s/it]
Skipping the first batches:  43%|████▎     | 2576/6000 [2:31:15<3:10:00,  3.33s/it]
Skipping the first batches:  43%|████▎     | 2577/6000 [2:31:19<3:12:00,  3.37s/it]
Skipping the first batches:  43%|████▎     | 2578/6000 [2:31:22<3:08:28,  3.30s/it]
Skipping the first batches:  43%|████▎     | 2579/6000 [2:31:25<3:08:14,  3.30s/it]
Skipping the first batches:  43%|████▎     | 2580/6000 [2:31:29<3:21:04,  3.53s/it]
Skipping the first batches:  43%|████▎     | 2581/6000 [2:31:33<3:24:15,  3.58s/it]
Skipping the first batches:  43%|████▎     | 2582/6000 [2:31:36<3:20:01,  3.51s/it]
Skipping the first batches:  43%|████▎     | 2583/6000 [2:31:40<3:15:24,  3.43s/it]
Skipping the first batches:  43%|████▎     | 2584/6000 [2:31:43<3:12:59,  3.39s/it]
Skipping the first batches:  43%|████▎     | 2585/6000 [2:31:47<3:30:49,  3.70s/it]
Skipping the first batches:  43%|████▎     | 2586/6000 [2:31:51<3:31:20,  3.71s/it]
Skipping the first batches:  43%|████▎     | 2587/6000 [2:31:55<3:27:32,  3.65s/it]
Skipping the first batches:  43%|████▎     | 2588/6000 [2:31:58<3:29:31,  3.68s/it]
Skipping the first batches:  43%|████▎     | 2589/6000 [2:32:02<3:33:33,  3.76s/it]
Skipping the first batches:  43%|████▎     | 2590/6000 [2:32:07<3:52:13,  4.09s/it]
Skipping the first batches:  43%|████▎     | 2591/6000 [2:32:11<3:41:00,  3.89s/it]
Skipping the first batches:  43%|████▎     | 2592/6000 [2:32:14<3:31:04,  3.72s/it]
Skipping the first batches:  43%|████▎     | 2593/6000 [2:32:17<3:23:12,  3.58s/it]
Skipping the first batches:  43%|████▎     | 2594/6000 [2:32:21<3:23:10,  3.58s/it]
Skipping the first batches:  43%|████▎     | 2595/6000 [2:32:24<3:19:14,  3.51s/it]
Skipping the first batches:  43%|████▎     | 2596/6000 [2:32:27<3:13:27,  3.41s/it]
Skipping the first batches:  43%|████▎     | 2597/6000 [2:32:31<3:20:48,  3.54s/it]
Skipping the first batches:  43%|████▎     | 2598/6000 [2:32:34<3:13:59,  3.42s/it]
Skipping the first batches:  43%|████▎     | 2599/6000 [2:32:38<3:15:54,  3.46s/it]
Skipping the first batches:  43%|████▎     | 2600/6000 [2:32:41<3:17:09,  3.48s/it]
Skipping the first batches:  43%|████▎     | 2601/6000 [2:32:44<3:11:10,  3.37s/it]
Skipping the first batches:  43%|████▎     | 2602/6000 [2:32:48<3:12:48,  3.40s/it]
Skipping the first batches:  43%|████▎     | 2603/6000 [2:32:52<3:15:48,  3.46s/it]
Skipping the first batches:  43%|████▎     | 2604/6000 [2:32:55<3:15:01,  3.45s/it]
Skipping the first batches:  43%|████▎     | 2605/6000 [2:32:59<3:18:37,  3.51s/it]
Skipping the first batches:  43%|████▎     | 2606/6000 [2:33:02<3:13:18,  3.42s/it]
Skipping the first batches:  43%|████▎     | 2607/6000 [2:33:05<3:10:30,  3.37s/it]
Skipping the first batches:  43%|████▎     | 2608/6000 [2:33:09<3:20:35,  3.55s/it]
Skipping the first batches:  43%|████▎     | 2609/6000 [2:33:12<3:15:50,  3.47s/it]
Skipping the first batches:  44%|████▎     | 2610/6000 [2:33:16<3:11:48,  3.39s/it]
Skipping the first batches:  44%|████▎     | 2611/6000 [2:33:19<3:16:26,  3.48s/it]
Skipping the first batches:  44%|████▎     | 2612/6000 [2:33:23<3:18:54,  3.52s/it]
Skipping the first batches:  44%|████▎     | 2613/6000 [2:33:27<3:23:21,  3.60s/it]
Skipping the first batches:  44%|████▎     | 2614/6000 [2:33:30<3:22:55,  3.60s/it]
Skipping the first batches:  44%|████▎     | 2615/6000 [2:33:34<3:25:24,  3.64s/it]
Skipping the first batches:  44%|████▎     | 2616/6000 [2:33:37<3:16:41,  3.49s/it]
Skipping the first batches:  44%|████▎     | 2617/6000 [2:33:41<3:21:55,  3.58s/it]
Skipping the first batches:  44%|████▎     | 2618/6000 [2:33:45<3:38:40,  3.88s/it]
Skipping the first batches:  44%|████▎     | 2619/6000 [2:33:50<3:42:36,  3.95s/it]
Skipping the first batches:  44%|████▎     | 2620/6000 [2:33:54<3:51:47,  4.11s/it]
Skipping the first batches:  44%|████▎     | 2621/6000 [2:33:58<3:48:20,  4.05s/it]
Skipping the first batches:  44%|████▎     | 2622/6000 [2:34:02<3:42:54,  3.96s/it]
Skipping the first batches:  44%|████▎     | 2623/6000 [2:34:06<3:41:27,  3.93s/it]
Skipping the first batches:  44%|████▎     | 2624/6000 [2:34:10<3:41:25,  3.94s/it]
Skipping the first batches:  44%|████▍     | 2625/6000 [2:34:13<3:40:50,  3.93s/it]
Skipping the first batches:  44%|████▍     | 2626/6000 [2:34:18<3:49:31,  4.08s/it]
Skipping the first batches:  44%|████▍     | 2627/6000 [2:34:22<3:54:44,  4.18s/it]
Skipping the first batches:  44%|████▍     | 2628/6000 [2:34:26<3:45:48,  4.02s/it]
Skipping the first batches:  44%|████▍     | 2629/6000 [2:34:29<3:36:07,  3.85s/it]
Skipping the first batches:  44%|████▍     | 2630/6000 [2:34:33<3:29:20,  3.73s/it]
Skipping the first batches:  44%|████▍     | 2631/6000 [2:34:36<3:21:52,  3.60s/it]
Skipping the first batches:  44%|████▍     | 2632/6000 [2:34:39<3:15:12,  3.48s/it]
Skipping the first batches:  44%|████▍     | 2633/6000 [2:34:43<3:14:14,  3.46s/it]
Skipping the first batches:  44%|████▍     | 2634/6000 [2:34:46<3:16:15,  3.50s/it]
Skipping the first batches:  44%|████▍     | 2635/6000 [2:34:50<3:25:08,  3.66s/it]
Skipping the first batches:  44%|████▍     | 2636/6000 [2:34:54<3:19:01,  3.55s/it]
Skipping the first batches:  44%|████▍     | 2637/6000 [2:34:57<3:13:33,  3.45s/it]
Skipping the first batches:  44%|████▍     | 2638/6000 [2:35:00<3:11:36,  3.42s/it]
Skipping the first batches:  44%|████▍     | 2639/6000 [2:35:04<3:13:12,  3.45s/it]
Skipping the first batches:  44%|████▍     | 2640/6000 [2:35:07<3:15:51,  3.50s/it]
Skipping the first batches:  44%|████▍     | 2641/6000 [2:35:11<3:14:53,  3.48s/it]
Skipping the first batches:  44%|████▍     | 2642/6000 [2:35:14<3:11:54,  3.43s/it]
Skipping the first batches:  44%|████▍     | 2643/6000 [2:35:18<3:22:00,  3.61s/it]
Skipping the first batches:  44%|████▍     | 2644/6000 [2:35:22<3:20:24,  3.58s/it]
Skipping the first batches:  44%|████▍     | 2645/6000 [2:35:25<3:13:41,  3.46s/it]
Skipping the first batches:  44%|████▍     | 2646/6000 [2:35:28<3:12:10,  3.44s/it]
Skipping the first batches:  44%|████▍     | 2647/6000 [2:35:32<3:14:22,  3.48s/it]
Skipping the first batches:  44%|████▍     | 2648/6000 [2:35:35<3:11:40,  3.43s/it]
Skipping the first batches:  44%|████▍     | 2649/6000 [2:35:39<3:12:23,  3.44s/it]
Skipping the first batches:  44%|████▍     | 2650/6000 [2:35:42<3:13:32,  3.47s/it]
Skipping the first batches:  44%|████▍     | 2651/6000 [2:35:46<3:20:16,  3.59s/it]
Skipping the first batches:  44%|████▍     | 2652/6000 [2:35:49<3:17:15,  3.54s/it]
Skipping the first batches:  44%|████▍     | 2653/6000 [2:35:53<3:15:02,  3.50s/it]
Skipping the first batches:  44%|████▍     | 2654/6000 [2:35:56<3:13:03,  3.46s/it]
Skipping the first batches:  44%|████▍     | 2655/6000 [2:35:59<3:09:25,  3.40s/it]
Skipping the first batches:  44%|████▍     | 2656/6000 [2:36:03<3:07:23,  3.36s/it]
Skipping the first batches:  44%|████▍     | 2657/6000 [2:36:06<3:11:50,  3.44s/it]
Skipping the first batches:  44%|████▍     | 2658/6000 [2:36:10<3:08:40,  3.39s/it]
Skipping the first batches:  44%|████▍     | 2659/6000 [2:36:13<3:13:17,  3.47s/it]
Skipping the first batches:  44%|████▍     | 2660/6000 [2:36:16<3:08:10,  3.38s/it]
Skipping the first batches:  44%|████▍     | 2661/6000 [2:36:20<3:09:57,  3.41s/it]
Skipping the first batches:  44%|████▍     | 2662/6000 [2:36:24<3:18:58,  3.58s/it]
Skipping the first batches:  44%|████▍     | 2663/6000 [2:36:27<3:10:41,  3.43s/it]
Skipping the first batches:  44%|████▍     | 2664/6000 [2:36:30<3:12:01,  3.45s/it]
Skipping the first batches:  44%|████▍     | 2665/6000 [2:36:34<3:11:32,  3.45s/it]
Skipping the first batches:  44%|████▍     | 2666/6000 [2:36:37<3:07:16,  3.37s/it]
Skipping the first batches:  44%|████▍     | 2667/6000 [2:36:40<3:05:23,  3.34s/it]
Skipping the first batches:  44%|████▍     | 2668/6000 [2:36:45<3:24:58,  3.69s/it]
Skipping the first batches:  44%|████▍     | 2669/6000 [2:36:48<3:17:30,  3.56s/it]
Skipping the first batches:  44%|████▍     | 2670/6000 [2:36:51<3:14:37,  3.51s/it]
Skipping the first batches:  45%|████▍     | 2671/6000 [2:36:56<3:38:56,  3.95s/it]
Skipping the first batches:  45%|████▍     | 2672/6000 [2:37:00<3:25:07,  3.70s/it]
Skipping the first batches:  45%|████▍     | 2673/6000 [2:37:03<3:18:40,  3.58s/it]
Skipping the first batches:  45%|████▍     | 2674/6000 [2:37:06<3:18:16,  3.58s/it]
Skipping the first batches:  45%|████▍     | 2675/6000 [2:37:10<3:12:46,  3.48s/it]
Skipping the first batches:  45%|████▍     | 2676/6000 [2:37:13<3:10:39,  3.44s/it]
Skipping the first batches:  45%|████▍     | 2677/6000 [2:37:16<3:07:15,  3.38s/it]
Skipping the first batches:  45%|████▍     | 2678/6000 [2:37:19<3:02:08,  3.29s/it]
Skipping the first batches:  45%|████▍     | 2679/6000 [2:37:23<3:09:43,  3.43s/it]
Skipping the first batches:  45%|████▍     | 2680/6000 [2:37:27<3:11:51,  3.47s/it]
Skipping the first batches:  45%|████▍     | 2681/6000 [2:37:30<3:15:55,  3.54s/it]
Skipping the first batches:  45%|████▍     | 2682/6000 [2:37:34<3:14:24,  3.52s/it]
Skipping the first batches:  45%|████▍     | 2683/6000 [2:37:38<3:19:18,  3.61s/it]
Skipping the first batches:  45%|████▍     | 2684/6000 [2:37:41<3:14:19,  3.52s/it]
Skipping the first batches:  45%|████▍     | 2685/6000 [2:37:45<3:14:20,  3.52s/it]
Skipping the first batches:  45%|████▍     | 2686/6000 [2:37:48<3:09:52,  3.44s/it]
Skipping the first batches:  45%|████▍     | 2687/6000 [2:37:52<3:28:44,  3.78s/it]
Skipping the first batches:  45%|████▍     | 2688/6000 [2:37:56<3:33:53,  3.87s/it]
Skipping the first batches:  45%|████▍     | 2689/6000 [2:38:00<3:33:35,  3.87s/it]
Skipping the first batches:  45%|████▍     | 2690/6000 [2:38:04<3:26:12,  3.74s/it]
Skipping the first batches:  45%|████▍     | 2691/6000 [2:38:07<3:15:24,  3.54s/it]
Skipping the first batches:  45%|████▍     | 2692/6000 [2:38:10<3:07:28,  3.40s/it]
Skipping the first batches:  45%|████▍     | 2693/6000 [2:38:14<3:12:03,  3.48s/it]
Skipping the first batches:  45%|████▍     | 2694/6000 [2:38:17<3:05:51,  3.37s/it]
Skipping the first batches:  45%|████▍     | 2695/6000 [2:38:20<3:01:17,  3.29s/it]
Skipping the first batches:  45%|████▍     | 2696/6000 [2:38:23<3:07:02,  3.40s/it]
Skipping the first batches:  45%|████▍     | 2697/6000 [2:38:27<3:07:04,  3.40s/it]
Skipping the first batches:  45%|████▍     | 2698/6000 [2:38:30<3:05:09,  3.36s/it]
Skipping the first batches:  45%|████▍     | 2699/6000 [2:38:35<3:29:47,  3.81s/it]
Skipping the first batches:  45%|████▌     | 2700/6000 [2:38:39<3:30:21,  3.82s/it]
Skipping the first batches:  45%|████▌     | 2701/6000 [2:38:42<3:18:16,  3.61s/it]
Skipping the first batches:  45%|████▌     | 2702/6000 [2:38:45<3:13:11,  3.51s/it]
Skipping the first batches:  45%|████▌     | 2703/6000 [2:38:49<3:16:06,  3.57s/it]
Skipping the first batches:  45%|████▌     | 2704/6000 [2:38:52<3:13:55,  3.53s/it]
Skipping the first batches:  45%|████▌     | 2705/6000 [2:38:55<3:06:31,  3.40s/it]
Skipping the first batches:  45%|████▌     | 2706/6000 [2:38:59<3:06:51,  3.40s/it]
Skipping the first batches:  45%|████▌     | 2707/6000 [2:39:03<3:11:09,  3.48s/it]
Skipping the first batches:  45%|████▌     | 2708/6000 [2:39:06<3:09:00,  3.44s/it]
Skipping the first batches:  45%|████▌     | 2709/6000 [2:39:09<3:07:41,  3.42s/it]
Skipping the first batches:  45%|████▌     | 2710/6000 [2:39:13<3:06:19,  3.40s/it]
Skipping the first batches:  45%|████▌     | 2711/6000 [2:39:16<3:03:31,  3.35s/it]
Skipping the first batches:  45%|████▌     | 2712/6000 [2:39:19<3:00:30,  3.29s/it]
Skipping the first batches:  45%|████▌     | 2713/6000 [2:39:23<3:04:11,  3.36s/it]
Skipping the first batches:  45%|████▌     | 2714/6000 [2:39:26<3:03:17,  3.35s/it]
Skipping the first batches:  45%|████▌     | 2715/6000 [2:39:29<2:59:24,  3.28s/it]
Skipping the first batches:  45%|████▌     | 2716/6000 [2:39:32<3:03:34,  3.35s/it]
Skipping the first batches:  45%|████▌     | 2717/6000 [2:39:37<3:17:25,  3.61s/it]
Skipping the first batches:  45%|████▌     | 2718/6000 [2:39:40<3:11:26,  3.50s/it]
Skipping the first batches:  45%|████▌     | 2719/6000 [2:39:43<3:11:46,  3.51s/it]
Skipping the first batches:  45%|████▌     | 2720/6000 [2:39:47<3:10:08,  3.48s/it]
Skipping the first batches:  45%|████▌     | 2721/6000 [2:39:50<3:07:35,  3.43s/it]
Skipping the first batches:  45%|████▌     | 2722/6000 [2:39:53<3:04:22,  3.37s/it]
Skipping the first batches:  45%|████▌     | 2723/6000 [2:39:57<3:02:34,  3.34s/it]
Skipping the first batches:  45%|████▌     | 2724/6000 [2:40:00<3:07:45,  3.44s/it]
Skipping the first batches:  45%|████▌     | 2725/6000 [2:40:05<3:23:39,  3.73s/it]
Skipping the first batches:  45%|████▌     | 2726/6000 [2:40:08<3:14:23,  3.56s/it]
Skipping the first batches:  45%|████▌     | 2727/6000 [2:40:11<3:12:03,  3.52s/it]
Skipping the first batches:  45%|████▌     | 2728/6000 [2:40:15<3:15:38,  3.59s/it]
Skipping the first batches:  45%|████▌     | 2729/6000 [2:40:18<3:08:47,  3.46s/it]
Skipping the first batches:  46%|████▌     | 2730/6000 [2:40:22<3:15:56,  3.60s/it]
Skipping the first batches:  46%|████▌     | 2731/6000 [2:40:26<3:16:03,  3.60s/it]
Skipping the first batches:  46%|████▌     | 2732/6000 [2:40:29<3:08:18,  3.46s/it]
Skipping the first batches:  46%|████▌     | 2733/6000 [2:40:32<3:08:13,  3.46s/it]
Skipping the first batches:  46%|████▌     | 2734/6000 [2:40:36<3:09:18,  3.48s/it]
Skipping the first batches:  46%|████▌     | 2735/6000 [2:40:39<3:07:57,  3.45s/it]
Skipping the first batches:  46%|████▌     | 2736/6000 [2:40:43<3:11:51,  3.53s/it]
Skipping the first batches:  46%|████▌     | 2737/6000 [2:40:49<3:45:16,  4.14s/it]
Skipping the first batches:  46%|████▌     | 2738/6000 [2:40:53<3:47:39,  4.19s/it]
Skipping the first batches:  46%|████▌     | 2739/6000 [2:40:57<3:38:52,  4.03s/it]
Skipping the first batches:  46%|████▌     | 2740/6000 [2:41:00<3:31:04,  3.88s/it]
Skipping the first batches:  46%|████▌     | 2741/6000 [2:41:03<3:19:51,  3.68s/it]
Skipping the first batches:  46%|████▌     | 2742/6000 [2:41:07<3:18:41,  3.66s/it]
Skipping the first batches:  46%|████▌     | 2743/6000 [2:41:10<3:15:15,  3.60s/it]
Skipping the first batches:  46%|████▌     | 2744/6000 [2:41:13<3:06:54,  3.44s/it]
Skipping the first batches:  46%|████▌     | 2745/6000 [2:41:17<3:11:17,  3.53s/it]
Skipping the first batches:  46%|████▌     | 2746/6000 [2:41:20<3:04:59,  3.41s/it]
Skipping the first batches:  46%|████▌     | 2747/6000 [2:41:23<3:01:52,  3.35s/it]
Skipping the first batches:  46%|████▌     | 2748/6000 [2:41:27<3:00:30,  3.33s/it]
Skipping the first batches:  46%|████▌     | 2749/6000 [2:41:30<3:06:35,  3.44s/it]
Skipping the first batches:  46%|████▌     | 2750/6000 [2:41:34<3:07:29,  3.46s/it]
Skipping the first batches:  46%|████▌     | 2751/6000 [2:41:37<3:07:08,  3.46s/it]
Skipping the first batches:  46%|████▌     | 2752/6000 [2:41:41<3:07:44,  3.47s/it]
Skipping the first batches:  46%|████▌     | 2753/6000 [2:41:44<3:06:36,  3.45s/it]
Skipping the first batches:  46%|████▌     | 2754/6000 [2:41:48<3:03:31,  3.39s/it]
Skipping the first batches:  46%|████▌     | 2755/6000 [2:41:51<3:05:56,  3.44s/it]
Skipping the first batches:  46%|████▌     | 2756/6000 [2:41:55<3:10:13,  3.52s/it]
Skipping the first batches:  46%|████▌     | 2757/6000 [2:42:00<3:38:03,  4.03s/it]
Skipping the first batches:  46%|████▌     | 2758/6000 [2:42:05<3:51:03,  4.28s/it]
Skipping the first batches:  46%|████▌     | 2759/6000 [2:42:08<3:34:43,  3.98s/it]
Skipping the first batches:  46%|████▌     | 2760/6000 [2:42:12<3:27:07,  3.84s/it]
Skipping the first batches:  46%|████▌     | 2761/6000 [2:42:15<3:21:39,  3.74s/it]
Skipping the first batches:  46%|████▌     | 2762/6000 [2:42:19<3:17:33,  3.66s/it]
Skipping the first batches:  46%|████▌     | 2763/6000 [2:42:22<3:11:10,  3.54s/it]
Skipping the first batches:  46%|████▌     | 2764/6000 [2:42:25<3:09:47,  3.52s/it]
Skipping the first batches:  46%|████▌     | 2765/6000 [2:42:29<3:13:41,  3.59s/it]
Skipping the first batches:  46%|████▌     | 2766/6000 [2:42:33<3:11:07,  3.55s/it]
Skipping the first batches:  46%|████▌     | 2767/6000 [2:42:36<3:09:13,  3.51s/it]
Skipping the first batches:  46%|████▌     | 2768/6000 [2:42:39<3:06:34,  3.46s/it]
Skipping the first batches:  46%|████▌     | 2769/6000 [2:42:43<3:08:05,  3.49s/it]
Skipping the first batches:  46%|████▌     | 2770/6000 [2:42:46<3:03:30,  3.41s/it]
Skipping the first batches:  46%|████▌     | 2771/6000 [2:42:50<3:02:47,  3.40s/it]
Skipping the first batches:  46%|████▌     | 2772/6000 [2:42:53<3:03:46,  3.42s/it]
Skipping the first batches:  46%|████▌     | 2773/6000 [2:42:57<3:08:02,  3.50s/it]
Skipping the first batches:  46%|████▌     | 2774/6000 [2:43:00<3:01:56,  3.38s/it]
Skipping the first batches:  46%|████▋     | 2775/6000 [2:43:03<3:05:09,  3.44s/it]
Skipping the first batches:  46%|████▋     | 2776/6000 [2:43:07<3:03:28,  3.41s/it]
Skipping the first batches:  46%|████▋     | 2777/6000 [2:43:10<2:58:59,  3.33s/it]
Skipping the first batches:  46%|████▋     | 2778/6000 [2:43:14<3:03:55,  3.42s/it]
Skipping the first batches:  46%|████▋     | 2779/6000 [2:43:17<3:02:32,  3.40s/it]
Skipping the first batches:  46%|████▋     | 2780/6000 [2:43:20<2:57:52,  3.31s/it]
Skipping the first batches:  46%|████▋     | 2781/6000 [2:43:24<3:02:24,  3.40s/it]
Skipping the first batches:  46%|████▋     | 2782/6000 [2:43:27<3:01:33,  3.39s/it]
Skipping the first batches:  46%|████▋     | 2783/6000 [2:43:30<2:57:41,  3.31s/it]
Skipping the first batches:  46%|████▋     | 2784/6000 [2:43:34<3:09:39,  3.54s/it]
Skipping the first batches:  46%|████▋     | 2785/6000 [2:43:38<3:10:16,  3.55s/it]
Skipping the first batches:  46%|████▋     | 2786/6000 [2:43:41<3:05:46,  3.47s/it]
Skipping the first batches:  46%|████▋     | 2787/6000 [2:43:45<3:06:28,  3.48s/it]
Skipping the first batches:  46%|████▋     | 2788/6000 [2:43:48<3:03:07,  3.42s/it]
Skipping the first batches:  46%|████▋     | 2789/6000 [2:43:51<3:01:57,  3.40s/it]
Skipping the first batches:  46%|████▋     | 2790/6000 [2:43:55<3:02:18,  3.41s/it]
Skipping the first batches:  47%|████▋     | 2791/6000 [2:43:58<2:59:26,  3.36s/it]
Skipping the first batches:  47%|████▋     | 2792/6000 [2:44:01<2:58:15,  3.33s/it]
Skipping the first batches:  47%|████▋     | 2793/6000 [2:44:05<3:03:06,  3.43s/it]
Skipping the first batches:  47%|████▋     | 2794/6000 [2:44:09<3:08:47,  3.53s/it]
Skipping the first batches:  47%|████▋     | 2795/6000 [2:44:12<3:08:22,  3.53s/it]
Skipping the first batches:  47%|████▋     | 2796/6000 [2:44:16<3:19:15,  3.73s/it]
Skipping the first batches:  47%|████▋     | 2797/6000 [2:44:20<3:11:54,  3.59s/it]
Skipping the first batches:  47%|████▋     | 2798/6000 [2:44:23<3:10:19,  3.57s/it]
Skipping the first batches:  47%|████▋     | 2799/6000 [2:44:26<3:08:01,  3.52s/it]
Skipping the first batches:  47%|████▋     | 2800/6000 [2:44:30<3:03:57,  3.45s/it]
Skipping the first batches:  47%|████▋     | 2801/6000 [2:44:33<3:02:00,  3.41s/it]
Skipping the first batches:  47%|████▋     | 2802/6000 [2:44:37<3:04:55,  3.47s/it]
Skipping the first batches:  47%|████▋     | 2803/6000 [2:44:40<3:08:02,  3.53s/it]
Skipping the first batches:  47%|████▋     | 2804/6000 [2:44:44<3:11:08,  3.59s/it]
Skipping the first batches:  47%|████▋     | 2805/6000 [2:44:47<3:05:59,  3.49s/it]
Skipping the first batches:  47%|████▋     | 2806/6000 [2:44:51<3:04:27,  3.47s/it]
Skipping the first batches:  47%|████▋     | 2807/6000 [2:44:54<3:05:03,  3.48s/it]
Skipping the first batches:  47%|████▋     | 2808/6000 [2:44:57<3:00:38,  3.40s/it]
Skipping the first batches:  47%|████▋     | 2809/6000 [2:45:01<2:57:55,  3.35s/it]
Skipping the first batches:  47%|████▋     | 2810/6000 [2:45:04<2:57:46,  3.34s/it]
Skipping the first batches:  47%|████▋     | 2811/6000 [2:45:08<3:03:40,  3.46s/it]
Skipping the first batches:  47%|████▋     | 2812/6000 [2:45:12<3:17:34,  3.72s/it]
Skipping the first batches:  47%|████▋     | 2813/6000 [2:45:15<3:13:14,  3.64s/it]
Skipping the first batches:  47%|████▋     | 2814/6000 [2:45:19<3:09:12,  3.56s/it]
Skipping the first batches:  47%|████▋     | 2815/6000 [2:45:22<3:05:52,  3.50s/it]
Skipping the first batches:  47%|████▋     | 2816/6000 [2:45:26<3:11:53,  3.62s/it]
Skipping the first batches:  47%|████▋     | 2817/6000 [2:45:30<3:08:46,  3.56s/it]
Skipping the first batches:  47%|████▋     | 2818/6000 [2:45:33<3:02:20,  3.44s/it]
Skipping the first batches:  47%|████▋     | 2819/6000 [2:45:36<3:01:36,  3.43s/it]
Skipping the first batches:  47%|████▋     | 2820/6000 [2:45:40<3:14:07,  3.66s/it]
Skipping the first batches:  47%|████▋     | 2821/6000 [2:45:44<3:14:17,  3.67s/it]
Skipping the first batches:  47%|████▋     | 2822/6000 [2:45:47<3:11:04,  3.61s/it]
Skipping the first batches:  47%|████▋     | 2823/6000 [2:45:51<3:04:34,  3.49s/it]
Skipping the first batches:  47%|████▋     | 2824/6000 [2:45:54<3:05:20,  3.50s/it]
Skipping the first batches:  47%|████▋     | 2825/6000 [2:45:57<2:59:25,  3.39s/it]
Skipping the first batches:  47%|████▋     | 2826/6000 [2:46:01<2:59:15,  3.39s/it]
Skipping the first batches:  47%|████▋     | 2827/6000 [2:46:04<3:01:48,  3.44s/it]
Skipping the first batches:  47%|████▋     | 2828/6000 [2:46:07<2:58:12,  3.37s/it]
Skipping the first batches:  47%|████▋     | 2829/6000 [2:46:11<3:05:37,  3.51s/it]
Skipping the first batches:  47%|████▋     | 2830/6000 [2:46:14<2:59:11,  3.39s/it]
Skipping the first batches:  47%|████▋     | 2831/6000 [2:46:18<3:00:20,  3.41s/it]
Skipping the first batches:  47%|████▋     | 2832/6000 [2:46:22<3:04:17,  3.49s/it]
Skipping the first batches:  47%|████▋     | 2833/6000 [2:46:25<3:01:33,  3.44s/it]
Skipping the first batches:  47%|████▋     | 2834/6000 [2:46:28<3:04:14,  3.49s/it]
Skipping the first batches:  47%|████▋     | 2835/6000 [2:46:32<3:01:55,  3.45s/it]
Skipping the first batches:  47%|████▋     | 2836/6000 [2:46:35<3:02:18,  3.46s/it]
Skipping the first batches:  47%|████▋     | 2837/6000 [2:46:39<3:07:34,  3.56s/it]
Skipping the first batches:  47%|████▋     | 2838/6000 [2:46:43<3:07:13,  3.55s/it]
Skipping the first batches:  47%|████▋     | 2839/6000 [2:46:46<3:03:37,  3.49s/it]
Skipping the first batches:  47%|████▋     | 2840/6000 [2:46:50<3:05:33,  3.52s/it]
Skipping the first batches:  47%|████▋     | 2841/6000 [2:46:53<3:01:12,  3.44s/it]
Skipping the first batches:  47%|████▋     | 2842/6000 [2:46:56<3:00:37,  3.43s/it]
Skipping the first batches:  47%|████▋     | 2843/6000 [2:46:59<2:57:03,  3.36s/it]
Skipping the first batches:  47%|████▋     | 2844/6000 [2:47:03<2:55:50,  3.34s/it]
Skipping the first batches:  47%|████▋     | 2845/6000 [2:47:06<2:55:58,  3.35s/it]
Skipping the first batches:  47%|████▋     | 2846/6000 [2:47:10<2:58:56,  3.40s/it]
Skipping the first batches:  47%|████▋     | 2847/6000 [2:47:13<3:00:29,  3.43s/it]
Skipping the first batches:  47%|████▋     | 2848/6000 [2:47:17<3:00:07,  3.43s/it]
Skipping the first batches:  47%|████▋     | 2849/6000 [2:47:20<3:02:37,  3.48s/it]
Skipping the first batches:  48%|████▊     | 2850/6000 [2:47:23<2:57:10,  3.37s/it]
Skipping the first batches:  48%|████▊     | 2851/6000 [2:47:27<2:59:01,  3.41s/it]
Skipping the first batches:  48%|████▊     | 2852/6000 [2:47:30<3:00:09,  3.43s/it]
Skipping the first batches:  48%|████▊     | 2853/6000 [2:47:34<2:59:15,  3.42s/it]
Skipping the first batches:  48%|████▊     | 2854/6000 [2:47:37<2:56:52,  3.37s/it]
Skipping the first batches:  48%|████▊     | 2855/6000 [2:47:40<2:57:20,  3.38s/it]
Skipping the first batches:  48%|████▊     | 2856/6000 [2:47:44<2:58:09,  3.40s/it]
Skipping the first batches:  48%|████▊     | 2857/6000 [2:47:47<2:55:13,  3.34s/it]
Skipping the first batches:  48%|████▊     | 2858/6000 [2:47:50<2:56:58,  3.38s/it]
Skipping the first batches:  48%|████▊     | 2859/6000 [2:47:54<3:00:42,  3.45s/it]
Skipping the first batches:  48%|████▊     | 2860/6000 [2:47:57<2:57:26,  3.39s/it]
Skipping the first batches:  48%|████▊     | 2861/6000 [2:48:01<2:58:07,  3.40s/it]
Skipping the first batches:  48%|████▊     | 2862/6000 [2:48:04<2:54:42,  3.34s/it]
Skipping the first batches:  48%|████▊     | 2863/6000 [2:48:07<2:56:07,  3.37s/it]
Skipping the first batches:  48%|████▊     | 2864/6000 [2:48:11<2:53:50,  3.33s/it]
Skipping the first batches:  48%|████▊     | 2865/6000 [2:48:14<2:58:49,  3.42s/it]
Skipping the first batches:  48%|████▊     | 2866/6000 [2:48:18<3:01:12,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2867/6000 [2:48:21<3:01:01,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2868/6000 [2:48:25<3:05:05,  3.55s/it]
Skipping the first batches:  48%|████▊     | 2869/6000 [2:48:29<3:11:42,  3.67s/it]
Skipping the first batches:  48%|████▊     | 2870/6000 [2:48:32<3:07:11,  3.59s/it]
Skipping the first batches:  48%|████▊     | 2871/6000 [2:48:36<3:10:40,  3.66s/it]
Skipping the first batches:  48%|████▊     | 2872/6000 [2:48:39<3:04:49,  3.55s/it]
Skipping the first batches:  48%|████▊     | 2873/6000 [2:48:43<3:09:50,  3.64s/it]
Skipping the first batches:  48%|████▊     | 2874/6000 [2:48:47<3:04:29,  3.54s/it]
Skipping the first batches:  48%|████▊     | 2875/6000 [2:48:50<3:00:25,  3.46s/it]
Skipping the first batches:  48%|████▊     | 2876/6000 [2:48:54<3:04:46,  3.55s/it]
Skipping the first batches:  48%|████▊     | 2877/6000 [2:48:57<3:01:36,  3.49s/it]
Skipping the first batches:  48%|████▊     | 2878/6000 [2:49:00<2:58:06,  3.42s/it]
Skipping the first batches:  48%|████▊     | 2879/6000 [2:49:04<2:56:46,  3.40s/it]
Skipping the first batches:  48%|████▊     | 2880/6000 [2:49:08<3:04:17,  3.54s/it]
Skipping the first batches:  48%|████▊     | 2881/6000 [2:49:11<3:06:05,  3.58s/it]
Skipping the first batches:  48%|████▊     | 2882/6000 [2:49:14<3:00:13,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2883/6000 [2:49:18<3:01:20,  3.49s/it]
Skipping the first batches:  48%|████▊     | 2884/6000 [2:49:22<3:02:58,  3.52s/it]
Skipping the first batches:  48%|████▊     | 2885/6000 [2:49:25<3:01:05,  3.49s/it]
Skipping the first batches:  48%|████▊     | 2886/6000 [2:49:28<2:57:57,  3.43s/it]
Skipping the first batches:  48%|████▊     | 2887/6000 [2:49:32<3:02:36,  3.52s/it]
Skipping the first batches:  48%|████▊     | 2888/6000 [2:49:36<3:07:31,  3.62s/it]
Skipping the first batches:  48%|████▊     | 2889/6000 [2:49:39<3:00:09,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2890/6000 [2:49:43<3:01:08,  3.49s/it]
Skipping the first batches:  48%|████▊     | 2891/6000 [2:49:46<2:58:24,  3.44s/it]
Skipping the first batches:  48%|████▊     | 2892/6000 [2:49:49<2:55:08,  3.38s/it]
Skipping the first batches:  48%|████▊     | 2893/6000 [2:49:53<3:01:28,  3.50s/it]
Skipping the first batches:  48%|████▊     | 2894/6000 [2:49:56<2:59:36,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2895/6000 [2:50:00<2:57:33,  3.43s/it]
Skipping the first batches:  48%|████▊     | 2896/6000 [2:50:04<3:18:00,  3.83s/it]
Skipping the first batches:  48%|████▊     | 2897/6000 [2:50:10<3:47:55,  4.41s/it]
Skipping the first batches:  48%|████▊     | 2898/6000 [2:50:15<4:03:15,  4.71s/it]
Skipping the first batches:  48%|████▊     | 2899/6000 [2:50:19<3:38:30,  4.23s/it]
Skipping the first batches:  48%|████▊     | 2900/6000 [2:50:22<3:28:16,  4.03s/it]
Skipping the first batches:  48%|████▊     | 2901/6000 [2:50:26<3:18:09,  3.84s/it]
Skipping the first batches:  48%|████▊     | 2902/6000 [2:50:29<3:06:11,  3.61s/it]
Skipping the first batches:  48%|████▊     | 2903/6000 [2:50:32<3:02:16,  3.53s/it]
Skipping the first batches:  48%|████▊     | 2904/6000 [2:50:36<3:02:05,  3.53s/it]
Skipping the first batches:  48%|████▊     | 2905/6000 [2:50:39<2:57:43,  3.45s/it]
Skipping the first batches:  48%|████▊     | 2906/6000 [2:50:42<2:57:12,  3.44s/it]
Skipping the first batches:  48%|████▊     | 2907/6000 [2:50:46<2:58:53,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2908/6000 [2:50:49<3:01:13,  3.52s/it]
Skipping the first batches:  48%|████▊     | 2909/6000 [2:50:53<2:58:51,  3.47s/it]
Skipping the first batches:  48%|████▊     | 2910/6000 [2:50:56<2:55:19,  3.40s/it]
Skipping the first batches:  49%|████▊     | 2911/6000 [2:50:59<2:54:32,  3.39s/it]
Skipping the first batches:  49%|████▊     | 2912/6000 [2:51:03<2:54:53,  3.40s/it]
Skipping the first batches:  49%|████▊     | 2913/6000 [2:51:06<2:56:02,  3.42s/it]
Skipping the first batches:  49%|████▊     | 2914/6000 [2:51:09<2:51:23,  3.33s/it]
Skipping the first batches:  49%|████▊     | 2915/6000 [2:51:13<3:00:32,  3.51s/it]
Skipping the first batches:  49%|████▊     | 2916/6000 [2:51:17<3:08:09,  3.66s/it]
Skipping the first batches:  49%|████▊     | 2917/6000 [2:51:21<3:04:09,  3.58s/it]
Skipping the first batches:  49%|████▊     | 2918/6000 [2:51:25<3:22:15,  3.94s/it]
Skipping the first batches:  49%|████▊     | 2919/6000 [2:51:31<3:43:51,  4.36s/it]
Skipping the first batches:  49%|████▊     | 2920/6000 [2:51:37<4:16:26,  5.00s/it]
Skipping the first batches:  49%|████▊     | 2921/6000 [2:51:41<3:50:46,  4.50s/it]
Skipping the first batches:  49%|████▊     | 2922/6000 [2:51:44<3:35:29,  4.20s/it]
Skipping the first batches:  49%|████▊     | 2923/6000 [2:51:48<3:22:54,  3.96s/it]
Skipping the first batches:  49%|████▊     | 2924/6000 [2:51:52<3:29:33,  4.09s/it]
Skipping the first batches:  49%|████▉     | 2925/6000 [2:51:55<3:20:36,  3.91s/it]
Skipping the first batches:  49%|████▉     | 2926/6000 [2:51:59<3:20:48,  3.92s/it]
Skipping the first batches:  49%|████▉     | 2927/6000 [2:52:03<3:20:46,  3.92s/it]
Skipping the first batches:  49%|████▉     | 2928/6000 [2:52:07<3:14:07,  3.79s/it]
Skipping the first batches:  49%|████▉     | 2929/6000 [2:52:10<3:09:50,  3.71s/it]
Skipping the first batches:  49%|████▉     | 2930/6000 [2:52:14<3:04:45,  3.61s/it]
Skipping the first batches:  49%|████▉     | 2931/6000 [2:52:19<3:27:12,  4.05s/it]
Skipping the first batches:  49%|████▉     | 2932/6000 [2:52:24<3:39:58,  4.30s/it]
Skipping the first batches:  49%|████▉     | 2933/6000 [2:52:28<3:33:59,  4.19s/it]
Skipping the first batches:  49%|████▉     | 2934/6000 [2:52:32<3:31:56,  4.15s/it]
Skipping the first batches:  49%|████▉     | 2935/6000 [2:52:36<3:35:38,  4.22s/it]
Skipping the first batches:  49%|████▉     | 2936/6000 [2:52:40<3:39:24,  4.30s/it]
Skipping the first batches:  49%|████▉     | 2937/6000 [2:52:44<3:27:41,  4.07s/it]
Skipping the first batches:  49%|████▉     | 2938/6000 [2:52:49<3:45:09,  4.41s/it]
Skipping the first batches:  49%|████▉     | 2939/6000 [2:52:52<3:28:03,  4.08s/it]
Skipping the first batches:  49%|████▉     | 2940/6000 [2:52:56<3:15:44,  3.84s/it]
Skipping the first batches:  49%|████▉     | 2941/6000 [2:52:59<3:13:00,  3.79s/it]
Skipping the first batches:  49%|████▉     | 2942/6000 [2:53:03<3:05:26,  3.64s/it]
Skipping the first batches:  49%|████▉     | 2943/6000 [2:53:06<2:58:35,  3.51s/it]
Skipping the first batches:  49%|████▉     | 2944/6000 [2:53:09<2:57:14,  3.48s/it]
Skipping the first batches:  49%|████▉     | 2945/6000 [2:53:12<2:51:35,  3.37s/it]
Skipping the first batches:  49%|████▉     | 2946/6000 [2:53:16<2:55:00,  3.44s/it]
Skipping the first batches:  49%|████▉     | 2947/6000 [2:53:20<3:04:15,  3.62s/it]
Skipping the first batches:  49%|████▉     | 2948/6000 [2:53:23<3:00:16,  3.54s/it]
Skipping the first batches:  49%|████▉     | 2949/6000 [2:53:27<3:07:21,  3.68s/it]
Skipping the first batches:  49%|████▉     | 2950/6000 [2:53:31<2:58:14,  3.51s/it]
Skipping the first batches:  49%|████▉     | 2951/6000 [2:53:35<3:16:24,  3.86s/it]
Skipping the first batches:  49%|████▉     | 2952/6000 [2:53:39<3:07:03,  3.68s/it]
Skipping the first batches:  49%|████▉     | 2953/6000 [2:53:43<3:20:47,  3.95s/it]
Skipping the first batches:  49%|████▉     | 2954/6000 [2:53:46<3:08:46,  3.72s/it]
Skipping the first batches:  49%|████▉     | 2955/6000 [2:53:51<3:16:50,  3.88s/it]
Skipping the first batches:  49%|████▉     | 2956/6000 [2:53:54<3:16:23,  3.87s/it]
Skipping the first batches:  49%|████▉     | 2957/6000 [2:53:58<3:09:31,  3.74s/it]
Skipping the first batches:  49%|████▉     | 2958/6000 [2:54:01<3:08:07,  3.71s/it]
Skipping the first batches:  49%|████▉     | 2959/6000 [2:54:06<3:12:58,  3.81s/it]
Skipping the first batches:  49%|████▉     | 2960/6000 [2:54:09<3:02:27,  3.60s/it]
Skipping the first batches:  49%|████▉     | 2961/6000 [2:54:12<2:59:37,  3.55s/it]
Skipping the first batches:  49%|████▉     | 2962/6000 [2:54:16<2:59:55,  3.55s/it]
Skipping the first batches:  49%|████▉     | 2963/6000 [2:54:19<2:52:47,  3.41s/it]
Skipping the first batches:  49%|████▉     | 2964/6000 [2:54:22<2:53:12,  3.42s/it]
Skipping the first batches:  49%|████▉     | 2965/6000 [2:54:26<2:59:38,  3.55s/it]
Skipping the first batches:  49%|████▉     | 2966/6000 [2:54:30<3:13:40,  3.83s/it]
Skipping the first batches:  49%|████▉     | 2967/6000 [2:54:34<3:08:44,  3.73s/it]
Skipping the first batches:  49%|████▉     | 2968/6000 [2:54:37<3:01:14,  3.59s/it]
Skipping the first batches:  49%|████▉     | 2969/6000 [2:54:41<2:56:50,  3.50s/it]
Skipping the first batches:  50%|████▉     | 2970/6000 [2:54:44<2:54:49,  3.46s/it]
Skipping the first batches:  50%|████▉     | 2971/6000 [2:54:47<2:53:52,  3.44s/it]
Skipping the first batches:  50%|████▉     | 2972/6000 [2:54:50<2:47:42,  3.32s/it]
Skipping the first batches:  50%|████▉     | 2973/6000 [2:54:54<2:45:55,  3.29s/it]
Skipping the first batches:  50%|████▉     | 2974/6000 [2:54:58<2:57:42,  3.52s/it]
Skipping the first batches:  50%|████▉     | 2975/6000 [2:55:01<2:51:06,  3.39s/it]
Skipping the first batches:  50%|████▉     | 2976/6000 [2:55:04<2:49:36,  3.37s/it]
Skipping the first batches:  50%|████▉     | 2977/6000 [2:55:08<2:57:16,  3.52s/it]
Skipping the first batches:  50%|████▉     | 2978/6000 [2:55:11<2:50:57,  3.39s/it]
Skipping the first batches:  50%|████▉     | 2979/6000 [2:55:14<2:50:17,  3.38s/it]
Skipping the first batches:  50%|████▉     | 2980/6000 [2:55:18<2:49:19,  3.36s/it]
Skipping the first batches:  50%|████▉     | 2981/6000 [2:55:21<2:55:50,  3.49s/it]
Skipping the first batches:  50%|████▉     | 2982/6000 [2:55:25<2:51:08,  3.40s/it]
Skipping the first batches:  50%|████▉     | 2983/6000 [2:55:29<2:58:03,  3.54s/it]
Skipping the first batches:  50%|████▉     | 2984/6000 [2:55:32<3:03:24,  3.65s/it]
Skipping the first batches:  50%|████▉     | 2985/6000 [2:55:36<2:57:07,  3.52s/it]
Skipping the first batches:  50%|████▉     | 2986/6000 [2:55:39<2:58:54,  3.56s/it]
Skipping the first batches:  50%|████▉     | 2987/6000 [2:55:43<3:06:03,  3.70s/it]
Skipping the first batches:  50%|████▉     | 2988/6000 [2:55:47<3:09:20,  3.77s/it]
Skipping the first batches:  50%|████▉     | 2989/6000 [2:55:51<3:06:38,  3.72s/it]
Skipping the first batches:  50%|████▉     | 2990/6000 [2:55:55<3:12:29,  3.84s/it]
Skipping the first batches:  50%|████▉     | 2991/6000 [2:55:58<3:02:48,  3.65s/it]
Skipping the first batches:  50%|████▉     | 2992/6000 [2:56:02<3:07:41,  3.74s/it]
Skipping the first batches:  50%|████▉     | 2993/6000 [2:56:06<3:07:23,  3.74s/it]
Skipping the first batches:  50%|████▉     | 2994/6000 [2:56:09<3:01:38,  3.63s/it]
Skipping the first batches:  50%|████▉     | 2995/6000 [2:56:13<2:59:14,  3.58s/it]
Skipping the first batches:  50%|████▉     | 2996/6000 [2:56:16<2:55:25,  3.50s/it]
Skipping the first batches:  50%|████▉     | 2997/6000 [2:56:20<2:56:05,  3.52s/it]
Skipping the first batches:  50%|████▉     | 2998/6000 [2:56:23<2:54:04,  3.48s/it]
Skipping the first batches:  50%|████▉     | 2999/6000 [2:56:26<2:54:13,  3.48s/it]
Skipping the first batches:  50%|█████     | 3000/6000 [2:56:30<2:58:07,  3.56s/it]
Skipping the first batches:  50%|█████     | 3001/6000 [2:56:34<3:01:37,  3.63s/it]
Skipping the first batches:  50%|█████     | 3002/6000 [2:56:38<3:02:04,  3.64s/it]
Skipping the first batches:  50%|█████     | 3003/6000 [2:56:42<3:08:07,  3.77s/it]
Skipping the first batches:  50%|█████     | 3004/6000 [2:56:45<2:58:17,  3.57s/it]
Skipping the first batches:  50%|█████     | 3005/6000 [2:56:49<3:08:09,  3.77s/it]
Skipping the first batches:  50%|█████     | 3006/6000 [2:56:55<3:40:56,  4.43s/it]
Skipping the first batches:  50%|█████     | 3007/6000 [2:57:01<4:08:34,  4.98s/it]
Skipping the first batches:  50%|█████     | 3008/6000 [2:57:05<3:48:50,  4.59s/it]
Skipping the first batches:  50%|█████     | 3009/6000 [2:57:08<3:28:51,  4.19s/it]
Skipping the first batches:  50%|█████     | 3010/6000 [2:57:12<3:22:03,  4.05s/it]
Skipping the first batches:  50%|█████     | 3011/6000 [2:57:15<3:11:32,  3.85s/it]
Skipping the first batches:  50%|█████     | 3012/6000 [2:57:19<3:05:24,  3.72s/it]
Skipping the first batches:  50%|█████     | 3013/6000 [2:57:22<2:57:33,  3.57s/it]
Skipping the first batches:  50%|█████     | 3014/6000 [2:57:26<3:07:40,  3.77s/it]
Skipping the first batches:  50%|█████     | 3015/6000 [2:57:30<3:02:03,  3.66s/it]
Skipping the first batches:  50%|█████     | 3016/6000 [2:57:33<2:53:44,  3.49s/it]
Skipping the first batches:  50%|█████     | 3017/6000 [2:57:36<2:53:59,  3.50s/it]
Skipping the first batches:  50%|█████     | 3018/6000 [2:57:39<2:47:47,  3.38s/it]
Skipping the first batches:  50%|█████     | 3019/6000 [2:57:43<2:55:30,  3.53s/it]
Skipping the first batches:  50%|█████     | 3020/6000 [2:57:46<2:51:04,  3.44s/it]
Skipping the first batches:  50%|█████     | 3021/6000 [2:57:50<2:48:26,  3.39s/it]
Skipping the first batches:  50%|█████     | 3022/6000 [2:57:53<2:45:27,  3.33s/it]
Skipping the first batches:  50%|█████     | 3023/6000 [2:57:57<2:51:20,  3.45s/it]
Skipping the first batches:  50%|█████     | 3024/6000 [2:58:00<2:56:21,  3.56s/it]
Skipping the first batches:  50%|█████     | 3025/6000 [2:58:04<2:58:45,  3.61s/it]
Skipping the first batches:  50%|█████     | 3026/6000 [2:58:08<2:57:09,  3.57s/it]
Skipping the first batches:  50%|█████     | 3027/6000 [2:58:11<2:52:11,  3.48s/it]
Skipping the first batches:  50%|█████     | 3028/6000 [2:58:15<2:55:06,  3.54s/it]
Skipping the first batches:  50%|█████     | 3029/6000 [2:58:18<2:53:26,  3.50s/it]
Skipping the first batches:  50%|█████     | 3030/6000 [2:58:21<2:49:56,  3.43s/it]
Skipping the first batches:  51%|█████     | 3031/6000 [2:58:25<2:48:40,  3.41s/it]
Skipping the first batches:  51%|█████     | 3032/6000 [2:58:29<3:02:32,  3.69s/it]
Skipping the first batches:  51%|█████     | 3033/6000 [2:58:32<2:54:12,  3.52s/it]
Skipping the first batches:  51%|█████     | 3034/6000 [2:58:36<2:54:19,  3.53s/it]
Skipping the first batches:  51%|█████     | 3035/6000 [2:58:39<2:56:59,  3.58s/it]
Skipping the first batches:  51%|█████     | 3036/6000 [2:58:42<2:49:46,  3.44s/it]
Skipping the first batches:  51%|█████     | 3037/6000 [2:58:46<2:51:21,  3.47s/it]
Skipping the first batches:  51%|█████     | 3038/6000 [2:58:50<2:57:50,  3.60s/it]
Skipping the first batches:  51%|█████     | 3039/6000 [2:58:53<2:54:49,  3.54s/it]
Skipping the first batches:  51%|█████     | 3040/6000 [2:58:57<2:48:56,  3.42s/it]
Skipping the first batches:  51%|█████     | 3041/6000 [2:59:00<2:50:17,  3.45s/it]
Skipping the first batches:  51%|█████     | 3042/6000 [2:59:04<2:54:26,  3.54s/it]
Skipping the first batches:  51%|█████     | 3043/6000 [2:59:07<2:49:16,  3.43s/it]
Skipping the first batches:  51%|█████     | 3044/6000 [2:59:10<2:49:58,  3.45s/it]
Skipping the first batches:  51%|█████     | 3045/6000 [2:59:14<2:55:24,  3.56s/it]
Skipping the first batches:  51%|█████     | 3046/6000 [2:59:18<2:57:00,  3.60s/it]
Skipping the first batches:  51%|█████     | 3047/6000 [2:59:21<2:49:21,  3.44s/it]
Skipping the first batches:  51%|█████     | 3048/6000 [2:59:24<2:49:09,  3.44s/it]
Skipping the first batches:  51%|█████     | 3049/6000 [2:59:28<2:48:40,  3.43s/it]
Skipping the first batches:  51%|█████     | 3050/6000 [2:59:31<2:47:03,  3.40s/it]
Skipping the first batches:  51%|█████     | 3051/6000 [2:59:35<2:48:57,  3.44s/it]
Skipping the first batches:  51%|█████     | 3052/6000 [2:59:38<2:52:10,  3.50s/it]
Skipping the first batches:  51%|█████     | 3053/6000 [2:59:41<2:45:40,  3.37s/it]
Skipping the first batches:  51%|█████     | 3054/6000 [2:59:45<2:52:37,  3.52s/it]
Skipping the first batches:  51%|█████     | 3055/6000 [2:59:49<2:53:23,  3.53s/it]
Skipping the first batches:  51%|█████     | 3056/6000 [2:59:52<2:53:08,  3.53s/it]
Skipping the first batches:  51%|█████     | 3057/6000 [2:59:56<2:49:53,  3.46s/it]
Skipping the first batches:  51%|█████     | 3058/6000 [2:59:59<2:48:34,  3.44s/it]
Skipping the first batches:  51%|█████     | 3059/6000 [3:00:03<2:51:19,  3.50s/it]
Skipping the first batches:  51%|█████     | 3060/6000 [3:00:06<2:46:54,  3.41s/it]
Skipping the first batches:  51%|█████     | 3061/6000 [3:00:09<2:44:55,  3.37s/it]
Skipping the first batches:  51%|█████     | 3062/6000 [3:00:13<2:47:57,  3.43s/it]
Skipping the first batches:  51%|█████     | 3063/6000 [3:00:16<2:48:03,  3.43s/it]
Skipping the first batches:  51%|█████     | 3064/6000 [3:00:22<3:16:20,  4.01s/it]
Skipping the first batches:  51%|█████     | 3065/6000 [3:00:25<3:09:07,  3.87s/it]
Skipping the first batches:  51%|█████     | 3066/6000 [3:00:30<3:24:52,  4.19s/it]
Skipping the first batches:  51%|█████     | 3067/6000 [3:00:33<3:13:57,  3.97s/it]
Skipping the first batches:  51%|█████     | 3068/6000 [3:00:37<3:07:11,  3.83s/it]
Skipping the first batches:  51%|█████     | 3069/6000 [3:00:41<3:05:45,  3.80s/it]
Skipping the first batches:  51%|█████     | 3070/6000 [3:00:44<2:58:03,  3.65s/it]
Skipping the first batches:  51%|█████     | 3071/6000 [3:00:47<2:55:04,  3.59s/it]
Skipping the first batches:  51%|█████     | 3072/6000 [3:00:51<2:54:33,  3.58s/it]
Skipping the first batches:  51%|█████     | 3073/6000 [3:00:55<2:57:07,  3.63s/it]
Skipping the first batches:  51%|█████     | 3074/6000 [3:00:58<2:51:34,  3.52s/it]
Skipping the first batches:  51%|█████▏    | 3075/6000 [3:01:01<2:45:43,  3.40s/it]
Skipping the first batches:  51%|█████▏    | 3076/6000 [3:01:05<2:49:55,  3.49s/it]
Skipping the first batches:  51%|█████▏    | 3077/6000 [3:01:09<2:54:20,  3.58s/it]
Skipping the first batches:  51%|█████▏    | 3078/6000 [3:01:12<2:52:58,  3.55s/it]
Skipping the first batches:  51%|█████▏    | 3079/6000 [3:01:15<2:49:25,  3.48s/it]
Skipping the first batches:  51%|█████▏    | 3080/6000 [3:01:19<2:50:41,  3.51s/it]
Skipping the first batches:  51%|█████▏    | 3081/6000 [3:01:22<2:47:46,  3.45s/it]
Skipping the first batches:  51%|█████▏    | 3082/6000 [3:01:26<2:46:36,  3.43s/it]
Skipping the first batches:  51%|█████▏    | 3083/6000 [3:01:30<2:58:42,  3.68s/it]
Skipping the first batches:  51%|█████▏    | 3084/6000 [3:01:33<2:55:23,  3.61s/it]
Skipping the first batches:  51%|█████▏    | 3085/6000 [3:01:37<2:48:16,  3.46s/it]
Skipping the first batches:  51%|█████▏    | 3086/6000 [3:01:40<2:51:43,  3.54s/it]
Skipping the first batches:  51%|█████▏    | 3087/6000 [3:01:43<2:46:53,  3.44s/it]
Skipping the first batches:  51%|█████▏    | 3088/6000 [3:01:48<3:05:02,  3.81s/it]
Skipping the first batches:  51%|█████▏    | 3089/6000 [3:01:53<3:15:23,  4.03s/it]
Skipping the first batches:  52%|█████▏    | 3090/6000 [3:01:56<3:08:41,  3.89s/it]
Skipping the first batches:  52%|█████▏    | 3091/6000 [3:02:01<3:19:14,  4.11s/it]
Skipping the first batches:  52%|█████▏    | 3092/6000 [3:02:06<3:28:09,  4.29s/it]
Skipping the first batches:  52%|█████▏    | 3093/6000 [3:02:09<3:13:14,  3.99s/it]
Skipping the first batches:  52%|█████▏    | 3094/6000 [3:02:12<3:00:58,  3.74s/it]
Skipping the first batches:  52%|█████▏    | 3095/6000 [3:02:15<2:54:21,  3.60s/it]
Skipping the first batches:  52%|█████▏    | 3096/6000 [3:02:19<2:55:26,  3.62s/it]
Skipping the first batches:  52%|█████▏    | 3097/6000 [3:02:22<2:49:50,  3.51s/it]
Skipping the first batches:  52%|█████▏    | 3098/6000 [3:02:26<2:56:50,  3.66s/it]
Skipping the first batches:  52%|█████▏    | 3099/6000 [3:02:30<2:52:42,  3.57s/it]
Skipping the first batches:  52%|█████▏    | 3100/6000 [3:02:34<3:04:26,  3.82s/it]
Skipping the first batches:  52%|█████▏    | 3101/6000 [3:02:37<2:53:39,  3.59s/it]
Skipping the first batches:  52%|█████▏    | 3102/6000 [3:02:41<2:51:58,  3.56s/it]
Skipping the first batches:  52%|█████▏    | 3103/6000 [3:02:44<2:56:08,  3.65s/it]
Skipping the first batches:  52%|█████▏    | 3104/6000 [3:02:48<2:50:45,  3.54s/it]
Skipping the first batches:  52%|█████▏    | 3105/6000 [3:02:51<2:44:30,  3.41s/it]
Skipping the first batches:  52%|█████▏    | 3106/6000 [3:02:54<2:49:08,  3.51s/it]
Skipping the first batches:  52%|█████▏    | 3107/6000 [3:02:58<2:49:55,  3.52s/it]
Skipping the first batches:  52%|█████▏    | 3108/6000 [3:03:01<2:43:29,  3.39s/it]
Skipping the first batches:  52%|█████▏    | 3109/6000 [3:03:05<2:57:00,  3.67s/it]
Skipping the first batches:  52%|█████▏    | 3110/6000 [3:03:09<3:01:40,  3.77s/it]
Skipping the first batches:  52%|█████▏    | 3111/6000 [3:03:13<2:54:41,  3.63s/it]
Skipping the first batches:  52%|█████▏    | 3112/6000 [3:03:16<2:56:09,  3.66s/it]
Skipping the first batches:  52%|█████▏    | 3113/6000 [3:03:20<2:52:55,  3.59s/it]
Skipping the first batches:  52%|█████▏    | 3114/6000 [3:03:23<2:50:36,  3.55s/it]
Skipping the first batches:  52%|█████▏    | 3115/6000 [3:03:27<2:48:12,  3.50s/it]
Skipping the first batches:  52%|█████▏    | 3116/6000 [3:03:30<2:44:45,  3.43s/it]
Skipping the first batches:  52%|█████▏    | 3117/6000 [3:03:33<2:42:08,  3.37s/it]
Skipping the first batches:  52%|█████▏    | 3118/6000 [3:03:37<2:53:57,  3.62s/it]
Skipping the first batches:  52%|█████▏    | 3119/6000 [3:03:42<3:07:52,  3.91s/it]
Skipping the first batches:  52%|█████▏    | 3120/6000 [3:03:46<3:03:56,  3.83s/it]
Skipping the first batches:  52%|█████▏    | 3121/6000 [3:03:49<2:58:52,  3.73s/it]
Skipping the first batches:  52%|█████▏    | 3122/6000 [3:03:53<2:55:48,  3.67s/it]
Skipping the first batches:  52%|█████▏    | 3123/6000 [3:03:56<2:50:09,  3.55s/it]
Skipping the first batches:  52%|█████▏    | 3124/6000 [3:04:00<2:49:49,  3.54s/it]
Skipping the first batches:  52%|█████▏    | 3125/6000 [3:04:03<2:43:19,  3.41s/it]
Skipping the first batches:  52%|█████▏    | 3126/6000 [3:04:08<3:18:20,  4.14s/it]
Skipping the first batches:  52%|█████▏    | 3127/6000 [3:04:12<3:07:24,  3.91s/it]
Skipping the first batches:  52%|█████▏    | 3128/6000 [3:04:15<2:59:07,  3.74s/it]
Skipping the first batches:  52%|█████▏    | 3129/6000 [3:04:18<2:51:14,  3.58s/it]
Skipping the first batches:  52%|█████▏    | 3130/6000 [3:04:22<2:57:25,  3.71s/it]
Skipping the first batches:  52%|█████▏    | 3131/6000 [3:04:26<2:56:27,  3.69s/it]
Skipping the first batches:  52%|█████▏    | 3132/6000 [3:04:30<3:02:50,  3.83s/it]
Skipping the first batches:  52%|█████▏    | 3133/6000 [3:04:34<2:56:58,  3.70s/it]
Skipping the first batches:  52%|█████▏    | 3134/6000 [3:04:38<3:07:34,  3.93s/it]
Skipping the first batches:  52%|█████▏    | 3135/6000 [3:04:41<3:00:38,  3.78s/it]
Skipping the first batches:  52%|█████▏    | 3136/6000 [3:04:45<3:03:33,  3.85s/it]
Skipping the first batches:  52%|█████▏    | 3137/6000 [3:04:49<2:58:16,  3.74s/it]
Skipping the first batches:  52%|█████▏    | 3138/6000 [3:04:52<2:49:57,  3.56s/it]
Skipping the first batches:  52%|█████▏    | 3139/6000 [3:04:55<2:46:14,  3.49s/it]
Skipping the first batches:  52%|█████▏    | 3140/6000 [3:04:59<2:49:37,  3.56s/it]
Skipping the first batches:  52%|█████▏    | 3141/6000 [3:05:03<2:46:58,  3.50s/it]
Skipping the first batches:  52%|█████▏    | 3142/6000 [3:05:06<2:42:55,  3.42s/it]
Skipping the first batches:  52%|█████▏    | 3143/6000 [3:05:09<2:42:00,  3.40s/it]
Skipping the first batches:  52%|█████▏    | 3144/6000 [3:05:14<2:58:53,  3.76s/it]
Skipping the first batches:  52%|█████▏    | 3145/6000 [3:05:17<2:57:11,  3.72s/it]
Skipping the first batches:  52%|█████▏    | 3146/6000 [3:05:21<2:55:49,  3.70s/it]
Skipping the first batches:  52%|█████▏    | 3147/6000 [3:05:24<2:49:51,  3.57s/it]
Skipping the first batches:  52%|█████▏    | 3148/6000 [3:05:28<2:54:09,  3.66s/it]
Skipping the first batches:  52%|█████▏    | 3149/6000 [3:05:32<2:51:02,  3.60s/it]
Skipping the first batches:  52%|█████▎    | 3150/6000 [3:05:35<2:47:06,  3.52s/it]
Skipping the first batches:  53%|█████▎    | 3151/6000 [3:05:39<2:50:20,  3.59s/it]
Skipping the first batches:  53%|█████▎    | 3152/6000 [3:05:43<3:06:17,  3.92s/it]
Skipping the first batches:  53%|█████▎    | 3153/6000 [3:05:49<3:30:23,  4.43s/it]
Skipping the first batches:  53%|█████▎    | 3154/6000 [3:05:52<3:13:36,  4.08s/it]
Skipping the first batches:  53%|█████▎    | 3155/6000 [3:05:57<3:19:19,  4.20s/it]
Skipping the first batches:  53%|█████▎    | 3156/6000 [3:06:00<3:09:11,  3.99s/it]
Skipping the first batches:  53%|█████▎    | 3157/6000 [3:06:04<3:04:21,  3.89s/it]
Skipping the first batches:  53%|█████▎    | 3158/6000 [3:06:07<2:56:59,  3.74s/it]
Skipping the first batches:  53%|█████▎    | 3159/6000 [3:06:11<2:59:29,  3.79s/it]
Skipping the first batches:  53%|█████▎    | 3160/6000 [3:06:14<2:51:12,  3.62s/it]
Skipping the first batches:  53%|█████▎    | 3161/6000 [3:06:22<3:46:53,  4.80s/it]
Skipping the first batches:  53%|█████▎    | 3162/6000 [3:06:27<3:45:26,  4.77s/it]
Skipping the first batches:  53%|█████▎    | 3163/6000 [3:06:31<3:34:55,  4.55s/it]
Skipping the first batches:  53%|█████▎    | 3164/6000 [3:06:34<3:16:19,  4.15s/it]
Skipping the first batches:  53%|█████▎    | 3165/6000 [3:06:37<3:03:36,  3.89s/it]
Skipping the first batches:  53%|█████▎    | 3166/6000 [3:06:42<3:14:32,  4.12s/it]
Skipping the first batches:  53%|█████▎    | 3167/6000 [3:06:45<3:02:33,  3.87s/it]
Skipping the first batches:  53%|█████▎    | 3168/6000 [3:06:48<2:51:38,  3.64s/it]
Skipping the first batches:  53%|█████▎    | 3169/6000 [3:06:52<2:48:26,  3.57s/it]
Skipping the first batches:  53%|█████▎    | 3170/6000 [3:06:55<2:42:52,  3.45s/it]
Skipping the first batches:  53%|█████▎    | 3171/6000 [3:06:58<2:40:48,  3.41s/it]
Skipping the first batches:  53%|█████▎    | 3172/6000 [3:07:02<2:47:24,  3.55s/it]
Skipping the first batches:  53%|█████▎    | 3173/6000 [3:07:06<2:46:39,  3.54s/it]
Skipping the first batches:  53%|█████▎    | 3174/6000 [3:07:09<2:42:39,  3.45s/it]
Skipping the first batches:  53%|█████▎    | 3175/6000 [3:07:12<2:42:32,  3.45s/it]
Skipping the first batches:  53%|█████▎    | 3176/6000 [3:07:15<2:38:32,  3.37s/it]
Skipping the first batches:  53%|█████▎    | 3177/6000 [3:07:19<2:41:02,  3.42s/it]
Skipping the first batches:  53%|█████▎    | 3178/6000 [3:07:24<3:05:00,  3.93s/it]
Skipping the first batches:  53%|█████▎    | 3179/6000 [3:07:27<2:55:30,  3.73s/it]
Skipping the first batches:  53%|█████▎    | 3180/6000 [3:07:32<3:08:24,  4.01s/it]
Skipping the first batches:  53%|█████▎    | 3181/6000 [3:07:36<3:01:21,  3.86s/it]
Skipping the first batches:  53%|█████▎    | 3182/6000 [3:07:39<2:50:27,  3.63s/it]
Skipping the first batches:  53%|█████▎    | 3183/6000 [3:07:43<2:57:35,  3.78s/it]
Skipping the first batches:  53%|█████▎    | 3184/6000 [3:07:46<2:57:02,  3.77s/it]
Skipping the first batches:  53%|█████▎    | 3185/6000 [3:07:50<2:53:48,  3.70s/it]
Skipping the first batches:  53%|█████▎    | 3186/6000 [3:07:53<2:48:25,  3.59s/it]
Skipping the first batches:  53%|█████▎    | 3187/6000 [3:07:57<2:46:18,  3.55s/it]
Skipping the first batches:  53%|█████▎    | 3188/6000 [3:08:00<2:42:11,  3.46s/it]
Skipping the first batches:  53%|█████▎    | 3189/6000 [3:08:04<2:46:50,  3.56s/it]
Skipping the first batches:  53%|█████▎    | 3190/6000 [3:08:07<2:41:21,  3.45s/it]
Skipping the first batches:  53%|█████▎    | 3191/6000 [3:08:10<2:40:50,  3.44s/it]
Skipping the first batches:  53%|█████▎    | 3192/6000 [3:08:14<2:42:17,  3.47s/it]
Skipping the first batches:  53%|█████▎    | 3193/6000 [3:08:17<2:39:05,  3.40s/it]
Skipping the first batches:  53%|█████▎    | 3194/6000 [3:08:21<2:41:26,  3.45s/it]
Skipping the first batches:  53%|█████▎    | 3195/6000 [3:08:24<2:42:28,  3.48s/it]
Skipping the first batches:  53%|█████▎    | 3196/6000 [3:08:27<2:37:09,  3.36s/it]
Skipping the first batches:  53%|█████▎    | 3197/6000 [3:08:31<2:36:39,  3.35s/it]
Skipping the first batches:  53%|█████▎    | 3198/6000 [3:08:34<2:41:27,  3.46s/it]
Skipping the first batches:  53%|█████▎    | 3199/6000 [3:08:38<2:46:38,  3.57s/it]
Skipping the first batches:  53%|█████▎    | 3200/6000 [3:08:42<2:42:28,  3.48s/it]
Skipping the first batches:  53%|█████▎    | 3201/6000 [3:08:45<2:40:25,  3.44s/it]
Skipping the first batches:  53%|█████▎    | 3202/6000 [3:08:49<2:42:56,  3.49s/it]
Skipping the first batches:  53%|█████▎    | 3203/6000 [3:08:52<2:39:37,  3.42s/it]
Skipping the first batches:  53%|█████▎    | 3204/6000 [3:08:55<2:43:16,  3.50s/it]
Skipping the first batches:  53%|█████▎    | 3205/6000 [3:08:59<2:43:58,  3.52s/it]
Skipping the first batches:  53%|█████▎    | 3206/6000 [3:09:04<3:00:25,  3.87s/it]
Skipping the first batches:  53%|█████▎    | 3207/6000 [3:09:07<2:55:46,  3.78s/it]
Skipping the first batches:  53%|█████▎    | 3208/6000 [3:09:11<2:58:37,  3.84s/it]
Skipping the first batches:  53%|█████▎    | 3209/6000 [3:09:15<2:54:42,  3.76s/it]
Skipping the first batches:  54%|█████▎    | 3210/6000 [3:09:18<2:52:09,  3.70s/it]
Skipping the first batches:  54%|█████▎    | 3211/6000 [3:09:22<2:48:44,  3.63s/it]
Skipping the first batches:  54%|█████▎    | 3212/6000 [3:09:26<2:50:06,  3.66s/it]
Skipping the first batches:  54%|█████▎    | 3213/6000 [3:09:29<2:43:21,  3.52s/it]
Skipping the first batches:  54%|█████▎    | 3214/6000 [3:09:32<2:40:16,  3.45s/it]
Skipping the first batches:  54%|█████▎    | 3215/6000 [3:09:36<2:52:52,  3.72s/it]
Skipping the first batches:  54%|█████▎    | 3216/6000 [3:09:42<3:12:38,  4.15s/it]
Skipping the first batches:  54%|█████▎    | 3217/6000 [3:09:45<3:01:35,  3.92s/it]
Skipping the first batches:  54%|█████▎    | 3218/6000 [3:09:48<2:55:04,  3.78s/it]
Skipping the first batches:  54%|█████▎    | 3219/6000 [3:09:52<2:48:51,  3.64s/it]
Skipping the first batches:  54%|█████▎    | 3220/6000 [3:09:56<2:54:09,  3.76s/it]
Skipping the first batches:  54%|█████▎    | 3221/6000 [3:10:00<3:01:26,  3.92s/it]
Skipping the first batches:  54%|█████▎    | 3222/6000 [3:10:05<3:09:04,  4.08s/it]
Skipping the first batches:  54%|█████▎    | 3223/6000 [3:10:08<3:01:13,  3.92s/it]
Skipping the first batches:  54%|█████▎    | 3224/6000 [3:10:11<2:51:55,  3.72s/it]
Skipping the first batches:  54%|█████▍    | 3225/6000 [3:10:16<3:08:26,  4.07s/it]
Skipping the first batches:  54%|█████▍    | 3226/6000 [3:10:20<2:59:47,  3.89s/it]
Skipping the first batches:  54%|█████▍    | 3227/6000 [3:10:24<3:09:42,  4.10s/it]
Skipping the first batches:  54%|█████▍    | 3228/6000 [3:10:28<2:58:49,  3.87s/it]
Skipping the first batches:  54%|█████▍    | 3229/6000 [3:10:32<3:00:58,  3.92s/it]
Skipping the first batches:  54%|█████▍    | 3230/6000 [3:10:35<2:49:04,  3.66s/it]
Skipping the first batches:  54%|█████▍    | 3231/6000 [3:10:38<2:44:06,  3.56s/it]
Skipping the first batches:  54%|█████▍    | 3232/6000 [3:10:42<2:44:39,  3.57s/it]
Skipping the first batches:  54%|█████▍    | 3233/6000 [3:10:45<2:40:16,  3.48s/it]
Skipping the first batches:  54%|█████▍    | 3234/6000 [3:10:50<2:59:16,  3.89s/it]
Skipping the first batches:  54%|█████▍    | 3235/6000 [3:10:54<3:04:51,  4.01s/it]
Skipping the first batches:  54%|█████▍    | 3236/6000 [3:10:57<2:54:47,  3.79s/it]
Skipping the first batches:  54%|█████▍    | 3237/6000 [3:11:01<2:59:13,  3.89s/it]
Skipping the first batches:  54%|█████▍    | 3238/6000 [3:11:07<3:19:26,  4.33s/it]
Skipping the first batches:  54%|█████▍    | 3239/6000 [3:11:10<3:06:47,  4.06s/it]
Skipping the first batches:  54%|█████▍    | 3240/6000 [3:11:13<2:55:36,  3.82s/it]
Skipping the first batches:  54%|█████▍    | 3241/6000 [3:11:17<2:49:14,  3.68s/it]
Skipping the first batches:  54%|█████▍    | 3242/6000 [3:11:20<2:46:50,  3.63s/it]
Skipping the first batches:  54%|█████▍    | 3243/6000 [3:11:24<2:48:19,  3.66s/it]
Skipping the first batches:  54%|█████▍    | 3244/6000 [3:11:28<2:46:15,  3.62s/it]
Skipping the first batches:  54%|█████▍    | 3245/6000 [3:11:31<2:40:36,  3.50s/it]
Skipping the first batches:  54%|█████▍    | 3246/6000 [3:11:35<2:47:17,  3.64s/it]
Skipping the first batches:  54%|█████▍    | 3247/6000 [3:11:41<3:16:59,  4.29s/it]
Skipping the first batches:  54%|█████▍    | 3248/6000 [3:11:44<3:09:36,  4.13s/it]
Skipping the first batches:  54%|█████▍    | 3249/6000 [3:11:48<2:57:27,  3.87s/it]
Skipping the first batches:  54%|█████▍    | 3250/6000 [3:11:51<2:54:14,  3.80s/it]
Skipping the first batches:  54%|█████▍    | 3251/6000 [3:11:54<2:45:27,  3.61s/it]
Skipping the first batches:  54%|█████▍    | 3252/6000 [3:11:58<2:49:01,  3.69s/it]
Skipping the first batches:  54%|█████▍    | 3253/6000 [3:12:02<2:48:53,  3.69s/it]
Skipping the first batches:  54%|█████▍    | 3254/6000 [3:12:05<2:42:17,  3.55s/it]
Skipping the first batches:  54%|█████▍    | 3255/6000 [3:12:09<2:42:04,  3.54s/it]
Skipping the first batches:  54%|█████▍    | 3256/6000 [3:12:13<2:49:22,  3.70s/it]
Skipping the first batches:  54%|█████▍    | 3257/6000 [3:12:16<2:43:47,  3.58s/it]
Skipping the first batches:  54%|█████▍    | 3258/6000 [3:12:19<2:40:26,  3.51s/it]
Skipping the first batches:  54%|█████▍    | 3259/6000 [3:12:23<2:41:17,  3.53s/it]
Skipping the first batches:  54%|█████▍    | 3260/6000 [3:12:28<2:57:32,  3.89s/it]
Skipping the first batches:  54%|█████▍    | 3261/6000 [3:12:31<2:49:25,  3.71s/it]
Skipping the first batches:  54%|█████▍    | 3262/6000 [3:12:34<2:42:14,  3.56s/it]
Skipping the first batches:  54%|█████▍    | 3263/6000 [3:12:38<2:39:35,  3.50s/it]
Skipping the first batches:  54%|█████▍    | 3264/6000 [3:12:41<2:42:25,  3.56s/it]
Skipping the first batches:  54%|█████▍    | 3265/6000 [3:12:45<2:40:36,  3.52s/it]
Skipping the first batches:  54%|█████▍    | 3266/6000 [3:12:48<2:37:02,  3.45s/it]
Skipping the first batches:  54%|█████▍    | 3267/6000 [3:12:52<2:41:22,  3.54s/it]
Skipping the first batches:  54%|█████▍    | 3268/6000 [3:12:55<2:42:27,  3.57s/it]
Skipping the first batches:  54%|█████▍    | 3269/6000 [3:12:59<2:40:31,  3.53s/it]
Skipping the first batches:  55%|█████▍    | 3270/6000 [3:13:03<2:44:03,  3.61s/it]
Skipping the first batches:  55%|█████▍    | 3271/6000 [3:13:06<2:38:32,  3.49s/it]
Skipping the first batches:  55%|█████▍    | 3272/6000 [3:13:09<2:32:59,  3.36s/it]
Skipping the first batches:  55%|█████▍    | 3273/6000 [3:13:13<2:36:11,  3.44s/it]
Skipping the first batches:  55%|█████▍    | 3274/6000 [3:13:16<2:41:00,  3.54s/it]
Skipping the first batches:  55%|█████▍    | 3275/6000 [3:13:20<2:44:00,  3.61s/it]
Skipping the first batches:  55%|█████▍    | 3276/6000 [3:13:24<2:44:05,  3.61s/it]
Skipping the first batches:  55%|█████▍    | 3277/6000 [3:13:28<2:47:18,  3.69s/it]
Skipping the first batches:  55%|█████▍    | 3278/6000 [3:13:31<2:50:18,  3.75s/it]
Skipping the first batches:  55%|█████▍    | 3279/6000 [3:13:35<2:43:18,  3.60s/it]
Skipping the first batches:  55%|█████▍    | 3280/6000 [3:13:38<2:37:37,  3.48s/it]
Skipping the first batches:  55%|█████▍    | 3281/6000 [3:13:42<2:47:46,  3.70s/it]
Skipping the first batches:  55%|█████▍    | 3282/6000 [3:13:46<2:48:55,  3.73s/it]
Skipping the first batches:  55%|█████▍    | 3283/6000 [3:13:49<2:40:02,  3.53s/it]
Skipping the first batches:  55%|█████▍    | 3284/6000 [3:13:53<2:41:22,  3.56s/it]
Skipping the first batches:  55%|█████▍    | 3285/6000 [3:13:56<2:41:31,  3.57s/it]
Skipping the first batches:  55%|█████▍    | 3286/6000 [3:14:00<2:49:56,  3.76s/it]
Skipping the first batches:  55%|█████▍    | 3287/6000 [3:14:04<2:43:58,  3.63s/it]
Skipping the first batches:  55%|█████▍    | 3288/6000 [3:14:08<2:50:35,  3.77s/it]
Skipping the first batches:  55%|█████▍    | 3289/6000 [3:14:12<2:59:19,  3.97s/it]
Skipping the first batches:  55%|█████▍    | 3290/6000 [3:14:16<2:50:25,  3.77s/it]
Skipping the first batches:  55%|█████▍    | 3291/6000 [3:14:19<2:41:45,  3.58s/it]
Skipping the first batches:  55%|█████▍    | 3292/6000 [3:14:25<3:11:22,  4.24s/it]
Skipping the first batches:  55%|█████▍    | 3293/6000 [3:14:28<2:56:37,  3.91s/it]
Skipping the first batches:  55%|█████▍    | 3294/6000 [3:14:31<2:47:02,  3.70s/it]
Skipping the first batches:  55%|█████▍    | 3295/6000 [3:14:34<2:44:10,  3.64s/it]
Skipping the first batches:  55%|█████▍    | 3296/6000 [3:14:38<2:38:32,  3.52s/it]
Skipping the first batches:  55%|█████▍    | 3297/6000 [3:14:41<2:36:25,  3.47s/it]
Skipping the first batches:  55%|█████▍    | 3298/6000 [3:14:46<2:54:21,  3.87s/it]
Skipping the first batches:  55%|█████▍    | 3299/6000 [3:14:49<2:51:29,  3.81s/it]
Skipping the first batches:  55%|█████▌    | 3300/6000 [3:14:53<2:41:53,  3.60s/it]
Skipping the first batches:  55%|█████▌    | 3301/6000 [3:14:56<2:44:42,  3.66s/it]
Skipping the first batches:  55%|█████▌    | 3302/6000 [3:15:00<2:41:06,  3.58s/it]
Skipping the first batches:  55%|█████▌    | 3303/6000 [3:15:04<2:45:53,  3.69s/it]
Skipping the first batches:  55%|█████▌    | 3304/6000 [3:15:08<2:47:28,  3.73s/it]
Skipping the first batches:  55%|█████▌    | 3305/6000 [3:15:11<2:44:07,  3.65s/it]
Skipping the first batches:  55%|█████▌    | 3306/6000 [3:15:14<2:38:55,  3.54s/it]
Skipping the first batches:  55%|█████▌    | 3307/6000 [3:15:18<2:46:18,  3.71s/it]
Skipping the first batches:  55%|█████▌    | 3308/6000 [3:15:23<2:58:30,  3.98s/it]
Skipping the first batches:  55%|█████▌    | 3309/6000 [3:15:26<2:52:18,  3.84s/it]
Skipping the first batches:  55%|█████▌    | 3310/6000 [3:15:30<2:49:39,  3.78s/it]
Skipping the first batches:  55%|█████▌    | 3311/6000 [3:15:34<2:52:00,  3.84s/it]
Skipping the first batches:  55%|█████▌    | 3312/6000 [3:15:38<2:48:40,  3.77s/it]
Skipping the first batches:  55%|█████▌    | 3313/6000 [3:15:41<2:42:06,  3.62s/it]
Skipping the first batches:  55%|█████▌    | 3314/6000 [3:15:45<2:41:20,  3.60s/it]
Skipping the first batches:  55%|█████▌    | 3315/6000 [3:15:48<2:40:08,  3.58s/it]
Skipping the first batches:  55%|█████▌    | 3316/6000 [3:15:52<2:38:20,  3.54s/it]
Skipping the first batches:  55%|█████▌    | 3317/6000 [3:15:55<2:33:20,  3.43s/it]
Skipping the first batches:  55%|█████▌    | 3318/6000 [3:15:58<2:32:34,  3.41s/it]
Skipping the first batches:  55%|█████▌    | 3319/6000 [3:16:03<2:53:43,  3.89s/it]
Skipping the first batches:  55%|█████▌    | 3320/6000 [3:16:07<2:59:47,  4.03s/it]
Skipping the first batches:  55%|█████▌    | 3321/6000 [3:16:11<2:49:25,  3.79s/it]
Skipping the first batches:  55%|█████▌    | 3322/6000 [3:16:15<2:50:55,  3.83s/it]
Skipping the first batches:  55%|█████▌    | 3323/6000 [3:16:19<2:52:35,  3.87s/it]
Skipping the first batches:  55%|█████▌    | 3324/6000 [3:16:22<2:52:35,  3.87s/it]
Skipping the first batches:  55%|█████▌    | 3325/6000 [3:16:27<2:57:35,  3.98s/it]
Skipping the first batches:  55%|█████▌    | 3326/6000 [3:16:30<2:55:29,  3.94s/it]
Skipping the first batches:  55%|█████▌    | 3327/6000 [3:16:34<2:48:56,  3.79s/it]
Skipping the first batches:  55%|█████▌    | 3328/6000 [3:16:37<2:39:33,  3.58s/it]
Skipping the first batches:  55%|█████▌    | 3329/6000 [3:16:41<2:44:31,  3.70s/it]
Skipping the first batches:  56%|█████▌    | 3330/6000 [3:16:45<2:49:36,  3.81s/it]
Skipping the first batches:  56%|█████▌    | 3331/6000 [3:16:48<2:39:33,  3.59s/it]
Skipping the first batches:  56%|█████▌    | 3332/6000 [3:16:51<2:32:35,  3.43s/it]
Skipping the first batches:  56%|█████▌    | 3333/6000 [3:16:55<2:32:37,  3.43s/it]
Skipping the first batches:  56%|█████▌    | 3334/6000 [3:16:58<2:34:38,  3.48s/it]
Skipping the first batches:  56%|█████▌    | 3335/6000 [3:17:01<2:29:18,  3.36s/it]
Skipping the first batches:  56%|█████▌    | 3336/6000 [3:17:05<2:36:26,  3.52s/it]
Skipping the first batches:  56%|█████▌    | 3337/6000 [3:17:10<2:48:17,  3.79s/it]
Skipping the first batches:  56%|█████▌    | 3338/6000 [3:17:13<2:46:33,  3.75s/it]
Skipping the first batches:  56%|█████▌    | 3339/6000 [3:17:16<2:38:18,  3.57s/it]
Skipping the first batches:  56%|█████▌    | 3340/6000 [3:17:21<2:49:29,  3.82s/it]
Skipping the first batches:  56%|█████▌    | 3341/6000 [3:17:24<2:41:30,  3.64s/it]
Skipping the first batches:  56%|█████▌    | 3342/6000 [3:17:28<2:38:56,  3.59s/it]
Skipping the first batches:  56%|█████▌    | 3343/6000 [3:17:31<2:32:15,  3.44s/it]
Skipping the first batches:  56%|█████▌    | 3344/6000 [3:17:35<2:38:12,  3.57s/it]
Skipping the first batches:  56%|█████▌    | 3345/6000 [3:17:38<2:31:58,  3.43s/it]
Skipping the first batches:  56%|█████▌    | 3346/6000 [3:17:41<2:31:13,  3.42s/it]
Skipping the first batches:  56%|█████▌    | 3347/6000 [3:17:45<2:33:51,  3.48s/it]
Skipping the first batches:  56%|█████▌    | 3348/6000 [3:17:48<2:33:34,  3.47s/it]
Skipping the first batches:  56%|█████▌    | 3349/6000 [3:17:51<2:29:20,  3.38s/it]
Skipping the first batches:  56%|█████▌    | 3350/6000 [3:17:54<2:26:37,  3.32s/it]
Skipping the first batches:  56%|█████▌    | 3351/6000 [3:17:58<2:27:38,  3.34s/it]
Skipping the first batches:  56%|█████▌    | 3352/6000 [3:18:01<2:26:47,  3.33s/it]
Skipping the first batches:  56%|█████▌    | 3353/6000 [3:18:04<2:24:46,  3.28s/it]
Skipping the first batches:  56%|█████▌    | 3354/6000 [3:18:08<2:24:55,  3.29s/it]
Skipping the first batches:  56%|█████▌    | 3355/6000 [3:18:11<2:31:33,  3.44s/it]
Skipping the first batches:  56%|█████▌    | 3356/6000 [3:18:15<2:40:21,  3.64s/it]
Skipping the first batches:  56%|█████▌    | 3357/6000 [3:18:19<2:37:25,  3.57s/it]
Skipping the first batches:  56%|█████▌    | 3358/6000 [3:18:23<2:39:12,  3.62s/it]
Skipping the first batches:  56%|█████▌    | 3359/6000 [3:18:26<2:41:48,  3.68s/it]
Skipping the first batches:  56%|█████▌    | 3360/6000 [3:18:30<2:41:43,  3.68s/it]
Skipping the first batches:  56%|█████▌    | 3361/6000 [3:18:35<2:55:30,  3.99s/it]
Skipping the first batches:  56%|█████▌    | 3362/6000 [3:18:38<2:46:41,  3.79s/it]
Skipping the first batches:  56%|█████▌    | 3363/6000 [3:18:42<2:45:46,  3.77s/it]
Skipping the first batches:  56%|█████▌    | 3364/6000 [3:18:45<2:39:56,  3.64s/it]
Skipping the first batches:  56%|█████▌    | 3365/6000 [3:18:49<2:42:23,  3.70s/it]
Skipping the first batches:  56%|█████▌    | 3366/6000 [3:18:53<2:39:32,  3.63s/it]
Skipping the first batches:  56%|█████▌    | 3367/6000 [3:18:56<2:32:33,  3.48s/it]
Skipping the first batches:  56%|█████▌    | 3368/6000 [3:18:59<2:32:00,  3.47s/it]
Skipping the first batches:  56%|█████▌    | 3369/6000 [3:19:03<2:31:23,  3.45s/it]
Skipping the first batches:  56%|█████▌    | 3370/6000 [3:19:06<2:29:21,  3.41s/it]
Skipping the first batches:  56%|█████▌    | 3371/6000 [3:19:11<2:49:45,  3.87s/it]
Skipping the first batches:  56%|█████▌    | 3372/6000 [3:19:15<2:48:17,  3.84s/it]
Skipping the first batches:  56%|█████▌    | 3373/6000 [3:19:18<2:47:41,  3.83s/it]
Skipping the first batches:  56%|█████▌    | 3374/6000 [3:19:22<2:43:04,  3.73s/it]
Skipping the first batches:  56%|█████▋    | 3375/6000 [3:19:25<2:34:53,  3.54s/it]
Skipping the first batches:  56%|█████▋    | 3376/6000 [3:19:29<2:37:57,  3.61s/it]
Skipping the first batches:  56%|█████▋    | 3377/6000 [3:19:32<2:31:15,  3.46s/it]
Skipping the first batches:  56%|█████▋    | 3378/6000 [3:19:35<2:28:55,  3.41s/it]
Skipping the first batches:  56%|█████▋    | 3379/6000 [3:19:39<2:39:43,  3.66s/it]
Skipping the first batches:  56%|█████▋    | 3380/6000 [3:19:43<2:32:58,  3.50s/it]
Skipping the first batches:  56%|█████▋    | 3381/6000 [3:19:46<2:30:11,  3.44s/it]
Skipping the first batches:  56%|█████▋    | 3382/6000 [3:19:50<2:34:48,  3.55s/it]
Skipping the first batches:  56%|█████▋    | 3383/6000 [3:19:53<2:33:17,  3.51s/it]
Skipping the first batches:  56%|█████▋    | 3384/6000 [3:19:56<2:28:41,  3.41s/it]
Skipping the first batches:  56%|█████▋    | 3385/6000 [3:20:00<2:29:24,  3.43s/it]
Skipping the first batches:  56%|█████▋    | 3386/6000 [3:20:03<2:26:25,  3.36s/it]
Skipping the first batches:  56%|█████▋    | 3387/6000 [3:20:06<2:25:40,  3.34s/it]
Skipping the first batches:  56%|█████▋    | 3388/6000 [3:20:09<2:23:56,  3.31s/it]
Skipping the first batches:  56%|█████▋    | 3389/6000 [3:20:13<2:23:15,  3.29s/it]
Skipping the first batches:  56%|█████▋    | 3390/6000 [3:20:16<2:25:35,  3.35s/it]
Skipping the first batches:  57%|█████▋    | 3391/6000 [3:20:19<2:25:34,  3.35s/it]
Skipping the first batches:  57%|█████▋    | 3392/6000 [3:20:23<2:25:11,  3.34s/it]
Skipping the first batches:  57%|█████▋    | 3393/6000 [3:20:26<2:27:57,  3.41s/it]
Skipping the first batches:  57%|█████▋    | 3394/6000 [3:20:30<2:36:19,  3.60s/it]
Skipping the first batches:  57%|█████▋    | 3395/6000 [3:20:34<2:38:56,  3.66s/it]
Skipping the first batches:  57%|█████▋    | 3396/6000 [3:20:38<2:41:20,  3.72s/it]
Skipping the first batches:  57%|█████▋    | 3397/6000 [3:20:41<2:37:10,  3.62s/it]
Skipping the first batches:  57%|█████▋    | 3398/6000 [3:20:46<2:44:46,  3.80s/it]
Skipping the first batches:  57%|█████▋    | 3399/6000 [3:20:49<2:43:02,  3.76s/it]
Skipping the first batches:  57%|█████▋    | 3400/6000 [3:20:53<2:40:11,  3.70s/it]
Skipping the first batches:  57%|█████▋    | 3401/6000 [3:20:56<2:36:42,  3.62s/it]
Skipping the first batches:  57%|█████▋    | 3402/6000 [3:21:00<2:34:35,  3.57s/it]
Skipping the first batches:  57%|█████▋    | 3403/6000 [3:21:03<2:31:48,  3.51s/it]
Skipping the first batches:  57%|█████▋    | 3404/6000 [3:21:07<2:30:12,  3.47s/it]
Skipping the first batches:  57%|█████▋    | 3405/6000 [3:21:10<2:28:09,  3.43s/it]
Skipping the first batches:  57%|█████▋    | 3406/6000 [3:21:13<2:24:15,  3.34s/it]
Skipping the first batches:  57%|█████▋    | 3407/6000 [3:21:17<2:27:53,  3.42s/it]
Skipping the first batches:  57%|█████▋    | 3408/6000 [3:21:21<2:37:34,  3.65s/it]
Skipping the first batches:  57%|█████▋    | 3409/6000 [3:21:24<2:35:47,  3.61s/it]
Skipping the first batches:  57%|█████▋    | 3410/6000 [3:21:29<2:43:42,  3.79s/it]
Skipping the first batches:  57%|█████▋    | 3411/6000 [3:21:33<2:48:02,  3.89s/it]
Skipping the first batches:  57%|█████▋    | 3412/6000 [3:21:36<2:45:33,  3.84s/it]
Skipping the first batches:  57%|█████▋    | 3413/6000 [3:21:40<2:38:47,  3.68s/it]
Skipping the first batches:  57%|█████▋    | 3414/6000 [3:21:44<2:40:29,  3.72s/it]
Skipping the first batches:  57%|█████▋    | 3415/6000 [3:21:48<2:44:22,  3.82s/it]
Skipping the first batches:  57%|█████▋    | 3416/6000 [3:21:51<2:36:45,  3.64s/it]
Skipping the first batches:  57%|█████▋    | 3417/6000 [3:21:54<2:32:03,  3.53s/it]
Skipping the first batches:  57%|█████▋    | 3418/6000 [3:21:59<2:54:20,  4.05s/it]
Skipping the first batches:  57%|█████▋    | 3419/6000 [3:22:04<3:07:57,  4.37s/it]
Skipping the first batches:  57%|█████▋    | 3420/6000 [3:22:10<3:23:03,  4.72s/it]
Skipping the first batches:  57%|█████▋    | 3421/6000 [3:22:13<3:06:10,  4.33s/it]
Skipping the first batches:  57%|█████▋    | 3422/6000 [3:22:17<2:50:47,  3.97s/it]
Skipping the first batches:  57%|█████▋    | 3423/6000 [3:22:20<2:44:28,  3.83s/it]
Skipping the first batches:  57%|█████▋    | 3424/6000 [3:22:23<2:39:08,  3.71s/it]
Skipping the first batches:  57%|█████▋    | 3425/6000 [3:22:27<2:35:40,  3.63s/it]
Skipping the first batches:  57%|█████▋    | 3426/6000 [3:22:31<2:35:44,  3.63s/it]
Skipping the first batches:  57%|█████▋    | 3427/6000 [3:22:34<2:31:55,  3.54s/it]
Skipping the first batches:  57%|█████▋    | 3428/6000 [3:22:37<2:31:14,  3.53s/it]
Skipping the first batches:  57%|█████▋    | 3429/6000 [3:22:41<2:37:07,  3.67s/it]
Skipping the first batches:  57%|█████▋    | 3430/6000 [3:22:45<2:30:39,  3.52s/it]
Skipping the first batches:  57%|█████▋    | 3431/6000 [3:22:48<2:25:20,  3.39s/it]
Skipping the first batches:  57%|█████▋    | 3432/6000 [3:22:51<2:27:34,  3.45s/it]
Skipping the first batches:  57%|█████▋    | 3433/6000 [3:22:55<2:25:55,  3.41s/it]
Skipping the first batches:  57%|█████▋    | 3434/6000 [3:22:58<2:23:30,  3.36s/it]
Skipping the first batches:  57%|█████▋    | 3435/6000 [3:23:01<2:23:53,  3.37s/it]
Skipping the first batches:  57%|█████▋    | 3436/6000 [3:23:05<2:25:23,  3.40s/it]
Skipping the first batches:  57%|█████▋    | 3437/6000 [3:23:08<2:24:28,  3.38s/it]
Skipping the first batches:  57%|█████▋    | 3438/6000 [3:23:12<2:28:19,  3.47s/it]
Skipping the first batches:  57%|█████▋    | 3439/6000 [3:23:15<2:28:00,  3.47s/it]
Skipping the first batches:  57%|█████▋    | 3440/6000 [3:23:18<2:24:17,  3.38s/it]
Skipping the first batches:  57%|█████▋    | 3441/6000 [3:23:22<2:27:23,  3.46s/it]
Skipping the first batches:  57%|█████▋    | 3442/6000 [3:23:25<2:25:42,  3.42s/it]
Skipping the first batches:  57%|█████▋    | 3443/6000 [3:23:28<2:21:41,  3.32s/it]
Skipping the first batches:  57%|█████▋    | 3444/6000 [3:23:32<2:21:04,  3.31s/it]
Skipping the first batches:  57%|█████▋    | 3445/6000 [3:23:35<2:23:57,  3.38s/it]
Skipping the first batches:  57%|█████▋    | 3446/6000 [3:23:38<2:22:44,  3.35s/it]
Skipping the first batches:  57%|█████▋    | 3447/6000 [3:23:42<2:20:16,  3.30s/it]
Skipping the first batches:  57%|█████▋    | 3448/6000 [3:23:45<2:22:31,  3.35s/it]
Skipping the first batches:  57%|█████▋    | 3449/6000 [3:23:48<2:20:43,  3.31s/it]
Skipping the first batches:  57%|█████▊    | 3450/6000 [3:23:51<2:17:38,  3.24s/it]
Skipping the first batches:  58%|█████▊    | 3451/6000 [3:23:55<2:17:13,  3.23s/it]
Skipping the first batches:  58%|█████▊    | 3452/6000 [3:23:58<2:24:47,  3.41s/it]
Skipping the first batches:  58%|█████▊    | 3453/6000 [3:24:02<2:20:48,  3.32s/it]
Skipping the first batches:  58%|█████▊    | 3454/6000 [3:24:05<2:22:39,  3.36s/it]
Skipping the first batches:  58%|█████▊    | 3455/6000 [3:24:08<2:19:53,  3.30s/it]
Skipping the first batches:  58%|█████▊    | 3456/6000 [3:24:11<2:19:45,  3.30s/it]
Skipping the first batches:  58%|█████▊    | 3457/6000 [3:24:15<2:25:18,  3.43s/it]
Skipping the first batches:  58%|█████▊    | 3458/6000 [3:24:18<2:21:28,  3.34s/it]
Skipping the first batches:  58%|█████▊    | 3459/6000 [3:24:21<2:19:24,  3.29s/it]
Skipping the first batches:  58%|█████▊    | 3460/6000 [3:24:25<2:22:41,  3.37s/it]
Skipping the first batches:  58%|█████▊    | 3461/6000 [3:24:29<2:25:39,  3.44s/it]
Skipping the first batches:  58%|█████▊    | 3462/6000 [3:24:32<2:25:03,  3.43s/it]
Skipping the first batches:  58%|█████▊    | 3463/6000 [3:24:37<2:38:31,  3.75s/it]
Skipping the first batches:  58%|█████▊    | 3464/6000 [3:24:41<2:45:12,  3.91s/it]
Skipping the first batches:  58%|█████▊    | 3465/6000 [3:24:45<2:46:52,  3.95s/it]
Skipping the first batches:  58%|█████▊    | 3466/6000 [3:24:48<2:38:40,  3.76s/it]
Skipping the first batches:  58%|█████▊    | 3467/6000 [3:24:52<2:34:32,  3.66s/it]
Skipping the first batches:  58%|█████▊    | 3468/6000 [3:24:55<2:31:35,  3.59s/it]
Skipping the first batches:  58%|█████▊    | 3469/6000 [3:24:58<2:27:09,  3.49s/it]
Skipping the first batches:  58%|█████▊    | 3470/6000 [3:25:02<2:25:17,  3.45s/it]
Skipping the first batches:  58%|█████▊    | 3471/6000 [3:25:05<2:22:48,  3.39s/it]
Skipping the first batches:  58%|█████▊    | 3472/6000 [3:25:09<2:28:28,  3.52s/it]
Skipping the first batches:  58%|█████▊    | 3473/6000 [3:25:12<2:25:13,  3.45s/it]
Skipping the first batches:  58%|█████▊    | 3474/6000 [3:25:15<2:22:42,  3.39s/it]
Skipping the first batches:  58%|█████▊    | 3475/6000 [3:25:20<2:41:15,  3.83s/it]
Skipping the first batches:  58%|█████▊    | 3476/6000 [3:25:23<2:33:51,  3.66s/it]
Skipping the first batches:  58%|█████▊    | 3477/6000 [3:25:26<2:27:06,  3.50s/it]
Skipping the first batches:  58%|█████▊    | 3478/6000 [3:25:30<2:30:40,  3.58s/it]
Skipping the first batches:  58%|█████▊    | 3479/6000 [3:25:36<2:56:34,  4.20s/it]
Skipping the first batches:  58%|█████▊    | 3480/6000 [3:25:41<3:09:33,  4.51s/it]
Skipping the first batches:  58%|█████▊    | 3481/6000 [3:25:45<3:00:19,  4.30s/it]
Skipping the first batches:  58%|█████▊    | 3482/6000 [3:25:48<2:46:32,  3.97s/it]
Skipping the first batches:  58%|█████▊    | 3483/6000 [3:25:52<2:42:36,  3.88s/it]
Skipping the first batches:  58%|█████▊    | 3484/6000 [3:25:55<2:32:46,  3.64s/it]
Skipping the first batches:  58%|█████▊    | 3485/6000 [3:25:58<2:25:22,  3.47s/it]
Skipping the first batches:  58%|█████▊    | 3486/6000 [3:26:02<2:33:31,  3.66s/it]
Skipping the first batches:  58%|█████▊    | 3487/6000 [3:26:05<2:26:12,  3.49s/it]
Skipping the first batches:  58%|█████▊    | 3488/6000 [3:26:09<2:25:46,  3.48s/it]
Skipping the first batches:  58%|█████▊    | 3489/6000 [3:26:12<2:23:28,  3.43s/it]
Skipping the first batches:  58%|█████▊    | 3490/6000 [3:26:15<2:24:49,  3.46s/it]
Skipping the first batches:  58%|█████▊    | 3491/6000 [3:26:19<2:19:39,  3.34s/it]
Skipping the first batches:  58%|█████▊    | 3492/6000 [3:26:22<2:17:09,  3.28s/it]
Skipping the first batches:  58%|█████▊    | 3493/6000 [3:26:25<2:18:09,  3.31s/it]
Skipping the first batches:  58%|█████▊    | 3494/6000 [3:26:30<2:36:19,  3.74s/it]
Skipping the first batches:  58%|█████▊    | 3495/6000 [3:26:33<2:31:54,  3.64s/it]
Skipping the first batches:  58%|█████▊    | 3496/6000 [3:26:36<2:25:49,  3.49s/it]
Skipping the first batches:  58%|█████▊    | 3497/6000 [3:26:40<2:22:42,  3.42s/it]
Skipping the first batches:  58%|█████▊    | 3498/6000 [3:26:43<2:25:17,  3.48s/it]
Skipping the first batches:  58%|█████▊    | 3499/6000 [3:26:47<2:27:50,  3.55s/it]
Skipping the first batches:  58%|█████▊    | 3500/6000 [3:26:50<2:23:38,  3.45s/it]
Skipping the first batches:  58%|█████▊    | 3501/6000 [3:26:53<2:21:42,  3.40s/it]
Skipping the first batches:  58%|█████▊    | 3502/6000 [3:26:57<2:21:56,  3.41s/it]
Skipping the first batches:  58%|█████▊    | 3503/6000 [3:27:00<2:19:12,  3.35s/it]
Skipping the first batches:  58%|█████▊    | 3504/6000 [3:27:04<2:23:28,  3.45s/it]
Skipping the first batches:  58%|█████▊    | 3505/6000 [3:27:07<2:19:43,  3.36s/it]
Skipping the first batches:  58%|█████▊    | 3506/6000 [3:27:11<2:30:14,  3.61s/it]
Skipping the first batches:  58%|█████▊    | 3507/6000 [3:27:15<2:29:38,  3.60s/it]
Skipping the first batches:  58%|█████▊    | 3508/6000 [3:27:18<2:24:06,  3.47s/it]
Skipping the first batches:  58%|█████▊    | 3509/6000 [3:27:22<2:28:00,  3.56s/it]
Skipping the first batches:  58%|█████▊    | 3510/6000 [3:27:26<2:32:03,  3.66s/it]
Skipping the first batches:  59%|█████▊    | 3511/6000 [3:27:29<2:29:43,  3.61s/it]
Skipping the first batches:  59%|█████▊    | 3512/6000 [3:27:33<2:31:32,  3.65s/it]
Skipping the first batches:  59%|█████▊    | 3513/6000 [3:27:36<2:25:58,  3.52s/it]
Skipping the first batches:  59%|█████▊    | 3514/6000 [3:27:40<2:28:55,  3.59s/it]
Skipping the first batches:  59%|█████▊    | 3515/6000 [3:27:44<2:31:01,  3.65s/it]
Skipping the first batches:  59%|█████▊    | 3516/6000 [3:27:48<2:37:59,  3.82s/it]
Skipping the first batches:  59%|█████▊    | 3517/6000 [3:27:53<2:53:16,  4.19s/it]
Skipping the first batches:  59%|█████▊    | 3518/6000 [3:27:56<2:41:29,  3.90s/it]
Skipping the first batches:  59%|█████▊    | 3519/6000 [3:28:01<2:58:31,  4.32s/it]
Skipping the first batches:  59%|█████▊    | 3520/6000 [3:28:04<2:42:52,  3.94s/it]
Skipping the first batches:  59%|█████▊    | 3521/6000 [3:28:08<2:42:59,  3.94s/it]
Skipping the first batches:  59%|█████▊    | 3522/6000 [3:28:12<2:38:42,  3.84s/it]
Skipping the first batches:  59%|█████▊    | 3523/6000 [3:28:15<2:32:20,  3.69s/it]
Skipping the first batches:  59%|█████▊    | 3524/6000 [3:28:19<2:38:06,  3.83s/it]
Skipping the first batches:  59%|█████▉    | 3525/6000 [3:28:23<2:40:41,  3.90s/it]
Skipping the first batches:  59%|█████▉    | 3526/6000 [3:28:27<2:38:39,  3.85s/it]
Skipping the first batches:  59%|█████▉    | 3527/6000 [3:28:32<2:45:49,  4.02s/it]
Skipping the first batches:  59%|█████▉    | 3528/6000 [3:28:35<2:34:15,  3.74s/it]
Skipping the first batches:  59%|█████▉    | 3529/6000 [3:28:38<2:30:45,  3.66s/it]
Skipping the first batches:  59%|█████▉    | 3530/6000 [3:28:42<2:27:32,  3.58s/it]
Skipping the first batches:  59%|█████▉    | 3531/6000 [3:28:45<2:23:43,  3.49s/it]
Skipping the first batches:  59%|█████▉    | 3532/6000 [3:28:49<2:25:44,  3.54s/it]
Skipping the first batches:  59%|█████▉    | 3533/6000 [3:28:52<2:20:00,  3.41s/it]
Skipping the first batches:  59%|█████▉    | 3534/6000 [3:28:56<2:26:00,  3.55s/it]
Skipping the first batches:  59%|█████▉    | 3535/6000 [3:28:59<2:22:29,  3.47s/it]
Skipping the first batches:  59%|█████▉    | 3536/6000 [3:29:02<2:21:22,  3.44s/it]
Skipping the first batches:  59%|█████▉    | 3537/6000 [3:29:06<2:22:31,  3.47s/it]
Skipping the first batches:  59%|█████▉    | 3538/6000 [3:29:10<2:36:19,  3.81s/it]
Skipping the first batches:  59%|█████▉    | 3539/6000 [3:29:15<2:41:59,  3.95s/it]
Skipping the first batches:  59%|█████▉    | 3540/6000 [3:29:18<2:37:59,  3.85s/it]
Skipping the first batches:  59%|█████▉    | 3541/6000 [3:29:23<2:43:26,  3.99s/it]
Skipping the first batches:  59%|█████▉    | 3542/6000 [3:29:26<2:41:01,  3.93s/it]
Skipping the first batches:  59%|█████▉    | 3543/6000 [3:29:30<2:33:35,  3.75s/it]
Skipping the first batches:  59%|█████▉    | 3544/6000 [3:29:33<2:30:53,  3.69s/it]
Skipping the first batches:  59%|█████▉    | 3545/6000 [3:29:38<2:42:29,  3.97s/it]
Skipping the first batches:  59%|█████▉    | 3546/6000 [3:29:41<2:33:24,  3.75s/it]
Skipping the first batches:  59%|█████▉    | 3547/6000 [3:29:44<2:26:27,  3.58s/it]
Skipping the first batches:  59%|█████▉    | 3548/6000 [3:29:47<2:21:45,  3.47s/it]
Skipping the first batches:  59%|█████▉    | 3549/6000 [3:29:52<2:32:13,  3.73s/it]
Skipping the first batches:  59%|█████▉    | 3550/6000 [3:29:56<2:43:11,  4.00s/it]
Skipping the first batches:  59%|█████▉    | 3551/6000 [3:30:01<2:48:47,  4.14s/it]
Skipping the first batches:  59%|█████▉    | 3552/6000 [3:30:05<2:53:55,  4.26s/it]
Skipping the first batches:  59%|█████▉    | 3553/6000 [3:30:10<2:55:03,  4.29s/it]
Skipping the first batches:  59%|█████▉    | 3554/6000 [3:30:15<3:00:48,  4.44s/it]
Skipping the first batches:  59%|█████▉    | 3555/6000 [3:30:18<2:51:20,  4.20s/it]
Skipping the first batches:  59%|█████▉    | 3556/6000 [3:30:22<2:46:50,  4.10s/it]
Skipping the first batches:  59%|█████▉    | 3557/6000 [3:30:25<2:34:32,  3.80s/it]
Skipping the first batches:  59%|█████▉    | 3558/6000 [3:30:29<2:33:41,  3.78s/it]
Skipping the first batches:  59%|█████▉    | 3559/6000 [3:30:33<2:32:06,  3.74s/it]
Skipping the first batches:  59%|█████▉    | 3560/6000 [3:30:36<2:30:58,  3.71s/it]
Skipping the first batches:  59%|█████▉    | 3561/6000 [3:30:40<2:32:07,  3.74s/it]
Skipping the first batches:  59%|█████▉    | 3562/6000 [3:30:43<2:24:58,  3.57s/it]
Skipping the first batches:  59%|█████▉    | 3563/6000 [3:30:47<2:24:46,  3.56s/it]
Skipping the first batches:  59%|█████▉    | 3564/6000 [3:30:50<2:20:21,  3.46s/it]
Skipping the first batches:  59%|█████▉    | 3565/6000 [3:30:53<2:19:37,  3.44s/it]
Skipping the first batches:  59%|█████▉    | 3566/6000 [3:30:57<2:20:08,  3.45s/it]
Skipping the first batches:  59%|█████▉    | 3567/6000 [3:31:00<2:16:49,  3.37s/it]
Skipping the first batches:  59%|█████▉    | 3568/6000 [3:31:03<2:17:32,  3.39s/it]
Skipping the first batches:  59%|█████▉    | 3569/6000 [3:31:07<2:17:10,  3.39s/it]
Skipping the first batches:  60%|█████▉    | 3570/6000 [3:31:10<2:19:59,  3.46s/it]
Skipping the first batches:  60%|█████▉    | 3571/6000 [3:31:14<2:15:56,  3.36s/it]
Skipping the first batches:  60%|█████▉    | 3572/6000 [3:31:17<2:16:52,  3.38s/it]
Skipping the first batches:  60%|█████▉    | 3573/6000 [3:31:21<2:21:38,  3.50s/it]
Skipping the first batches:  60%|█████▉    | 3574/6000 [3:31:24<2:19:05,  3.44s/it]
Skipping the first batches:  60%|█████▉    | 3575/6000 [3:31:28<2:23:44,  3.56s/it]
Skipping the first batches:  60%|█████▉    | 3576/6000 [3:31:31<2:18:00,  3.42s/it]
Skipping the first batches:  60%|█████▉    | 3577/6000 [3:31:34<2:17:49,  3.41s/it]
Skipping the first batches:  60%|█████▉    | 3578/6000 [3:31:38<2:17:09,  3.40s/it]
Skipping the first batches:  60%|█████▉    | 3579/6000 [3:31:41<2:16:33,  3.38s/it]
Skipping the first batches:  60%|█████▉    | 3580/6000 [3:31:44<2:13:06,  3.30s/it]
Skipping the first batches:  60%|█████▉    | 3581/6000 [3:31:48<2:14:23,  3.33s/it]
Skipping the first batches:  60%|█████▉    | 3582/6000 [3:31:51<2:14:17,  3.33s/it]
Skipping the first batches:  60%|█████▉    | 3583/6000 [3:31:54<2:13:16,  3.31s/it]
Skipping the first batches:  60%|█████▉    | 3584/6000 [3:31:58<2:14:06,  3.33s/it]
Skipping the first batches:  60%|█████▉    | 3585/6000 [3:32:01<2:16:58,  3.40s/it]
Skipping the first batches:  60%|█████▉    | 3586/6000 [3:32:05<2:18:23,  3.44s/it]
Skipping the first batches:  60%|█████▉    | 3587/6000 [3:32:08<2:16:35,  3.40s/it]
Skipping the first batches:  60%|█████▉    | 3588/6000 [3:32:11<2:15:13,  3.36s/it]
Skipping the first batches:  60%|█████▉    | 3589/6000 [3:32:16<2:34:14,  3.84s/it]
Skipping the first batches:  60%|█████▉    | 3590/6000 [3:32:20<2:33:38,  3.83s/it]
Skipping the first batches:  60%|█████▉    | 3591/6000 [3:32:24<2:31:32,  3.77s/it]
Skipping the first batches:  60%|█████▉    | 3592/6000 [3:32:28<2:37:00,  3.91s/it]
Skipping the first batches:  60%|█████▉    | 3593/6000 [3:32:31<2:29:53,  3.74s/it]
Skipping the first batches:  60%|█████▉    | 3594/6000 [3:32:35<2:28:21,  3.70s/it]
Skipping the first batches:  60%|█████▉    | 3595/6000 [3:32:38<2:24:52,  3.61s/it]
Skipping the first batches:  60%|█████▉    | 3596/6000 [3:32:42<2:20:43,  3.51s/it]
Skipping the first batches:  60%|█████▉    | 3597/6000 [3:32:45<2:19:01,  3.47s/it]
Skipping the first batches:  60%|█████▉    | 3598/6000 [3:32:49<2:26:40,  3.66s/it]
Skipping the first batches:  60%|█████▉    | 3599/6000 [3:32:52<2:18:45,  3.47s/it]
Skipping the first batches:  60%|██████    | 3600/6000 [3:32:55<2:18:08,  3.45s/it]
Skipping the first batches:  60%|██████    | 3601/6000 [3:32:59<2:18:19,  3.46s/it]
Skipping the first batches:  60%|██████    | 3602/6000 [3:33:02<2:13:16,  3.33s/it]
Skipping the first batches:  60%|██████    | 3603/6000 [3:33:05<2:11:52,  3.30s/it]
Skipping the first batches:  60%|██████    | 3604/6000 [3:33:09<2:18:09,  3.46s/it]
Skipping the first batches:  60%|██████    | 3605/6000 [3:33:12<2:17:25,  3.44s/it]
Skipping the first batches:  60%|██████    | 3606/6000 [3:33:15<2:11:40,  3.30s/it]
Skipping the first batches:  60%|██████    | 3607/6000 [3:33:19<2:13:15,  3.34s/it]
Skipping the first batches:  60%|██████    | 3608/6000 [3:33:22<2:13:46,  3.36s/it]
Skipping the first batches:  60%|██████    | 3609/6000 [3:33:25<2:11:05,  3.29s/it]
Skipping the first batches:  60%|██████    | 3610/6000 [3:33:29<2:12:23,  3.32s/it]
Skipping the first batches:  60%|██████    | 3611/6000 [3:33:32<2:14:20,  3.37s/it]
Skipping the first batches:  60%|██████    | 3612/6000 [3:33:35<2:12:20,  3.33s/it]
Skipping the first batches:  60%|██████    | 3613/6000 [3:33:39<2:12:24,  3.33s/it]
Skipping the first batches:  60%|██████    | 3614/6000 [3:33:42<2:11:47,  3.31s/it]
Skipping the first batches:  60%|██████    | 3615/6000 [3:33:45<2:10:58,  3.30s/it]
Skipping the first batches:  60%|██████    | 3616/6000 [3:33:49<2:13:59,  3.37s/it]
Skipping the first batches:  60%|██████    | 3617/6000 [3:33:52<2:14:21,  3.38s/it]
Skipping the first batches:  60%|██████    | 3618/6000 [3:33:56<2:13:12,  3.36s/it]
Skipping the first batches:  60%|██████    | 3619/6000 [3:33:59<2:11:31,  3.31s/it]
Skipping the first batches:  60%|██████    | 3620/6000 [3:34:02<2:10:39,  3.29s/it]
Skipping the first batches:  60%|██████    | 3621/6000 [3:34:06<2:14:01,  3.38s/it]
Skipping the first batches:  60%|██████    | 3622/6000 [3:34:09<2:12:59,  3.36s/it]
Skipping the first batches:  60%|██████    | 3623/6000 [3:34:12<2:12:08,  3.34s/it]
Skipping the first batches:  60%|██████    | 3624/6000 [3:34:15<2:09:37,  3.27s/it]
Skipping the first batches:  60%|██████    | 3625/6000 [3:34:19<2:11:24,  3.32s/it]
Skipping the first batches:  60%|██████    | 3626/6000 [3:34:22<2:13:09,  3.37s/it]
Skipping the first batches:  60%|██████    | 3627/6000 [3:34:25<2:09:49,  3.28s/it]
Skipping the first batches:  60%|██████    | 3628/6000 [3:34:28<2:07:34,  3.23s/it]
Skipping the first batches:  60%|██████    | 3629/6000 [3:34:32<2:10:34,  3.30s/it]
Skipping the first batches:  60%|██████    | 3630/6000 [3:34:35<2:11:55,  3.34s/it]
Skipping the first batches:  61%|██████    | 3631/6000 [3:34:39<2:15:49,  3.44s/it]
Skipping the first batches:  61%|██████    | 3632/6000 [3:34:43<2:18:55,  3.52s/it]
Skipping the first batches:  61%|██████    | 3633/6000 [3:34:46<2:14:50,  3.42s/it]
Skipping the first batches:  61%|██████    | 3634/6000 [3:34:49<2:12:21,  3.36s/it]
Skipping the first batches:  61%|██████    | 3635/6000 [3:34:52<2:12:40,  3.37s/it]
Skipping the first batches:  61%|██████    | 3636/6000 [3:34:56<2:14:16,  3.41s/it]
Skipping the first batches:  61%|██████    | 3637/6000 [3:35:00<2:26:12,  3.71s/it]
Skipping the first batches:  61%|██████    | 3638/6000 [3:35:04<2:18:34,  3.52s/it]
Skipping the first batches:  61%|██████    | 3639/6000 [3:35:07<2:17:28,  3.49s/it]
Skipping the first batches:  61%|██████    | 3640/6000 [3:35:11<2:21:38,  3.60s/it]
Skipping the first batches:  61%|██████    | 3641/6000 [3:35:14<2:15:09,  3.44s/it]
Skipping the first batches:  61%|██████    | 3642/6000 [3:35:17<2:16:51,  3.48s/it]
Skipping the first batches:  61%|██████    | 3643/6000 [3:35:20<2:11:46,  3.35s/it]
Skipping the first batches:  61%|██████    | 3644/6000 [3:35:24<2:13:29,  3.40s/it]
Skipping the first batches:  61%|██████    | 3645/6000 [3:35:27<2:11:30,  3.35s/it]
Skipping the first batches:  61%|██████    | 3646/6000 [3:35:30<2:08:37,  3.28s/it]
Skipping the first batches:  61%|██████    | 3647/6000 [3:35:34<2:12:32,  3.38s/it]
Skipping the first batches:  61%|██████    | 3648/6000 [3:35:38<2:14:39,  3.44s/it]
Skipping the first batches:  61%|██████    | 3649/6000 [3:35:41<2:15:03,  3.45s/it]
Skipping the first batches:  61%|██████    | 3650/6000 [3:35:44<2:15:40,  3.46s/it]
Skipping the first batches:  61%|██████    | 3651/6000 [3:35:48<2:14:43,  3.44s/it]
Skipping the first batches:  61%|██████    | 3652/6000 [3:35:51<2:13:42,  3.42s/it]
Skipping the first batches:  61%|██████    | 3653/6000 [3:35:54<2:11:28,  3.36s/it]
Skipping the first batches:  61%|██████    | 3654/6000 [3:35:58<2:16:34,  3.49s/it]
Skipping the first batches:  61%|██████    | 3655/6000 [3:36:02<2:13:46,  3.42s/it]
Skipping the first batches:  61%|██████    | 3656/6000 [3:36:05<2:11:50,  3.37s/it]
Skipping the first batches:  61%|██████    | 3657/6000 [3:36:08<2:12:59,  3.41s/it]
Skipping the first batches:  61%|██████    | 3658/6000 [3:36:12<2:13:50,  3.43s/it]
Skipping the first batches:  61%|██████    | 3659/6000 [3:36:15<2:11:37,  3.37s/it]
Skipping the first batches:  61%|██████    | 3660/6000 [3:36:18<2:12:03,  3.39s/it]
Skipping the first batches:  61%|██████    | 3661/6000 [3:36:21<2:07:40,  3.28s/it]
Skipping the first batches:  61%|██████    | 3662/6000 [3:36:25<2:10:11,  3.34s/it]
Skipping the first batches:  61%|██████    | 3663/6000 [3:36:28<2:09:26,  3.32s/it]
Skipping the first batches:  61%|██████    | 3664/6000 [3:36:32<2:12:04,  3.39s/it]
Skipping the first batches:  61%|██████    | 3665/6000 [3:36:35<2:07:54,  3.29s/it]
Skipping the first batches:  61%|██████    | 3666/6000 [3:36:38<2:05:26,  3.22s/it]
Skipping the first batches:  61%|██████    | 3667/6000 [3:36:42<2:12:04,  3.40s/it]
Skipping the first batches:  61%|██████    | 3668/6000 [3:36:45<2:10:24,  3.36s/it]
Skipping the first batches:  61%|██████    | 3669/6000 [3:36:48<2:09:45,  3.34s/it]
Skipping the first batches:  61%|██████    | 3670/6000 [3:36:51<2:06:39,  3.26s/it]
Skipping the first batches:  61%|██████    | 3671/6000 [3:36:55<2:06:10,  3.25s/it]
Skipping the first batches:  61%|██████    | 3672/6000 [3:36:58<2:09:38,  3.34s/it]
Skipping the first batches:  61%|██████    | 3673/6000 [3:37:02<2:15:51,  3.50s/it]
Skipping the first batches:  61%|██████    | 3674/6000 [3:37:05<2:11:21,  3.39s/it]
Skipping the first batches:  61%|██████▏   | 3675/6000 [3:37:08<2:10:40,  3.37s/it]
Skipping the first batches:  61%|██████▏   | 3676/6000 [3:37:12<2:13:54,  3.46s/it]
Skipping the first batches:  61%|██████▏   | 3677/6000 [3:37:15<2:12:52,  3.43s/it]
Skipping the first batches:  61%|██████▏   | 3678/6000 [3:37:19<2:09:47,  3.35s/it]
Skipping the first batches:  61%|██████▏   | 3679/6000 [3:37:22<2:09:54,  3.36s/it]
Skipping the first batches:  61%|██████▏   | 3680/6000 [3:37:26<2:14:44,  3.48s/it]
Skipping the first batches:  61%|██████▏   | 3681/6000 [3:37:29<2:14:08,  3.47s/it]
Skipping the first batches:  61%|██████▏   | 3682/6000 [3:37:32<2:09:42,  3.36s/it]
Skipping the first batches:  61%|██████▏   | 3683/6000 [3:37:36<2:16:11,  3.53s/it]
Skipping the first batches:  61%|██████▏   | 3684/6000 [3:37:40<2:17:59,  3.57s/it]
Skipping the first batches:  61%|██████▏   | 3685/6000 [3:37:43<2:15:46,  3.52s/it]
Skipping the first batches:  61%|██████▏   | 3686/6000 [3:37:47<2:14:53,  3.50s/it]
Skipping the first batches:  61%|██████▏   | 3687/6000 [3:37:51<2:25:03,  3.76s/it]
Skipping the first batches:  61%|██████▏   | 3688/6000 [3:37:54<2:18:03,  3.58s/it]
Skipping the first batches:  61%|██████▏   | 3689/6000 [3:37:58<2:21:27,  3.67s/it]
Skipping the first batches:  62%|██████▏   | 3690/6000 [3:38:02<2:18:47,  3.61s/it]
Skipping the first batches:  62%|██████▏   | 3691/6000 [3:38:05<2:16:38,  3.55s/it]
Skipping the first batches:  62%|██████▏   | 3692/6000 [3:38:08<2:13:43,  3.48s/it]
Skipping the first batches:  62%|██████▏   | 3693/6000 [3:38:12<2:18:44,  3.61s/it]
Skipping the first batches:  62%|██████▏   | 3694/6000 [3:38:16<2:19:40,  3.63s/it]
Skipping the first batches:  62%|██████▏   | 3695/6000 [3:38:19<2:16:33,  3.55s/it]
Skipping the first batches:  62%|██████▏   | 3696/6000 [3:38:23<2:17:36,  3.58s/it]
Skipping the first batches:  62%|██████▏   | 3697/6000 [3:38:27<2:18:11,  3.60s/it]
Skipping the first batches:  62%|██████▏   | 3698/6000 [3:38:30<2:18:01,  3.60s/it]
Skipping the first batches:  62%|██████▏   | 3699/6000 [3:38:35<2:26:06,  3.81s/it]
Skipping the first batches:  62%|██████▏   | 3700/6000 [3:38:40<2:42:28,  4.24s/it]
Skipping the first batches:  62%|██████▏   | 3701/6000 [3:38:44<2:44:01,  4.28s/it]
Skipping the first batches:  62%|██████▏   | 3702/6000 [3:38:48<2:38:26,  4.14s/it]
Skipping the first batches:  62%|██████▏   | 3703/6000 [3:38:51<2:30:16,  3.93s/it]
Skipping the first batches:  62%|██████▏   | 3704/6000 [3:38:55<2:24:15,  3.77s/it]
Skipping the first batches:  62%|██████▏   | 3705/6000 [3:38:58<2:17:04,  3.58s/it]
Skipping the first batches:  62%|██████▏   | 3706/6000 [3:39:01<2:15:52,  3.55s/it]
Skipping the first batches:  62%|██████▏   | 3707/6000 [3:39:05<2:14:52,  3.53s/it]
Skipping the first batches:  62%|██████▏   | 3708/6000 [3:39:09<2:19:37,  3.65s/it]
Skipping the first batches:  62%|██████▏   | 3709/6000 [3:39:12<2:14:44,  3.53s/it]
Skipping the first batches:  62%|██████▏   | 3710/6000 [3:39:15<2:12:24,  3.47s/it]
Skipping the first batches:  62%|██████▏   | 3711/6000 [3:39:20<2:25:43,  3.82s/it]
Skipping the first batches:  62%|██████▏   | 3712/6000 [3:39:24<2:21:40,  3.72s/it]
Skipping the first batches:  62%|██████▏   | 3713/6000 [3:39:27<2:15:36,  3.56s/it]
Skipping the first batches:  62%|██████▏   | 3714/6000 [3:39:30<2:12:27,  3.48s/it]
Skipping the first batches:  62%|██████▏   | 3715/6000 [3:39:34<2:13:28,  3.50s/it]
Skipping the first batches:  62%|██████▏   | 3716/6000 [3:39:37<2:08:18,  3.37s/it]
Skipping the first batches:  62%|██████▏   | 3717/6000 [3:39:40<2:07:42,  3.36s/it]
Skipping the first batches:  62%|██████▏   | 3718/6000 [3:39:43<2:09:21,  3.40s/it]
Skipping the first batches:  62%|██████▏   | 3719/6000 [3:39:47<2:08:25,  3.38s/it]
Skipping the first batches:  62%|██████▏   | 3720/6000 [3:39:50<2:08:02,  3.37s/it]
Skipping the first batches:  62%|██████▏   | 3721/6000 [3:39:54<2:13:28,  3.51s/it]
Skipping the first batches:  62%|██████▏   | 3722/6000 [3:39:57<2:10:42,  3.44s/it]
Skipping the first batches:  62%|██████▏   | 3723/6000 [3:40:00<2:07:14,  3.35s/it]
Skipping the first batches:  62%|██████▏   | 3724/6000 [3:40:04<2:08:53,  3.40s/it]
Skipping the first batches:  62%|██████▏   | 3725/6000 [3:40:07<2:04:56,  3.30s/it]
Skipping the first batches:  62%|██████▏   | 3726/6000 [3:40:10<2:06:02,  3.33s/it]
Skipping the first batches:  62%|██████▏   | 3727/6000 [3:40:14<2:10:32,  3.45s/it]
Skipping the first batches:  62%|██████▏   | 3728/6000 [3:40:17<2:06:30,  3.34s/it]
Skipping the first batches:  62%|██████▏   | 3729/6000 [3:40:21<2:11:43,  3.48s/it]
Skipping the first batches:  62%|██████▏   | 3730/6000 [3:40:24<2:11:11,  3.47s/it]
Skipping the first batches:  62%|██████▏   | 3731/6000 [3:40:28<2:07:46,  3.38s/it]
Skipping the first batches:  62%|██████▏   | 3732/6000 [3:40:31<2:03:57,  3.28s/it]
Skipping the first batches:  62%|██████▏   | 3733/6000 [3:40:35<2:10:39,  3.46s/it]
Skipping the first batches:  62%|██████▏   | 3734/6000 [3:40:38<2:08:34,  3.40s/it]
Skipping the first batches:  62%|██████▏   | 3735/6000 [3:40:42<2:19:17,  3.69s/it]
Skipping the first batches:  62%|██████▏   | 3736/6000 [3:40:46<2:16:59,  3.63s/it]
Skipping the first batches:  62%|██████▏   | 3737/6000 [3:40:49<2:17:28,  3.64s/it]
Skipping the first batches:  62%|██████▏   | 3738/6000 [3:40:53<2:12:39,  3.52s/it]
Skipping the first batches:  62%|██████▏   | 3739/6000 [3:40:56<2:12:45,  3.52s/it]
Skipping the first batches:  62%|██████▏   | 3740/6000 [3:41:00<2:12:55,  3.53s/it]
Skipping the first batches:  62%|██████▏   | 3741/6000 [3:41:03<2:10:06,  3.46s/it]
Skipping the first batches:  62%|██████▏   | 3742/6000 [3:41:06<2:06:11,  3.35s/it]
Skipping the first batches:  62%|██████▏   | 3743/6000 [3:41:09<2:05:41,  3.34s/it]
Skipping the first batches:  62%|██████▏   | 3744/6000 [3:41:13<2:09:05,  3.43s/it]
Skipping the first batches:  62%|██████▏   | 3745/6000 [3:41:16<2:05:19,  3.33s/it]
Skipping the first batches:  62%|██████▏   | 3746/6000 [3:41:20<2:08:07,  3.41s/it]
Skipping the first batches:  62%|██████▏   | 3747/6000 [3:41:23<2:06:30,  3.37s/it]
Skipping the first batches:  62%|██████▏   | 3748/6000 [3:41:26<2:07:25,  3.40s/it]
Skipping the first batches:  62%|██████▏   | 3749/6000 [3:41:30<2:10:02,  3.47s/it]
Skipping the first batches:  62%|██████▎   | 3750/6000 [3:41:33<2:08:01,  3.41s/it]
Skipping the first batches:  63%|██████▎   | 3751/6000 [3:41:37<2:09:08,  3.45s/it]
Skipping the first batches:  63%|██████▎   | 3752/6000 [3:41:40<2:05:19,  3.35s/it]
Skipping the first batches:  63%|██████▎   | 3753/6000 [3:41:44<2:09:29,  3.46s/it]
Skipping the first batches:  63%|██████▎   | 3754/6000 [3:41:47<2:09:44,  3.47s/it]
Skipping the first batches:  63%|██████▎   | 3755/6000 [3:41:51<2:12:19,  3.54s/it]
Skipping the first batches:  63%|██████▎   | 3756/6000 [3:41:54<2:08:39,  3.44s/it]
Skipping the first batches:  63%|██████▎   | 3757/6000 [3:41:57<2:08:14,  3.43s/it]
Skipping the first batches:  63%|██████▎   | 3758/6000 [3:42:01<2:05:35,  3.36s/it]
Skipping the first batches:  63%|██████▎   | 3759/6000 [3:42:04<2:06:02,  3.37s/it]
Skipping the first batches:  63%|██████▎   | 3760/6000 [3:42:09<2:20:25,  3.76s/it]
Skipping the first batches:  63%|██████▎   | 3761/6000 [3:42:12<2:15:57,  3.64s/it]
Skipping the first batches:  63%|██████▎   | 3762/6000 [3:42:16<2:16:08,  3.65s/it]
Skipping the first batches:  63%|██████▎   | 3763/6000 [3:42:19<2:12:36,  3.56s/it]
Skipping the first batches:  63%|██████▎   | 3764/6000 [3:42:23<2:14:20,  3.60s/it]
Skipping the first batches:  63%|██████▎   | 3765/6000 [3:42:26<2:13:57,  3.60s/it]
Skipping the first batches:  63%|██████▎   | 3766/6000 [3:42:30<2:11:03,  3.52s/it]
Skipping the first batches:  63%|██████▎   | 3767/6000 [3:42:33<2:11:59,  3.55s/it]
Skipping the first batches:  63%|██████▎   | 3768/6000 [3:42:37<2:18:21,  3.72s/it]
Skipping the first batches:  63%|██████▎   | 3769/6000 [3:42:42<2:31:17,  4.07s/it]
Skipping the first batches:  63%|██████▎   | 3770/6000 [3:42:46<2:31:14,  4.07s/it]
Skipping the first batches:  63%|██████▎   | 3771/6000 [3:42:51<2:37:06,  4.23s/it]
Skipping the first batches:  63%|██████▎   | 3772/6000 [3:42:56<2:50:11,  4.58s/it]
Skipping the first batches:  63%|██████▎   | 3773/6000 [3:43:02<3:00:33,  4.86s/it]
Skipping the first batches:  63%|██████▎   | 3774/6000 [3:43:06<2:48:34,  4.54s/it]
Skipping the first batches:  63%|██████▎   | 3775/6000 [3:43:10<2:42:17,  4.38s/it]
Skipping the first batches:  63%|██████▎   | 3776/6000 [3:43:14<2:41:20,  4.35s/it]
Skipping the first batches:  63%|██████▎   | 3777/6000 [3:43:17<2:30:59,  4.08s/it]
Skipping the first batches:  63%|██████▎   | 3778/6000 [3:43:21<2:27:07,  3.97s/it]
Skipping the first batches:  63%|██████▎   | 3779/6000 [3:43:25<2:24:40,  3.91s/it]
Skipping the first batches:  63%|██████▎   | 3780/6000 [3:43:30<2:36:17,  4.22s/it]
Skipping the first batches:  63%|██████▎   | 3781/6000 [3:43:35<2:48:36,  4.56s/it]
Skipping the first batches:  63%|██████▎   | 3782/6000 [3:43:39<2:35:05,  4.20s/it]
Skipping the first batches:  63%|██████▎   | 3783/6000 [3:43:42<2:26:02,  3.95s/it]
Skipping the first batches:  63%|██████▎   | 3784/6000 [3:43:46<2:21:35,  3.83s/it]
Skipping the first batches:  63%|██████▎   | 3785/6000 [3:43:49<2:21:13,  3.83s/it]
Skipping the first batches:  63%|██████▎   | 3786/6000 [3:43:53<2:20:39,  3.81s/it]
Skipping the first batches:  63%|██████▎   | 3787/6000 [3:43:57<2:16:17,  3.70s/it]
Skipping the first batches:  63%|██████▎   | 3788/6000 [3:44:00<2:14:39,  3.65s/it]
Skipping the first batches:  63%|██████▎   | 3789/6000 [3:44:04<2:15:36,  3.68s/it]
Skipping the first batches:  63%|██████▎   | 3790/6000 [3:44:07<2:14:59,  3.67s/it]
Skipping the first batches:  63%|██████▎   | 3791/6000 [3:44:11<2:08:14,  3.48s/it]
Skipping the first batches:  63%|██████▎   | 3792/6000 [3:44:14<2:07:28,  3.46s/it]
Skipping the first batches:  63%|██████▎   | 3793/6000 [3:44:17<2:03:49,  3.37s/it]
Skipping the first batches:  63%|██████▎   | 3794/6000 [3:44:21<2:06:00,  3.43s/it]
Skipping the first batches:  63%|██████▎   | 3795/6000 [3:44:24<2:05:48,  3.42s/it]
Skipping the first batches:  63%|██████▎   | 3796/6000 [3:44:27<2:05:27,  3.42s/it]
Skipping the first batches:  63%|██████▎   | 3797/6000 [3:44:31<2:03:48,  3.37s/it]
Skipping the first batches:  63%|██████▎   | 3798/6000 [3:44:34<2:03:52,  3.38s/it]
Skipping the first batches:  63%|██████▎   | 3799/6000 [3:44:37<2:00:50,  3.29s/it]
Skipping the first batches:  63%|██████▎   | 3800/6000 [3:44:41<2:05:53,  3.43s/it]
Skipping the first batches:  63%|██████▎   | 3801/6000 [3:44:44<2:04:23,  3.39s/it]
Skipping the first batches:  63%|██████▎   | 3802/6000 [3:44:47<2:00:43,  3.30s/it]
Skipping the first batches:  63%|██████▎   | 3803/6000 [3:44:51<2:02:43,  3.35s/it]
Skipping the first batches:  63%|██████▎   | 3804/6000 [3:44:54<2:05:41,  3.43s/it]
Skipping the first batches:  63%|██████▎   | 3805/6000 [3:44:58<2:02:40,  3.35s/it]
Skipping the first batches:  63%|██████▎   | 3806/6000 [3:45:02<2:09:34,  3.54s/it]
Skipping the first batches:  63%|██████▎   | 3807/6000 [3:45:05<2:11:23,  3.59s/it]
Skipping the first batches:  63%|██████▎   | 3808/6000 [3:45:09<2:10:58,  3.59s/it]
Skipping the first batches:  63%|██████▎   | 3809/6000 [3:45:12<2:09:56,  3.56s/it]
Skipping the first batches:  64%|██████▎   | 3810/6000 [3:45:16<2:11:12,  3.59s/it]
Skipping the first batches:  64%|██████▎   | 3811/6000 [3:45:19<2:05:05,  3.43s/it]
Skipping the first batches:  64%|██████▎   | 3812/6000 [3:45:23<2:06:25,  3.47s/it]
Skipping the first batches:  64%|██████▎   | 3813/6000 [3:45:26<2:08:06,  3.51s/it]
Skipping the first batches:  64%|██████▎   | 3814/6000 [3:45:30<2:10:56,  3.59s/it]
Skipping the first batches:  64%|██████▎   | 3815/6000 [3:45:34<2:16:17,  3.74s/it]
Skipping the first batches:  64%|██████▎   | 3816/6000 [3:45:39<2:26:51,  4.03s/it]
Skipping the first batches:  64%|██████▎   | 3817/6000 [3:45:43<2:25:35,  4.00s/it]
Skipping the first batches:  64%|██████▎   | 3818/6000 [3:45:46<2:16:50,  3.76s/it]
Skipping the first batches:  64%|██████▎   | 3819/6000 [3:45:50<2:15:35,  3.73s/it]
Skipping the first batches:  64%|██████▎   | 3820/6000 [3:45:53<2:10:44,  3.60s/it]
Skipping the first batches:  64%|██████▎   | 3821/6000 [3:45:56<2:06:32,  3.48s/it]
Skipping the first batches:  64%|██████▎   | 3822/6000 [3:45:59<2:03:18,  3.40s/it]
Skipping the first batches:  64%|██████▎   | 3823/6000 [3:46:03<2:03:16,  3.40s/it]
Skipping the first batches:  64%|██████▎   | 3824/6000 [3:46:06<2:05:00,  3.45s/it]
Skipping the first batches:  64%|██████▍   | 3825/6000 [3:46:10<2:05:28,  3.46s/it]
Skipping the first batches:  64%|██████▍   | 3826/6000 [3:46:13<2:03:10,  3.40s/it]
Skipping the first batches:  64%|██████▍   | 3827/6000 [3:46:16<2:02:08,  3.37s/it]
Skipping the first batches:  64%|██████▍   | 3828/6000 [3:46:20<1:59:11,  3.29s/it]
Skipping the first batches:  64%|██████▍   | 3829/6000 [3:46:23<1:59:45,  3.31s/it]
Skipping the first batches:  64%|██████▍   | 3830/6000 [3:46:26<1:57:03,  3.24s/it]
Skipping the first batches:  64%|██████▍   | 3831/6000 [3:46:30<2:04:30,  3.44s/it]
Skipping the first batches:  64%|██████▍   | 3832/6000 [3:46:33<2:01:26,  3.36s/it]
Skipping the first batches:  64%|██████▍   | 3833/6000 [3:46:36<2:00:44,  3.34s/it]
Skipping the first batches:  64%|██████▍   | 3834/6000 [3:46:40<2:01:11,  3.36s/it]
Skipping the first batches:  64%|██████▍   | 3835/6000 [3:46:43<2:04:30,  3.45s/it]
Skipping the first batches:  64%|██████▍   | 3836/6000 [3:46:46<2:00:41,  3.35s/it]
Skipping the first batches:  64%|██████▍   | 3837/6000 [3:46:50<2:02:32,  3.40s/it]
Skipping the first batches:  64%|██████▍   | 3838/6000 [3:46:54<2:06:41,  3.52s/it]
Skipping the first batches:  64%|██████▍   | 3839/6000 [3:46:57<2:03:14,  3.42s/it]
Skipping the first batches:  64%|██████▍   | 3840/6000 [3:47:01<2:07:42,  3.55s/it]
Skipping the first batches:  64%|██████▍   | 3841/6000 [3:47:05<2:09:30,  3.60s/it]
Skipping the first batches:  64%|██████▍   | 3842/6000 [3:47:08<2:06:13,  3.51s/it]
Skipping the first batches:  64%|██████▍   | 3843/6000 [3:47:11<2:05:19,  3.49s/it]
Skipping the first batches:  64%|██████▍   | 3844/6000 [3:47:15<2:05:47,  3.50s/it]
Skipping the first batches:  64%|██████▍   | 3845/6000 [3:47:18<2:00:58,  3.37s/it]
Skipping the first batches:  64%|██████▍   | 3846/6000 [3:47:21<1:59:06,  3.32s/it]
Skipping the first batches:  64%|██████▍   | 3847/6000 [3:47:24<1:59:10,  3.32s/it]
Skipping the first batches:  64%|██████▍   | 3848/6000 [3:47:28<2:00:44,  3.37s/it]
Skipping the first batches:  64%|██████▍   | 3849/6000 [3:47:31<2:00:23,  3.36s/it]
Skipping the first batches:  64%|██████▍   | 3850/6000 [3:47:34<1:57:29,  3.28s/it]
Skipping the first batches:  64%|██████▍   | 3851/6000 [3:47:38<2:00:13,  3.36s/it]
Skipping the first batches:  64%|██████▍   | 3852/6000 [3:47:41<2:01:09,  3.38s/it]
Skipping the first batches:  64%|██████▍   | 3853/6000 [3:47:44<1:57:51,  3.29s/it]
Skipping the first batches:  64%|██████▍   | 3854/6000 [3:47:48<2:01:27,  3.40s/it]
Skipping the first batches:  64%|██████▍   | 3855/6000 [3:47:51<1:57:52,  3.30s/it]
Skipping the first batches:  64%|██████▍   | 3856/6000 [3:47:54<1:55:08,  3.22s/it]
Skipping the first batches:  64%|██████▍   | 3857/6000 [3:47:58<1:59:39,  3.35s/it]
Skipping the first batches:  64%|██████▍   | 3858/6000 [3:48:01<2:02:17,  3.43s/it]
Skipping the first batches:  64%|██████▍   | 3859/6000 [3:48:05<2:01:48,  3.41s/it]
Skipping the first batches:  64%|██████▍   | 3860/6000 [3:48:08<2:03:14,  3.46s/it]
Skipping the first batches:  64%|██████▍   | 3861/6000 [3:48:12<2:04:58,  3.51s/it]
Skipping the first batches:  64%|██████▍   | 3862/6000 [3:48:15<2:00:19,  3.38s/it]
Skipping the first batches:  64%|██████▍   | 3863/6000 [3:48:18<1:57:49,  3.31s/it]
Skipping the first batches:  64%|██████▍   | 3864/6000 [3:48:21<1:57:49,  3.31s/it]
Skipping the first batches:  64%|██████▍   | 3865/6000 [3:48:25<1:56:36,  3.28s/it]
Skipping the first batches:  64%|██████▍   | 3866/6000 [3:48:28<1:54:41,  3.22s/it]
Skipping the first batches:  64%|██████▍   | 3867/6000 [3:48:31<1:55:12,  3.24s/it]
Skipping the first batches:  64%|██████▍   | 3868/6000 [3:48:34<1:53:16,  3.19s/it]
Skipping the first batches:  64%|██████▍   | 3869/6000 [3:48:38<2:00:57,  3.41s/it]
Skipping the first batches:  64%|██████▍   | 3870/6000 [3:48:42<2:07:17,  3.59s/it]
Skipping the first batches:  65%|██████▍   | 3871/6000 [3:48:45<2:04:55,  3.52s/it]
Skipping the first batches:  65%|██████▍   | 3872/6000 [3:48:49<2:02:41,  3.46s/it]
Skipping the first batches:  65%|██████▍   | 3873/6000 [3:48:53<2:07:54,  3.61s/it]
Skipping the first batches:  65%|██████▍   | 3874/6000 [3:48:56<2:04:47,  3.52s/it]
Skipping the first batches:  65%|██████▍   | 3875/6000 [3:48:59<2:01:53,  3.44s/it]
Skipping the first batches:  65%|██████▍   | 3876/6000 [3:49:03<1:59:41,  3.38s/it]
Skipping the first batches:  65%|██████▍   | 3877/6000 [3:49:06<1:59:40,  3.38s/it]
Skipping the first batches:  65%|██████▍   | 3878/6000 [3:49:09<1:58:37,  3.35s/it]
Skipping the first batches:  65%|██████▍   | 3879/6000 [3:49:13<1:58:47,  3.36s/it]
Skipping the first batches:  65%|██████▍   | 3880/6000 [3:49:17<2:12:23,  3.75s/it]
Skipping the first batches:  65%|██████▍   | 3881/6000 [3:49:22<2:20:57,  3.99s/it]
Skipping the first batches:  65%|██████▍   | 3882/6000 [3:49:25<2:15:38,  3.84s/it]
Skipping the first batches:  65%|██████▍   | 3883/6000 [3:49:29<2:12:24,  3.75s/it]
Skipping the first batches:  65%|██████▍   | 3884/6000 [3:49:32<2:05:29,  3.56s/it]
Skipping the first batches:  65%|██████▍   | 3885/6000 [3:49:36<2:14:01,  3.80s/it]
Skipping the first batches:  65%|██████▍   | 3886/6000 [3:49:40<2:08:39,  3.65s/it]
Skipping the first batches:  65%|██████▍   | 3887/6000 [3:49:43<2:03:43,  3.51s/it]
Skipping the first batches:  65%|██████▍   | 3888/6000 [3:49:47<2:06:06,  3.58s/it]
Skipping the first batches:  65%|██████▍   | 3889/6000 [3:49:51<2:12:57,  3.78s/it]
Skipping the first batches:  65%|██████▍   | 3890/6000 [3:49:54<2:08:49,  3.66s/it]
Skipping the first batches:  65%|██████▍   | 3891/6000 [3:49:58<2:14:25,  3.82s/it]
Skipping the first batches:  65%|██████▍   | 3892/6000 [3:50:02<2:15:40,  3.86s/it]
Skipping the first batches:  65%|██████▍   | 3893/6000 [3:50:06<2:10:04,  3.70s/it]
Skipping the first batches:  65%|██████▍   | 3894/6000 [3:50:09<2:08:23,  3.66s/it]
Skipping the first batches:  65%|██████▍   | 3895/6000 [3:50:12<2:03:57,  3.53s/it]
Skipping the first batches:  65%|██████▍   | 3896/6000 [3:50:16<2:03:50,  3.53s/it]
Skipping the first batches:  65%|██████▍   | 3897/6000 [3:50:19<2:01:43,  3.47s/it]
Skipping the first batches:  65%|██████▍   | 3898/6000 [3:50:22<1:58:03,  3.37s/it]
Skipping the first batches:  65%|██████▍   | 3899/6000 [3:50:26<2:00:15,  3.43s/it]
Skipping the first batches:  65%|██████▌   | 3900/6000 [3:50:30<2:09:05,  3.69s/it]
Skipping the first batches:  65%|██████▌   | 3901/6000 [3:50:34<2:09:26,  3.70s/it]
Skipping the first batches:  65%|██████▌   | 3902/6000 [3:50:37<2:04:10,  3.55s/it]
Skipping the first batches:  65%|██████▌   | 3903/6000 [3:50:41<2:01:21,  3.47s/it]
Skipping the first batches:  65%|██████▌   | 3904/6000 [3:50:44<2:02:32,  3.51s/it]
Skipping the first batches:  65%|██████▌   | 3905/6000 [3:50:47<2:01:02,  3.47s/it]
Skipping the first batches:  65%|██████▌   | 3906/6000 [3:50:51<1:57:25,  3.36s/it]
Skipping the first batches:  65%|██████▌   | 3907/6000 [3:50:54<1:57:38,  3.37s/it]
Skipping the first batches:  65%|██████▌   | 3908/6000 [3:50:57<1:55:29,  3.31s/it]
Skipping the first batches:  65%|██████▌   | 3909/6000 [3:51:00<1:55:41,  3.32s/it]
Skipping the first batches:  65%|██████▌   | 3910/6000 [3:51:04<1:57:10,  3.36s/it]
Skipping the first batches:  65%|██████▌   | 3911/6000 [3:51:08<1:58:57,  3.42s/it]
Skipping the first batches:  65%|██████▌   | 3912/6000 [3:51:11<1:57:51,  3.39s/it]
Skipping the first batches:  65%|██████▌   | 3913/6000 [3:51:14<1:54:49,  3.30s/it]
Skipping the first batches:  65%|██████▌   | 3914/6000 [3:51:18<1:58:53,  3.42s/it]
Skipping the first batches:  65%|██████▌   | 3915/6000 [3:51:21<1:56:13,  3.34s/it]
Skipping the first batches:  65%|██████▌   | 3916/6000 [3:51:24<1:55:34,  3.33s/it]
Skipping the first batches:  65%|██████▌   | 3917/6000 [3:51:27<1:54:26,  3.30s/it]
Skipping the first batches:  65%|██████▌   | 3918/6000 [3:51:31<1:59:26,  3.44s/it]
Skipping the first batches:  65%|██████▌   | 3919/6000 [3:51:34<1:56:20,  3.35s/it]
Skipping the first batches:  65%|██████▌   | 3920/6000 [3:51:38<1:55:33,  3.33s/it]
Skipping the first batches:  65%|██████▌   | 3921/6000 [3:51:41<1:59:45,  3.46s/it]
Skipping the first batches:  65%|██████▌   | 3922/6000 [3:51:45<2:03:15,  3.56s/it]
Skipping the first batches:  65%|██████▌   | 3923/6000 [3:51:49<2:09:03,  3.73s/it]
Skipping the first batches:  65%|██████▌   | 3924/6000 [3:51:52<2:03:33,  3.57s/it]
Skipping the first batches:  65%|██████▌   | 3925/6000 [3:51:56<2:04:41,  3.61s/it]
Skipping the first batches:  65%|██████▌   | 3926/6000 [3:52:00<2:05:33,  3.63s/it]
Skipping the first batches:  65%|██████▌   | 3927/6000 [3:52:03<2:01:24,  3.51s/it]
Skipping the first batches:  65%|██████▌   | 3928/6000 [3:52:06<1:57:09,  3.39s/it]
Skipping the first batches:  65%|██████▌   | 3929/6000 [3:52:10<2:00:39,  3.50s/it]
Skipping the first batches:  66%|██████▌   | 3930/6000 [3:52:13<1:57:07,  3.39s/it]
Skipping the first batches:  66%|██████▌   | 3931/6000 [3:52:16<1:57:24,  3.40s/it]
Skipping the first batches:  66%|██████▌   | 3932/6000 [3:52:20<2:00:46,  3.50s/it]
Skipping the first batches:  66%|██████▌   | 3933/6000 [3:52:24<2:01:38,  3.53s/it]
Skipping the first batches:  66%|██████▌   | 3934/6000 [3:52:28<2:09:52,  3.77s/it]
Skipping the first batches:  66%|██████▌   | 3935/6000 [3:52:32<2:08:51,  3.74s/it]
Skipping the first batches:  66%|██████▌   | 3936/6000 [3:52:36<2:11:34,  3.82s/it]
Skipping the first batches:  66%|██████▌   | 3937/6000 [3:52:39<2:10:09,  3.79s/it]
Skipping the first batches:  66%|██████▌   | 3938/6000 [3:52:43<2:07:43,  3.72s/it]
Skipping the first batches:  66%|██████▌   | 3939/6000 [3:52:46<2:01:38,  3.54s/it]
Skipping the first batches:  66%|██████▌   | 3940/6000 [3:52:49<1:58:29,  3.45s/it]
Skipping the first batches:  66%|██████▌   | 3941/6000 [3:52:53<1:57:02,  3.41s/it]
Skipping the first batches:  66%|██████▌   | 3942/6000 [3:52:56<1:55:14,  3.36s/it]
Skipping the first batches:  66%|██████▌   | 3943/6000 [3:53:01<2:11:52,  3.85s/it]
Skipping the first batches:  66%|██████▌   | 3944/6000 [3:53:05<2:16:24,  3.98s/it]
Skipping the first batches:  66%|██████▌   | 3945/6000 [3:53:09<2:12:48,  3.88s/it]
Skipping the first batches:  66%|██████▌   | 3946/6000 [3:53:12<2:07:45,  3.73s/it]
Skipping the first batches:  66%|██████▌   | 3947/6000 [3:53:16<2:03:22,  3.61s/it]
Skipping the first batches:  66%|██████▌   | 3948/6000 [3:53:19<2:01:44,  3.56s/it]
Skipping the first batches:  66%|██████▌   | 3949/6000 [3:53:22<2:00:38,  3.53s/it]
Skipping the first batches:  66%|██████▌   | 3950/6000 [3:53:26<2:05:02,  3.66s/it]
Skipping the first batches:  66%|██████▌   | 3951/6000 [3:53:30<1:59:30,  3.50s/it]
Skipping the first batches:  66%|██████▌   | 3952/6000 [3:53:33<1:58:00,  3.46s/it]
Skipping the first batches:  66%|██████▌   | 3953/6000 [3:53:36<1:57:41,  3.45s/it]
Skipping the first batches:  66%|██████▌   | 3954/6000 [3:53:40<1:55:45,  3.39s/it]
Skipping the first batches:  66%|██████▌   | 3955/6000 [3:53:43<1:59:28,  3.51s/it]
Skipping the first batches:  66%|██████▌   | 3956/6000 [3:53:47<2:04:54,  3.67s/it]
Skipping the first batches:  66%|██████▌   | 3957/6000 [3:53:51<2:00:02,  3.53s/it]
Skipping the first batches:  66%|██████▌   | 3958/6000 [3:53:54<1:59:40,  3.52s/it]
Skipping the first batches:  66%|██████▌   | 3959/6000 [3:53:58<1:59:23,  3.51s/it]
Skipping the first batches:  66%|██████▌   | 3960/6000 [3:54:01<1:59:04,  3.50s/it]
Skipping the first batches:  66%|██████▌   | 3961/6000 [3:54:05<2:01:42,  3.58s/it]
Skipping the first batches:  66%|██████▌   | 3962/6000 [3:54:09<2:09:13,  3.80s/it]
Skipping the first batches:  66%|██████▌   | 3963/6000 [3:54:14<2:17:54,  4.06s/it]
Skipping the first batches:  66%|██████▌   | 3964/6000 [3:54:18<2:14:40,  3.97s/it]
Skipping the first batches:  66%|██████▌   | 3965/6000 [3:54:21<2:11:16,  3.87s/it]
Skipping the first batches:  66%|██████▌   | 3966/6000 [3:54:25<2:05:02,  3.69s/it]
Skipping the first batches:  66%|██████▌   | 3967/6000 [3:54:28<2:00:34,  3.56s/it]
Skipping the first batches:  66%|██████▌   | 3968/6000 [3:54:31<1:59:55,  3.54s/it]
Skipping the first batches:  66%|██████▌   | 3969/6000 [3:54:34<1:56:18,  3.44s/it]
Skipping the first batches:  66%|██████▌   | 3970/6000 [3:54:38<1:55:55,  3.43s/it]
Skipping the first batches:  66%|██████▌   | 3971/6000 [3:54:41<1:55:53,  3.43s/it]
Skipping the first batches:  66%|██████▌   | 3972/6000 [3:54:46<2:07:35,  3.77s/it]
Skipping the first batches:  66%|██████▌   | 3973/6000 [3:54:49<2:01:39,  3.60s/it]
Skipping the first batches:  66%|██████▌   | 3974/6000 [3:54:52<1:59:07,  3.53s/it]
Skipping the first batches:  66%|██████▋   | 3975/6000 [3:54:56<1:59:24,  3.54s/it]
Skipping the first batches:  66%|██████▋   | 3976/6000 [3:54:59<1:58:05,  3.50s/it]
Skipping the first batches:  66%|██████▋   | 3977/6000 [3:55:03<1:56:01,  3.44s/it]
Skipping the first batches:  66%|██████▋   | 3978/6000 [3:55:07<2:03:47,  3.67s/it]
Skipping the first batches:  66%|██████▋   | 3979/6000 [3:55:10<1:57:08,  3.48s/it]
Skipping the first batches:  66%|██████▋   | 3980/6000 [3:55:13<1:53:19,  3.37s/it]
Skipping the first batches:  66%|██████▋   | 3981/6000 [3:55:17<2:02:58,  3.65s/it]
Skipping the first batches:  66%|██████▋   | 3982/6000 [3:55:21<1:58:15,  3.52s/it]
Skipping the first batches:  66%|██████▋   | 3983/6000 [3:55:24<1:54:31,  3.41s/it]
Skipping the first batches:  66%|██████▋   | 3984/6000 [3:55:28<1:58:09,  3.52s/it]
Skipping the first batches:  66%|██████▋   | 3985/6000 [3:55:31<1:59:15,  3.55s/it]
Skipping the first batches:  66%|██████▋   | 3986/6000 [3:55:34<1:54:46,  3.42s/it]
Skipping the first batches:  66%|██████▋   | 3987/6000 [3:55:38<1:54:36,  3.42s/it]
Skipping the first batches:  66%|██████▋   | 3988/6000 [3:55:41<1:53:29,  3.38s/it]
Skipping the first batches:  66%|██████▋   | 3989/6000 [3:55:44<1:50:25,  3.29s/it]
Skipping the first batches:  66%|██████▋   | 3990/6000 [3:55:48<1:55:24,  3.45s/it]
Skipping the first batches:  67%|██████▋   | 3991/6000 [3:55:52<2:01:24,  3.63s/it]
Skipping the first batches:  67%|██████▋   | 3992/6000 [3:55:55<1:56:53,  3.49s/it]
Skipping the first batches:  67%|██████▋   | 3993/6000 [3:55:58<1:55:52,  3.46s/it]
Skipping the first batches:  67%|██████▋   | 3994/6000 [3:56:02<1:54:30,  3.43s/it]
Skipping the first batches:  67%|██████▋   | 3995/6000 [3:56:05<1:51:03,  3.32s/it]
Skipping the first batches:  67%|██████▋   | 3996/6000 [3:56:08<1:53:08,  3.39s/it]
Skipping the first batches:  67%|██████▋   | 3997/6000 [3:56:12<1:55:52,  3.47s/it]
Skipping the first batches:  67%|██████▋   | 3998/6000 [3:56:15<1:53:14,  3.39s/it]
Skipping the first batches:  67%|██████▋   | 3999/6000 [3:56:19<1:54:00,  3.42s/it]
Skipping the first batches:  67%|██████▋   | 4000/6000 [3:56:23<1:58:07,  3.54s/it]
Skipping the first batches:  67%|██████▋   | 4001/6000 [3:56:26<1:56:27,  3.50s/it]
Skipping the first batches:  67%|██████▋   | 4002/6000 [3:56:31<2:07:34,  3.83s/it]
Skipping the first batches:  67%|██████▋   | 4003/6000 [3:56:34<2:00:58,  3.63s/it]
Skipping the first batches:  67%|██████▋   | 4004/6000 [3:56:37<1:56:24,  3.50s/it]
Skipping the first batches:  67%|██████▋   | 4005/6000 [3:56:40<1:53:18,  3.41s/it]
Skipping the first batches:  67%|██████▋   | 4006/6000 [3:56:44<1:54:24,  3.44s/it]
Skipping the first batches:  67%|██████▋   | 4007/6000 [3:56:47<1:52:52,  3.40s/it]
Skipping the first batches:  67%|██████▋   | 4008/6000 [3:56:50<1:49:44,  3.31s/it]
Skipping the first batches:  67%|██████▋   | 4009/6000 [3:56:54<1:55:42,  3.49s/it]
Skipping the first batches:  67%|██████▋   | 4010/6000 [3:56:58<2:05:11,  3.77s/it]
Skipping the first batches:  67%|██████▋   | 4011/6000 [3:57:02<1:59:36,  3.61s/it]
Skipping the first batches:  67%|██████▋   | 4012/6000 [3:57:05<2:01:27,  3.67s/it]
Skipping the first batches:  67%|██████▋   | 4013/6000 [3:57:09<2:00:35,  3.64s/it]
Skipping the first batches:  67%|██████▋   | 4014/6000 [3:57:12<1:56:24,  3.52s/it]
Skipping the first batches:  67%|██████▋   | 4015/6000 [3:57:15<1:53:20,  3.43s/it]
Skipping the first batches:  67%|██████▋   | 4016/6000 [3:57:19<1:51:01,  3.36s/it]
Skipping the first batches:  67%|██████▋   | 4017/6000 [3:57:22<1:53:04,  3.42s/it]
Skipping the first batches:  67%|██████▋   | 4018/6000 [3:57:26<1:51:56,  3.39s/it]
Skipping the first batches:  67%|██████▋   | 4019/6000 [3:57:29<1:54:24,  3.46s/it]
Skipping the first batches:  67%|██████▋   | 4020/6000 [3:57:33<1:56:16,  3.52s/it]
Skipping the first batches:  67%|██████▋   | 4021/6000 [3:57:36<1:55:03,  3.49s/it]
Skipping the first batches:  67%|██████▋   | 4022/6000 [3:57:39<1:51:54,  3.39s/it]
Skipping the first batches:  67%|██████▋   | 4023/6000 [3:57:43<1:53:44,  3.45s/it]
Skipping the first batches:  67%|██████▋   | 4024/6000 [3:57:47<1:54:56,  3.49s/it]
Skipping the first batches:  67%|██████▋   | 4025/6000 [3:57:50<1:51:52,  3.40s/it]
Skipping the first batches:  67%|██████▋   | 4026/6000 [3:57:53<1:49:15,  3.32s/it]
Skipping the first batches:  67%|██████▋   | 4027/6000 [3:57:56<1:49:34,  3.33s/it]
Skipping the first batches:  67%|██████▋   | 4028/6000 [3:58:00<1:51:55,  3.41s/it]
Skipping the first batches:  67%|██████▋   | 4029/6000 [3:58:03<1:50:11,  3.35s/it]
Skipping the first batches:  67%|██████▋   | 4030/6000 [3:58:07<1:53:10,  3.45s/it]
Skipping the first batches:  67%|██████▋   | 4031/6000 [3:58:10<1:52:18,  3.42s/it]
Skipping the first batches:  67%|██████▋   | 4032/6000 [3:58:14<1:52:18,  3.42s/it]
Skipping the first batches:  67%|██████▋   | 4033/6000 [3:58:17<1:50:05,  3.36s/it]
Skipping the first batches:  67%|██████▋   | 4034/6000 [3:58:22<2:07:37,  3.90s/it]
Skipping the first batches:  67%|██████▋   | 4035/6000 [3:58:25<2:01:53,  3.72s/it]
Skipping the first batches:  67%|██████▋   | 4036/6000 [3:58:28<1:56:51,  3.57s/it]
Skipping the first batches:  67%|██████▋   | 4037/6000 [3:58:32<1:54:41,  3.51s/it]
Skipping the first batches:  67%|██████▋   | 4038/6000 [3:58:35<1:51:35,  3.41s/it]
Skipping the first batches:  67%|██████▋   | 4039/6000 [3:58:39<1:52:56,  3.46s/it]
Skipping the first batches:  67%|██████▋   | 4040/6000 [3:58:43<2:03:58,  3.80s/it]
Skipping the first batches:  67%|██████▋   | 4041/6000 [3:58:47<2:01:20,  3.72s/it]
Skipping the first batches:  67%|██████▋   | 4042/6000 [3:58:50<2:00:15,  3.69s/it]
Skipping the first batches:  67%|██████▋   | 4043/6000 [3:58:53<1:55:11,  3.53s/it]
Skipping the first batches:  67%|██████▋   | 4044/6000 [3:58:57<1:55:03,  3.53s/it]
Skipping the first batches:  67%|██████▋   | 4045/6000 [3:59:01<2:00:22,  3.69s/it]
Skipping the first batches:  67%|██████▋   | 4046/6000 [3:59:04<1:57:19,  3.60s/it]
Skipping the first batches:  67%|██████▋   | 4047/6000 [3:59:08<1:55:41,  3.55s/it]
Skipping the first batches:  67%|██████▋   | 4048/6000 [3:59:11<1:51:05,  3.41s/it]
Skipping the first batches:  67%|██████▋   | 4049/6000 [3:59:15<1:57:36,  3.62s/it]
Skipping the first batches:  68%|██████▊   | 4050/6000 [3:59:18<1:55:04,  3.54s/it]
Skipping the first batches:  68%|██████▊   | 4051/6000 [3:59:22<1:59:06,  3.67s/it]
Skipping the first batches:  68%|██████▊   | 4052/6000 [3:59:26<1:57:15,  3.61s/it]
Skipping the first batches:  68%|██████▊   | 4053/6000 [3:59:29<1:54:54,  3.54s/it]
Skipping the first batches:  68%|██████▊   | 4054/6000 [3:59:33<1:52:26,  3.47s/it]
Skipping the first batches:  68%|██████▊   | 4055/6000 [3:59:36<1:53:28,  3.50s/it]
Skipping the first batches:  68%|██████▊   | 4056/6000 [3:59:40<2:00:03,  3.71s/it]
Skipping the first batches:  68%|██████▊   | 4057/6000 [3:59:44<1:55:58,  3.58s/it]
Skipping the first batches:  68%|██████▊   | 4058/6000 [3:59:47<1:54:34,  3.54s/it]
Skipping the first batches:  68%|██████▊   | 4059/6000 [3:59:52<2:07:29,  3.94s/it]
Skipping the first batches:  68%|██████▊   | 4060/6000 [3:59:55<2:00:09,  3.72s/it]
Skipping the first batches:  68%|██████▊   | 4061/6000 [3:59:58<1:53:57,  3.53s/it]
Skipping the first batches:  68%|██████▊   | 4062/6000 [4:00:01<1:51:29,  3.45s/it]
Skipping the first batches:  68%|██████▊   | 4063/6000 [4:00:05<1:52:00,  3.47s/it]
Skipping the first batches:  68%|██████▊   | 4064/6000 [4:00:08<1:50:00,  3.41s/it]
Skipping the first batches:  68%|██████▊   | 4065/6000 [4:00:12<1:48:20,  3.36s/it]
Skipping the first batches:  68%|██████▊   | 4066/6000 [4:00:15<1:52:18,  3.48s/it]
Skipping the first batches:  68%|██████▊   | 4067/6000 [4:00:20<2:06:20,  3.92s/it]
Skipping the first batches:  68%|██████▊   | 4068/6000 [4:00:25<2:09:52,  4.03s/it]
Skipping the first batches:  68%|██████▊   | 4069/6000 [4:00:29<2:12:53,  4.13s/it]
Skipping the first batches:  68%|██████▊   | 4070/6000 [4:00:33<2:17:31,  4.28s/it]
Skipping the first batches:  68%|██████▊   | 4071/6000 [4:00:37<2:05:49,  3.91s/it]
Skipping the first batches:  68%|██████▊   | 4072/6000 [4:00:40<2:03:52,  3.85s/it]
Skipping the first batches:  68%|██████▊   | 4073/6000 [4:00:44<1:58:40,  3.70s/it]
Skipping the first batches:  68%|██████▊   | 4074/6000 [4:00:47<1:54:40,  3.57s/it]
Skipping the first batches:  68%|██████▊   | 4075/6000 [4:00:50<1:52:45,  3.51s/it]
Skipping the first batches:  68%|██████▊   | 4076/6000 [4:00:54<1:50:40,  3.45s/it]
Skipping the first batches:  68%|██████▊   | 4077/6000 [4:00:58<1:56:04,  3.62s/it]
Skipping the first batches:  68%|██████▊   | 4078/6000 [4:01:03<2:11:22,  4.10s/it]
Skipping the first batches:  68%|██████▊   | 4079/6000 [4:01:06<2:01:52,  3.81s/it]
Skipping the first batches:  68%|██████▊   | 4080/6000 [4:01:10<1:59:33,  3.74s/it]
Skipping the first batches:  68%|██████▊   | 4081/6000 [4:01:13<1:57:08,  3.66s/it]
Skipping the first batches:  68%|██████▊   | 4082/6000 [4:01:17<1:55:59,  3.63s/it]
Skipping the first batches:  68%|██████▊   | 4083/6000 [4:01:20<1:52:21,  3.52s/it]
Skipping the first batches:  68%|██████▊   | 4084/6000 [4:01:23<1:48:42,  3.40s/it]
Skipping the first batches:  68%|██████▊   | 4085/6000 [4:01:27<1:52:41,  3.53s/it]
Skipping the first batches:  68%|██████▊   | 4086/6000 [4:01:30<1:50:44,  3.47s/it]
Skipping the first batches:  68%|██████▊   | 4087/6000 [4:01:33<1:49:16,  3.43s/it]
Skipping the first batches:  68%|██████▊   | 4088/6000 [4:01:39<2:11:25,  4.12s/it]
Skipping the first batches:  68%|██████▊   | 4089/6000 [4:01:42<2:02:15,  3.84s/it]
Skipping the first batches:  68%|██████▊   | 4090/6000 [4:01:46<1:59:05,  3.74s/it]
Skipping the first batches:  68%|██████▊   | 4091/6000 [4:01:50<2:04:40,  3.92s/it]
Skipping the first batches:  68%|██████▊   | 4092/6000 [4:01:54<2:00:28,  3.79s/it]
Skipping the first batches:  68%|██████▊   | 4093/6000 [4:01:57<1:53:13,  3.56s/it]
Skipping the first batches:  68%|██████▊   | 4094/6000 [4:02:00<1:53:28,  3.57s/it]
Skipping the first batches:  68%|██████▊   | 4095/6000 [4:02:04<1:53:32,  3.58s/it]
Skipping the first batches:  68%|██████▊   | 4096/6000 [4:02:07<1:48:49,  3.43s/it]
Skipping the first batches:  68%|██████▊   | 4097/6000 [4:02:10<1:48:31,  3.42s/it]
Skipping the first batches:  68%|██████▊   | 4098/6000 [4:02:15<1:58:50,  3.75s/it]
Skipping the first batches:  68%|██████▊   | 4099/6000 [4:02:18<1:52:25,  3.55s/it]
Skipping the first batches:  68%|██████▊   | 4100/6000 [4:02:22<1:57:30,  3.71s/it]
Skipping the first batches:  68%|██████▊   | 4101/6000 [4:02:25<1:53:42,  3.59s/it]
Skipping the first batches:  68%|██████▊   | 4102/6000 [4:02:29<1:54:03,  3.61s/it]
Skipping the first batches:  68%|██████▊   | 4103/6000 [4:02:34<2:03:10,  3.90s/it]
Skipping the first batches:  68%|██████▊   | 4104/6000 [4:02:37<1:57:42,  3.72s/it]
Skipping the first batches:  68%|██████▊   | 4105/6000 [4:02:40<1:54:28,  3.62s/it]
Skipping the first batches:  68%|██████▊   | 4106/6000 [4:02:43<1:49:24,  3.47s/it]
Skipping the first batches:  68%|██████▊   | 4107/6000 [4:02:47<1:52:01,  3.55s/it]
Skipping the first batches:  68%|██████▊   | 4108/6000 [4:02:51<1:59:20,  3.78s/it]
Skipping the first batches:  68%|██████▊   | 4109/6000 [4:02:55<1:54:35,  3.64s/it]
Skipping the first batches:  68%|██████▊   | 4110/6000 [4:02:58<1:55:14,  3.66s/it]
Skipping the first batches:  69%|██████▊   | 4111/6000 [4:03:02<1:55:25,  3.67s/it]
Skipping the first batches:  69%|██████▊   | 4112/6000 [4:03:06<1:57:41,  3.74s/it]
Skipping the first batches:  69%|██████▊   | 4113/6000 [4:03:11<2:05:17,  3.98s/it]
Skipping the first batches:  69%|██████▊   | 4114/6000 [4:03:14<2:01:33,  3.87s/it]
Skipping the first batches:  69%|██████▊   | 4115/6000 [4:03:18<1:58:20,  3.77s/it]
Skipping the first batches:  69%|██████▊   | 4116/6000 [4:03:21<1:55:05,  3.67s/it]
Skipping the first batches:  69%|██████▊   | 4117/6000 [4:03:25<1:53:20,  3.61s/it]
Skipping the first batches:  69%|██████▊   | 4118/6000 [4:03:28<1:53:59,  3.63s/it]
Skipping the first batches:  69%|██████▊   | 4119/6000 [4:03:33<2:01:32,  3.88s/it]
Skipping the first batches:  69%|██████▊   | 4120/6000 [4:03:36<1:56:08,  3.71s/it]
Skipping the first batches:  69%|██████▊   | 4121/6000 [4:03:40<1:54:33,  3.66s/it]
Skipping the first batches:  69%|██████▊   | 4122/6000 [4:03:43<1:50:41,  3.54s/it]
Skipping the first batches:  69%|██████▊   | 4123/6000 [4:03:47<1:52:46,  3.60s/it]
Skipping the first batches:  69%|██████▊   | 4124/6000 [4:03:50<1:52:38,  3.60s/it]
Skipping the first batches:  69%|██████▉   | 4125/6000 [4:03:54<1:49:53,  3.52s/it]
Skipping the first batches:  69%|██████▉   | 4126/6000 [4:03:57<1:46:09,  3.40s/it]
Skipping the first batches:  69%|██████▉   | 4127/6000 [4:04:01<1:51:31,  3.57s/it]
Skipping the first batches:  69%|██████▉   | 4128/6000 [4:04:04<1:50:46,  3.55s/it]
Skipping the first batches:  69%|██████▉   | 4129/6000 [4:04:07<1:46:34,  3.42s/it]
Skipping the first batches:  69%|██████▉   | 4130/6000 [4:04:12<2:00:08,  3.85s/it]
Skipping the first batches:  69%|██████▉   | 4131/6000 [4:04:16<1:56:39,  3.74s/it]
Skipping the first batches:  69%|██████▉   | 4132/6000 [4:04:19<1:53:21,  3.64s/it]
Skipping the first batches:  69%|██████▉   | 4133/6000 [4:04:23<1:55:18,  3.71s/it]
Skipping the first batches:  69%|██████▉   | 4134/6000 [4:04:26<1:53:01,  3.63s/it]
Skipping the first batches:  69%|██████▉   | 4135/6000 [4:04:30<1:52:40,  3.62s/it]
Skipping the first batches:  69%|██████▉   | 4136/6000 [4:04:33<1:48:11,  3.48s/it]
Skipping the first batches:  69%|██████▉   | 4137/6000 [4:04:37<1:51:03,  3.58s/it]
Skipping the first batches:  69%|██████▉   | 4138/6000 [4:04:40<1:50:09,  3.55s/it]
Skipping the first batches:  69%|██████▉   | 4139/6000 [4:04:46<2:06:03,  4.06s/it]
Skipping the first batches:  69%|██████▉   | 4140/6000 [4:04:50<2:11:15,  4.23s/it]
Skipping the first batches:  69%|██████▉   | 4141/6000 [4:04:56<2:23:27,  4.63s/it]
Skipping the first batches:  69%|██████▉   | 4142/6000 [4:05:00<2:17:13,  4.43s/it]
Skipping the first batches:  69%|██████▉   | 4143/6000 [4:05:05<2:25:32,  4.70s/it]
Skipping the first batches:  69%|██████▉   | 4144/6000 [4:05:11<2:33:07,  4.95s/it]
Skipping the first batches:  69%|██████▉   | 4145/6000 [4:05:15<2:28:52,  4.82s/it]
Skipping the first batches:  69%|██████▉   | 4146/6000 [4:05:18<2:12:53,  4.30s/it]
Skipping the first batches:  69%|██████▉   | 4147/6000 [4:05:21<2:01:40,  3.94s/it]
Skipping the first batches:  69%|██████▉   | 4148/6000 [4:05:26<2:03:40,  4.01s/it]
Skipping the first batches:  69%|██████▉   | 4149/6000 [4:05:29<1:58:46,  3.85s/it]
Skipping the first batches:  69%|██████▉   | 4150/6000 [4:05:32<1:51:19,  3.61s/it]
Skipping the first batches:  69%|██████▉   | 4151/6000 [4:05:37<1:59:49,  3.89s/it]
Skipping the first batches:  69%|██████▉   | 4152/6000 [4:05:41<2:02:24,  3.97s/it]
Skipping the first batches:  69%|██████▉   | 4153/6000 [4:05:46<2:12:35,  4.31s/it]
Skipping the first batches:  69%|██████▉   | 4154/6000 [4:05:50<2:12:51,  4.32s/it]
Skipping the first batches:  69%|██████▉   | 4155/6000 [4:05:55<2:17:23,  4.47s/it]
Skipping the first batches:  69%|██████▉   | 4156/6000 [4:06:01<2:27:25,  4.80s/it]
Skipping the first batches:  69%|██████▉   | 4157/6000 [4:06:06<2:30:04,  4.89s/it]
Skipping the first batches:  69%|██████▉   | 4158/6000 [4:06:09<2:15:41,  4.42s/it]
Skipping the first batches:  69%|██████▉   | 4159/6000 [4:06:13<2:07:24,  4.15s/it]
Skipping the first batches:  69%|██████▉   | 4160/6000 [4:06:16<2:00:36,  3.93s/it]
Skipping the first batches:  69%|██████▉   | 4161/6000 [4:06:19<1:52:53,  3.68s/it]
Skipping the first batches:  69%|██████▉   | 4162/6000 [4:06:22<1:49:24,  3.57s/it]
Skipping the first batches:  69%|██████▉   | 4163/6000 [4:06:27<2:02:05,  3.99s/it]
Skipping the first batches:  69%|██████▉   | 4164/6000 [4:06:31<1:58:13,  3.86s/it]
Skipping the first batches:  69%|██████▉   | 4165/6000 [4:06:35<1:56:45,  3.82s/it]
Skipping the first batches:  69%|██████▉   | 4166/6000 [4:06:38<1:56:22,  3.81s/it]
Skipping the first batches:  69%|██████▉   | 4167/6000 [4:06:43<2:00:13,  3.94s/it]
Skipping the first batches:  69%|██████▉   | 4168/6000 [4:06:46<1:57:32,  3.85s/it]
Skipping the first batches:  69%|██████▉   | 4169/6000 [4:06:50<1:53:31,  3.72s/it]
Skipping the first batches:  70%|██████▉   | 4170/6000 [4:06:53<1:51:32,  3.66s/it]
Skipping the first batches:  70%|██████▉   | 4171/6000 [4:06:58<2:00:35,  3.96s/it]
Skipping the first batches:  70%|██████▉   | 4172/6000 [4:07:01<1:54:41,  3.76s/it]
Skipping the first batches:  70%|██████▉   | 4173/6000 [4:07:05<1:54:21,  3.76s/it]
Skipping the first batches:  70%|██████▉   | 4174/6000 [4:07:08<1:48:38,  3.57s/it]
Skipping the first batches:  70%|██████▉   | 4175/6000 [4:07:12<1:51:59,  3.68s/it]
Skipping the first batches:  70%|██████▉   | 4176/6000 [4:07:15<1:49:12,  3.59s/it]
Skipping the first batches:  70%|██████▉   | 4177/6000 [4:07:19<1:47:33,  3.54s/it]
Skipping the first batches:  70%|██████▉   | 4178/6000 [4:07:22<1:48:08,  3.56s/it]
Skipping the first batches:  70%|██████▉   | 4179/6000 [4:07:26<1:48:34,  3.58s/it]
Skipping the first batches:  70%|██████▉   | 4180/6000 [4:07:29<1:43:44,  3.42s/it]
Skipping the first batches:  70%|██████▉   | 4181/6000 [4:07:32<1:40:10,  3.30s/it]
Skipping the first batches:  70%|██████▉   | 4182/6000 [4:07:36<1:42:14,  3.37s/it]
Skipping the first batches:  70%|██████▉   | 4183/6000 [4:07:39<1:39:24,  3.28s/it]
Skipping the first batches:  70%|██████▉   | 4184/6000 [4:07:43<1:47:58,  3.57s/it]
Skipping the first batches:  70%|██████▉   | 4185/6000 [4:07:46<1:46:45,  3.53s/it]
Skipping the first batches:  70%|██████▉   | 4186/6000 [4:07:50<1:49:00,  3.61s/it]
Skipping the first batches:  70%|██████▉   | 4187/6000 [4:07:54<1:50:23,  3.65s/it]
Skipping the first batches:  70%|██████▉   | 4188/6000 [4:07:57<1:47:00,  3.54s/it]
Skipping the first batches:  70%|██████▉   | 4189/6000 [4:08:00<1:42:31,  3.40s/it]
Skipping the first batches:  70%|██████▉   | 4190/6000 [4:08:04<1:44:28,  3.46s/it]
Skipping the first batches:  70%|██████▉   | 4191/6000 [4:08:07<1:41:50,  3.38s/it]
Skipping the first batches:  70%|██████▉   | 4192/6000 [4:08:11<1:42:23,  3.40s/it]
Skipping the first batches:  70%|██████▉   | 4193/6000 [4:08:14<1:41:52,  3.38s/it]
Skipping the first batches:  70%|██████▉   | 4194/6000 [4:08:17<1:39:24,  3.30s/it]
Skipping the first batches:  70%|██████▉   | 4195/6000 [4:08:21<1:44:32,  3.47s/it]
Skipping the first batches:  70%|██████▉   | 4196/6000 [4:08:25<1:47:14,  3.57s/it]
Skipping the first batches:  70%|██████▉   | 4197/6000 [4:08:28<1:44:59,  3.49s/it]
Skipping the first batches:  70%|██████▉   | 4198/6000 [4:08:31<1:42:29,  3.41s/it]
Skipping the first batches:  70%|██████▉   | 4199/6000 [4:08:35<1:47:52,  3.59s/it]
Skipping the first batches:  70%|███████   | 4200/6000 [4:08:38<1:42:50,  3.43s/it]
Skipping the first batches:  70%|███████   | 4201/6000 [4:08:41<1:39:36,  3.32s/it]
Skipping the first batches:  70%|███████   | 4202/6000 [4:08:45<1:42:26,  3.42s/it]
Skipping the first batches:  70%|███████   | 4203/6000 [4:08:48<1:39:18,  3.32s/it]
Skipping the first batches:  70%|███████   | 4204/6000 [4:08:51<1:39:15,  3.32s/it]
Skipping the first batches:  70%|███████   | 4205/6000 [4:08:55<1:38:51,  3.30s/it]
Skipping the first batches:  70%|███████   | 4206/6000 [4:08:59<1:44:28,  3.49s/it]
Skipping the first batches:  70%|███████   | 4207/6000 [4:09:02<1:42:25,  3.43s/it]
Skipping the first batches:  70%|███████   | 4208/6000 [4:09:05<1:42:14,  3.42s/it]
Skipping the first batches:  70%|███████   | 4209/6000 [4:09:09<1:43:36,  3.47s/it]
Skipping the first batches:  70%|███████   | 4210/6000 [4:09:12<1:44:35,  3.51s/it]
Skipping the first batches:  70%|███████   | 4211/6000 [4:09:16<1:41:19,  3.40s/it]
Skipping the first batches:  70%|███████   | 4212/6000 [4:09:19<1:41:53,  3.42s/it]
Skipping the first batches:  70%|███████   | 4213/6000 [4:09:23<1:44:09,  3.50s/it]
Skipping the first batches:  70%|███████   | 4214/6000 [4:09:26<1:44:05,  3.50s/it]
Skipping the first batches:  70%|███████   | 4215/6000 [4:09:29<1:40:22,  3.37s/it]
Skipping the first batches:  70%|███████   | 4216/6000 [4:09:33<1:40:07,  3.37s/it]
Skipping the first batches:  70%|███████   | 4217/6000 [4:09:38<1:53:16,  3.81s/it]
Skipping the first batches:  70%|███████   | 4218/6000 [4:09:41<1:46:17,  3.58s/it]
Skipping the first batches:  70%|███████   | 4219/6000 [4:09:44<1:43:13,  3.48s/it]
Skipping the first batches:  70%|███████   | 4220/6000 [4:09:49<1:55:25,  3.89s/it]
Skipping the first batches:  70%|███████   | 4221/6000 [4:09:52<1:52:23,  3.79s/it]
Skipping the first batches:  70%|███████   | 4222/6000 [4:09:56<1:49:31,  3.70s/it]
Skipping the first batches:  70%|███████   | 4223/6000 [4:09:59<1:44:04,  3.51s/it]
Skipping the first batches:  70%|███████   | 4224/6000 [4:10:02<1:42:00,  3.45s/it]
Skipping the first batches:  70%|███████   | 4225/6000 [4:10:05<1:41:02,  3.42s/it]
Skipping the first batches:  70%|███████   | 4226/6000 [4:10:09<1:39:36,  3.37s/it]
Skipping the first batches:  70%|███████   | 4227/6000 [4:10:12<1:42:02,  3.45s/it]
Skipping the first batches:  70%|███████   | 4228/6000 [4:10:16<1:47:13,  3.63s/it]
Skipping the first batches:  70%|███████   | 4229/6000 [4:10:19<1:42:20,  3.47s/it]
Skipping the first batches:  70%|███████   | 4230/6000 [4:10:23<1:39:29,  3.37s/it]
Skipping the first batches:  71%|███████   | 4231/6000 [4:10:27<1:44:12,  3.53s/it]
Skipping the first batches:  71%|███████   | 4232/6000 [4:10:30<1:43:40,  3.52s/it]
Skipping the first batches:  71%|███████   | 4233/6000 [4:10:33<1:39:49,  3.39s/it]
Skipping the first batches:  71%|███████   | 4234/6000 [4:10:37<1:39:53,  3.39s/it]
Skipping the first batches:  71%|███████   | 4235/6000 [4:10:40<1:40:24,  3.41s/it]
Skipping the first batches:  71%|███████   | 4236/6000 [4:10:43<1:40:43,  3.43s/it]
Skipping the first batches:  71%|███████   | 4237/6000 [4:10:47<1:40:58,  3.44s/it]
Skipping the first batches:  71%|███████   | 4238/6000 [4:10:50<1:41:07,  3.44s/it]
Skipping the first batches:  71%|███████   | 4239/6000 [4:10:54<1:41:14,  3.45s/it]
Skipping the first batches:  71%|███████   | 4240/6000 [4:10:57<1:39:55,  3.41s/it]
Skipping the first batches:  71%|███████   | 4241/6000 [4:11:00<1:38:29,  3.36s/it]
Skipping the first batches:  71%|███████   | 4242/6000 [4:11:04<1:39:33,  3.40s/it]
Skipping the first batches:  71%|███████   | 4243/6000 [4:11:08<1:43:31,  3.54s/it]
Skipping the first batches:  71%|███████   | 4244/6000 [4:11:11<1:42:28,  3.50s/it]
Skipping the first batches:  71%|███████   | 4245/6000 [4:11:14<1:40:56,  3.45s/it]
Skipping the first batches:  71%|███████   | 4246/6000 [4:11:18<1:37:34,  3.34s/it]
Skipping the first batches:  71%|███████   | 4247/6000 [4:11:22<1:45:16,  3.60s/it]
Skipping the first batches:  71%|███████   | 4248/6000 [4:11:26<1:49:58,  3.77s/it]
Skipping the first batches:  71%|███████   | 4249/6000 [4:11:29<1:47:59,  3.70s/it]
Skipping the first batches:  71%|███████   | 4250/6000 [4:11:33<1:45:42,  3.62s/it]
Skipping the first batches:  71%|███████   | 4251/6000 [4:11:37<1:45:30,  3.62s/it]
Skipping the first batches:  71%|███████   | 4252/6000 [4:11:40<1:42:12,  3.51s/it]
Skipping the first batches:  71%|███████   | 4253/6000 [4:11:44<1:49:43,  3.77s/it]
Skipping the first batches:  71%|███████   | 4254/6000 [4:11:48<1:47:31,  3.70s/it]
Skipping the first batches:  71%|███████   | 4255/6000 [4:11:51<1:43:21,  3.55s/it]
Skipping the first batches:  71%|███████   | 4256/6000 [4:11:55<1:44:17,  3.59s/it]
Skipping the first batches:  71%|███████   | 4257/6000 [4:11:59<1:49:53,  3.78s/it]
Skipping the first batches:  71%|███████   | 4258/6000 [4:12:02<1:47:10,  3.69s/it]
Skipping the first batches:  71%|███████   | 4259/6000 [4:12:06<1:44:47,  3.61s/it]
Skipping the first batches:  71%|███████   | 4260/6000 [4:12:09<1:42:26,  3.53s/it]
Skipping the first batches:  71%|███████   | 4261/6000 [4:12:13<1:48:02,  3.73s/it]
Skipping the first batches:  71%|███████   | 4262/6000 [4:12:17<1:48:59,  3.76s/it]
Skipping the first batches:  71%|███████   | 4263/6000 [4:12:20<1:42:40,  3.55s/it]
Skipping the first batches:  71%|███████   | 4264/6000 [4:12:23<1:40:44,  3.48s/it]
Skipping the first batches:  71%|███████   | 4265/6000 [4:12:27<1:37:56,  3.39s/it]
Skipping the first batches:  71%|███████   | 4266/6000 [4:12:30<1:39:38,  3.45s/it]
Skipping the first batches:  71%|███████   | 4267/6000 [4:12:34<1:39:53,  3.46s/it]
Skipping the first batches:  71%|███████   | 4268/6000 [4:12:37<1:36:22,  3.34s/it]
Skipping the first batches:  71%|███████   | 4269/6000 [4:12:40<1:39:17,  3.44s/it]
Skipping the first batches:  71%|███████   | 4270/6000 [4:12:44<1:42:11,  3.54s/it]
Skipping the first batches:  71%|███████   | 4271/6000 [4:12:48<1:40:56,  3.50s/it]
Skipping the first batches:  71%|███████   | 4272/6000 [4:12:51<1:40:58,  3.51s/it]
Skipping the first batches:  71%|███████   | 4273/6000 [4:12:54<1:38:48,  3.43s/it]
Skipping the first batches:  71%|███████   | 4274/6000 [4:12:58<1:40:54,  3.51s/it]
Skipping the first batches:  71%|███████▏  | 4275/6000 [4:13:02<1:46:23,  3.70s/it]
Skipping the first batches:  71%|███████▏  | 4276/6000 [4:13:06<1:47:48,  3.75s/it]
Skipping the first batches:  71%|███████▏  | 4277/6000 [4:13:09<1:44:17,  3.63s/it]
Skipping the first batches:  71%|███████▏  | 4278/6000 [4:13:13<1:46:16,  3.70s/it]
Skipping the first batches:  71%|███████▏  | 4279/6000 [4:13:17<1:42:42,  3.58s/it]
Skipping the first batches:  71%|███████▏  | 4280/6000 [4:13:20<1:43:48,  3.62s/it]
Skipping the first batches:  71%|███████▏  | 4281/6000 [4:13:24<1:45:33,  3.68s/it]
Skipping the first batches:  71%|███████▏  | 4282/6000 [4:13:27<1:40:22,  3.51s/it]
Skipping the first batches:  71%|███████▏  | 4283/6000 [4:13:30<1:37:04,  3.39s/it]
Skipping the first batches:  71%|███████▏  | 4284/6000 [4:13:34<1:38:17,  3.44s/it]
Skipping the first batches:  71%|███████▏  | 4285/6000 [4:13:37<1:36:48,  3.39s/it]
Skipping the first batches:  71%|███████▏  | 4286/6000 [4:13:41<1:36:28,  3.38s/it]
Skipping the first batches:  71%|███████▏  | 4287/6000 [4:13:44<1:35:25,  3.34s/it]
Skipping the first batches:  71%|███████▏  | 4288/6000 [4:13:47<1:36:35,  3.39s/it]
Skipping the first batches:  71%|███████▏  | 4289/6000 [4:13:51<1:36:15,  3.38s/it]
Skipping the first batches:  72%|███████▏  | 4290/6000 [4:13:54<1:36:26,  3.38s/it]
Skipping the first batches:  72%|███████▏  | 4291/6000 [4:13:58<1:42:56,  3.61s/it]
Skipping the first batches:  72%|███████▏  | 4292/6000 [4:14:01<1:38:31,  3.46s/it]
Skipping the first batches:  72%|███████▏  | 4293/6000 [4:14:05<1:37:14,  3.42s/it]
Skipping the first batches:  72%|███████▏  | 4294/6000 [4:14:08<1:37:05,  3.41s/it]
Skipping the first batches:  72%|███████▏  | 4295/6000 [4:14:12<1:40:02,  3.52s/it]
Skipping the first batches:  72%|███████▏  | 4296/6000 [4:14:15<1:39:50,  3.52s/it]
Skipping the first batches:  72%|███████▏  | 4297/6000 [4:14:19<1:39:08,  3.49s/it]
Skipping the first batches:  72%|███████▏  | 4298/6000 [4:14:22<1:40:15,  3.53s/it]
Skipping the first batches:  72%|███████▏  | 4299/6000 [4:14:25<1:36:28,  3.40s/it]
Skipping the first batches:  72%|███████▏  | 4300/6000 [4:14:29<1:35:46,  3.38s/it]
Skipping the first batches:  72%|███████▏  | 4301/6000 [4:14:33<1:40:20,  3.54s/it]
Skipping the first batches:  72%|███████▏  | 4302/6000 [4:14:36<1:39:37,  3.52s/it]
Skipping the first batches:  72%|███████▏  | 4303/6000 [4:14:39<1:37:47,  3.46s/it]
Skipping the first batches:  72%|███████▏  | 4304/6000 [4:14:43<1:37:07,  3.44s/it]
Skipping the first batches:  72%|███████▏  | 4305/6000 [4:14:46<1:37:31,  3.45s/it]
Skipping the first batches:  72%|███████▏  | 4306/6000 [4:14:50<1:42:57,  3.65s/it]
Skipping the first batches:  72%|███████▏  | 4307/6000 [4:14:54<1:41:10,  3.59s/it]
Skipping the first batches:  72%|███████▏  | 4308/6000 [4:14:57<1:38:19,  3.49s/it]
Skipping the first batches:  72%|███████▏  | 4309/6000 [4:15:00<1:35:14,  3.38s/it]
Skipping the first batches:  72%|███████▏  | 4310/6000 [4:15:04<1:37:32,  3.46s/it]
Skipping the first batches:  72%|███████▏  | 4311/6000 [4:15:07<1:37:01,  3.45s/it]
Skipping the first batches:  72%|███████▏  | 4312/6000 [4:15:11<1:37:27,  3.46s/it]
Skipping the first batches:  72%|███████▏  | 4313/6000 [4:15:14<1:37:50,  3.48s/it]
Skipping the first batches:  72%|███████▏  | 4314/6000 [4:15:17<1:34:16,  3.35s/it]
Skipping the first batches:  72%|███████▏  | 4315/6000 [4:15:21<1:39:34,  3.55s/it]
Skipping the first batches:  72%|███████▏  | 4316/6000 [4:15:25<1:41:47,  3.63s/it]
Skipping the first batches:  72%|███████▏  | 4317/6000 [4:15:29<1:40:16,  3.58s/it]
Skipping the first batches:  72%|███████▏  | 4318/6000 [4:15:32<1:39:55,  3.56s/it]
Skipping the first batches:  72%|███████▏  | 4319/6000 [4:15:36<1:39:17,  3.54s/it]
Skipping the first batches:  72%|███████▏  | 4320/6000 [4:15:39<1:35:35,  3.41s/it]
Skipping the first batches:  72%|███████▏  | 4321/6000 [4:15:43<1:38:15,  3.51s/it]
Skipping the first batches:  72%|███████▏  | 4322/6000 [4:15:46<1:38:14,  3.51s/it]
Skipping the first batches:  72%|███████▏  | 4323/6000 [4:15:50<1:40:04,  3.58s/it]
Skipping the first batches:  72%|███████▏  | 4324/6000 [4:15:54<1:47:40,  3.85s/it]
Skipping the first batches:  72%|███████▏  | 4325/6000 [4:15:58<1:42:25,  3.67s/it]
Skipping the first batches:  72%|███████▏  | 4326/6000 [4:16:01<1:40:59,  3.62s/it]
Skipping the first batches:  72%|███████▏  | 4327/6000 [4:16:05<1:41:53,  3.65s/it]
Skipping the first batches:  72%|███████▏  | 4328/6000 [4:16:08<1:39:34,  3.57s/it]
Skipping the first batches:  72%|███████▏  | 4329/6000 [4:16:11<1:35:55,  3.44s/it]
Skipping the first batches:  72%|███████▏  | 4330/6000 [4:16:15<1:37:37,  3.51s/it]
Skipping the first batches:  72%|███████▏  | 4331/6000 [4:16:19<1:38:28,  3.54s/it]
Skipping the first batches:  72%|███████▏  | 4332/6000 [4:16:22<1:34:28,  3.40s/it]
Skipping the first batches:  72%|███████▏  | 4333/6000 [4:16:25<1:35:18,  3.43s/it]
Skipping the first batches:  72%|███████▏  | 4334/6000 [4:16:29<1:37:56,  3.53s/it]
Skipping the first batches:  72%|███████▏  | 4335/6000 [4:16:32<1:36:01,  3.46s/it]
Skipping the first batches:  72%|███████▏  | 4336/6000 [4:16:35<1:32:48,  3.35s/it]
Skipping the first batches:  72%|███████▏  | 4337/6000 [4:16:39<1:36:41,  3.49s/it]
Skipping the first batches:  72%|███████▏  | 4338/6000 [4:16:43<1:36:01,  3.47s/it]
Skipping the first batches:  72%|███████▏  | 4339/6000 [4:16:46<1:32:47,  3.35s/it]
Skipping the first batches:  72%|███████▏  | 4340/6000 [4:16:50<1:37:26,  3.52s/it]
Skipping the first batches:  72%|███████▏  | 4341/6000 [4:16:53<1:33:45,  3.39s/it]
Skipping the first batches:  72%|███████▏  | 4342/6000 [4:16:56<1:35:07,  3.44s/it]
Skipping the first batches:  72%|███████▏  | 4343/6000 [4:17:00<1:37:30,  3.53s/it]
Skipping the first batches:  72%|███████▏  | 4344/6000 [4:17:03<1:36:11,  3.49s/it]
Skipping the first batches:  72%|███████▏  | 4345/6000 [4:17:07<1:36:47,  3.51s/it]
Skipping the first batches:  72%|███████▏  | 4346/6000 [4:17:10<1:36:36,  3.50s/it]
Skipping the first batches:  72%|███████▏  | 4347/6000 [4:17:14<1:36:57,  3.52s/it]
Skipping the first batches:  72%|███████▏  | 4348/6000 [4:17:17<1:36:05,  3.49s/it]
Skipping the first batches:  72%|███████▏  | 4349/6000 [4:17:20<1:32:20,  3.36s/it]
Skipping the first batches:  72%|███████▎  | 4350/6000 [4:17:24<1:32:55,  3.38s/it]
Skipping the first batches:  73%|███████▎  | 4351/6000 [4:17:27<1:32:55,  3.38s/it]
Skipping the first batches:  73%|███████▎  | 4352/6000 [4:17:30<1:31:43,  3.34s/it]
Skipping the first batches:  73%|███████▎  | 4353/6000 [4:17:34<1:35:47,  3.49s/it]
Skipping the first batches:  73%|███████▎  | 4354/6000 [4:17:38<1:33:38,  3.41s/it]
Skipping the first batches:  73%|███████▎  | 4355/6000 [4:17:41<1:32:54,  3.39s/it]
Skipping the first batches:  73%|███████▎  | 4356/6000 [4:17:45<1:35:12,  3.47s/it]
Skipping the first batches:  73%|███████▎  | 4357/6000 [4:17:48<1:36:47,  3.53s/it]
Skipping the first batches:  73%|███████▎  | 4358/6000 [4:17:52<1:35:18,  3.48s/it]
Skipping the first batches:  73%|███████▎  | 4359/6000 [4:17:56<1:39:52,  3.65s/it]
Skipping the first batches:  73%|███████▎  | 4360/6000 [4:17:59<1:40:06,  3.66s/it]
Skipping the first batches:  73%|███████▎  | 4361/6000 [4:18:03<1:38:01,  3.59s/it]
Skipping the first batches:  73%|███████▎  | 4362/6000 [4:18:07<1:39:49,  3.66s/it]
Skipping the first batches:  73%|███████▎  | 4363/6000 [4:18:10<1:37:38,  3.58s/it]
Skipping the first batches:  73%|███████▎  | 4364/6000 [4:18:14<1:39:26,  3.65s/it]
Skipping the first batches:  73%|███████▎  | 4365/6000 [4:18:18<1:40:29,  3.69s/it]
Skipping the first batches:  73%|███████▎  | 4366/6000 [4:18:21<1:41:03,  3.71s/it]
Skipping the first batches:  73%|███████▎  | 4367/6000 [4:18:25<1:39:12,  3.65s/it]
Skipping the first batches:  73%|███████▎  | 4368/6000 [4:18:28<1:34:55,  3.49s/it]
Skipping the first batches:  73%|███████▎  | 4369/6000 [4:18:31<1:35:28,  3.51s/it]
Skipping the first batches:  73%|███████▎  | 4370/6000 [4:18:35<1:34:35,  3.48s/it]
Skipping the first batches:  73%|███████▎  | 4371/6000 [4:18:40<1:44:40,  3.86s/it]
Skipping the first batches:  73%|███████▎  | 4372/6000 [4:18:43<1:42:09,  3.77s/it]
Skipping the first batches:  73%|███████▎  | 4373/6000 [4:18:46<1:36:29,  3.56s/it]
Skipping the first batches:  73%|███████▎  | 4374/6000 [4:18:50<1:34:21,  3.48s/it]
Skipping the first batches:  73%|███████▎  | 4375/6000 [4:18:53<1:33:18,  3.45s/it]
Skipping the first batches:  73%|███████▎  | 4376/6000 [4:18:57<1:37:26,  3.60s/it]
Skipping the first batches:  73%|███████▎  | 4377/6000 [4:19:00<1:33:55,  3.47s/it]
Skipping the first batches:  73%|███████▎  | 4378/6000 [4:19:03<1:31:09,  3.37s/it]
Skipping the first batches:  73%|███████▎  | 4379/6000 [4:19:07<1:33:15,  3.45s/it]
Skipping the first batches:  73%|███████▎  | 4380/6000 [4:19:10<1:32:19,  3.42s/it]
Skipping the first batches:  73%|███████▎  | 4381/6000 [4:19:14<1:37:33,  3.62s/it]
Skipping the first batches:  73%|███████▎  | 4382/6000 [4:19:18<1:40:08,  3.71s/it]
Skipping the first batches:  73%|███████▎  | 4383/6000 [4:19:23<1:46:28,  3.95s/it]
Skipping the first batches:  73%|███████▎  | 4384/6000 [4:19:27<1:53:16,  4.21s/it]
Skipping the first batches:  73%|███████▎  | 4385/6000 [4:19:31<1:49:49,  4.08s/it]
Skipping the first batches:  73%|███████▎  | 4386/6000 [4:19:36<1:54:44,  4.27s/it]
Skipping the first batches:  73%|███████▎  | 4387/6000 [4:19:39<1:47:23,  3.99s/it]
Skipping the first batches:  73%|███████▎  | 4388/6000 [4:19:43<1:41:30,  3.78s/it]
Skipping the first batches:  73%|███████▎  | 4389/6000 [4:19:46<1:39:19,  3.70s/it]
Skipping the first batches:  73%|███████▎  | 4390/6000 [4:19:49<1:36:01,  3.58s/it]
Skipping the first batches:  73%|███████▎  | 4391/6000 [4:19:53<1:33:14,  3.48s/it]
Skipping the first batches:  73%|███████▎  | 4392/6000 [4:19:57<1:36:37,  3.61s/it]
Skipping the first batches:  73%|███████▎  | 4393/6000 [4:20:00<1:35:22,  3.56s/it]
Skipping the first batches:  73%|███████▎  | 4394/6000 [4:20:03<1:33:00,  3.47s/it]
Skipping the first batches:  73%|███████▎  | 4395/6000 [4:20:07<1:35:15,  3.56s/it]
Skipping the first batches:  73%|███████▎  | 4396/6000 [4:20:10<1:31:10,  3.41s/it]
Skipping the first batches:  73%|███████▎  | 4397/6000 [4:20:13<1:30:55,  3.40s/it]
Skipping the first batches:  73%|███████▎  | 4398/6000 [4:20:18<1:36:24,  3.61s/it]
Skipping the first batches:  73%|███████▎  | 4399/6000 [4:20:21<1:32:07,  3.45s/it]
Skipping the first batches:  73%|███████▎  | 4400/6000 [4:20:24<1:29:19,  3.35s/it]
Skipping the first batches:  73%|███████▎  | 4401/6000 [4:20:27<1:31:50,  3.45s/it]
Skipping the first batches:  73%|███████▎  | 4402/6000 [4:20:31<1:31:15,  3.43s/it]
Skipping the first batches:  73%|███████▎  | 4403/6000 [4:20:35<1:35:54,  3.60s/it]
Skipping the first batches:  73%|███████▎  | 4404/6000 [4:20:39<1:40:13,  3.77s/it]
Skipping the first batches:  73%|███████▎  | 4405/6000 [4:20:43<1:45:23,  3.96s/it]
Skipping the first batches:  73%|███████▎  | 4406/6000 [4:20:48<1:47:17,  4.04s/it]
Skipping the first batches:  73%|███████▎  | 4407/6000 [4:20:52<1:46:44,  4.02s/it]
Skipping the first batches:  73%|███████▎  | 4408/6000 [4:20:55<1:40:59,  3.81s/it]
Skipping the first batches:  73%|███████▎  | 4409/6000 [4:20:58<1:38:09,  3.70s/it]
Skipping the first batches:  74%|███████▎  | 4410/6000 [4:21:02<1:35:11,  3.59s/it]
Skipping the first batches:  74%|███████▎  | 4411/6000 [4:21:05<1:32:13,  3.48s/it]
Skipping the first batches:  74%|███████▎  | 4412/6000 [4:21:08<1:30:23,  3.42s/it]
Skipping the first batches:  74%|███████▎  | 4413/6000 [4:21:12<1:29:22,  3.38s/it]
Skipping the first batches:  74%|███████▎  | 4414/6000 [4:21:15<1:33:43,  3.55s/it]
Skipping the first batches:  74%|███████▎  | 4415/6000 [4:21:19<1:31:43,  3.47s/it]
Skipping the first batches:  74%|███████▎  | 4416/6000 [4:21:22<1:32:40,  3.51s/it]
Skipping the first batches:  74%|███████▎  | 4417/6000 [4:21:26<1:37:45,  3.71s/it]
Skipping the first batches:  74%|███████▎  | 4418/6000 [4:21:30<1:36:15,  3.65s/it]
Skipping the first batches:  74%|███████▎  | 4419/6000 [4:21:34<1:36:40,  3.67s/it]
Skipping the first batches:  74%|███████▎  | 4420/6000 [4:21:37<1:32:39,  3.52s/it]
Skipping the first batches:  74%|███████▎  | 4421/6000 [4:21:41<1:35:23,  3.62s/it]
Skipping the first batches:  74%|███████▎  | 4422/6000 [4:21:44<1:33:19,  3.55s/it]
Skipping the first batches:  74%|███████▎  | 4423/6000 [4:21:48<1:32:19,  3.51s/it]
Skipping the first batches:  74%|███████▎  | 4424/6000 [4:21:51<1:34:55,  3.61s/it]
Skipping the first batches:  74%|███████▍  | 4425/6000 [4:21:55<1:30:45,  3.46s/it]
Skipping the first batches:  74%|███████▍  | 4426/6000 [4:22:00<1:47:50,  4.11s/it]
Skipping the first batches:  74%|███████▍  | 4427/6000 [4:22:04<1:43:58,  3.97s/it]
Skipping the first batches:  74%|███████▍  | 4428/6000 [4:22:08<1:44:50,  4.00s/it]
Skipping the first batches:  74%|███████▍  | 4429/6000 [4:22:11<1:40:37,  3.84s/it]
Skipping the first batches:  74%|███████▍  | 4430/6000 [4:22:15<1:35:48,  3.66s/it]
Skipping the first batches:  74%|███████▍  | 4431/6000 [4:22:18<1:36:23,  3.69s/it]
Skipping the first batches:  74%|███████▍  | 4432/6000 [4:22:22<1:34:02,  3.60s/it]
Skipping the first batches:  74%|███████▍  | 4433/6000 [4:22:25<1:32:10,  3.53s/it]
Skipping the first batches:  74%|███████▍  | 4434/6000 [4:22:28<1:30:21,  3.46s/it]
Skipping the first batches:  74%|███████▍  | 4435/6000 [4:22:32<1:30:10,  3.46s/it]
Skipping the first batches:  74%|███████▍  | 4436/6000 [4:22:36<1:31:52,  3.52s/it]
Skipping the first batches:  74%|███████▍  | 4437/6000 [4:22:39<1:31:13,  3.50s/it]
Skipping the first batches:  74%|███████▍  | 4438/6000 [4:22:43<1:34:52,  3.64s/it]
Skipping the first batches:  74%|███████▍  | 4439/6000 [4:22:46<1:30:29,  3.48s/it]
Skipping the first batches:  74%|███████▍  | 4440/6000 [4:22:50<1:30:39,  3.49s/it]
Skipping the first batches:  74%|███████▍  | 4441/6000 [4:22:53<1:30:07,  3.47s/it]
Skipping the first batches:  74%|███████▍  | 4442/6000 [4:22:56<1:28:53,  3.42s/it]
Skipping the first batches:  74%|███████▍  | 4443/6000 [4:23:00<1:30:26,  3.49s/it]
Skipping the first batches:  74%|███████▍  | 4444/6000 [4:23:03<1:29:06,  3.44s/it]
Skipping the first batches:  74%|███████▍  | 4445/6000 [4:23:06<1:26:32,  3.34s/it]
Skipping the first batches:  74%|███████▍  | 4446/6000 [4:23:10<1:32:49,  3.58s/it]
Skipping the first batches:  74%|███████▍  | 4447/6000 [4:23:14<1:35:54,  3.71s/it]
Skipping the first batches:  74%|███████▍  | 4448/6000 [4:23:18<1:31:00,  3.52s/it]
Skipping the first batches:  74%|███████▍  | 4449/6000 [4:23:21<1:31:20,  3.53s/it]
Skipping the first batches:  74%|███████▍  | 4450/6000 [4:23:25<1:30:25,  3.50s/it]
Skipping the first batches:  74%|███████▍  | 4451/6000 [4:23:28<1:31:34,  3.55s/it]
Skipping the first batches:  74%|███████▍  | 4452/6000 [4:23:31<1:28:52,  3.44s/it]
Skipping the first batches:  74%|███████▍  | 4453/6000 [4:23:35<1:27:54,  3.41s/it]
Skipping the first batches:  74%|███████▍  | 4454/6000 [4:23:38<1:29:00,  3.45s/it]
Skipping the first batches:  74%|███████▍  | 4455/6000 [4:23:43<1:40:31,  3.90s/it]
Skipping the first batches:  74%|███████▍  | 4456/6000 [4:23:47<1:37:18,  3.78s/it]
Skipping the first batches:  74%|███████▍  | 4457/6000 [4:23:55<2:09:55,  5.05s/it]
Skipping the first batches:  74%|███████▍  | 4458/6000 [4:23:58<1:57:08,  4.56s/it]
Skipping the first batches:  74%|███████▍  | 4459/6000 [4:24:02<1:49:43,  4.27s/it]
Skipping the first batches:  74%|███████▍  | 4460/6000 [4:24:06<1:48:08,  4.21s/it]
Skipping the first batches:  74%|███████▍  | 4461/6000 [4:24:09<1:39:48,  3.89s/it]
Skipping the first batches:  74%|███████▍  | 4462/6000 [4:24:12<1:34:44,  3.70s/it]
Skipping the first batches:  74%|███████▍  | 4463/6000 [4:24:16<1:38:39,  3.85s/it]
Skipping the first batches:  74%|███████▍  | 4464/6000 [4:24:20<1:32:56,  3.63s/it]
Skipping the first batches:  74%|███████▍  | 4465/6000 [4:24:23<1:29:35,  3.50s/it]
Skipping the first batches:  74%|███████▍  | 4466/6000 [4:24:27<1:37:57,  3.83s/it]
Skipping the first batches:  74%|███████▍  | 4467/6000 [4:24:31<1:37:12,  3.80s/it]
Skipping the first batches:  74%|███████▍  | 4468/6000 [4:24:36<1:42:23,  4.01s/it]
Skipping the first batches:  74%|███████▍  | 4469/6000 [4:24:39<1:37:13,  3.81s/it]
Skipping the first batches:  74%|███████▍  | 4470/6000 [4:24:42<1:34:29,  3.71s/it]
Skipping the first batches:  75%|███████▍  | 4471/6000 [4:24:46<1:37:21,  3.82s/it]
Skipping the first batches:  75%|███████▍  | 4472/6000 [4:24:50<1:33:02,  3.65s/it]
Skipping the first batches:  75%|███████▍  | 4473/6000 [4:24:53<1:33:00,  3.65s/it]
Skipping the first batches:  75%|███████▍  | 4474/6000 [4:24:58<1:37:56,  3.85s/it]
Skipping the first batches:  75%|███████▍  | 4475/6000 [4:25:01<1:32:17,  3.63s/it]
Skipping the first batches:  75%|███████▍  | 4476/6000 [4:25:04<1:32:07,  3.63s/it]
Skipping the first batches:  75%|███████▍  | 4477/6000 [4:25:09<1:37:07,  3.83s/it]
Skipping the first batches:  75%|███████▍  | 4478/6000 [4:25:12<1:34:26,  3.72s/it]
Skipping the first batches:  75%|███████▍  | 4479/6000 [4:25:16<1:37:02,  3.83s/it]
Skipping the first batches:  75%|███████▍  | 4480/6000 [4:25:20<1:35:29,  3.77s/it]
Skipping the first batches:  75%|███████▍  | 4481/6000 [4:25:23<1:32:46,  3.66s/it]
Skipping the first batches:  75%|███████▍  | 4482/6000 [4:25:27<1:35:42,  3.78s/it]
Skipping the first batches:  75%|███████▍  | 4483/6000 [4:25:31<1:32:18,  3.65s/it]
Skipping the first batches:  75%|███████▍  | 4484/6000 [4:25:34<1:29:16,  3.53s/it]
Skipping the first batches:  75%|███████▍  | 4485/6000 [4:25:38<1:34:54,  3.76s/it]
Skipping the first batches:  75%|███████▍  | 4486/6000 [4:25:42<1:33:40,  3.71s/it]
Skipping the first batches:  75%|███████▍  | 4487/6000 [4:25:45<1:28:39,  3.52s/it]
Skipping the first batches:  75%|███████▍  | 4488/6000 [4:25:49<1:35:59,  3.81s/it]
Skipping the first batches:  75%|███████▍  | 4489/6000 [4:25:54<1:38:38,  3.92s/it]
Skipping the first batches:  75%|███████▍  | 4490/6000 [4:25:57<1:33:48,  3.73s/it]
Skipping the first batches:  75%|███████▍  | 4491/6000 [4:26:00<1:32:11,  3.67s/it]
Skipping the first batches:  75%|███████▍  | 4492/6000 [4:26:05<1:38:15,  3.91s/it]
Skipping the first batches:  75%|███████▍  | 4493/6000 [4:26:08<1:31:58,  3.66s/it]
Skipping the first batches:  75%|███████▍  | 4494/6000 [4:26:11<1:28:56,  3.54s/it]
Skipping the first batches:  75%|███████▍  | 4495/6000 [4:26:14<1:25:47,  3.42s/it]
Skipping the first batches:  75%|███████▍  | 4496/6000 [4:26:18<1:26:56,  3.47s/it]
Skipping the first batches:  75%|███████▍  | 4497/6000 [4:26:22<1:32:47,  3.70s/it]
Skipping the first batches:  75%|███████▍  | 4498/6000 [4:26:25<1:28:35,  3.54s/it]
Skipping the first batches:  75%|███████▍  | 4499/6000 [4:26:29<1:30:29,  3.62s/it]
Skipping the first batches:  75%|███████▌  | 4500/6000 [4:26:34<1:40:46,  4.03s/it]
Skipping the first batches:  75%|███████▌  | 4501/6000 [4:26:38<1:37:28,  3.90s/it]
Skipping the first batches:  75%|███████▌  | 4502/6000 [4:26:42<1:38:30,  3.95s/it]
Skipping the first batches:  75%|███████▌  | 4503/6000 [4:26:45<1:36:01,  3.85s/it]
Skipping the first batches:  75%|███████▌  | 4504/6000 [4:26:49<1:35:48,  3.84s/it]
Skipping the first batches:  75%|███████▌  | 4505/6000 [4:26:53<1:32:20,  3.71s/it]
Skipping the first batches:  75%|███████▌  | 4506/6000 [4:26:56<1:32:11,  3.70s/it]
Skipping the first batches:  75%|███████▌  | 4507/6000 [4:27:00<1:33:16,  3.75s/it]
Skipping the first batches:  75%|███████▌  | 4508/6000 [4:27:03<1:29:24,  3.60s/it]
Skipping the first batches:  75%|███████▌  | 4509/6000 [4:27:07<1:25:57,  3.46s/it]
Skipping the first batches:  75%|███████▌  | 4510/6000 [4:27:10<1:28:42,  3.57s/it]
Skipping the first batches:  75%|███████▌  | 4511/6000 [4:27:14<1:27:33,  3.53s/it]
Skipping the first batches:  75%|███████▌  | 4512/6000 [4:27:18<1:30:16,  3.64s/it]
Skipping the first batches:  75%|███████▌  | 4513/6000 [4:27:21<1:26:22,  3.49s/it]
Skipping the first batches:  75%|███████▌  | 4514/6000 [4:27:24<1:25:21,  3.45s/it]
Skipping the first batches:  75%|███████▌  | 4515/6000 [4:27:29<1:32:40,  3.74s/it]
Skipping the first batches:  75%|███████▌  | 4516/6000 [4:27:32<1:29:15,  3.61s/it]
Skipping the first batches:  75%|███████▌  | 4517/6000 [4:27:35<1:27:51,  3.55s/it]
Skipping the first batches:  75%|███████▌  | 4518/6000 [4:27:39<1:27:57,  3.56s/it]
Skipping the first batches:  75%|███████▌  | 4519/6000 [4:27:43<1:29:32,  3.63s/it]
Skipping the first batches:  75%|███████▌  | 4520/6000 [4:27:46<1:27:21,  3.54s/it]
Skipping the first batches:  75%|███████▌  | 4521/6000 [4:27:50<1:32:00,  3.73s/it]
Skipping the first batches:  75%|███████▌  | 4522/6000 [4:27:54<1:29:26,  3.63s/it]
Skipping the first batches:  75%|███████▌  | 4523/6000 [4:27:57<1:27:19,  3.55s/it]
Skipping the first batches:  75%|███████▌  | 4524/6000 [4:28:01<1:27:08,  3.54s/it]
Skipping the first batches:  75%|███████▌  | 4525/6000 [4:28:04<1:27:43,  3.57s/it]
Skipping the first batches:  75%|███████▌  | 4526/6000 [4:28:08<1:26:19,  3.51s/it]
Skipping the first batches:  75%|███████▌  | 4527/6000 [4:28:11<1:27:09,  3.55s/it]
Skipping the first batches:  75%|███████▌  | 4528/6000 [4:28:15<1:28:50,  3.62s/it]
Skipping the first batches:  75%|███████▌  | 4529/6000 [4:28:18<1:25:50,  3.50s/it]
Skipping the first batches:  76%|███████▌  | 4530/6000 [4:28:21<1:23:47,  3.42s/it]
Skipping the first batches:  76%|███████▌  | 4531/6000 [4:28:25<1:23:16,  3.40s/it]
Skipping the first batches:  76%|███████▌  | 4532/6000 [4:28:28<1:22:43,  3.38s/it]
Skipping the first batches:  76%|███████▌  | 4533/6000 [4:28:33<1:30:49,  3.71s/it]
Skipping the first batches:  76%|███████▌  | 4534/6000 [4:28:36<1:26:39,  3.55s/it]
Skipping the first batches:  76%|███████▌  | 4535/6000 [4:28:39<1:25:42,  3.51s/it]
Skipping the first batches:  76%|███████▌  | 4536/6000 [4:28:43<1:26:59,  3.57s/it]
Skipping the first batches:  76%|███████▌  | 4537/6000 [4:28:47<1:29:41,  3.68s/it]
Skipping the first batches:  76%|███████▌  | 4538/6000 [4:28:50<1:26:49,  3.56s/it]
Skipping the first batches:  76%|███████▌  | 4539/6000 [4:28:54<1:26:16,  3.54s/it]
Skipping the first batches:  76%|███████▌  | 4540/6000 [4:28:57<1:24:39,  3.48s/it]
Skipping the first batches:  76%|███████▌  | 4541/6000 [4:29:00<1:23:39,  3.44s/it]
Skipping the first batches:  76%|███████▌  | 4542/6000 [4:29:04<1:25:10,  3.51s/it]
Skipping the first batches:  76%|███████▌  | 4543/6000 [4:29:07<1:23:26,  3.44s/it]
Skipping the first batches:  76%|███████▌  | 4544/6000 [4:29:11<1:25:10,  3.51s/it]
Skipping the first batches:  76%|███████▌  | 4545/6000 [4:29:15<1:25:48,  3.54s/it]
Skipping the first batches:  76%|███████▌  | 4546/6000 [4:29:18<1:27:39,  3.62s/it]
Skipping the first batches:  76%|███████▌  | 4547/6000 [4:29:22<1:25:10,  3.52s/it]
Skipping the first batches:  76%|███████▌  | 4548/6000 [4:29:25<1:21:53,  3.38s/it]
Skipping the first batches:  76%|███████▌  | 4549/6000 [4:29:28<1:23:05,  3.44s/it]
Skipping the first batches:  76%|███████▌  | 4550/6000 [4:29:32<1:23:53,  3.47s/it]
Skipping the first batches:  76%|███████▌  | 4551/6000 [4:29:35<1:21:12,  3.36s/it]
Skipping the first batches:  76%|███████▌  | 4552/6000 [4:29:38<1:21:27,  3.38s/it]
Skipping the first batches:  76%|███████▌  | 4553/6000 [4:29:42<1:23:41,  3.47s/it]
Skipping the first batches:  76%|███████▌  | 4554/6000 [4:29:46<1:26:17,  3.58s/it]
Skipping the first batches:  76%|███████▌  | 4555/6000 [4:29:50<1:28:40,  3.68s/it]
Skipping the first batches:  76%|███████▌  | 4556/6000 [4:29:54<1:30:06,  3.74s/it]
Skipping the first batches:  76%|███████▌  | 4557/6000 [4:29:57<1:29:24,  3.72s/it]
Skipping the first batches:  76%|███████▌  | 4558/6000 [4:30:01<1:31:33,  3.81s/it]
Skipping the first batches:  76%|███████▌  | 4559/6000 [4:30:05<1:29:16,  3.72s/it]
Skipping the first batches:  76%|███████▌  | 4560/6000 [4:30:08<1:28:21,  3.68s/it]
Skipping the first batches:  76%|███████▌  | 4561/6000 [4:30:12<1:25:52,  3.58s/it]
Skipping the first batches:  76%|███████▌  | 4562/6000 [4:30:15<1:22:53,  3.46s/it]
Skipping the first batches:  76%|███████▌  | 4563/6000 [4:30:19<1:23:36,  3.49s/it]
Skipping the first batches:  76%|███████▌  | 4564/6000 [4:30:22<1:25:25,  3.57s/it]
Skipping the first batches:  76%|███████▌  | 4565/6000 [4:30:26<1:29:22,  3.74s/it]
Skipping the first batches:  76%|███████▌  | 4566/6000 [4:30:30<1:27:57,  3.68s/it]
Skipping the first batches:  76%|███████▌  | 4567/6000 [4:30:33<1:24:01,  3.52s/it]
Skipping the first batches:  76%|███████▌  | 4568/6000 [4:30:37<1:25:47,  3.59s/it]
Skipping the first batches:  76%|███████▌  | 4569/6000 [4:30:41<1:27:04,  3.65s/it]
Skipping the first batches:  76%|███████▌  | 4570/6000 [4:30:45<1:32:22,  3.88s/it]
Skipping the first batches:  76%|███████▌  | 4571/6000 [4:30:50<1:36:53,  4.07s/it]
Skipping the first batches:  76%|███████▌  | 4572/6000 [4:30:54<1:40:32,  4.22s/it]
Skipping the first batches:  76%|███████▌  | 4573/6000 [4:30:57<1:33:23,  3.93s/it]
Skipping the first batches:  76%|███████▌  | 4574/6000 [4:31:01<1:32:44,  3.90s/it]
Skipping the first batches:  76%|███████▋  | 4575/6000 [4:31:05<1:30:27,  3.81s/it]
Skipping the first batches:  76%|███████▋  | 4576/6000 [4:31:08<1:29:17,  3.76s/it]
Skipping the first batches:  76%|███████▋  | 4577/6000 [4:31:12<1:27:53,  3.71s/it]
Skipping the first batches:  76%|███████▋  | 4578/6000 [4:31:16<1:29:02,  3.76s/it]
Skipping the first batches:  76%|███████▋  | 4579/6000 [4:31:20<1:34:15,  3.98s/it]
Skipping the first batches:  76%|███████▋  | 4580/6000 [4:31:23<1:27:26,  3.69s/it]
Skipping the first batches:  76%|███████▋  | 4581/6000 [4:31:27<1:23:12,  3.52s/it]
Skipping the first batches:  76%|███████▋  | 4582/6000 [4:31:30<1:24:28,  3.57s/it]
Skipping the first batches:  76%|███████▋  | 4583/6000 [4:31:34<1:22:30,  3.49s/it]
Skipping the first batches:  76%|███████▋  | 4584/6000 [4:31:37<1:22:05,  3.48s/it]
Skipping the first batches:  76%|███████▋  | 4585/6000 [4:31:41<1:23:42,  3.55s/it]
Skipping the first batches:  76%|███████▋  | 4586/6000 [4:31:45<1:26:23,  3.67s/it]
Skipping the first batches:  76%|███████▋  | 4587/6000 [4:31:48<1:22:23,  3.50s/it]
Skipping the first batches:  76%|███████▋  | 4588/6000 [4:31:52<1:24:45,  3.60s/it]
Skipping the first batches:  76%|███████▋  | 4589/6000 [4:31:55<1:21:52,  3.48s/it]
Skipping the first batches:  76%|███████▋  | 4590/6000 [4:31:58<1:21:36,  3.47s/it]
Skipping the first batches:  77%|███████▋  | 4591/6000 [4:32:02<1:23:40,  3.56s/it]
Skipping the first batches:  77%|███████▋  | 4592/6000 [4:32:05<1:21:44,  3.48s/it]
Skipping the first batches:  77%|███████▋  | 4593/6000 [4:32:09<1:21:32,  3.48s/it]
Skipping the first batches:  77%|███████▋  | 4594/6000 [4:32:12<1:21:03,  3.46s/it]
Skipping the first batches:  77%|███████▋  | 4595/6000 [4:32:16<1:20:59,  3.46s/it]
Skipping the first batches:  77%|███████▋  | 4596/6000 [4:32:19<1:20:56,  3.46s/it]
Skipping the first batches:  77%|███████▋  | 4597/6000 [4:32:22<1:19:43,  3.41s/it]
Skipping the first batches:  77%|███████▋  | 4598/6000 [4:32:26<1:20:37,  3.45s/it]
Skipping the first batches:  77%|███████▋  | 4599/6000 [4:32:29<1:18:47,  3.37s/it]
Skipping the first batches:  77%|███████▋  | 4600/6000 [4:32:33<1:20:21,  3.44s/it]
Skipping the first batches:  77%|███████▋  | 4601/6000 [4:32:36<1:18:32,  3.37s/it]
Skipping the first batches:  77%|███████▋  | 4602/6000 [4:32:39<1:16:29,  3.28s/it]
Skipping the first batches:  77%|███████▋  | 4603/6000 [4:32:42<1:16:02,  3.27s/it]
Skipping the first batches:  77%|███████▋  | 4604/6000 [4:32:46<1:21:21,  3.50s/it]
Skipping the first batches:  77%|███████▋  | 4605/6000 [4:32:50<1:21:54,  3.52s/it]
Skipping the first batches:  77%|███████▋  | 4606/6000 [4:32:53<1:20:26,  3.46s/it]
Skipping the first batches:  77%|███████▋  | 4607/6000 [4:32:57<1:24:17,  3.63s/it]
Skipping the first batches:  77%|███████▋  | 4608/6000 [4:33:00<1:20:31,  3.47s/it]
Skipping the first batches:  77%|███████▋  | 4609/6000 [4:33:04<1:21:52,  3.53s/it]
Skipping the first batches:  77%|███████▋  | 4610/6000 [4:33:07<1:20:19,  3.47s/it]
Skipping the first batches:  77%|███████▋  | 4611/6000 [4:33:11<1:18:59,  3.41s/it]
Skipping the first batches:  77%|███████▋  | 4612/6000 [4:33:15<1:25:54,  3.71s/it]
Skipping the first batches:  77%|███████▋  | 4613/6000 [4:33:18<1:22:15,  3.56s/it]
Skipping the first batches:  77%|███████▋  | 4614/6000 [4:33:22<1:23:20,  3.61s/it]
Skipping the first batches:  77%|███████▋  | 4615/6000 [4:33:26<1:23:25,  3.61s/it]
Skipping the first batches:  77%|███████▋  | 4616/6000 [4:33:29<1:21:09,  3.52s/it]
Skipping the first batches:  77%|███████▋  | 4617/6000 [4:33:33<1:24:34,  3.67s/it]
Skipping the first batches:  77%|███████▋  | 4618/6000 [4:33:36<1:20:29,  3.49s/it]
Skipping the first batches:  77%|███████▋  | 4619/6000 [4:33:40<1:21:53,  3.56s/it]
Skipping the first batches:  77%|███████▋  | 4620/6000 [4:33:43<1:19:59,  3.48s/it]
Skipping the first batches:  77%|███████▋  | 4621/6000 [4:33:46<1:17:41,  3.38s/it]
Skipping the first batches:  77%|███████▋  | 4622/6000 [4:33:50<1:19:18,  3.45s/it]
Skipping the first batches:  77%|███████▋  | 4623/6000 [4:33:54<1:24:17,  3.67s/it]
Skipping the first batches:  77%|███████▋  | 4624/6000 [4:33:57<1:22:46,  3.61s/it]
Skipping the first batches:  77%|███████▋  | 4625/6000 [4:34:01<1:25:58,  3.75s/it]
Skipping the first batches:  77%|███████▋  | 4626/6000 [4:34:05<1:27:24,  3.82s/it]
Skipping the first batches:  77%|███████▋  | 4627/6000 [4:34:11<1:37:41,  4.27s/it]
Skipping the first batches:  77%|███████▋  | 4628/6000 [4:34:14<1:31:33,  4.00s/it]
Skipping the first batches:  77%|███████▋  | 4629/6000 [4:34:18<1:29:16,  3.91s/it]
Skipping the first batches:  77%|███████▋  | 4630/6000 [4:34:21<1:27:08,  3.82s/it]
Skipping the first batches:  77%|███████▋  | 4631/6000 [4:34:26<1:28:54,  3.90s/it]
Skipping the first batches:  77%|███████▋  | 4632/6000 [4:34:29<1:23:41,  3.67s/it]
Skipping the first batches:  77%|███████▋  | 4633/6000 [4:34:32<1:21:34,  3.58s/it]
Skipping the first batches:  77%|███████▋  | 4634/6000 [4:34:36<1:22:02,  3.60s/it]
Skipping the first batches:  77%|███████▋  | 4635/6000 [4:34:39<1:18:49,  3.47s/it]
Skipping the first batches:  77%|███████▋  | 4636/6000 [4:34:43<1:20:07,  3.52s/it]
Skipping the first batches:  77%|███████▋  | 4637/6000 [4:34:46<1:18:15,  3.45s/it]
Skipping the first batches:  77%|███████▋  | 4638/6000 [4:34:49<1:17:29,  3.41s/it]
Skipping the first batches:  77%|███████▋  | 4639/6000 [4:34:53<1:21:18,  3.58s/it]
Skipping the first batches:  77%|███████▋  | 4640/6000 [4:34:57<1:22:08,  3.62s/it]
Skipping the first batches:  77%|███████▋  | 4641/6000 [4:35:00<1:19:43,  3.52s/it]
Skipping the first batches:  77%|███████▋  | 4642/6000 [4:35:03<1:16:38,  3.39s/it]
Skipping the first batches:  77%|███████▋  | 4643/6000 [4:35:07<1:20:54,  3.58s/it]
Skipping the first batches:  77%|███████▋  | 4644/6000 [4:35:10<1:17:25,  3.43s/it]
Skipping the first batches:  77%|███████▋  | 4645/6000 [4:35:14<1:17:16,  3.42s/it]
Skipping the first batches:  77%|███████▋  | 4646/6000 [4:35:17<1:15:51,  3.36s/it]
Skipping the first batches:  77%|███████▋  | 4647/6000 [4:35:20<1:14:23,  3.30s/it]
Skipping the first batches:  77%|███████▋  | 4648/6000 [4:35:24<1:17:36,  3.44s/it]
Skipping the first batches:  77%|███████▋  | 4649/6000 [4:35:27<1:17:16,  3.43s/it]
Skipping the first batches:  78%|███████▊  | 4650/6000 [4:35:31<1:16:26,  3.40s/it]
Skipping the first batches:  78%|███████▊  | 4651/6000 [4:35:34<1:17:52,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4652/6000 [4:35:37<1:15:00,  3.34s/it]
Skipping the first batches:  78%|███████▊  | 4653/6000 [4:35:41<1:14:55,  3.34s/it]
Skipping the first batches:  78%|███████▊  | 4654/6000 [4:35:45<1:20:21,  3.58s/it]
Skipping the first batches:  78%|███████▊  | 4655/6000 [4:35:48<1:19:59,  3.57s/it]
Skipping the first batches:  78%|███████▊  | 4656/6000 [4:35:51<1:17:25,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4657/6000 [4:35:55<1:17:28,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4658/6000 [4:35:59<1:18:21,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4659/6000 [4:36:02<1:17:24,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4660/6000 [4:36:05<1:14:48,  3.35s/it]
Skipping the first batches:  78%|███████▊  | 4661/6000 [4:36:09<1:18:52,  3.53s/it]
Skipping the first batches:  78%|███████▊  | 4662/6000 [4:36:12<1:15:50,  3.40s/it]
Skipping the first batches:  78%|███████▊  | 4663/6000 [4:36:16<1:17:07,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4664/6000 [4:36:19<1:19:15,  3.56s/it]
Skipping the first batches:  78%|███████▊  | 4665/6000 [4:36:23<1:16:20,  3.43s/it]
Skipping the first batches:  78%|███████▊  | 4666/6000 [4:36:26<1:16:06,  3.42s/it]
Skipping the first batches:  78%|███████▊  | 4667/6000 [4:36:29<1:16:01,  3.42s/it]
Skipping the first batches:  78%|███████▊  | 4668/6000 [4:36:34<1:20:44,  3.64s/it]
Skipping the first batches:  78%|███████▊  | 4669/6000 [4:36:37<1:19:42,  3.59s/it]
Skipping the first batches:  78%|███████▊  | 4670/6000 [4:36:40<1:17:23,  3.49s/it]
Skipping the first batches:  78%|███████▊  | 4671/6000 [4:36:44<1:18:24,  3.54s/it]
Skipping the first batches:  78%|███████▊  | 4672/6000 [4:36:47<1:16:42,  3.47s/it]
Skipping the first batches:  78%|███████▊  | 4673/6000 [4:36:51<1:15:55,  3.43s/it]
Skipping the first batches:  78%|███████▊  | 4674/6000 [4:36:55<1:19:38,  3.60s/it]
Skipping the first batches:  78%|███████▊  | 4675/6000 [4:36:58<1:17:19,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4676/6000 [4:37:02<1:18:52,  3.57s/it]
Skipping the first batches:  78%|███████▊  | 4677/6000 [4:37:05<1:16:58,  3.49s/it]
Skipping the first batches:  78%|███████▊  | 4678/6000 [4:37:08<1:15:18,  3.42s/it]
Skipping the first batches:  78%|███████▊  | 4679/6000 [4:37:12<1:16:53,  3.49s/it]
Skipping the first batches:  78%|███████▊  | 4680/6000 [4:37:15<1:16:49,  3.49s/it]
Skipping the first batches:  78%|███████▊  | 4681/6000 [4:37:19<1:18:04,  3.55s/it]
Skipping the first batches:  78%|███████▊  | 4682/6000 [4:37:22<1:17:53,  3.55s/it]
Skipping the first batches:  78%|███████▊  | 4683/6000 [4:37:26<1:16:26,  3.48s/it]
Skipping the first batches:  78%|███████▊  | 4684/6000 [4:37:29<1:16:49,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4685/6000 [4:37:33<1:15:52,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4686/6000 [4:37:36<1:15:28,  3.45s/it]
Skipping the first batches:  78%|███████▊  | 4687/6000 [4:37:40<1:16:30,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4688/6000 [4:37:43<1:13:41,  3.37s/it]
Skipping the first batches:  78%|███████▊  | 4689/6000 [4:37:46<1:13:24,  3.36s/it]
Skipping the first batches:  78%|███████▊  | 4690/6000 [4:37:50<1:13:54,  3.38s/it]
Skipping the first batches:  78%|███████▊  | 4691/6000 [4:37:53<1:16:25,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4692/6000 [4:37:57<1:15:24,  3.46s/it]
Skipping the first batches:  78%|███████▊  | 4693/6000 [4:38:00<1:15:47,  3.48s/it]
Skipping the first batches:  78%|███████▊  | 4694/6000 [4:38:04<1:16:12,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4695/6000 [4:38:07<1:15:32,  3.47s/it]
Skipping the first batches:  78%|███████▊  | 4696/6000 [4:38:11<1:16:08,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4697/6000 [4:38:15<1:17:30,  3.57s/it]
Skipping the first batches:  78%|███████▊  | 4698/6000 [4:38:18<1:16:25,  3.52s/it]
Skipping the first batches:  78%|███████▊  | 4699/6000 [4:38:21<1:14:51,  3.45s/it]
Skipping the first batches:  78%|███████▊  | 4700/6000 [4:38:25<1:15:29,  3.48s/it]
Skipping the first batches:  78%|███████▊  | 4701/6000 [4:38:28<1:15:54,  3.51s/it]
Skipping the first batches:  78%|███████▊  | 4702/6000 [4:38:32<1:14:25,  3.44s/it]
Skipping the first batches:  78%|███████▊  | 4703/6000 [4:38:35<1:15:03,  3.47s/it]
Skipping the first batches:  78%|███████▊  | 4704/6000 [4:38:38<1:13:22,  3.40s/it]
Skipping the first batches:  78%|███████▊  | 4705/6000 [4:38:42<1:15:20,  3.49s/it]
Skipping the first batches:  78%|███████▊  | 4706/6000 [4:38:46<1:15:33,  3.50s/it]
Skipping the first batches:  78%|███████▊  | 4707/6000 [4:38:49<1:13:02,  3.39s/it]
Skipping the first batches:  78%|███████▊  | 4708/6000 [4:38:53<1:17:10,  3.58s/it]
Skipping the first batches:  78%|███████▊  | 4709/6000 [4:38:56<1:15:27,  3.51s/it]
Skipping the first batches:  78%|███████▊  | 4710/6000 [4:38:59<1:14:03,  3.44s/it]
Skipping the first batches:  79%|███████▊  | 4711/6000 [4:39:03<1:12:38,  3.38s/it]
Skipping the first batches:  79%|███████▊  | 4712/6000 [4:39:06<1:15:06,  3.50s/it]
Skipping the first batches:  79%|███████▊  | 4713/6000 [4:39:10<1:14:53,  3.49s/it]
Skipping the first batches:  79%|███████▊  | 4714/6000 [4:39:14<1:18:06,  3.64s/it]
Skipping the first batches:  79%|███████▊  | 4715/6000 [4:39:17<1:14:28,  3.48s/it]
Skipping the first batches:  79%|███████▊  | 4716/6000 [4:39:20<1:11:59,  3.36s/it]
Skipping the first batches:  79%|███████▊  | 4717/6000 [4:39:24<1:12:34,  3.39s/it]
Skipping the first batches:  79%|███████▊  | 4718/6000 [4:39:27<1:15:54,  3.55s/it]
Skipping the first batches:  79%|███████▊  | 4719/6000 [4:39:31<1:14:57,  3.51s/it]
Skipping the first batches:  79%|███████▊  | 4720/6000 [4:39:34<1:13:19,  3.44s/it]
Skipping the first batches:  79%|███████▊  | 4721/6000 [4:39:37<1:12:09,  3.39s/it]
Skipping the first batches:  79%|███████▊  | 4722/6000 [4:39:41<1:12:20,  3.40s/it]
Skipping the first batches:  79%|███████▊  | 4723/6000 [4:39:45<1:15:51,  3.56s/it]
Skipping the first batches:  79%|███████▊  | 4724/6000 [4:39:48<1:14:06,  3.49s/it]
Skipping the first batches:  79%|███████▉  | 4725/6000 [4:39:52<1:14:06,  3.49s/it]
Skipping the first batches:  79%|███████▉  | 4726/6000 [4:39:55<1:13:15,  3.45s/it]
Skipping the first batches:  79%|███████▉  | 4727/6000 [4:39:59<1:14:00,  3.49s/it]
Skipping the first batches:  79%|███████▉  | 4728/6000 [4:40:02<1:11:18,  3.36s/it]
Skipping the first batches:  79%|███████▉  | 4729/6000 [4:40:05<1:13:40,  3.48s/it]
Skipping the first batches:  79%|███████▉  | 4730/6000 [4:40:09<1:12:59,  3.45s/it]
Skipping the first batches:  79%|███████▉  | 4731/6000 [4:40:12<1:13:04,  3.46s/it]
Skipping the first batches:  79%|███████▉  | 4732/6000 [4:40:16<1:13:15,  3.47s/it]
Skipping the first batches:  79%|███████▉  | 4733/6000 [4:40:20<1:21:27,  3.86s/it]
Skipping the first batches:  79%|███████▉  | 4734/6000 [4:40:24<1:16:22,  3.62s/it]
Skipping the first batches:  79%|███████▉  | 4735/6000 [4:40:27<1:15:35,  3.59s/it]
Skipping the first batches:  79%|███████▉  | 4736/6000 [4:40:31<1:17:16,  3.67s/it]
Skipping the first batches:  79%|███████▉  | 4737/6000 [4:40:34<1:14:08,  3.52s/it]
Skipping the first batches:  79%|███████▉  | 4738/6000 [4:40:38<1:14:42,  3.55s/it]
Skipping the first batches:  79%|███████▉  | 4739/6000 [4:40:42<1:17:01,  3.66s/it]
Skipping the first batches:  79%|███████▉  | 4740/6000 [4:40:45<1:14:42,  3.56s/it]
Skipping the first batches:  79%|███████▉  | 4741/6000 [4:40:49<1:19:01,  3.77s/it]
Skipping the first batches:  79%|███████▉  | 4742/6000 [4:40:53<1:16:58,  3.67s/it]
Skipping the first batches:  79%|███████▉  | 4743/6000 [4:40:56<1:16:42,  3.66s/it]
Skipping the first batches:  79%|███████▉  | 4744/6000 [4:41:00<1:15:20,  3.60s/it]
Skipping the first batches:  79%|███████▉  | 4745/6000 [4:41:03<1:14:56,  3.58s/it]
Skipping the first batches:  79%|███████▉  | 4746/6000 [4:41:06<1:12:14,  3.46s/it]
Skipping the first batches:  79%|███████▉  | 4747/6000 [4:41:10<1:12:22,  3.47s/it]
Skipping the first batches:  79%|███████▉  | 4748/6000 [4:41:13<1:10:24,  3.37s/it]
Skipping the first batches:  79%|███████▉  | 4749/6000 [4:41:16<1:10:26,  3.38s/it]
Skipping the first batches:  79%|███████▉  | 4750/6000 [4:41:20<1:11:44,  3.44s/it]
Skipping the first batches:  79%|███████▉  | 4751/6000 [4:41:23<1:09:46,  3.35s/it]
Skipping the first batches:  79%|███████▉  | 4752/6000 [4:41:27<1:14:09,  3.57s/it]
Skipping the first batches:  79%|███████▉  | 4753/6000 [4:41:31<1:13:09,  3.52s/it]
Skipping the first batches:  79%|███████▉  | 4754/6000 [4:41:35<1:15:08,  3.62s/it]
Skipping the first batches:  79%|███████▉  | 4755/6000 [4:41:38<1:14:28,  3.59s/it]
Skipping the first batches:  79%|███████▉  | 4756/6000 [4:41:41<1:12:10,  3.48s/it]
Skipping the first batches:  79%|███████▉  | 4757/6000 [4:41:45<1:12:39,  3.51s/it]
Skipping the first batches:  79%|███████▉  | 4758/6000 [4:41:48<1:09:49,  3.37s/it]
Skipping the first batches:  79%|███████▉  | 4759/6000 [4:41:51<1:09:21,  3.35s/it]
Skipping the first batches:  79%|███████▉  | 4760/6000 [4:41:55<1:10:50,  3.43s/it]
Skipping the first batches:  79%|███████▉  | 4761/6000 [4:41:58<1:11:05,  3.44s/it]
Skipping the first batches:  79%|███████▉  | 4762/6000 [4:42:02<1:10:01,  3.39s/it]
Skipping the first batches:  79%|███████▉  | 4763/6000 [4:42:05<1:11:32,  3.47s/it]
Skipping the first batches:  79%|███████▉  | 4764/6000 [4:42:09<1:13:30,  3.57s/it]
Skipping the first batches:  79%|███████▉  | 4765/6000 [4:42:13<1:14:15,  3.61s/it]
Skipping the first batches:  79%|███████▉  | 4766/6000 [4:42:16<1:14:40,  3.63s/it]
Skipping the first batches:  79%|███████▉  | 4767/6000 [4:42:20<1:14:29,  3.62s/it]
Skipping the first batches:  79%|███████▉  | 4768/6000 [4:42:23<1:12:28,  3.53s/it]
Skipping the first batches:  79%|███████▉  | 4769/6000 [4:42:27<1:12:44,  3.55s/it]
Skipping the first batches:  80%|███████▉  | 4770/6000 [4:42:30<1:11:06,  3.47s/it]
Skipping the first batches:  80%|███████▉  | 4771/6000 [4:42:33<1:09:38,  3.40s/it]
Skipping the first batches:  80%|███████▉  | 4772/6000 [4:42:37<1:09:58,  3.42s/it]
Skipping the first batches:  80%|███████▉  | 4773/6000 [4:42:40<1:10:06,  3.43s/it]
Skipping the first batches:  80%|███████▉  | 4774/6000 [4:42:45<1:15:42,  3.71s/it]
Skipping the first batches:  80%|███████▉  | 4775/6000 [4:42:48<1:13:48,  3.61s/it]
Skipping the first batches:  80%|███████▉  | 4776/6000 [4:42:52<1:14:44,  3.66s/it]
Skipping the first batches:  80%|███████▉  | 4777/6000 [4:42:55<1:13:38,  3.61s/it]
Skipping the first batches:  80%|███████▉  | 4778/6000 [4:42:59<1:12:00,  3.54s/it]
Skipping the first batches:  80%|███████▉  | 4779/6000 [4:43:02<1:12:27,  3.56s/it]
Skipping the first batches:  80%|███████▉  | 4780/6000 [4:43:06<1:12:30,  3.57s/it]
Skipping the first batches:  80%|███████▉  | 4781/6000 [4:43:09<1:09:47,  3.43s/it]
Skipping the first batches:  80%|███████▉  | 4782/6000 [4:43:13<1:13:14,  3.61s/it]
Skipping the first batches:  80%|███████▉  | 4783/6000 [4:43:17<1:16:29,  3.77s/it]
Skipping the first batches:  80%|███████▉  | 4784/6000 [4:43:20<1:12:56,  3.60s/it]
Skipping the first batches:  80%|███████▉  | 4785/6000 [4:43:24<1:10:10,  3.47s/it]
Skipping the first batches:  80%|███████▉  | 4786/6000 [4:43:27<1:11:39,  3.54s/it]
Skipping the first batches:  80%|███████▉  | 4787/6000 [4:43:31<1:11:19,  3.53s/it]
Skipping the first batches:  80%|███████▉  | 4788/6000 [4:43:34<1:08:46,  3.40s/it]
Skipping the first batches:  80%|███████▉  | 4789/6000 [4:43:38<1:12:37,  3.60s/it]
Skipping the first batches:  80%|███████▉  | 4790/6000 [4:43:41<1:10:46,  3.51s/it]
Skipping the first batches:  80%|███████▉  | 4791/6000 [4:43:45<1:09:44,  3.46s/it]
Skipping the first batches:  80%|███████▉  | 4792/6000 [4:43:48<1:11:35,  3.56s/it]
Skipping the first batches:  80%|███████▉  | 4793/6000 [4:43:52<1:10:57,  3.53s/it]
Skipping the first batches:  80%|███████▉  | 4794/6000 [4:43:55<1:10:06,  3.49s/it]
Skipping the first batches:  80%|███████▉  | 4795/6000 [4:43:59<1:11:29,  3.56s/it]
Skipping the first batches:  80%|███████▉  | 4796/6000 [4:44:03<1:12:47,  3.63s/it]
Skipping the first batches:  80%|███████▉  | 4797/6000 [4:44:08<1:21:27,  4.06s/it]
Skipping the first batches:  80%|███████▉  | 4798/6000 [4:44:13<1:25:56,  4.29s/it]
Skipping the first batches:  80%|███████▉  | 4799/6000 [4:44:18<1:29:22,  4.46s/it]
Skipping the first batches:  80%|████████  | 4800/6000 [4:44:22<1:32:00,  4.60s/it]
Skipping the first batches:  80%|████████  | 4801/6000 [4:44:27<1:30:54,  4.55s/it]
Skipping the first batches:  80%|████████  | 4802/6000 [4:44:30<1:23:00,  4.16s/it]
Skipping the first batches:  80%|████████  | 4803/6000 [4:44:34<1:23:23,  4.18s/it]
Skipping the first batches:  80%|████████  | 4804/6000 [4:44:39<1:26:22,  4.33s/it]
Skipping the first batches:  80%|████████  | 4805/6000 [4:44:43<1:25:09,  4.28s/it]
Skipping the first batches:  80%|████████  | 4806/6000 [4:44:47<1:24:47,  4.26s/it]
Skipping the first batches:  80%|████████  | 4807/6000 [4:44:51<1:22:05,  4.13s/it]
Skipping the first batches:  80%|████████  | 4808/6000 [4:44:55<1:20:21,  4.04s/it]
Skipping the first batches:  80%|████████  | 4809/6000 [4:45:00<1:23:52,  4.23s/it]
Skipping the first batches:  80%|████████  | 4810/6000 [4:45:05<1:27:11,  4.40s/it]
Skipping the first batches:  80%|████████  | 4811/6000 [4:45:08<1:21:20,  4.10s/it]
Skipping the first batches:  80%|████████  | 4812/6000 [4:45:11<1:16:54,  3.88s/it]
Skipping the first batches:  80%|████████  | 4813/6000 [4:45:15<1:14:11,  3.75s/it]
Skipping the first batches:  80%|████████  | 4814/6000 [4:45:18<1:13:43,  3.73s/it]
Skipping the first batches:  80%|████████  | 4815/6000 [4:45:22<1:13:06,  3.70s/it]
Skipping the first batches:  80%|████████  | 4816/6000 [4:45:26<1:13:31,  3.73s/it]
Skipping the first batches:  80%|████████  | 4817/6000 [4:45:29<1:09:35,  3.53s/it]
Skipping the first batches:  80%|████████  | 4818/6000 [4:45:33<1:12:15,  3.67s/it]
Skipping the first batches:  80%|████████  | 4819/6000 [4:45:36<1:10:31,  3.58s/it]
Skipping the first batches:  80%|████████  | 4820/6000 [4:45:39<1:07:50,  3.45s/it]
Skipping the first batches:  80%|████████  | 4821/6000 [4:45:43<1:07:02,  3.41s/it]
Skipping the first batches:  80%|████████  | 4822/6000 [4:45:47<1:09:05,  3.52s/it]
Skipping the first batches:  80%|████████  | 4823/6000 [4:45:50<1:10:18,  3.58s/it]
Skipping the first batches:  80%|████████  | 4824/6000 [4:45:53<1:07:54,  3.47s/it]
Skipping the first batches:  80%|████████  | 4825/6000 [4:45:57<1:11:03,  3.63s/it]
Skipping the first batches:  80%|████████  | 4826/6000 [4:46:01<1:08:10,  3.48s/it]
Skipping the first batches:  80%|████████  | 4827/6000 [4:46:04<1:09:49,  3.57s/it]
Skipping the first batches:  80%|████████  | 4828/6000 [4:46:08<1:09:20,  3.55s/it]
Skipping the first batches:  80%|████████  | 4829/6000 [4:46:12<1:11:40,  3.67s/it]
Skipping the first batches:  80%|████████  | 4830/6000 [4:46:15<1:08:25,  3.51s/it]
Skipping the first batches:  81%|████████  | 4831/6000 [4:46:18<1:07:05,  3.44s/it]
Skipping the first batches:  81%|████████  | 4832/6000 [4:46:22<1:07:17,  3.46s/it]
Skipping the first batches:  81%|████████  | 4833/6000 [4:46:25<1:07:19,  3.46s/it]
Skipping the first batches:  81%|████████  | 4834/6000 [4:46:29<1:10:24,  3.62s/it]
Skipping the first batches:  81%|████████  | 4835/6000 [4:46:33<1:08:30,  3.53s/it]
Skipping the first batches:  81%|████████  | 4836/6000 [4:46:36<1:07:58,  3.50s/it]
Skipping the first batches:  81%|████████  | 4837/6000 [4:46:40<1:07:59,  3.51s/it]
Skipping the first batches:  81%|████████  | 4838/6000 [4:46:43<1:07:36,  3.49s/it]
Skipping the first batches:  81%|████████  | 4839/6000 [4:46:47<1:07:56,  3.51s/it]
Skipping the first batches:  81%|████████  | 4840/6000 [4:46:50<1:06:42,  3.45s/it]
Skipping the first batches:  81%|████████  | 4841/6000 [4:46:53<1:05:39,  3.40s/it]
Skipping the first batches:  81%|████████  | 4842/6000 [4:46:57<1:05:55,  3.42s/it]
Skipping the first batches:  81%|████████  | 4843/6000 [4:47:00<1:06:07,  3.43s/it]
Skipping the first batches:  81%|████████  | 4844/6000 [4:47:05<1:14:20,  3.86s/it]
Skipping the first batches:  81%|████████  | 4845/6000 [4:47:08<1:11:08,  3.70s/it]
Skipping the first batches:  81%|████████  | 4846/6000 [4:47:12<1:11:15,  3.71s/it]
Skipping the first batches:  81%|████████  | 4847/6000 [4:47:16<1:10:37,  3.68s/it]
Skipping the first batches:  81%|████████  | 4848/6000 [4:47:19<1:07:24,  3.51s/it]
Skipping the first batches:  81%|████████  | 4849/6000 [4:47:22<1:07:14,  3.51s/it]
Skipping the first batches:  81%|████████  | 4850/6000 [4:47:26<1:07:27,  3.52s/it]
Skipping the first batches:  81%|████████  | 4851/6000 [4:47:29<1:05:07,  3.40s/it]
Skipping the first batches:  81%|████████  | 4852/6000 [4:47:33<1:08:42,  3.59s/it]
Skipping the first batches:  81%|████████  | 4853/6000 [4:47:36<1:07:16,  3.52s/it]
Skipping the first batches:  81%|████████  | 4854/6000 [4:47:39<1:05:42,  3.44s/it]
Skipping the first batches:  81%|████████  | 4855/6000 [4:47:43<1:06:04,  3.46s/it]
Skipping the first batches:  81%|████████  | 4856/6000 [4:47:46<1:04:56,  3.41s/it]
Skipping the first batches:  81%|████████  | 4857/6000 [4:47:49<1:03:14,  3.32s/it]
Skipping the first batches:  81%|████████  | 4858/6000 [4:47:53<1:04:54,  3.41s/it]
Skipping the first batches:  81%|████████  | 4859/6000 [4:47:57<1:05:28,  3.44s/it]
Skipping the first batches:  81%|████████  | 4860/6000 [4:48:00<1:03:38,  3.35s/it]
Skipping the first batches:  81%|████████  | 4861/6000 [4:48:03<1:03:55,  3.37s/it]
Skipping the first batches:  81%|████████  | 4862/6000 [4:48:07<1:08:23,  3.61s/it]
Skipping the first batches:  81%|████████  | 4863/6000 [4:48:10<1:06:26,  3.51s/it]
Skipping the first batches:  81%|████████  | 4864/6000 [4:48:14<1:05:03,  3.44s/it]
Skipping the first batches:  81%|████████  | 4865/6000 [4:48:17<1:05:08,  3.44s/it]
Skipping the first batches:  81%|████████  | 4866/6000 [4:48:21<1:04:21,  3.41s/it]
Skipping the first batches:  81%|████████  | 4867/6000 [4:48:24<1:04:41,  3.43s/it]
Skipping the first batches:  81%|████████  | 4868/6000 [4:48:27<1:03:23,  3.36s/it]
Skipping the first batches:  81%|████████  | 4869/6000 [4:48:31<1:05:10,  3.46s/it]
Skipping the first batches:  81%|████████  | 4870/6000 [4:48:34<1:04:19,  3.42s/it]
Skipping the first batches:  81%|████████  | 4871/6000 [4:48:39<1:10:09,  3.73s/it]
Skipping the first batches:  81%|████████  | 4872/6000 [4:48:42<1:08:23,  3.64s/it]
Skipping the first batches:  81%|████████  | 4873/6000 [4:48:46<1:08:49,  3.66s/it]
Skipping the first batches:  81%|████████  | 4874/6000 [4:48:49<1:05:42,  3.50s/it]
Skipping the first batches:  81%|████████▏ | 4875/6000 [4:48:53<1:05:54,  3.52s/it]
Skipping the first batches:  81%|████████▏ | 4876/6000 [4:48:58<1:15:43,  4.04s/it]
Skipping the first batches:  81%|████████▏ | 4877/6000 [4:49:03<1:22:18,  4.40s/it]
Skipping the first batches:  81%|████████▏ | 4878/6000 [4:49:08<1:24:24,  4.51s/it]
Skipping the first batches:  81%|████████▏ | 4879/6000 [4:49:12<1:20:43,  4.32s/it]
Skipping the first batches:  81%|████████▏ | 4880/6000 [4:49:15<1:15:32,  4.05s/it]
Skipping the first batches:  81%|████████▏ | 4881/6000 [4:49:19<1:12:20,  3.88s/it]
Skipping the first batches:  81%|████████▏ | 4882/6000 [4:49:22<1:11:27,  3.83s/it]
Skipping the first batches:  81%|████████▏ | 4883/6000 [4:49:26<1:09:50,  3.75s/it]
Skipping the first batches:  81%|████████▏ | 4884/6000 [4:49:29<1:06:44,  3.59s/it]
Skipping the first batches:  81%|████████▏ | 4885/6000 [4:49:33<1:07:27,  3.63s/it]
Skipping the first batches:  81%|████████▏ | 4886/6000 [4:49:36<1:05:49,  3.55s/it]
Skipping the first batches:  81%|████████▏ | 4887/6000 [4:49:40<1:05:39,  3.54s/it]
Skipping the first batches:  81%|████████▏ | 4888/6000 [4:49:43<1:04:53,  3.50s/it]
Skipping the first batches:  81%|████████▏ | 4889/6000 [4:49:47<1:05:12,  3.52s/it]
Skipping the first batches:  82%|████████▏ | 4890/6000 [4:49:50<1:05:03,  3.52s/it]
Skipping the first batches:  82%|████████▏ | 4891/6000 [4:49:54<1:04:28,  3.49s/it]
Skipping the first batches:  82%|████████▏ | 4892/6000 [4:49:57<1:04:05,  3.47s/it]
Skipping the first batches:  82%|████████▏ | 4893/6000 [4:50:01<1:06:35,  3.61s/it]
Skipping the first batches:  82%|████████▏ | 4894/6000 [4:50:04<1:06:10,  3.59s/it]
Skipping the first batches:  82%|████████▏ | 4895/6000 [4:50:08<1:03:58,  3.47s/it]
Skipping the first batches:  82%|████████▏ | 4896/6000 [4:50:12<1:05:56,  3.58s/it]
Skipping the first batches:  82%|████████▏ | 4897/6000 [4:50:15<1:03:10,  3.44s/it]
Skipping the first batches:  82%|████████▏ | 4898/6000 [4:50:18<1:03:03,  3.43s/it]
Skipping the first batches:  82%|████████▏ | 4899/6000 [4:50:22<1:05:07,  3.55s/it]
Skipping the first batches:  82%|████████▏ | 4900/6000 [4:50:25<1:03:43,  3.48s/it]
Skipping the first batches:  82%|████████▏ | 4901/6000 [4:50:29<1:04:30,  3.52s/it]
Skipping the first batches:  82%|████████▏ | 4902/6000 [4:50:32<1:01:58,  3.39s/it]
Skipping the first batches:  82%|████████▏ | 4903/6000 [4:50:36<1:06:25,  3.63s/it]
Skipping the first batches:  82%|████████▏ | 4904/6000 [4:50:40<1:07:36,  3.70s/it]
Skipping the first batches:  82%|████████▏ | 4905/6000 [4:50:43<1:04:55,  3.56s/it]
Skipping the first batches:  82%|████████▏ | 4906/6000 [4:50:46<1:03:44,  3.50s/it]
Skipping the first batches:  82%|████████▏ | 4907/6000 [4:50:50<1:04:06,  3.52s/it]
Skipping the first batches:  82%|████████▏ | 4908/6000 [4:50:53<1:01:34,  3.38s/it]
Skipping the first batches:  82%|████████▏ | 4909/6000 [4:50:56<1:01:20,  3.37s/it]
Skipping the first batches:  82%|████████▏ | 4910/6000 [4:51:00<1:02:49,  3.46s/it]
Skipping the first batches:  82%|████████▏ | 4911/6000 [4:51:04<1:02:23,  3.44s/it]
Skipping the first batches:  82%|████████▏ | 4912/6000 [4:51:07<1:00:39,  3.34s/it]
Skipping the first batches:  82%|████████▏ | 4913/6000 [4:51:10<1:01:11,  3.38s/it]
Skipping the first batches:  82%|████████▏ | 4914/6000 [4:51:14<1:03:23,  3.50s/it]
Skipping the first batches:  82%|████████▏ | 4915/6000 [4:51:17<1:02:20,  3.45s/it]
Skipping the first batches:  82%|████████▏ | 4916/6000 [4:51:21<1:04:36,  3.58s/it]
Skipping the first batches:  82%|████████▏ | 4917/6000 [4:51:24<1:02:20,  3.45s/it]
Skipping the first batches:  82%|████████▏ | 4918/6000 [4:51:28<1:01:48,  3.43s/it]
Skipping the first batches:  82%|████████▏ | 4919/6000 [4:51:31<1:02:51,  3.49s/it]
Skipping the first batches:  82%|████████▏ | 4920/6000 [4:51:34<1:00:45,  3.38s/it]
Skipping the first batches:  82%|████████▏ | 4921/6000 [4:51:38<1:01:31,  3.42s/it]
Skipping the first batches:  82%|████████▏ | 4922/6000 [4:51:41<1:00:30,  3.37s/it]
Skipping the first batches:  82%|████████▏ | 4923/6000 [4:51:45<1:03:50,  3.56s/it]
Skipping the first batches:  82%|████████▏ | 4924/6000 [4:51:48<1:02:08,  3.47s/it]
Skipping the first batches:  82%|████████▏ | 4925/6000 [4:51:52<1:03:47,  3.56s/it]
Skipping the first batches:  82%|████████▏ | 4926/6000 [4:51:56<1:06:44,  3.73s/it]
Skipping the first batches:  82%|████████▏ | 4927/6000 [4:52:00<1:05:53,  3.68s/it]
Skipping the first batches:  82%|████████▏ | 4928/6000 [4:52:03<1:04:02,  3.58s/it]
Skipping the first batches:  82%|████████▏ | 4929/6000 [4:52:07<1:03:22,  3.55s/it]
Skipping the first batches:  82%|████████▏ | 4930/6000 [4:52:10<1:01:56,  3.47s/it]
Skipping the first batches:  82%|████████▏ | 4931/6000 [4:52:13<1:01:38,  3.46s/it]
Skipping the first batches:  82%|████████▏ | 4932/6000 [4:52:17<1:01:45,  3.47s/it]
Skipping the first batches:  82%|████████▏ | 4933/6000 [4:52:20<1:01:31,  3.46s/it]
Skipping the first batches:  82%|████████▏ | 4934/6000 [4:52:24<1:00:26,  3.40s/it]
Skipping the first batches:  82%|████████▏ | 4935/6000 [4:52:27<1:01:02,  3.44s/it]
Skipping the first batches:  82%|████████▏ | 4936/6000 [4:52:31<1:01:43,  3.48s/it]
Skipping the first batches:  82%|████████▏ | 4937/6000 [4:52:34<1:01:08,  3.45s/it]
Skipping the first batches:  82%|████████▏ | 4938/6000 [4:52:38<1:01:10,  3.46s/it]
Skipping the first batches:  82%|████████▏ | 4939/6000 [4:52:41<1:00:40,  3.43s/it]
Skipping the first batches:  82%|████████▏ | 4940/6000 [4:52:44<59:02,  3.34s/it]  
Skipping the first batches:  82%|████████▏ | 4941/6000 [4:52:48<1:00:35,  3.43s/it]
Skipping the first batches:  82%|████████▏ | 4942/6000 [4:52:51<1:00:24,  3.43s/it]
Skipping the first batches:  82%|████████▏ | 4943/6000 [4:52:55<1:00:38,  3.44s/it]
Skipping the first batches:  82%|████████▏ | 4944/6000 [4:52:58<1:01:43,  3.51s/it]
Skipping the first batches:  82%|████████▏ | 4945/6000 [4:53:02<1:01:36,  3.50s/it]
Skipping the first batches:  82%|████████▏ | 4946/6000 [4:53:05<1:02:27,  3.56s/it]
Skipping the first batches:  82%|████████▏ | 4947/6000 [4:53:09<1:02:01,  3.53s/it]
Skipping the first batches:  82%|████████▏ | 4948/6000 [4:53:12<1:01:52,  3.53s/it]
Skipping the first batches:  82%|████████▏ | 4949/6000 [4:53:16<1:02:10,  3.55s/it]
Skipping the first batches:  82%|████████▎ | 4950/6000 [4:53:20<1:04:56,  3.71s/it]
Skipping the first batches:  83%|████████▎ | 4951/6000 [4:53:23<1:02:04,  3.55s/it]
Skipping the first batches:  83%|████████▎ | 4952/6000 [4:53:27<1:03:19,  3.63s/it]
Skipping the first batches:  83%|████████▎ | 4953/6000 [4:53:31<1:03:20,  3.63s/it]
Skipping the first batches:  83%|████████▎ | 4954/6000 [4:53:34<1:01:36,  3.53s/it]
Skipping the first batches:  83%|████████▎ | 4955/6000 [4:53:38<1:01:22,  3.52s/it]
Skipping the first batches:  83%|████████▎ | 4956/6000 [4:53:41<1:00:17,  3.46s/it]
Skipping the first batches:  83%|████████▎ | 4957/6000 [4:53:44<1:00:02,  3.45s/it]
Skipping the first batches:  83%|████████▎ | 4958/6000 [4:53:48<58:57,  3.39s/it]  
Skipping the first batches:  83%|████████▎ | 4959/6000 [4:53:51<1:01:12,  3.53s/it]
Skipping the first batches:  83%|████████▎ | 4960/6000 [4:53:55<1:00:03,  3.46s/it]
Skipping the first batches:  83%|████████▎ | 4961/6000 [4:53:58<1:00:12,  3.48s/it]
Skipping the first batches:  83%|████████▎ | 4962/6000 [4:54:02<1:00:30,  3.50s/it]
Skipping the first batches:  83%|████████▎ | 4963/6000 [4:54:05<59:58,  3.47s/it]  
Skipping the first batches:  83%|████████▎ | 4964/6000 [4:54:09<59:20,  3.44s/it]
Skipping the first batches:  83%|████████▎ | 4965/6000 [4:54:12<1:00:40,  3.52s/it]
Skipping the first batches:  83%|████████▎ | 4966/6000 [4:54:16<59:28,  3.45s/it]  
Skipping the first batches:  83%|████████▎ | 4967/6000 [4:54:19<59:39,  3.47s/it]
Skipping the first batches:  83%|████████▎ | 4968/6000 [4:54:22<57:41,  3.35s/it]
Skipping the first batches:  83%|████████▎ | 4969/6000 [4:54:26<59:41,  3.47s/it]
Skipping the first batches:  83%|████████▎ | 4970/6000 [4:54:30<1:01:01,  3.55s/it]
Skipping the first batches:  83%|████████▎ | 4971/6000 [4:54:33<59:54,  3.49s/it]  
Skipping the first batches:  83%|████████▎ | 4972/6000 [4:54:36<58:54,  3.44s/it]
Skipping the first batches:  83%|████████▎ | 4973/6000 [4:54:40<58:34,  3.42s/it]
Skipping the first batches:  83%|████████▎ | 4974/6000 [4:54:43<58:31,  3.42s/it]
Skipping the first batches:  83%|████████▎ | 4975/6000 [4:54:46<57:44,  3.38s/it]
Skipping the first batches:  83%|████████▎ | 4976/6000 [4:54:50<58:51,  3.45s/it]
Skipping the first batches:  83%|████████▎ | 4977/6000 [4:54:53<58:10,  3.41s/it]
Skipping the first batches:  83%|████████▎ | 4978/6000 [4:54:57<58:11,  3.42s/it]
Skipping the first batches:  83%|████████▎ | 4979/6000 [4:55:00<56:40,  3.33s/it]
Skipping the first batches:  83%|████████▎ | 4980/6000 [4:55:05<1:03:36,  3.74s/it]
Skipping the first batches:  83%|████████▎ | 4981/6000 [4:55:08<1:00:22,  3.56s/it]
Skipping the first batches:  83%|████████▎ | 4982/6000 [4:55:12<1:02:07,  3.66s/it]
Skipping the first batches:  83%|████████▎ | 4983/6000 [4:55:15<1:00:56,  3.60s/it]
Skipping the first batches:  83%|████████▎ | 4984/6000 [4:55:19<1:00:42,  3.59s/it]
Skipping the first batches:  83%|████████▎ | 4985/6000 [4:55:22<1:00:13,  3.56s/it]
Skipping the first batches:  83%|████████▎ | 4986/6000 [4:55:26<59:30,  3.52s/it]  
Skipping the first batches:  83%|████████▎ | 4987/6000 [4:55:29<1:00:38,  3.59s/it]
Skipping the first batches:  83%|████████▎ | 4988/6000 [4:55:32<58:13,  3.45s/it]  
Skipping the first batches:  83%|████████▎ | 4989/6000 [4:55:36<58:14,  3.46s/it]
Skipping the first batches:  83%|████████▎ | 4990/6000 [4:55:40<1:00:10,  3.57s/it]
Skipping the first batches:  83%|████████▎ | 4991/6000 [4:55:43<59:29,  3.54s/it]  
Skipping the first batches:  83%|████████▎ | 4992/6000 [4:55:47<1:01:05,  3.64s/it]
Skipping the first batches:  83%|████████▎ | 4993/6000 [4:55:51<1:00:18,  3.59s/it]
Skipping the first batches:  83%|████████▎ | 4994/6000 [4:55:54<59:00,  3.52s/it]  
Skipping the first batches:  83%|████████▎ | 4995/6000 [4:55:58<1:02:22,  3.72s/it]
Skipping the first batches:  83%|████████▎ | 4996/6000 [4:56:02<1:04:07,  3.83s/it]
Skipping the first batches:  83%|████████▎ | 4997/6000 [4:56:05<1:00:54,  3.64s/it]
Skipping the first batches:  83%|████████▎ | 4998/6000 [4:56:10<1:06:11,  3.96s/it]
Skipping the first batches:  83%|████████▎ | 4999/6000 [4:56:13<1:02:17,  3.73s/it]
Skipping the first batches:  83%|████████▎ | 5000/6000 [4:56:17<1:02:33,  3.75s/it]
Skipping the first batches:  83%|████████▎ | 5001/6000 [4:56:21<1:04:00,  3.84s/it]
Skipping the first batches:  83%|████████▎ | 5002/6000 [4:56:25<1:04:49,  3.90s/it]
Skipping the first batches:  83%|████████▎ | 5003/6000 [4:56:29<1:04:46,  3.90s/it]
Skipping the first batches:  83%|████████▎ | 5004/6000 [4:56:32<1:01:15,  3.69s/it]
Skipping the first batches:  83%|████████▎ | 5005/6000 [4:56:37<1:05:14,  3.93s/it]
Skipping the first batches:  83%|████████▎ | 5006/6000 [4:56:42<1:09:39,  4.20s/it]
Skipping the first batches:  83%|████████▎ | 5007/6000 [4:56:46<1:10:16,  4.25s/it]
Skipping the first batches:  83%|████████▎ | 5008/6000 [4:56:50<1:10:11,  4.25s/it]
Skipping the first batches:  83%|████████▎ | 5009/6000 [4:56:54<1:08:04,  4.12s/it]
Skipping the first batches:  84%|████████▎ | 5010/6000 [4:56:59<1:10:07,  4.25s/it]
Skipping the first batches:  84%|████████▎ | 5011/6000 [4:57:03<1:10:39,  4.29s/it]
Skipping the first batches:  84%|████████▎ | 5012/6000 [4:57:08<1:12:16,  4.39s/it]
Skipping the first batches:  84%|████████▎ | 5013/6000 [4:57:12<1:10:22,  4.28s/it]
Skipping the first batches:  84%|████████▎ | 5014/6000 [4:57:15<1:07:10,  4.09s/it]
Skipping the first batches:  84%|████████▎ | 5015/6000 [4:57:18<1:02:13,  3.79s/it]
Skipping the first batches:  84%|████████▎ | 5016/6000 [4:57:22<59:34,  3.63s/it]  
Skipping the first batches:  84%|████████▎ | 5017/6000 [4:57:25<57:56,  3.54s/it]
Skipping the first batches:  84%|████████▎ | 5018/6000 [4:57:28<56:58,  3.48s/it]
Skipping the first batches:  84%|████████▎ | 5019/6000 [4:57:32<57:00,  3.49s/it]
Skipping the first batches:  84%|████████▎ | 5020/6000 [4:57:36<58:19,  3.57s/it]
Skipping the first batches:  84%|████████▎ | 5021/6000 [4:57:39<57:40,  3.54s/it]
Skipping the first batches:  84%|████████▎ | 5022/6000 [4:57:43<58:47,  3.61s/it]
Skipping the first batches:  84%|████████▎ | 5023/6000 [4:57:46<57:01,  3.50s/it]
Skipping the first batches:  84%|████████▎ | 5024/6000 [4:57:50<57:18,  3.52s/it]
Skipping the first batches:  84%|████████▍ | 5025/6000 [4:57:53<55:38,  3.42s/it]
Skipping the first batches:  84%|████████▍ | 5026/6000 [4:57:57<57:35,  3.55s/it]
Skipping the first batches:  84%|████████▍ | 5027/6000 [4:58:00<55:55,  3.45s/it]
Skipping the first batches:  84%|████████▍ | 5028/6000 [4:58:03<54:42,  3.38s/it]
Skipping the first batches:  84%|████████▍ | 5029/6000 [4:58:07<55:23,  3.42s/it]
Skipping the first batches:  84%|████████▍ | 5030/6000 [4:58:10<54:27,  3.37s/it]
Skipping the first batches:  84%|████████▍ | 5031/6000 [4:58:13<55:05,  3.41s/it]
Skipping the first batches:  84%|████████▍ | 5032/6000 [4:58:17<57:06,  3.54s/it]
Skipping the first batches:  84%|████████▍ | 5033/6000 [4:58:20<55:39,  3.45s/it]
Skipping the first batches:  84%|████████▍ | 5034/6000 [4:58:23<53:39,  3.33s/it]
Skipping the first batches:  84%|████████▍ | 5035/6000 [4:58:27<53:19,  3.32s/it]
Skipping the first batches:  84%|████████▍ | 5036/6000 [4:58:30<54:00,  3.36s/it]
Skipping the first batches:  84%|████████▍ | 5037/6000 [4:58:34<53:33,  3.34s/it]
Skipping the first batches:  84%|████████▍ | 5038/6000 [4:58:37<53:47,  3.36s/it]
Skipping the first batches:  84%|████████▍ | 5039/6000 [4:58:41<54:56,  3.43s/it]
Skipping the first batches:  84%|████████▍ | 5040/6000 [4:58:44<53:11,  3.32s/it]
Skipping the first batches:  84%|████████▍ | 5041/6000 [4:58:47<54:20,  3.40s/it]
Skipping the first batches:  84%|████████▍ | 5042/6000 [4:58:51<54:16,  3.40s/it]
Skipping the first batches:  84%|████████▍ | 5043/6000 [4:58:55<58:31,  3.67s/it]
Skipping the first batches:  84%|████████▍ | 5044/6000 [4:58:58<58:06,  3.65s/it]
Skipping the first batches:  84%|████████▍ | 5045/6000 [4:59:03<1:00:26,  3.80s/it]
Skipping the first batches:  84%|████████▍ | 5046/6000 [4:59:06<59:54,  3.77s/it]  
Skipping the first batches:  84%|████████▍ | 5047/6000 [4:59:10<59:30,  3.75s/it]
Skipping the first batches:  84%|████████▍ | 5048/6000 [4:59:13<56:45,  3.58s/it]
Skipping the first batches:  84%|████████▍ | 5049/6000 [4:59:17<57:48,  3.65s/it]
Skipping the first batches:  84%|████████▍ | 5050/6000 [4:59:20<56:54,  3.59s/it]
Skipping the first batches:  84%|████████▍ | 5051/6000 [4:59:24<55:58,  3.54s/it]
Skipping the first batches:  84%|████████▍ | 5052/6000 [4:59:28<57:00,  3.61s/it]
Skipping the first batches:  84%|████████▍ | 5053/6000 [4:59:31<56:56,  3.61s/it]
Skipping the first batches:  84%|████████▍ | 5054/6000 [4:59:35<59:14,  3.76s/it]
Skipping the first batches:  84%|████████▍ | 5055/6000 [4:59:39<58:37,  3.72s/it]
Skipping the first batches:  84%|████████▍ | 5056/6000 [4:59:43<59:07,  3.76s/it]
Skipping the first batches:  84%|████████▍ | 5057/6000 [4:59:46<57:31,  3.66s/it]
Skipping the first batches:  84%|████████▍ | 5058/6000 [4:59:49<54:52,  3.50s/it]
Skipping the first batches:  84%|████████▍ | 5059/6000 [4:59:53<55:39,  3.55s/it]
Skipping the first batches:  84%|████████▍ | 5060/6000 [4:59:56<54:20,  3.47s/it]
Skipping the first batches:  84%|████████▍ | 5061/6000 [5:00:00<52:53,  3.38s/it]
Skipping the first batches:  84%|████████▍ | 5062/6000 [5:00:03<54:16,  3.47s/it]
Skipping the first batches:  84%|████████▍ | 5063/6000 [5:00:07<55:33,  3.56s/it]
Skipping the first batches:  84%|████████▍ | 5064/6000 [5:00:11<55:33,  3.56s/it]
Skipping the first batches:  84%|████████▍ | 5065/6000 [5:00:14<55:52,  3.59s/it]
Skipping the first batches:  84%|████████▍ | 5066/6000 [5:00:18<55:10,  3.54s/it]
Skipping the first batches:  84%|████████▍ | 5067/6000 [5:00:21<53:03,  3.41s/it]
Skipping the first batches:  84%|████████▍ | 5068/6000 [5:00:24<53:22,  3.44s/it]
Skipping the first batches:  84%|████████▍ | 5069/6000 [5:00:28<53:25,  3.44s/it]
Skipping the first batches:  84%|████████▍ | 5070/6000 [5:00:31<52:00,  3.36s/it]
Skipping the first batches:  85%|████████▍ | 5071/6000 [5:00:34<52:30,  3.39s/it]
Skipping the first batches:  85%|████████▍ | 5072/6000 [5:00:38<53:13,  3.44s/it]
Skipping the first batches:  85%|████████▍ | 5073/6000 [5:00:41<52:06,  3.37s/it]
Skipping the first batches:  85%|████████▍ | 5074/6000 [5:00:45<53:14,  3.45s/it]
Skipping the first batches:  85%|████████▍ | 5075/6000 [5:00:49<54:57,  3.57s/it]
Skipping the first batches:  85%|████████▍ | 5076/6000 [5:00:52<53:59,  3.51s/it]
Skipping the first batches:  85%|████████▍ | 5077/6000 [5:00:56<54:35,  3.55s/it]
Skipping the first batches:  85%|████████▍ | 5078/6000 [5:00:59<53:20,  3.47s/it]
Skipping the first batches:  85%|████████▍ | 5079/6000 [5:01:02<51:32,  3.36s/it]
Skipping the first batches:  85%|████████▍ | 5080/6000 [5:01:06<52:54,  3.45s/it]
Skipping the first batches:  85%|████████▍ | 5081/6000 [5:01:10<56:17,  3.68s/it]
Skipping the first batches:  85%|████████▍ | 5082/6000 [5:01:13<54:47,  3.58s/it]
Skipping the first batches:  85%|████████▍ | 5083/6000 [5:01:17<57:03,  3.73s/it]
Skipping the first batches:  85%|████████▍ | 5084/6000 [5:01:21<55:38,  3.64s/it]
Skipping the first batches:  85%|████████▍ | 5085/6000 [5:01:24<55:57,  3.67s/it]
Skipping the first batches:  85%|████████▍ | 5086/6000 [5:01:28<54:34,  3.58s/it]
Skipping the first batches:  85%|████████▍ | 5087/6000 [5:01:31<54:57,  3.61s/it]
Skipping the first batches:  85%|████████▍ | 5088/6000 [5:01:35<53:55,  3.55s/it]
Skipping the first batches:  85%|████████▍ | 5089/6000 [5:01:38<53:11,  3.50s/it]
Skipping the first batches:  85%|████████▍ | 5090/6000 [5:01:42<52:13,  3.44s/it]
Skipping the first batches:  85%|████████▍ | 5091/6000 [5:01:45<53:19,  3.52s/it]
Skipping the first batches:  85%|████████▍ | 5092/6000 [5:01:49<55:31,  3.67s/it]
Skipping the first batches:  85%|████████▍ | 5093/6000 [5:01:53<56:53,  3.76s/it]
Skipping the first batches:  85%|████████▍ | 5094/6000 [5:01:56<53:37,  3.55s/it]
Skipping the first batches:  85%|████████▍ | 5095/6000 [5:02:00<54:47,  3.63s/it]
Skipping the first batches:  85%|████████▍ | 5096/6000 [5:02:04<53:38,  3.56s/it]
Skipping the first batches:  85%|████████▍ | 5097/6000 [5:02:07<52:18,  3.48s/it]
Skipping the first batches:  85%|████████▍ | 5098/6000 [5:02:12<58:14,  3.87s/it]
Skipping the first batches:  85%|████████▍ | 5099/6000 [5:02:15<56:41,  3.78s/it]
Skipping the first batches:  85%|████████▌ | 5100/6000 [5:02:20<1:02:25,  4.16s/it]
Skipping the first batches:  85%|████████▌ | 5101/6000 [5:02:24<59:46,  3.99s/it]  
Skipping the first batches:  85%|████████▌ | 5102/6000 [5:02:27<57:37,  3.85s/it]
Skipping the first batches:  85%|████████▌ | 5103/6000 [5:02:31<57:41,  3.86s/it]
Skipping the first batches:  85%|████████▌ | 5104/6000 [5:02:35<56:39,  3.79s/it]
Skipping the first batches:  85%|████████▌ | 5105/6000 [5:02:39<59:10,  3.97s/it]
Skipping the first batches:  85%|████████▌ | 5106/6000 [5:02:42<55:27,  3.72s/it]
Skipping the first batches:  85%|████████▌ | 5107/6000 [5:02:46<53:35,  3.60s/it]
Skipping the first batches:  85%|████████▌ | 5108/6000 [5:02:49<51:19,  3.45s/it]
Skipping the first batches:  85%|████████▌ | 5109/6000 [5:02:53<56:47,  3.82s/it]
Skipping the first batches:  85%|████████▌ | 5110/6000 [5:02:57<56:18,  3.80s/it]
Skipping the first batches:  85%|████████▌ | 5111/6000 [5:03:01<54:30,  3.68s/it]
Skipping the first batches:  85%|████████▌ | 5112/6000 [5:03:05<56:26,  3.81s/it]
Skipping the first batches:  85%|████████▌ | 5113/6000 [5:03:08<54:18,  3.67s/it]
Skipping the first batches:  85%|████████▌ | 5114/6000 [5:03:11<52:51,  3.58s/it]
Skipping the first batches:  85%|████████▌ | 5115/6000 [5:03:15<51:30,  3.49s/it]
Skipping the first batches:  85%|████████▌ | 5116/6000 [5:03:18<52:05,  3.54s/it]
Skipping the first batches:  85%|████████▌ | 5117/6000 [5:03:21<49:58,  3.40s/it]
Skipping the first batches:  85%|████████▌ | 5118/6000 [5:03:25<52:14,  3.55s/it]
Skipping the first batches:  85%|████████▌ | 5119/6000 [5:03:29<51:06,  3.48s/it]
Skipping the first batches:  85%|████████▌ | 5120/6000 [5:03:32<50:21,  3.43s/it]
Skipping the first batches:  85%|████████▌ | 5121/6000 [5:03:35<50:13,  3.43s/it]
Skipping the first batches:  85%|████████▌ | 5122/6000 [5:03:39<48:52,  3.34s/it]
Skipping the first batches:  85%|████████▌ | 5123/6000 [5:03:44<56:57,  3.90s/it]
Skipping the first batches:  85%|████████▌ | 5124/6000 [5:03:48<57:57,  3.97s/it]
Skipping the first batches:  85%|████████▌ | 5125/6000 [5:03:52<56:48,  3.90s/it]
Skipping the first batches:  85%|████████▌ | 5126/6000 [5:03:56<1:00:08,  4.13s/it]
Skipping the first batches:  85%|████████▌ | 5127/6000 [5:04:00<57:43,  3.97s/it]  
Skipping the first batches:  85%|████████▌ | 5128/6000 [5:04:04<1:00:04,  4.13s/it]
Skipping the first batches:  85%|████████▌ | 5129/6000 [5:04:08<56:31,  3.89s/it]  
Skipping the first batches:  86%|████████▌ | 5130/6000 [5:04:11<55:03,  3.80s/it]
Skipping the first batches:  86%|████████▌ | 5131/6000 [5:04:15<53:39,  3.70s/it]
Skipping the first batches:  86%|████████▌ | 5132/6000 [5:04:19<54:36,  3.77s/it]
Skipping the first batches:  86%|████████▌ | 5133/6000 [5:04:23<54:35,  3.78s/it]
Skipping the first batches:  86%|████████▌ | 5134/6000 [5:04:27<55:27,  3.84s/it]
Skipping the first batches:  86%|████████▌ | 5135/6000 [5:04:30<54:59,  3.81s/it]
Skipping the first batches:  86%|████████▌ | 5136/6000 [5:04:34<52:55,  3.68s/it]
Skipping the first batches:  86%|████████▌ | 5137/6000 [5:04:38<54:50,  3.81s/it]
Skipping the first batches:  86%|████████▌ | 5138/6000 [5:04:42<58:27,  4.07s/it]
Skipping the first batches:  86%|████████▌ | 5139/6000 [5:04:47<59:21,  4.14s/it]
Skipping the first batches:  86%|████████▌ | 5140/6000 [5:04:50<55:01,  3.84s/it]
Skipping the first batches:  86%|████████▌ | 5141/6000 [5:04:54<55:00,  3.84s/it]
Skipping the first batches:  86%|████████▌ | 5142/6000 [5:04:57<53:39,  3.75s/it]
Skipping the first batches:  86%|████████▌ | 5143/6000 [5:05:01<52:18,  3.66s/it]
Skipping the first batches:  86%|████████▌ | 5144/6000 [5:05:04<51:28,  3.61s/it]
Skipping the first batches:  86%|████████▌ | 5145/6000 [5:05:08<50:49,  3.57s/it]
Skipping the first batches:  86%|████████▌ | 5146/6000 [5:05:11<49:47,  3.50s/it]
Skipping the first batches:  86%|████████▌ | 5147/6000 [5:05:14<48:50,  3.43s/it]
Skipping the first batches:  86%|████████▌ | 5148/6000 [5:05:18<48:52,  3.44s/it]
Skipping the first batches:  86%|████████▌ | 5149/6000 [5:05:21<48:42,  3.43s/it]
Skipping the first batches:  86%|████████▌ | 5150/6000 [5:05:24<47:37,  3.36s/it]
Skipping the first batches:  86%|████████▌ | 5151/6000 [5:05:27<46:12,  3.27s/it]
Skipping the first batches:  86%|████████▌ | 5152/6000 [5:05:31<47:26,  3.36s/it]
Skipping the first batches:  86%|████████▌ | 5153/6000 [5:05:35<51:10,  3.63s/it]
Skipping the first batches:  86%|████████▌ | 5154/6000 [5:05:39<50:30,  3.58s/it]
Skipping the first batches:  86%|████████▌ | 5155/6000 [5:05:42<49:52,  3.54s/it]
Skipping the first batches:  86%|████████▌ | 5156/6000 [5:05:46<49:16,  3.50s/it]
Skipping the first batches:  86%|████████▌ | 5157/6000 [5:05:49<48:29,  3.45s/it]
Skipping the first batches:  86%|████████▌ | 5158/6000 [5:05:52<48:17,  3.44s/it]
Skipping the first batches:  86%|████████▌ | 5159/6000 [5:05:57<51:36,  3.68s/it]
Skipping the first batches:  86%|████████▌ | 5160/6000 [5:06:00<50:13,  3.59s/it]
Skipping the first batches:  86%|████████▌ | 5161/6000 [5:06:04<51:38,  3.69s/it]
Skipping the first batches:  86%|████████▌ | 5162/6000 [5:06:07<50:43,  3.63s/it]
Skipping the first batches:  86%|████████▌ | 5163/6000 [5:06:11<51:31,  3.69s/it]
Skipping the first batches:  86%|████████▌ | 5164/6000 [5:06:14<49:31,  3.55s/it]
Skipping the first batches:  86%|████████▌ | 5165/6000 [5:06:18<48:41,  3.50s/it]
Skipping the first batches:  86%|████████▌ | 5166/6000 [5:06:21<48:48,  3.51s/it]
Skipping the first batches:  86%|████████▌ | 5167/6000 [5:06:26<55:41,  4.01s/it]
Skipping the first batches:  86%|████████▌ | 5168/6000 [5:06:32<1:01:24,  4.43s/it]
Skipping the first batches:  86%|████████▌ | 5169/6000 [5:06:36<58:35,  4.23s/it]  
Skipping the first batches:  86%|████████▌ | 5170/6000 [5:06:40<59:48,  4.32s/it]
Skipping the first batches:  86%|████████▌ | 5171/6000 [5:06:44<56:29,  4.09s/it]
Skipping the first batches:  86%|████████▌ | 5172/6000 [5:06:47<54:46,  3.97s/it]
Skipping the first batches:  86%|████████▌ | 5173/6000 [5:06:51<52:09,  3.78s/it]
Skipping the first batches:  86%|████████▌ | 5174/6000 [5:06:54<49:45,  3.61s/it]
Skipping the first batches:  86%|████████▋ | 5175/6000 [5:06:57<48:38,  3.54s/it]
Skipping the first batches:  86%|████████▋ | 5176/6000 [5:07:01<47:42,  3.47s/it]
Skipping the first batches:  86%|████████▋ | 5177/6000 [5:07:05<49:26,  3.60s/it]
Skipping the first batches:  86%|████████▋ | 5178/6000 [5:07:08<47:58,  3.50s/it]
Skipping the first batches:  86%|████████▋ | 5179/6000 [5:07:11<47:07,  3.44s/it]
Skipping the first batches:  86%|████████▋ | 5180/6000 [5:07:15<46:43,  3.42s/it]
Skipping the first batches:  86%|████████▋ | 5181/6000 [5:07:18<48:30,  3.55s/it]
Skipping the first batches:  86%|████████▋ | 5182/6000 [5:07:22<48:06,  3.53s/it]
Skipping the first batches:  86%|████████▋ | 5183/6000 [5:07:25<46:05,  3.39s/it]
Skipping the first batches:  86%|████████▋ | 5184/6000 [5:07:28<46:13,  3.40s/it]
Skipping the first batches:  86%|████████▋ | 5185/6000 [5:07:32<45:47,  3.37s/it]
Skipping the first batches:  86%|████████▋ | 5186/6000 [5:07:35<47:00,  3.47s/it]
Skipping the first batches:  86%|████████▋ | 5187/6000 [5:07:39<47:44,  3.52s/it]
Skipping the first batches:  86%|████████▋ | 5188/6000 [5:07:42<46:48,  3.46s/it]
Skipping the first batches:  86%|████████▋ | 5189/6000 [5:07:45<45:06,  3.34s/it]
Skipping the first batches:  86%|████████▋ | 5190/6000 [5:07:49<44:44,  3.31s/it]
Skipping the first batches:  87%|████████▋ | 5191/6000 [5:07:53<47:50,  3.55s/it]
Skipping the first batches:  87%|████████▋ | 5192/6000 [5:07:56<46:40,  3.47s/it]
Skipping the first batches:  87%|████████▋ | 5193/6000 [5:07:59<45:12,  3.36s/it]
Skipping the first batches:  87%|████████▋ | 5194/6000 [5:08:03<45:32,  3.39s/it]
Skipping the first batches:  87%|████████▋ | 5195/6000 [5:08:06<47:20,  3.53s/it]
Skipping the first batches:  87%|████████▋ | 5196/6000 [5:08:10<45:44,  3.41s/it]
Skipping the first batches:  87%|████████▋ | 5197/6000 [5:08:13<45:09,  3.37s/it]
Skipping the first batches:  87%|████████▋ | 5198/6000 [5:08:16<45:56,  3.44s/it]
Skipping the first batches:  87%|████████▋ | 5199/6000 [5:08:20<45:20,  3.40s/it]
Skipping the first batches:  87%|████████▋ | 5200/6000 [5:08:23<44:20,  3.33s/it]
Skipping the first batches:  87%|████████▋ | 5201/6000 [5:08:27<46:00,  3.46s/it]
Skipping the first batches:  87%|████████▋ | 5202/6000 [5:08:31<47:42,  3.59s/it]
Skipping the first batches:  87%|████████▋ | 5203/6000 [5:08:34<45:33,  3.43s/it]
Skipping the first batches:  87%|████████▋ | 5204/6000 [5:08:38<47:27,  3.58s/it]
Skipping the first batches:  87%|████████▋ | 5205/6000 [5:08:41<45:24,  3.43s/it]
Skipping the first batches:  87%|████████▋ | 5206/6000 [5:08:44<46:02,  3.48s/it]
Skipping the first batches:  87%|████████▋ | 5207/6000 [5:08:48<46:15,  3.50s/it]
Skipping the first batches:  87%|████████▋ | 5208/6000 [5:08:51<44:30,  3.37s/it]
Skipping the first batches:  87%|████████▋ | 5209/6000 [5:08:54<44:02,  3.34s/it]
Skipping the first batches:  87%|████████▋ | 5210/6000 [5:08:57<44:11,  3.36s/it]
Skipping the first batches:  87%|████████▋ | 5211/6000 [5:09:01<44:31,  3.39s/it]
Skipping the first batches:  87%|████████▋ | 5212/6000 [5:09:04<44:05,  3.36s/it]
Skipping the first batches:  87%|████████▋ | 5213/6000 [5:09:08<44:30,  3.39s/it]
Skipping the first batches:  87%|████████▋ | 5214/6000 [5:09:11<45:03,  3.44s/it]
Skipping the first batches:  87%|████████▋ | 5215/6000 [5:09:14<44:05,  3.37s/it]
Skipping the first batches:  87%|████████▋ | 5216/6000 [5:09:18<43:28,  3.33s/it]
Skipping the first batches:  87%|████████▋ | 5217/6000 [5:09:21<43:30,  3.33s/it]
Skipping the first batches:  87%|████████▋ | 5218/6000 [5:09:24<43:04,  3.30s/it]
Skipping the first batches:  87%|████████▋ | 5219/6000 [5:09:27<42:36,  3.27s/it]
Skipping the first batches:  87%|████████▋ | 5220/6000 [5:09:31<43:30,  3.35s/it]
Skipping the first batches:  87%|████████▋ | 5221/6000 [5:09:34<43:18,  3.34s/it]
Skipping the first batches:  87%|████████▋ | 5222/6000 [5:09:38<43:30,  3.36s/it]
Skipping the first batches:  87%|████████▋ | 5223/6000 [5:09:42<45:51,  3.54s/it]
Skipping the first batches:  87%|████████▋ | 5224/6000 [5:09:45<44:20,  3.43s/it]
Skipping the first batches:  87%|████████▋ | 5225/6000 [5:09:48<43:34,  3.37s/it]
Skipping the first batches:  87%|████████▋ | 5226/6000 [5:09:52<44:25,  3.44s/it]
Skipping the first batches:  87%|████████▋ | 5227/6000 [5:09:56<45:57,  3.57s/it]
Skipping the first batches:  87%|████████▋ | 5228/6000 [5:09:59<44:03,  3.42s/it]
Skipping the first batches:  87%|████████▋ | 5229/6000 [5:10:02<43:34,  3.39s/it]
Skipping the first batches:  87%|████████▋ | 5230/6000 [5:10:06<44:35,  3.47s/it]
Skipping the first batches:  87%|████████▋ | 5231/6000 [5:10:09<43:57,  3.43s/it]
Skipping the first batches:  87%|████████▋ | 5232/6000 [5:10:12<43:07,  3.37s/it]
Skipping the first batches:  87%|████████▋ | 5233/6000 [5:10:16<44:25,  3.47s/it]
Skipping the first batches:  87%|████████▋ | 5234/6000 [5:10:20<46:34,  3.65s/it]
Skipping the first batches:  87%|████████▋ | 5235/6000 [5:10:23<44:36,  3.50s/it]
Skipping the first batches:  87%|████████▋ | 5236/6000 [5:10:27<44:19,  3.48s/it]
Skipping the first batches:  87%|████████▋ | 5237/6000 [5:10:30<44:44,  3.52s/it]
Skipping the first batches:  87%|████████▋ | 5238/6000 [5:10:34<44:14,  3.48s/it]
Skipping the first batches:  87%|████████▋ | 5239/6000 [5:10:37<42:40,  3.36s/it]
Skipping the first batches:  87%|████████▋ | 5240/6000 [5:10:40<42:41,  3.37s/it]
Skipping the first batches:  87%|████████▋ | 5241/6000 [5:10:44<44:19,  3.50s/it]
Skipping the first batches:  87%|████████▋ | 5242/6000 [5:10:47<43:31,  3.45s/it]
Skipping the first batches:  87%|████████▋ | 5243/6000 [5:10:51<44:04,  3.49s/it]
Skipping the first batches:  87%|████████▋ | 5244/6000 [5:10:55<45:18,  3.60s/it]
Skipping the first batches:  87%|████████▋ | 5245/6000 [5:10:58<43:37,  3.47s/it]
Skipping the first batches:  87%|████████▋ | 5246/6000 [5:11:01<42:59,  3.42s/it]
Skipping the first batches:  87%|████████▋ | 5247/6000 [5:11:05<43:40,  3.48s/it]
Skipping the first batches:  87%|████████▋ | 5248/6000 [5:11:09<45:30,  3.63s/it]
Skipping the first batches:  87%|████████▋ | 5249/6000 [5:11:12<43:54,  3.51s/it]
Skipping the first batches:  88%|████████▊ | 5250/6000 [5:11:15<42:19,  3.39s/it]
Skipping the first batches:  88%|████████▊ | 5251/6000 [5:11:18<42:33,  3.41s/it]
Skipping the first batches:  88%|████████▊ | 5252/6000 [5:11:22<41:59,  3.37s/it]
Skipping the first batches:  88%|████████▊ | 5253/6000 [5:11:25<42:10,  3.39s/it]
Skipping the first batches:  88%|████████▊ | 5254/6000 [5:11:29<42:36,  3.43s/it]
Skipping the first batches:  88%|████████▊ | 5255/6000 [5:11:33<44:04,  3.55s/it]
Skipping the first batches:  88%|████████▊ | 5256/6000 [5:11:36<42:20,  3.41s/it]
Skipping the first batches:  88%|████████▊ | 5257/6000 [5:11:39<41:56,  3.39s/it]
Skipping the first batches:  88%|████████▊ | 5258/6000 [5:11:42<42:29,  3.44s/it]
Skipping the first batches:  88%|████████▊ | 5259/6000 [5:11:46<42:44,  3.46s/it]
Skipping the first batches:  88%|████████▊ | 5260/6000 [5:11:49<41:23,  3.36s/it]
Skipping the first batches:  88%|████████▊ | 5261/6000 [5:11:52<41:01,  3.33s/it]
Skipping the first batches:  88%|████████▊ | 5262/6000 [5:11:56<40:52,  3.32s/it]
Skipping the first batches:  88%|████████▊ | 5263/6000 [5:11:59<42:29,  3.46s/it]
Skipping the first batches:  88%|████████▊ | 5264/6000 [5:12:03<41:39,  3.40s/it]
Skipping the first batches:  88%|████████▊ | 5265/6000 [5:12:07<43:09,  3.52s/it]
Skipping the first batches:  88%|████████▊ | 5266/6000 [5:12:10<42:28,  3.47s/it]
Skipping the first batches:  88%|████████▊ | 5267/6000 [5:12:13<42:19,  3.46s/it]
Skipping the first batches:  88%|████████▊ | 5268/6000 [5:12:17<41:31,  3.40s/it]
Skipping the first batches:  88%|████████▊ | 5269/6000 [5:12:20<42:17,  3.47s/it]
Skipping the first batches:  88%|████████▊ | 5270/6000 [5:12:24<41:54,  3.44s/it]
Skipping the first batches:  88%|████████▊ | 5271/6000 [5:12:27<41:47,  3.44s/it]
Skipping the first batches:  88%|████████▊ | 5272/6000 [5:12:31<43:29,  3.58s/it]
Skipping the first batches:  88%|████████▊ | 5273/6000 [5:12:34<41:45,  3.45s/it]
Skipping the first batches:  88%|████████▊ | 5274/6000 [5:12:38<41:50,  3.46s/it]
Skipping the first batches:  88%|████████▊ | 5275/6000 [5:12:41<41:05,  3.40s/it]
Skipping the first batches:  88%|████████▊ | 5276/6000 [5:12:44<41:14,  3.42s/it]
Skipping the first batches:  88%|████████▊ | 5277/6000 [5:12:48<41:54,  3.48s/it]
Skipping the first batches:  88%|████████▊ | 5278/6000 [5:12:51<41:21,  3.44s/it]
Skipping the first batches:  88%|████████▊ | 5279/6000 [5:12:54<40:16,  3.35s/it]
Skipping the first batches:  88%|████████▊ | 5280/6000 [5:12:59<43:53,  3.66s/it]
Skipping the first batches:  88%|████████▊ | 5281/6000 [5:13:02<43:38,  3.64s/it]
Skipping the first batches:  88%|████████▊ | 5282/6000 [5:13:06<42:38,  3.56s/it]
Skipping the first batches:  88%|████████▊ | 5283/6000 [5:13:09<41:39,  3.49s/it]
Skipping the first batches:  88%|████████▊ | 5284/6000 [5:13:13<42:35,  3.57s/it]
Skipping the first batches:  88%|████████▊ | 5285/6000 [5:13:16<41:25,  3.48s/it]
Skipping the first batches:  88%|████████▊ | 5286/6000 [5:13:20<42:20,  3.56s/it]
Skipping the first batches:  88%|████████▊ | 5287/6000 [5:13:23<41:12,  3.47s/it]
Skipping the first batches:  88%|████████▊ | 5288/6000 [5:13:26<40:02,  3.37s/it]
Skipping the first batches:  88%|████████▊ | 5289/6000 [5:13:30<40:31,  3.42s/it]
Skipping the first batches:  88%|████████▊ | 5290/6000 [5:13:34<41:52,  3.54s/it]
Skipping the first batches:  88%|████████▊ | 5291/6000 [5:13:37<42:12,  3.57s/it]
Skipping the first batches:  88%|████████▊ | 5292/6000 [5:13:41<41:38,  3.53s/it]
Skipping the first batches:  88%|████████▊ | 5293/6000 [5:13:44<40:02,  3.40s/it]
Skipping the first batches:  88%|████████▊ | 5294/6000 [5:13:48<41:23,  3.52s/it]
Skipping the first batches:  88%|████████▊ | 5295/6000 [5:13:51<40:33,  3.45s/it]
Skipping the first batches:  88%|████████▊ | 5296/6000 [5:13:54<41:02,  3.50s/it]
Skipping the first batches:  88%|████████▊ | 5297/6000 [5:13:58<40:04,  3.42s/it]
Skipping the first batches:  88%|████████▊ | 5298/6000 [5:14:01<40:34,  3.47s/it]
Skipping the first batches:  88%|████████▊ | 5299/6000 [5:14:05<40:22,  3.46s/it]
Skipping the first batches:  88%|████████▊ | 5300/6000 [5:14:08<39:07,  3.35s/it]
Skipping the first batches:  88%|████████▊ | 5301/6000 [5:14:11<39:15,  3.37s/it]
Skipping the first batches:  88%|████████▊ | 5302/6000 [5:14:15<41:07,  3.54s/it]
Skipping the first batches:  88%|████████▊ | 5303/6000 [5:14:18<39:31,  3.40s/it]
Skipping the first batches:  88%|████████▊ | 5304/6000 [5:14:22<40:57,  3.53s/it]
Skipping the first batches:  88%|████████▊ | 5305/6000 [5:14:25<39:24,  3.40s/it]
Skipping the first batches:  88%|████████▊ | 5306/6000 [5:14:29<41:49,  3.62s/it]
Skipping the first batches:  88%|████████▊ | 5307/6000 [5:14:34<44:55,  3.89s/it]
Skipping the first batches:  88%|████████▊ | 5308/6000 [5:14:38<44:17,  3.84s/it]
Skipping the first batches:  88%|████████▊ | 5309/6000 [5:14:41<41:35,  3.61s/it]
Skipping the first batches:  88%|████████▊ | 5310/6000 [5:14:44<42:12,  3.67s/it]
Skipping the first batches:  89%|████████▊ | 5311/6000 [5:14:48<41:57,  3.65s/it]
Skipping the first batches:  89%|████████▊ | 5312/6000 [5:14:51<39:52,  3.48s/it]
Skipping the first batches:  89%|████████▊ | 5313/6000 [5:14:55<40:31,  3.54s/it]
Skipping the first batches:  89%|████████▊ | 5314/6000 [5:14:58<40:11,  3.52s/it]
Skipping the first batches:  89%|████████▊ | 5315/6000 [5:15:01<38:33,  3.38s/it]
Skipping the first batches:  89%|████████▊ | 5316/6000 [5:15:05<39:36,  3.47s/it]
Skipping the first batches:  89%|████████▊ | 5317/6000 [5:15:08<39:09,  3.44s/it]
Skipping the first batches:  89%|████████▊ | 5318/6000 [5:15:12<40:27,  3.56s/it]
Skipping the first batches:  89%|████████▊ | 5319/6000 [5:15:16<39:49,  3.51s/it]
Skipping the first batches:  89%|████████▊ | 5320/6000 [5:15:19<39:43,  3.51s/it]
Skipping the first batches:  89%|████████▊ | 5321/6000 [5:15:23<39:22,  3.48s/it]
Skipping the first batches:  89%|████████▊ | 5322/6000 [5:15:26<37:58,  3.36s/it]
Skipping the first batches:  89%|████████▊ | 5323/6000 [5:15:29<38:00,  3.37s/it]
Skipping the first batches:  89%|████████▊ | 5324/6000 [5:15:33<40:46,  3.62s/it]
Skipping the first batches:  89%|████████▉ | 5325/6000 [5:15:37<41:22,  3.68s/it]
Skipping the first batches:  89%|████████▉ | 5326/6000 [5:15:41<41:41,  3.71s/it]
Skipping the first batches:  89%|████████▉ | 5327/6000 [5:15:45<41:40,  3.72s/it]
Skipping the first batches:  89%|████████▉ | 5328/6000 [5:15:48<41:30,  3.71s/it]
Skipping the first batches:  89%|████████▉ | 5329/6000 [5:15:51<39:57,  3.57s/it]
Skipping the first batches:  89%|████████▉ | 5330/6000 [5:15:55<40:47,  3.65s/it]
Skipping the first batches:  89%|████████▉ | 5331/6000 [5:15:59<40:21,  3.62s/it]
Skipping the first batches:  89%|████████▉ | 5332/6000 [5:16:02<39:08,  3.52s/it]
Skipping the first batches:  89%|████████▉ | 5333/6000 [5:16:05<38:11,  3.43s/it]
Skipping the first batches:  89%|████████▉ | 5334/6000 [5:16:09<39:23,  3.55s/it]
Skipping the first batches:  89%|████████▉ | 5335/6000 [5:16:12<38:19,  3.46s/it]
Skipping the first batches:  89%|████████▉ | 5336/6000 [5:16:16<38:59,  3.52s/it]
Skipping the first batches:  89%|████████▉ | 5337/6000 [5:16:20<40:15,  3.64s/it]
Skipping the first batches:  89%|████████▉ | 5338/6000 [5:16:24<42:14,  3.83s/it]
Skipping the first batches:  89%|████████▉ | 5339/6000 [5:16:29<46:13,  4.20s/it]
Skipping the first batches:  89%|████████▉ | 5340/6000 [5:16:34<46:16,  4.21s/it]
Skipping the first batches:  89%|████████▉ | 5341/6000 [5:16:39<49:01,  4.46s/it]
Skipping the first batches:  89%|████████▉ | 5342/6000 [5:16:43<49:43,  4.53s/it]
Skipping the first batches:  89%|████████▉ | 5343/6000 [5:16:48<50:40,  4.63s/it]
Skipping the first batches:  89%|████████▉ | 5344/6000 [5:16:53<50:34,  4.63s/it]
Skipping the first batches:  89%|████████▉ | 5345/6000 [5:16:57<49:24,  4.53s/it]
Skipping the first batches:  89%|████████▉ | 5346/6000 [5:17:01<48:04,  4.41s/it]
Skipping the first batches:  89%|████████▉ | 5347/6000 [5:17:05<47:01,  4.32s/it]
Skipping the first batches:  89%|████████▉ | 5348/6000 [5:17:10<46:55,  4.32s/it]
Skipping the first batches:  89%|████████▉ | 5349/6000 [5:17:14<47:05,  4.34s/it]
Skipping the first batches:  89%|████████▉ | 5350/6000 [5:17:18<45:59,  4.25s/it]
Skipping the first batches:  89%|████████▉ | 5351/6000 [5:17:22<46:09,  4.27s/it]
Skipping the first batches:  89%|████████▉ | 5352/6000 [5:17:27<47:02,  4.36s/it]
Skipping the first batches:  89%|████████▉ | 5353/6000 [5:17:31<44:50,  4.16s/it]
Skipping the first batches:  89%|████████▉ | 5354/6000 [5:17:34<41:41,  3.87s/it]
Skipping the first batches:  89%|████████▉ | 5355/6000 [5:17:37<40:14,  3.74s/it]
Skipping the first batches:  89%|████████▉ | 5356/6000 [5:17:41<40:23,  3.76s/it]
Skipping the first batches:  89%|████████▉ | 5357/6000 [5:17:46<42:37,  3.98s/it]
Skipping the first batches:  89%|████████▉ | 5358/6000 [5:17:50<45:15,  4.23s/it]
Skipping the first batches:  89%|████████▉ | 5359/6000 [5:17:54<43:04,  4.03s/it]
Skipping the first batches:  89%|████████▉ | 5360/6000 [5:17:59<44:50,  4.20s/it]
Skipping the first batches:  89%|████████▉ | 5361/6000 [5:18:03<45:08,  4.24s/it]
Skipping the first batches:  89%|████████▉ | 5362/6000 [5:18:08<46:47,  4.40s/it]
Skipping the first batches:  89%|████████▉ | 5363/6000 [5:18:11<44:40,  4.21s/it]
Skipping the first batches:  89%|████████▉ | 5364/6000 [5:18:16<44:53,  4.24s/it]
Skipping the first batches:  89%|████████▉ | 5365/6000 [5:18:19<41:51,  3.96s/it]
Skipping the first batches:  89%|████████▉ | 5366/6000 [5:18:23<40:12,  3.81s/it]
Skipping the first batches:  89%|████████▉ | 5367/6000 [5:18:26<37:48,  3.58s/it]
Skipping the first batches:  89%|████████▉ | 5368/6000 [5:18:29<36:51,  3.50s/it]
Skipping the first batches:  89%|████████▉ | 5369/6000 [5:18:32<37:09,  3.53s/it]
Skipping the first batches:  90%|████████▉ | 5370/6000 [5:18:37<38:39,  3.68s/it]
Skipping the first batches:  90%|████████▉ | 5371/6000 [5:18:40<38:12,  3.64s/it]
Skipping the first batches:  90%|████████▉ | 5372/6000 [5:18:45<40:40,  3.89s/it]
Skipping the first batches:  90%|████████▉ | 5373/6000 [5:18:48<38:31,  3.69s/it]
Skipping the first batches:  90%|████████▉ | 5374/6000 [5:18:51<38:30,  3.69s/it]
Skipping the first batches:  90%|████████▉ | 5375/6000 [5:18:55<38:21,  3.68s/it]
Skipping the first batches:  90%|████████▉ | 5376/6000 [5:18:59<39:13,  3.77s/it]
Skipping the first batches:  90%|████████▉ | 5377/6000 [5:19:03<38:42,  3.73s/it]
Skipping the first batches:  90%|████████▉ | 5378/6000 [5:19:06<37:58,  3.66s/it]
Skipping the first batches:  90%|████████▉ | 5379/6000 [5:19:10<38:57,  3.76s/it]
Skipping the first batches:  90%|████████▉ | 5380/6000 [5:19:14<38:00,  3.68s/it]
Skipping the first batches:  90%|████████▉ | 5381/6000 [5:19:17<36:59,  3.59s/it]
Skipping the first batches:  90%|████████▉ | 5382/6000 [5:19:21<38:45,  3.76s/it]
Skipping the first batches:  90%|████████▉ | 5383/6000 [5:19:25<37:14,  3.62s/it]
Skipping the first batches:  90%|████████▉ | 5384/6000 [5:19:28<37:54,  3.69s/it]
Skipping the first batches:  90%|████████▉ | 5385/6000 [5:19:32<36:29,  3.56s/it]
Skipping the first batches:  90%|████████▉ | 5386/6000 [5:19:35<35:41,  3.49s/it]
Skipping the first batches:  90%|████████▉ | 5387/6000 [5:19:38<35:06,  3.44s/it]
Skipping the first batches:  90%|████████▉ | 5388/6000 [5:19:41<34:15,  3.36s/it]
Skipping the first batches:  90%|████████▉ | 5389/6000 [5:19:45<35:24,  3.48s/it]
Skipping the first batches:  90%|████████▉ | 5390/6000 [5:19:49<36:05,  3.55s/it]
Skipping the first batches:  90%|████████▉ | 5391/6000 [5:19:52<34:36,  3.41s/it]
Skipping the first batches:  90%|████████▉ | 5392/6000 [5:19:56<36:59,  3.65s/it]
Skipping the first batches:  90%|████████▉ | 5393/6000 [5:20:00<37:23,  3.70s/it]
Skipping the first batches:  90%|████████▉ | 5394/6000 [5:20:03<35:25,  3.51s/it]
Skipping the first batches:  90%|████████▉ | 5395/6000 [5:20:07<35:41,  3.54s/it]
Skipping the first batches:  90%|████████▉ | 5396/6000 [5:20:10<34:15,  3.40s/it]
Skipping the first batches:  90%|████████▉ | 5397/6000 [5:20:13<33:47,  3.36s/it]
Skipping the first batches:  90%|████████▉ | 5398/6000 [5:20:17<34:33,  3.44s/it]
Skipping the first batches:  90%|████████▉ | 5399/6000 [5:20:20<34:10,  3.41s/it]
Skipping the first batches:  90%|█████████ | 5400/6000 [5:20:23<33:07,  3.31s/it]
Skipping the first batches:  90%|█████████ | 5401/6000 [5:20:27<34:47,  3.49s/it]
Skipping the first batches:  90%|█████████ | 5402/6000 [5:20:30<34:16,  3.44s/it]
Skipping the first batches:  90%|█████████ | 5403/6000 [5:20:34<34:19,  3.45s/it]
Skipping the first batches:  90%|█████████ | 5404/6000 [5:20:37<33:56,  3.42s/it]
Skipping the first batches:  90%|█████████ | 5405/6000 [5:20:40<33:33,  3.38s/it]
Skipping the first batches:  90%|█████████ | 5406/6000 [5:20:44<33:46,  3.41s/it]
Skipping the first batches:  90%|█████████ | 5407/6000 [5:20:48<34:56,  3.54s/it]
Skipping the first batches:  90%|█████████ | 5408/6000 [5:20:51<33:35,  3.40s/it]
Skipping the first batches:  90%|█████████ | 5409/6000 [5:20:55<34:37,  3.52s/it]
Skipping the first batches:  90%|█████████ | 5410/6000 [5:20:58<33:18,  3.39s/it]
Skipping the first batches:  90%|█████████ | 5411/6000 [5:21:01<33:21,  3.40s/it]
Skipping the first batches:  90%|█████████ | 5412/6000 [5:21:05<35:05,  3.58s/it]
Skipping the first batches:  90%|█████████ | 5413/6000 [5:21:09<34:55,  3.57s/it]
Skipping the first batches:  90%|█████████ | 5414/6000 [5:21:12<33:29,  3.43s/it]
Skipping the first batches:  90%|█████████ | 5415/6000 [5:21:15<33:41,  3.46s/it]
Skipping the first batches:  90%|█████████ | 5416/6000 [5:21:19<33:26,  3.44s/it]
Skipping the first batches:  90%|█████████ | 5417/6000 [5:21:22<32:19,  3.33s/it]
Skipping the first batches:  90%|█████████ | 5418/6000 [5:21:25<32:50,  3.39s/it]
Skipping the first batches:  90%|█████████ | 5419/6000 [5:21:29<32:38,  3.37s/it]
Skipping the first batches:  90%|█████████ | 5420/6000 [5:21:32<32:44,  3.39s/it]
Skipping the first batches:  90%|█████████ | 5421/6000 [5:21:36<33:16,  3.45s/it]
Skipping the first batches:  90%|█████████ | 5422/6000 [5:21:40<34:32,  3.59s/it]
Skipping the first batches:  90%|█████████ | 5423/6000 [5:21:43<33:35,  3.49s/it]
Skipping the first batches:  90%|█████████ | 5424/6000 [5:21:47<35:48,  3.73s/it]
Skipping the first batches:  90%|█████████ | 5425/6000 [5:21:51<36:37,  3.82s/it]
Skipping the first batches:  90%|█████████ | 5426/6000 [5:21:54<35:10,  3.68s/it]
Skipping the first batches:  90%|█████████ | 5427/6000 [5:21:58<34:10,  3.58s/it]
Skipping the first batches:  90%|█████████ | 5428/6000 [5:22:01<33:11,  3.48s/it]
Skipping the first batches:  90%|█████████ | 5429/6000 [5:22:05<33:08,  3.48s/it]
Skipping the first batches:  90%|█████████ | 5430/6000 [5:22:08<32:35,  3.43s/it]
Skipping the first batches:  91%|█████████ | 5431/6000 [5:22:11<32:52,  3.47s/it]
Skipping the first batches:  91%|█████████ | 5432/6000 [5:22:15<32:38,  3.45s/it]
Skipping the first batches:  91%|█████████ | 5433/6000 [5:22:18<31:47,  3.36s/it]
Skipping the first batches:  91%|█████████ | 5434/6000 [5:22:22<32:54,  3.49s/it]
Skipping the first batches:  91%|█████████ | 5435/6000 [5:22:25<32:15,  3.42s/it]
Skipping the first batches:  91%|█████████ | 5436/6000 [5:22:29<32:59,  3.51s/it]
Skipping the first batches:  91%|█████████ | 5437/6000 [5:22:32<32:42,  3.49s/it]
Skipping the first batches:  91%|█████████ | 5438/6000 [5:22:36<32:11,  3.44s/it]
Skipping the first batches:  91%|█████████ | 5439/6000 [5:22:39<32:29,  3.48s/it]
Skipping the first batches:  91%|█████████ | 5440/6000 [5:22:42<31:19,  3.36s/it]
Skipping the first batches:  91%|█████████ | 5441/6000 [5:22:46<32:24,  3.48s/it]
Skipping the first batches:  91%|█████████ | 5442/6000 [5:22:49<31:23,  3.38s/it]
Skipping the first batches:  91%|█████████ | 5443/6000 [5:22:53<32:27,  3.50s/it]
Skipping the first batches:  91%|█████████ | 5444/6000 [5:22:56<31:18,  3.38s/it]
Skipping the first batches:  91%|█████████ | 5445/6000 [5:23:00<32:03,  3.47s/it]
Skipping the first batches:  91%|█████████ | 5446/6000 [5:23:03<32:37,  3.53s/it]
Skipping the first batches:  91%|█████████ | 5447/6000 [5:23:07<31:47,  3.45s/it]
Skipping the first batches:  91%|█████████ | 5448/6000 [5:23:10<31:20,  3.41s/it]
Skipping the first batches:  91%|█████████ | 5449/6000 [5:23:14<32:01,  3.49s/it]
Skipping the first batches:  91%|█████████ | 5450/6000 [5:23:17<30:47,  3.36s/it]
Skipping the first batches:  91%|█████████ | 5451/6000 [5:23:20<30:09,  3.30s/it]
Skipping the first batches:  91%|█████████ | 5452/6000 [5:23:24<32:26,  3.55s/it]
Skipping the first batches:  91%|█████████ | 5453/6000 [5:23:27<31:39,  3.47s/it]
Skipping the first batches:  91%|█████████ | 5454/6000 [5:23:31<31:44,  3.49s/it]
Skipping the first batches:  91%|█████████ | 5455/6000 [5:23:35<32:45,  3.61s/it]
Skipping the first batches:  91%|█████████ | 5456/6000 [5:23:38<31:51,  3.51s/it]
Skipping the first batches:  91%|█████████ | 5457/6000 [5:23:43<35:10,  3.89s/it]
Skipping the first batches:  91%|█████████ | 5458/6000 [5:23:46<33:44,  3.73s/it]
Skipping the first batches:  91%|█████████ | 5459/6000 [5:23:49<32:47,  3.64s/it]
Skipping the first batches:  91%|█████████ | 5460/6000 [5:23:53<32:41,  3.63s/it]
Skipping the first batches:  91%|█████████ | 5461/6000 [5:23:57<33:22,  3.71s/it]
Skipping the first batches:  91%|█████████ | 5462/6000 [5:24:00<31:54,  3.56s/it]
Skipping the first batches:  91%|█████████ | 5463/6000 [5:24:03<31:07,  3.48s/it]
Skipping the first batches:  91%|█████████ | 5464/6000 [5:24:07<31:04,  3.48s/it]
Skipping the first batches:  91%|█████████ | 5465/6000 [5:24:11<31:15,  3.50s/it]
Skipping the first batches:  91%|█████████ | 5466/6000 [5:24:14<32:04,  3.60s/it]
Skipping the first batches:  91%|█████████ | 5467/6000 [5:24:18<32:18,  3.64s/it]
Skipping the first batches:  91%|█████████ | 5468/6000 [5:24:23<34:44,  3.92s/it]
Skipping the first batches:  91%|█████████ | 5469/6000 [5:24:27<34:44,  3.93s/it]
Skipping the first batches:  91%|█████████ | 5470/6000 [5:24:30<33:04,  3.74s/it]
Skipping the first batches:  91%|█████████ | 5471/6000 [5:24:34<33:32,  3.80s/it]
Skipping the first batches:  91%|█████████ | 5472/6000 [5:24:37<31:32,  3.58s/it]
Skipping the first batches:  91%|█████████ | 5473/6000 [5:24:40<30:34,  3.48s/it]
Skipping the first batches:  91%|█████████ | 5474/6000 [5:24:44<31:15,  3.57s/it]
Skipping the first batches:  91%|█████████▏| 5475/6000 [5:24:47<31:01,  3.55s/it]
Skipping the first batches:  91%|█████████▏| 5476/6000 [5:24:51<30:08,  3.45s/it]
Skipping the first batches:  91%|█████████▏| 5477/6000 [5:24:55<31:18,  3.59s/it]
Skipping the first batches:  91%|█████████▏| 5478/6000 [5:24:58<30:24,  3.50s/it]
Skipping the first batches:  91%|█████████▏| 5479/6000 [5:25:02<31:07,  3.58s/it]
Skipping the first batches:  91%|█████████▏| 5480/6000 [5:25:05<30:43,  3.54s/it]
Skipping the first batches:  91%|█████████▏| 5481/6000 [5:25:09<30:22,  3.51s/it]
Skipping the first batches:  91%|█████████▏| 5482/6000 [5:25:12<31:22,  3.63s/it]
Skipping the first batches:  91%|█████████▏| 5483/6000 [5:25:16<31:33,  3.66s/it]
Skipping the first batches:  91%|█████████▏| 5484/6000 [5:25:19<30:13,  3.51s/it]
Skipping the first batches:  91%|█████████▏| 5485/6000 [5:25:23<29:52,  3.48s/it]
Skipping the first batches:  91%|█████████▏| 5486/6000 [5:25:26<29:54,  3.49s/it]
Skipping the first batches:  91%|█████████▏| 5487/6000 [5:25:30<30:06,  3.52s/it]
Skipping the first batches:  91%|█████████▏| 5488/6000 [5:25:33<29:49,  3.49s/it]
Skipping the first batches:  91%|█████████▏| 5489/6000 [5:25:37<29:40,  3.48s/it]
Skipping the first batches:  92%|█████████▏| 5490/6000 [5:25:41<30:33,  3.59s/it]
Skipping the first batches:  92%|█████████▏| 5491/6000 [5:25:44<30:08,  3.55s/it]
Skipping the first batches:  92%|█████████▏| 5492/6000 [5:25:47<29:13,  3.45s/it]
Skipping the first batches:  92%|█████████▏| 5493/6000 [5:25:51<29:38,  3.51s/it]
Skipping the first batches:  92%|█████████▏| 5494/6000 [5:25:54<28:56,  3.43s/it]
Skipping the first batches:  92%|█████████▏| 5495/6000 [5:25:57<28:16,  3.36s/it]
Skipping the first batches:  92%|█████████▏| 5496/6000 [5:26:00<27:34,  3.28s/it]
Skipping the first batches:  92%|█████████▏| 5497/6000 [5:26:04<29:02,  3.46s/it]
Skipping the first batches:  92%|█████████▏| 5498/6000 [5:26:08<29:21,  3.51s/it]
Skipping the first batches:  92%|█████████▏| 5499/6000 [5:26:11<28:57,  3.47s/it]
Skipping the first batches:  92%|█████████▏| 5500/6000 [5:26:15<29:24,  3.53s/it]
Skipping the first batches:  92%|█████████▏| 5501/6000 [5:26:18<28:50,  3.47s/it]
Skipping the first batches:  92%|█████████▏| 5502/6000 [5:26:22<28:12,  3.40s/it]
Skipping the first batches:  92%|█████████▏| 5503/6000 [5:26:25<28:56,  3.49s/it]
Skipping the first batches:  92%|█████████▏| 5504/6000 [5:26:28<28:06,  3.40s/it]
Skipping the first batches:  92%|█████████▏| 5505/6000 [5:26:32<28:35,  3.47s/it]
Skipping the first batches:  92%|█████████▏| 5506/6000 [5:26:35<27:50,  3.38s/it]
Skipping the first batches:  92%|█████████▏| 5507/6000 [5:26:39<27:37,  3.36s/it]
Skipping the first batches:  92%|█████████▏| 5508/6000 [5:26:43<30:13,  3.69s/it]
Skipping the first batches:  92%|█████████▏| 5509/6000 [5:26:46<28:57,  3.54s/it]
Skipping the first batches:  92%|█████████▏| 5510/6000 [5:26:50<28:44,  3.52s/it]
Skipping the first batches:  92%|█████████▏| 5511/6000 [5:26:53<29:09,  3.58s/it]
Skipping the first batches:  92%|█████████▏| 5512/6000 [5:26:56<27:51,  3.42s/it]
Skipping the first batches:  92%|█████████▏| 5513/6000 [5:27:00<27:21,  3.37s/it]
Skipping the first batches:  92%|█████████▏| 5514/6000 [5:27:03<28:11,  3.48s/it]
Skipping the first batches:  92%|█████████▏| 5515/6000 [5:27:07<27:12,  3.37s/it]
Skipping the first batches:  92%|█████████▏| 5516/6000 [5:27:10<27:25,  3.40s/it]
Skipping the first batches:  92%|█████████▏| 5517/6000 [5:27:14<28:06,  3.49s/it]
Skipping the first batches:  92%|█████████▏| 5518/6000 [5:27:17<28:17,  3.52s/it]
Skipping the first batches:  92%|█████████▏| 5519/6000 [5:27:21<27:39,  3.45s/it]
Skipping the first batches:  92%|█████████▏| 5520/6000 [5:27:24<28:15,  3.53s/it]
Skipping the first batches:  92%|█████████▏| 5521/6000 [5:27:27<27:08,  3.40s/it]
Skipping the first batches:  92%|█████████▏| 5522/6000 [5:27:30<26:14,  3.29s/it]
Skipping the first batches:  92%|█████████▏| 5523/6000 [5:27:34<26:10,  3.29s/it]
Skipping the first batches:  92%|█████████▏| 5524/6000 [5:27:37<26:44,  3.37s/it]
Skipping the first batches:  92%|█████████▏| 5525/6000 [5:27:41<26:19,  3.33s/it]
Skipping the first batches:  92%|█████████▏| 5526/6000 [5:27:44<27:12,  3.44s/it]
Skipping the first batches:  92%|█████████▏| 5527/6000 [5:27:48<27:08,  3.44s/it]
Skipping the first batches:  92%|█████████▏| 5528/6000 [5:27:51<27:44,  3.53s/it]
Skipping the first batches:  92%|█████████▏| 5529/6000 [5:27:55<28:13,  3.60s/it]
Skipping the first batches:  92%|█████████▏| 5530/6000 [5:27:59<27:35,  3.52s/it]
Skipping the first batches:  92%|█████████▏| 5531/6000 [5:28:02<28:25,  3.64s/it]
Skipping the first batches:  92%|█████████▏| 5532/6000 [5:28:06<27:31,  3.53s/it]
Skipping the first batches:  92%|█████████▏| 5533/6000 [5:28:09<27:26,  3.53s/it]
Skipping the first batches:  92%|█████████▏| 5534/6000 [5:28:13<27:17,  3.51s/it]
Skipping the first batches:  92%|█████████▏| 5535/6000 [5:28:16<27:50,  3.59s/it]
Skipping the first batches:  92%|█████████▏| 5536/6000 [5:28:20<28:27,  3.68s/it]
Skipping the first batches:  92%|█████████▏| 5537/6000 [5:28:24<27:45,  3.60s/it]
Skipping the first batches:  92%|█████████▏| 5538/6000 [5:28:28<29:34,  3.84s/it]
Skipping the first batches:  92%|█████████▏| 5539/6000 [5:28:32<30:25,  3.96s/it]
Skipping the first batches:  92%|█████████▏| 5540/6000 [5:28:36<28:50,  3.76s/it]
Skipping the first batches:  92%|█████████▏| 5541/6000 [5:28:39<28:37,  3.74s/it]
Skipping the first batches:  92%|█████████▏| 5542/6000 [5:28:43<28:34,  3.74s/it]
Skipping the first batches:  92%|█████████▏| 5543/6000 [5:28:46<27:19,  3.59s/it]
Skipping the first batches:  92%|█████████▏| 5544/6000 [5:28:50<27:27,  3.61s/it]
Skipping the first batches:  92%|█████████▏| 5545/6000 [5:28:53<26:23,  3.48s/it]
Skipping the first batches:  92%|█████████▏| 5546/6000 [5:28:57<27:04,  3.58s/it]
Skipping the first batches:  92%|█████████▏| 5547/6000 [5:29:00<26:44,  3.54s/it]
Skipping the first batches:  92%|█████████▏| 5548/6000 [5:29:04<26:19,  3.49s/it]
Skipping the first batches:  92%|█████████▏| 5549/6000 [5:29:07<26:26,  3.52s/it]
Skipping the first batches:  92%|█████████▎| 5550/6000 [5:29:11<27:01,  3.60s/it]
Skipping the first batches:  93%|█████████▎| 5551/6000 [5:29:15<26:16,  3.51s/it]
Skipping the first batches:  93%|█████████▎| 5552/6000 [5:29:18<26:32,  3.55s/it]
Skipping the first batches:  93%|█████████▎| 5553/6000 [5:29:22<26:03,  3.50s/it]
Skipping the first batches:  93%|█████████▎| 5554/6000 [5:29:25<26:25,  3.55s/it]
Skipping the first batches:  93%|█████████▎| 5555/6000 [5:29:29<26:38,  3.59s/it]
Skipping the first batches:  93%|█████████▎| 5556/6000 [5:29:32<25:51,  3.49s/it]
Skipping the first batches:  93%|█████████▎| 5557/6000 [5:29:36<26:15,  3.56s/it]
Skipping the first batches:  93%|█████████▎| 5558/6000 [5:29:40<28:13,  3.83s/it]
Skipping the first batches:  93%|█████████▎| 5559/6000 [5:29:44<27:48,  3.78s/it]
Skipping the first batches:  93%|█████████▎| 5560/6000 [5:29:48<28:18,  3.86s/it]
Skipping the first batches:  93%|█████████▎| 5561/6000 [5:29:52<27:23,  3.74s/it]
Skipping the first batches:  93%|█████████▎| 5562/6000 [5:29:55<26:13,  3.59s/it]
Skipping the first batches:  93%|█████████▎| 5563/6000 [5:29:58<26:10,  3.59s/it]
Skipping the first batches:  93%|█████████▎| 5564/6000 [5:30:02<25:42,  3.54s/it]
Skipping the first batches:  93%|█████████▎| 5565/6000 [5:30:05<25:41,  3.54s/it]
Skipping the first batches:  93%|█████████▎| 5566/6000 [5:30:08<24:41,  3.41s/it]
Skipping the first batches:  93%|█████████▎| 5567/6000 [5:30:12<25:39,  3.56s/it]
Skipping the first batches:  93%|█████████▎| 5568/6000 [5:30:16<24:54,  3.46s/it]
Skipping the first batches:  93%|█████████▎| 5569/6000 [5:30:19<24:03,  3.35s/it]
Skipping the first batches:  93%|█████████▎| 5570/6000 [5:30:22<24:15,  3.38s/it]
Skipping the first batches:  93%|█████████▎| 5571/6000 [5:30:26<24:16,  3.39s/it]
Skipping the first batches:  93%|█████████▎| 5572/6000 [5:30:29<23:55,  3.35s/it]
Skipping the first batches:  93%|█████████▎| 5573/6000 [5:30:33<25:40,  3.61s/it]
Skipping the first batches:  93%|█████████▎| 5574/6000 [5:30:37<25:22,  3.58s/it]
Skipping the first batches:  93%|█████████▎| 5575/6000 [5:30:40<24:20,  3.44s/it]
Skipping the first batches:  93%|█████████▎| 5576/6000 [5:30:43<24:35,  3.48s/it]
Skipping the first batches:  93%|█████████▎| 5577/6000 [5:30:46<23:41,  3.36s/it]
Skipping the first batches:  93%|█████████▎| 5578/6000 [5:30:50<24:51,  3.54s/it]
Skipping the first batches:  93%|█████████▎| 5579/6000 [5:30:54<24:33,  3.50s/it]
Skipping the first batches:  93%|█████████▎| 5580/6000 [5:30:57<24:58,  3.57s/it]
Skipping the first batches:  93%|█████████▎| 5581/6000 [5:31:00<23:51,  3.42s/it]
Skipping the first batches:  93%|█████████▎| 5582/6000 [5:31:05<25:46,  3.70s/it]
Skipping the first batches:  93%|█████████▎| 5583/6000 [5:31:09<25:55,  3.73s/it]
Skipping the first batches:  93%|█████████▎| 5584/6000 [5:31:13<26:14,  3.79s/it]
Skipping the first batches:  93%|█████████▎| 5585/6000 [5:31:16<26:18,  3.80s/it]
Skipping the first batches:  93%|█████████▎| 5586/6000 [5:31:20<26:14,  3.80s/it]
Skipping the first batches:  93%|█████████▎| 5587/6000 [5:31:24<25:17,  3.67s/it]
Skipping the first batches:  93%|█████████▎| 5588/6000 [5:31:27<25:02,  3.65s/it]
Skipping the first batches:  93%|█████████▎| 5589/6000 [5:31:30<24:02,  3.51s/it]
Skipping the first batches:  93%|█████████▎| 5590/6000 [5:31:34<24:39,  3.61s/it]
Skipping the first batches:  93%|█████████▎| 5591/6000 [5:31:37<24:02,  3.53s/it]
Skipping the first batches:  93%|█████████▎| 5592/6000 [5:31:41<23:34,  3.47s/it]
Skipping the first batches:  93%|█████████▎| 5593/6000 [5:31:44<23:36,  3.48s/it]
Skipping the first batches:  93%|█████████▎| 5594/6000 [5:31:48<23:15,  3.44s/it]
Skipping the first batches:  93%|█████████▎| 5595/6000 [5:31:52<24:03,  3.56s/it]
Skipping the first batches:  93%|█████████▎| 5596/6000 [5:31:55<23:21,  3.47s/it]
Skipping the first batches:  93%|█████████▎| 5597/6000 [5:31:58<22:40,  3.38s/it]
Skipping the first batches:  93%|█████████▎| 5598/6000 [5:32:02<23:43,  3.54s/it]
Skipping the first batches:  93%|█████████▎| 5599/6000 [5:32:05<23:03,  3.45s/it]
Skipping the first batches:  93%|█████████▎| 5600/6000 [5:32:08<22:25,  3.36s/it]
Skipping the first batches:  93%|█████████▎| 5601/6000 [5:32:12<22:58,  3.45s/it]
Skipping the first batches:  93%|█████████▎| 5602/6000 [5:32:16<23:20,  3.52s/it]
Skipping the first batches:  93%|█████████▎| 5603/6000 [5:32:19<22:19,  3.37s/it]
Skipping the first batches:  93%|█████████▎| 5604/6000 [5:32:23<24:52,  3.77s/it]
Skipping the first batches:  93%|█████████▎| 5605/6000 [5:32:30<29:58,  4.55s/it]
Skipping the first batches:  93%|█████████▎| 5606/6000 [5:32:34<30:00,  4.57s/it]
Skipping the first batches:  93%|█████████▎| 5607/6000 [5:32:38<28:52,  4.41s/it]
Skipping the first batches:  93%|█████████▎| 5608/6000 [5:32:41<26:16,  4.02s/it]
Skipping the first batches:  93%|█████████▎| 5609/6000 [5:32:45<24:39,  3.78s/it]
Skipping the first batches:  94%|█████████▎| 5610/6000 [5:32:48<24:35,  3.78s/it]
Skipping the first batches:  94%|█████████▎| 5611/6000 [5:32:52<23:09,  3.57s/it]
Skipping the first batches:  94%|█████████▎| 5612/6000 [5:32:55<23:01,  3.56s/it]
Skipping the first batches:  94%|█████████▎| 5613/6000 [5:32:58<22:28,  3.49s/it]
Skipping the first batches:  94%|█████████▎| 5614/6000 [5:33:02<22:41,  3.53s/it]
Skipping the first batches:  94%|█████████▎| 5615/6000 [5:33:05<21:46,  3.39s/it]
Skipping the first batches:  94%|█████████▎| 5616/6000 [5:33:09<22:36,  3.53s/it]
Skipping the first batches:  94%|█████████▎| 5617/6000 [5:33:13<23:21,  3.66s/it]
Skipping the first batches:  94%|█████████▎| 5618/6000 [5:33:16<22:31,  3.54s/it]
Skipping the first batches:  94%|█████████▎| 5619/6000 [5:33:20<22:20,  3.52s/it]
Skipping the first batches:  94%|█████████▎| 5620/6000 [5:33:23<22:10,  3.50s/it]
Skipping the first batches:  94%|█████████▎| 5621/6000 [5:33:26<21:45,  3.44s/it]
Skipping the first batches:  94%|█████████▎| 5622/6000 [5:33:30<21:08,  3.36s/it]
Skipping the first batches:  94%|█████████▎| 5623/6000 [5:33:33<21:23,  3.40s/it]
Skipping the first batches:  94%|█████████▎| 5624/6000 [5:33:36<21:19,  3.40s/it]
Skipping the first batches:  94%|█████████▍| 5625/6000 [5:33:40<20:55,  3.35s/it]
Skipping the first batches:  94%|█████████▍| 5626/6000 [5:33:44<22:55,  3.68s/it]
Skipping the first batches:  94%|█████████▍| 5627/6000 [5:33:48<22:50,  3.67s/it]
Skipping the first batches:  94%|█████████▍| 5628/6000 [5:33:52<23:17,  3.76s/it]
Skipping the first batches:  94%|█████████▍| 5629/6000 [5:33:56<23:53,  3.86s/it]
Skipping the first batches:  94%|█████████▍| 5630/6000 [5:33:59<22:28,  3.65s/it]
Skipping the first batches:  94%|█████████▍| 5631/6000 [5:34:02<21:49,  3.55s/it]
Skipping the first batches:  94%|█████████▍| 5632/6000 [5:34:06<22:17,  3.64s/it]
Skipping the first batches:  94%|█████████▍| 5633/6000 [5:34:09<21:35,  3.53s/it]
Skipping the first batches:  94%|█████████▍| 5634/6000 [5:34:13<21:51,  3.58s/it]
Skipping the first batches:  94%|█████████▍| 5635/6000 [5:34:17<22:31,  3.70s/it]
Skipping the first batches:  94%|█████████▍| 5636/6000 [5:34:21<22:04,  3.64s/it]
Skipping the first batches:  94%|█████████▍| 5637/6000 [5:34:24<21:28,  3.55s/it]
Skipping the first batches:  94%|█████████▍| 5638/6000 [5:34:30<25:00,  4.15s/it]
Skipping the first batches:  94%|█████████▍| 5639/6000 [5:34:33<24:23,  4.05s/it]
Skipping the first batches:  94%|█████████▍| 5640/6000 [5:34:37<22:42,  3.78s/it]
Skipping the first batches:  94%|█████████▍| 5641/6000 [5:34:41<24:07,  4.03s/it]
Skipping the first batches:  94%|█████████▍| 5642/6000 [5:34:44<22:37,  3.79s/it]
Skipping the first batches:  94%|█████████▍| 5643/6000 [5:34:48<22:17,  3.75s/it]
Skipping the first batches:  94%|█████████▍| 5644/6000 [5:34:54<25:25,  4.28s/it]
Skipping the first batches:  94%|█████████▍| 5645/6000 [5:34:57<24:10,  4.09s/it]
Skipping the first batches:  94%|█████████▍| 5646/6000 [5:35:01<22:48,  3.87s/it]
Skipping the first batches:  94%|█████████▍| 5647/6000 [5:35:04<21:41,  3.69s/it]
Skipping the first batches:  94%|█████████▍| 5648/6000 [5:35:07<21:35,  3.68s/it]
Skipping the first batches:  94%|█████████▍| 5649/6000 [5:35:11<21:33,  3.68s/it]
Skipping the first batches:  94%|█████████▍| 5650/6000 [5:35:15<21:58,  3.77s/it]
Skipping the first batches:  94%|█████████▍| 5651/6000 [5:35:18<21:00,  3.61s/it]
Skipping the first batches:  94%|█████████▍| 5652/6000 [5:35:22<21:01,  3.63s/it]
Skipping the first batches:  94%|█████████▍| 5653/6000 [5:35:25<20:31,  3.55s/it]
Skipping the first batches:  94%|█████████▍| 5654/6000 [5:35:29<20:07,  3.49s/it]
Skipping the first batches:  94%|█████████▍| 5655/6000 [5:35:33<21:07,  3.68s/it]
Skipping the first batches:  94%|█████████▍| 5656/6000 [5:35:36<20:44,  3.62s/it]
Skipping the first batches:  94%|█████████▍| 5657/6000 [5:35:40<20:05,  3.51s/it]
Skipping the first batches:  94%|█████████▍| 5658/6000 [5:35:43<19:19,  3.39s/it]
Skipping the first batches:  94%|█████████▍| 5659/6000 [5:35:46<19:58,  3.51s/it]
Skipping the first batches:  94%|█████████▍| 5660/6000 [5:35:50<19:30,  3.44s/it]
Skipping the first batches:  94%|█████████▍| 5661/6000 [5:35:53<18:52,  3.34s/it]
Skipping the first batches:  94%|█████████▍| 5662/6000 [5:35:56<18:58,  3.37s/it]
Skipping the first batches:  94%|█████████▍| 5663/6000 [5:36:00<19:17,  3.43s/it]
Skipping the first batches:  94%|█████████▍| 5664/6000 [5:36:03<18:39,  3.33s/it]
Skipping the first batches:  94%|█████████▍| 5665/6000 [5:36:07<19:08,  3.43s/it]
Skipping the first batches:  94%|█████████▍| 5666/6000 [5:36:11<20:08,  3.62s/it]
Skipping the first batches:  94%|█████████▍| 5667/6000 [5:36:14<19:16,  3.47s/it]
Skipping the first batches:  94%|█████████▍| 5668/6000 [5:36:17<19:03,  3.44s/it]
Skipping the first batches:  94%|█████████▍| 5669/6000 [5:36:21<18:47,  3.41s/it]
Skipping the first batches:  94%|█████████▍| 5670/6000 [5:36:24<18:11,  3.31s/it]
Skipping the first batches:  95%|█████████▍| 5671/6000 [5:36:28<19:07,  3.49s/it]
Skipping the first batches:  95%|█████████▍| 5672/6000 [5:36:31<19:22,  3.54s/it]
Skipping the first batches:  95%|█████████▍| 5673/6000 [5:36:34<18:42,  3.43s/it]
Skipping the first batches:  95%|█████████▍| 5674/6000 [5:36:38<19:17,  3.55s/it]
Skipping the first batches:  95%|█████████▍| 5675/6000 [5:36:42<19:34,  3.61s/it]
Skipping the first batches:  95%|█████████▍| 5676/6000 [5:36:45<18:59,  3.52s/it]
Skipping the first batches:  95%|█████████▍| 5677/6000 [5:36:49<18:54,  3.51s/it]
Skipping the first batches:  95%|█████████▍| 5678/6000 [5:36:52<19:02,  3.55s/it]
Skipping the first batches:  95%|█████████▍| 5679/6000 [5:36:56<19:16,  3.60s/it]
Skipping the first batches:  95%|█████████▍| 5680/6000 [5:36:59<18:25,  3.46s/it]
Skipping the first batches:  95%|█████████▍| 5681/6000 [5:37:03<18:15,  3.43s/it]
Skipping the first batches:  95%|█████████▍| 5682/6000 [5:37:07<19:40,  3.71s/it]
Skipping the first batches:  95%|█████████▍| 5683/6000 [5:37:12<21:10,  4.01s/it]
Skipping the first batches:  95%|█████████▍| 5684/6000 [5:37:15<20:38,  3.92s/it]
Skipping the first batches:  95%|█████████▍| 5685/6000 [5:37:19<19:50,  3.78s/it]
Skipping the first batches:  95%|█████████▍| 5686/6000 [5:37:23<20:22,  3.89s/it]
Skipping the first batches:  95%|█████████▍| 5687/6000 [5:37:26<19:24,  3.72s/it]
Skipping the first batches:  95%|█████████▍| 5688/6000 [5:37:30<18:51,  3.63s/it]
Skipping the first batches:  95%|█████████▍| 5689/6000 [5:37:33<18:49,  3.63s/it]
Skipping the first batches:  95%|█████████▍| 5690/6000 [5:37:37<18:23,  3.56s/it]
Skipping the first batches:  95%|█████████▍| 5691/6000 [5:37:40<18:07,  3.52s/it]
Skipping the first batches:  95%|█████████▍| 5692/6000 [5:37:43<17:27,  3.40s/it]
Skipping the first batches:  95%|█████████▍| 5693/6000 [5:37:47<18:22,  3.59s/it]
Skipping the first batches:  95%|█████████▍| 5694/6000 [5:37:51<18:04,  3.55s/it]
Skipping the first batches:  95%|█████████▍| 5695/6000 [5:37:54<17:22,  3.42s/it]
Skipping the first batches:  95%|█████████▍| 5696/6000 [5:37:57<17:19,  3.42s/it]
Skipping the first batches:  95%|█████████▍| 5697/6000 [5:38:01<17:48,  3.53s/it]
Skipping the first batches:  95%|█████████▍| 5698/6000 [5:38:04<17:22,  3.45s/it]
Skipping the first batches:  95%|█████████▍| 5699/6000 [5:38:08<17:37,  3.51s/it]
Skipping the first batches:  95%|█████████▌| 5700/6000 [5:38:11<17:06,  3.42s/it]
Skipping the first batches:  95%|█████████▌| 5701/6000 [5:38:15<16:56,  3.40s/it]
Skipping the first batches:  95%|█████████▌| 5702/6000 [5:38:18<16:43,  3.37s/it]
Skipping the first batches:  95%|█████████▌| 5703/6000 [5:38:21<16:47,  3.39s/it]
Skipping the first batches:  95%|█████████▌| 5704/6000 [5:38:25<17:14,  3.50s/it]
Skipping the first batches:  95%|█████████▌| 5705/6000 [5:38:28<16:54,  3.44s/it]
Skipping the first batches:  95%|█████████▌| 5706/6000 [5:38:32<16:34,  3.38s/it]
Skipping the first batches:  95%|█████████▌| 5707/6000 [5:38:35<16:42,  3.42s/it]
Skipping the first batches:  95%|█████████▌| 5708/6000 [5:38:39<17:01,  3.50s/it]
Skipping the first batches:  95%|█████████▌| 5709/6000 [5:38:43<17:48,  3.67s/it]
Skipping the first batches:  95%|█████████▌| 5710/6000 [5:38:47<17:49,  3.69s/it]
Skipping the first batches:  95%|█████████▌| 5711/6000 [5:38:50<17:50,  3.70s/it]
Skipping the first batches:  95%|█████████▌| 5712/6000 [5:38:54<17:52,  3.72s/it]
Skipping the first batches:  95%|█████████▌| 5713/6000 [5:38:58<17:22,  3.63s/it]
Skipping the first batches:  95%|█████████▌| 5714/6000 [5:39:01<16:47,  3.52s/it]
Skipping the first batches:  95%|█████████▌| 5715/6000 [5:39:04<16:16,  3.43s/it]
Skipping the first batches:  95%|█████████▌| 5716/6000 [5:39:08<16:56,  3.58s/it]
Skipping the first batches:  95%|█████████▌| 5717/6000 [5:39:11<16:12,  3.44s/it]
Skipping the first batches:  95%|█████████▌| 5718/6000 [5:39:15<17:19,  3.69s/it]
Skipping the first batches:  95%|█████████▌| 5719/6000 [5:39:19<16:53,  3.61s/it]
Skipping the first batches:  95%|█████████▌| 5720/6000 [5:39:22<16:33,  3.55s/it]
Skipping the first batches:  95%|█████████▌| 5721/6000 [5:39:26<16:38,  3.58s/it]
Skipping the first batches:  95%|█████████▌| 5722/6000 [5:39:29<16:20,  3.53s/it]
Skipping the first batches:  95%|█████████▌| 5723/6000 [5:39:32<15:37,  3.38s/it]
Skipping the first batches:  95%|█████████▌| 5724/6000 [5:39:36<15:39,  3.40s/it]
Skipping the first batches:  95%|█████████▌| 5725/6000 [5:39:39<15:12,  3.32s/it]
Skipping the first batches:  95%|█████████▌| 5726/6000 [5:39:43<15:40,  3.43s/it]
Skipping the first batches:  95%|█████████▌| 5727/6000 [5:39:46<15:44,  3.46s/it]
Skipping the first batches:  95%|█████████▌| 5728/6000 [5:39:50<16:24,  3.62s/it]
Skipping the first batches:  95%|█████████▌| 5729/6000 [5:39:54<17:02,  3.77s/it]
Skipping the first batches:  96%|█████████▌| 5730/6000 [5:39:57<16:08,  3.59s/it]
Skipping the first batches:  96%|█████████▌| 5731/6000 [5:40:01<16:22,  3.65s/it]
Skipping the first batches:  96%|█████████▌| 5732/6000 [5:40:05<16:16,  3.65s/it]
Skipping the first batches:  96%|█████████▌| 5733/6000 [5:40:08<16:13,  3.65s/it]
Skipping the first batches:  96%|█████████▌| 5734/6000 [5:40:12<16:14,  3.66s/it]
Skipping the first batches:  96%|█████████▌| 5735/6000 [5:40:16<15:59,  3.62s/it]
Skipping the first batches:  96%|█████████▌| 5736/6000 [5:40:19<15:51,  3.60s/it]
Skipping the first batches:  96%|█████████▌| 5737/6000 [5:40:23<15:48,  3.61s/it]
Skipping the first batches:  96%|█████████▌| 5738/6000 [5:40:26<15:30,  3.55s/it]
Skipping the first batches:  96%|█████████▌| 5739/6000 [5:40:30<15:34,  3.58s/it]
Skipping the first batches:  96%|█████████▌| 5740/6000 [5:40:34<15:41,  3.62s/it]
Skipping the first batches:  96%|█████████▌| 5741/6000 [5:40:37<15:21,  3.56s/it]
Skipping the first batches:  96%|█████████▌| 5742/6000 [5:40:40<15:09,  3.53s/it]
Skipping the first batches:  96%|█████████▌| 5743/6000 [5:40:44<15:28,  3.61s/it]
Skipping the first batches:  96%|█████████▌| 5744/6000 [5:40:47<14:51,  3.48s/it]
Skipping the first batches:  96%|█████████▌| 5745/6000 [5:40:51<15:07,  3.56s/it]
Skipping the first batches:  96%|█████████▌| 5746/6000 [5:40:55<14:54,  3.52s/it]
Skipping the first batches:  96%|█████████▌| 5747/6000 [5:40:58<14:38,  3.47s/it]
Skipping the first batches:  96%|█████████▌| 5748/6000 [5:41:01<14:06,  3.36s/it]
Skipping the first batches:  96%|█████████▌| 5749/6000 [5:41:05<14:57,  3.58s/it]
Skipping the first batches:  96%|█████████▌| 5750/6000 [5:41:09<14:52,  3.57s/it]
Skipping the first batches:  96%|█████████▌| 5751/6000 [5:41:12<14:15,  3.44s/it]
Skipping the first batches:  96%|█████████▌| 5752/6000 [5:41:16<15:43,  3.81s/it]
Skipping the first batches:  96%|█████████▌| 5753/6000 [5:41:20<15:07,  3.67s/it]
Skipping the first batches:  96%|█████████▌| 5754/6000 [5:41:23<14:48,  3.61s/it]
Skipping the first batches:  96%|█████████▌| 5755/6000 [5:41:27<14:20,  3.51s/it]
Skipping the first batches:  96%|█████████▌| 5756/6000 [5:41:30<14:08,  3.48s/it]
Skipping the first batches:  96%|█████████▌| 5757/6000 [5:41:33<13:49,  3.41s/it]
Skipping the first batches:  96%|█████████▌| 5758/6000 [5:41:37<13:48,  3.43s/it]
Skipping the first batches:  96%|█████████▌| 5759/6000 [5:41:40<13:47,  3.43s/it]
Skipping the first batches:  96%|█████████▌| 5760/6000 [5:41:44<13:57,  3.49s/it]
Skipping the first batches:  96%|█████████▌| 5761/6000 [5:41:47<13:48,  3.47s/it]
Skipping the first batches:  96%|█████████▌| 5762/6000 [5:41:51<13:57,  3.52s/it]
Skipping the first batches:  96%|█████████▌| 5763/6000 [5:41:54<13:40,  3.46s/it]
Skipping the first batches:  96%|█████████▌| 5764/6000 [5:41:58<13:37,  3.46s/it]
Skipping the first batches:  96%|█████████▌| 5765/6000 [5:42:01<13:23,  3.42s/it]
Skipping the first batches:  96%|█████████▌| 5766/6000 [5:42:04<13:05,  3.36s/it]
Skipping the first batches:  96%|█████████▌| 5767/6000 [5:42:08<13:38,  3.51s/it]
Skipping the first batches:  96%|█████████▌| 5768/6000 [5:42:12<13:38,  3.53s/it]
Skipping the first batches:  96%|█████████▌| 5769/6000 [5:42:15<13:42,  3.56s/it]
Skipping the first batches:  96%|█████████▌| 5770/6000 [5:42:19<13:50,  3.61s/it]
Skipping the first batches:  96%|█████████▌| 5771/6000 [5:42:23<13:59,  3.67s/it]
Skipping the first batches:  96%|█████████▌| 5772/6000 [5:42:27<14:09,  3.73s/it]
Skipping the first batches:  96%|█████████▌| 5773/6000 [5:42:31<14:22,  3.80s/it]
Skipping the first batches:  96%|█████████▌| 5774/6000 [5:42:35<14:30,  3.85s/it]
Skipping the first batches:  96%|█████████▋| 5775/6000 [5:42:39<14:59,  4.00s/it]
Skipping the first batches:  96%|█████████▋| 5776/6000 [5:42:43<14:29,  3.88s/it]
Skipping the first batches:  96%|█████████▋| 5777/6000 [5:42:46<13:49,  3.72s/it]
Skipping the first batches:  96%|█████████▋| 5778/6000 [5:42:49<13:09,  3.55s/it]
Skipping the first batches:  96%|█████████▋| 5779/6000 [5:42:53<13:03,  3.54s/it]
Skipping the first batches:  96%|█████████▋| 5780/6000 [5:42:56<12:54,  3.52s/it]
Skipping the first batches:  96%|█████████▋| 5781/6000 [5:43:00<12:55,  3.54s/it]
Skipping the first batches:  96%|█████████▋| 5782/6000 [5:43:04<13:29,  3.71s/it]
Skipping the first batches:  96%|█████████▋| 5783/6000 [5:43:07<13:14,  3.66s/it]
Skipping the first batches:  96%|█████████▋| 5784/6000 [5:43:11<12:49,  3.56s/it]
Skipping the first batches:  96%|█████████▋| 5785/6000 [5:43:14<12:33,  3.51s/it]
Skipping the first batches:  96%|█████████▋| 5786/6000 [5:43:17<12:28,  3.50s/it]
Skipping the first batches:  96%|█████████▋| 5787/6000 [5:43:21<11:59,  3.38s/it]
Skipping the first batches:  96%|█████████▋| 5788/6000 [5:43:24<12:17,  3.48s/it]
Skipping the first batches:  96%|█████████▋| 5789/6000 [5:43:27<11:51,  3.37s/it]
Skipping the first batches:  96%|█████████▋| 5790/6000 [5:43:31<11:53,  3.40s/it]
Skipping the first batches:  97%|█████████▋| 5791/6000 [5:43:34<11:39,  3.35s/it]
Skipping the first batches:  97%|█████████▋| 5792/6000 [5:43:39<13:26,  3.88s/it]
Skipping the first batches:  97%|█████████▋| 5793/6000 [5:43:43<13:08,  3.81s/it]
Skipping the first batches:  97%|█████████▋| 5794/6000 [5:43:46<12:30,  3.65s/it]
Skipping the first batches:  97%|█████████▋| 5795/6000 [5:43:50<13:12,  3.86s/it]
Skipping the first batches:  97%|█████████▋| 5796/6000 [5:43:54<12:34,  3.70s/it]
Skipping the first batches:  97%|█████████▋| 5797/6000 [5:43:57<12:06,  3.58s/it]
Skipping the first batches:  97%|█████████▋| 5798/6000 [5:44:00<11:34,  3.44s/it]
Skipping the first batches:  97%|█████████▋| 5799/6000 [5:44:04<12:15,  3.66s/it]
Skipping the first batches:  97%|█████████▋| 5800/6000 [5:44:08<11:59,  3.60s/it]
Skipping the first batches:  97%|█████████▋| 5801/6000 [5:44:11<11:32,  3.48s/it]
Skipping the first batches:  97%|█████████▋| 5802/6000 [5:44:15<11:59,  3.63s/it]
Skipping the first batches:  97%|█████████▋| 5803/6000 [5:44:20<13:08,  4.00s/it]
Skipping the first batches:  97%|█████████▋| 5804/6000 [5:44:23<12:24,  3.80s/it]
Skipping the first batches:  97%|█████████▋| 5805/6000 [5:44:26<11:40,  3.59s/it]
Skipping the first batches:  97%|█████████▋| 5806/6000 [5:44:30<11:30,  3.56s/it]
Skipping the first batches:  97%|█████████▋| 5807/6000 [5:44:34<11:51,  3.69s/it]
Skipping the first batches:  97%|█████████▋| 5808/6000 [5:44:37<11:25,  3.57s/it]
Skipping the first batches:  97%|█████████▋| 5809/6000 [5:44:40<11:09,  3.51s/it]
Skipping the first batches:  97%|█████████▋| 5810/6000 [5:44:44<11:03,  3.49s/it]
Skipping the first batches:  97%|█████████▋| 5811/6000 [5:44:47<10:57,  3.48s/it]
Skipping the first batches:  97%|█████████▋| 5812/6000 [5:44:51<11:14,  3.59s/it]
Skipping the first batches:  97%|█████████▋| 5813/6000 [5:44:54<10:52,  3.49s/it]
Skipping the first batches:  97%|█████████▋| 5814/6000 [5:44:58<10:55,  3.52s/it]
Skipping the first batches:  97%|█████████▋| 5815/6000 [5:45:02<11:02,  3.58s/it]
Skipping the first batches:  97%|█████████▋| 5816/6000 [5:45:05<10:44,  3.50s/it]
Skipping the first batches:  97%|█████████▋| 5817/6000 [5:45:09<10:40,  3.50s/it]
Skipping the first batches:  97%|█████████▋| 5818/6000 [5:45:13<11:00,  3.63s/it]
Skipping the first batches:  97%|█████████▋| 5819/6000 [5:45:16<10:29,  3.48s/it]
Skipping the first batches:  97%|█████████▋| 5820/6000 [5:45:19<10:16,  3.43s/it]
Skipping the first batches:  97%|█████████▋| 5821/6000 [5:45:24<11:39,  3.91s/it]
Skipping the first batches:  97%|█████████▋| 5822/6000 [5:45:28<11:39,  3.93s/it]
Skipping the first batches:  97%|█████████▋| 5823/6000 [5:45:31<10:54,  3.70s/it]
Skipping the first batches:  97%|█████████▋| 5824/6000 [5:45:35<11:04,  3.77s/it]
Skipping the first batches:  97%|█████████▋| 5825/6000 [5:45:39<11:01,  3.78s/it]
Skipping the first batches:  97%|█████████▋| 5826/6000 [5:45:44<12:12,  4.21s/it]
Skipping the first batches:  97%|█████████▋| 5827/6000 [5:45:50<13:11,  4.58s/it]
Skipping the first batches:  97%|█████████▋| 5828/6000 [5:45:55<14:20,  5.00s/it]
Skipping the first batches:  97%|█████████▋| 5829/6000 [5:46:01<14:44,  5.17s/it]
Skipping the first batches:  97%|█████████▋| 5830/6000 [5:46:06<14:48,  5.23s/it]
Skipping the first batches:  97%|█████████▋| 5831/6000 [5:46:11<14:10,  5.03s/it]
Skipping the first batches:  97%|█████████▋| 5832/6000 [5:46:15<12:51,  4.59s/it]
Skipping the first batches:  97%|█████████▋| 5833/6000 [5:46:18<11:33,  4.15s/it]
Skipping the first batches:  97%|█████████▋| 5834/6000 [5:46:21<11:05,  4.01s/it]
Skipping the first batches:  97%|█████████▋| 5835/6000 [5:46:25<10:45,  3.91s/it]
Skipping the first batches:  97%|█████████▋| 5836/6000 [5:46:28<10:15,  3.75s/it]
Skipping the first batches:  97%|█████████▋| 5837/6000 [5:46:32<09:50,  3.62s/it]
Skipping the first batches:  97%|█████████▋| 5838/6000 [5:46:36<09:54,  3.67s/it]
Skipping the first batches:  97%|█████████▋| 5839/6000 [5:46:39<10:04,  3.75s/it]
Skipping the first batches:  97%|█████████▋| 5840/6000 [5:46:43<09:39,  3.62s/it]
Skipping the first batches:  97%|█████████▋| 5841/6000 [5:46:46<09:18,  3.51s/it]
Skipping the first batches:  97%|█████████▋| 5842/6000 [5:46:50<09:58,  3.79s/it]
Skipping the first batches:  97%|█████████▋| 5843/6000 [5:46:56<11:12,  4.28s/it]
Skipping the first batches:  97%|█████████▋| 5844/6000 [5:47:01<11:47,  4.54s/it]
Skipping the first batches:  97%|█████████▋| 5845/6000 [5:47:05<11:28,  4.44s/it]
Skipping the first batches:  97%|█████████▋| 5846/6000 [5:47:09<10:48,  4.21s/it]
Skipping the first batches:  97%|█████████▋| 5847/6000 [5:47:14<11:26,  4.49s/it]
Skipping the first batches:  97%|█████████▋| 5848/6000 [5:47:19<11:59,  4.73s/it]
Skipping the first batches:  97%|█████████▋| 5849/6000 [5:47:24<11:47,  4.69s/it]
Skipping the first batches:  98%|█████████▊| 5850/6000 [5:47:27<10:49,  4.33s/it]
Skipping the first batches:  98%|█████████▊| 5851/6000 [5:47:32<10:43,  4.32s/it]
Skipping the first batches:  98%|█████████▊| 5852/6000 [5:47:35<10:05,  4.09s/it]
Skipping the first batches:  98%|█████████▊| 5853/6000 [5:47:39<09:36,  3.92s/it]
Skipping the first batches:  98%|█████████▊| 5854/6000 [5:47:42<09:10,  3.77s/it]
Skipping the first batches:  98%|█████████▊| 5855/6000 [5:47:46<08:46,  3.63s/it]
Skipping the first batches:  98%|█████████▊| 5856/6000 [5:47:51<09:57,  4.15s/it]
Skipping the first batches:  98%|█████████▊| 5857/6000 [5:47:56<10:22,  4.35s/it]
Skipping the first batches:  98%|█████████▊| 5858/6000 [5:47:59<09:41,  4.10s/it]
Skipping the first batches:  98%|█████████▊| 5859/6000 [5:48:03<09:04,  3.86s/it]
Skipping the first batches:  98%|█████████▊| 5860/6000 [5:48:06<08:28,  3.63s/it]
Skipping the first batches:  98%|█████████▊| 5861/6000 [5:48:09<08:02,  3.47s/it]
Skipping the first batches:  98%|█████████▊| 5862/6000 [5:48:13<08:23,  3.65s/it]
Skipping the first batches:  98%|█████████▊| 5863/6000 [5:48:16<08:08,  3.56s/it]
Skipping the first batches:  98%|█████████▊| 5864/6000 [5:48:19<07:48,  3.44s/it]
Skipping the first batches:  98%|█████████▊| 5865/6000 [5:48:23<07:52,  3.50s/it]
Skipping the first batches:  98%|█████████▊| 5866/6000 [5:48:26<07:42,  3.45s/it]
Skipping the first batches:  98%|█████████▊| 5867/6000 [5:48:30<07:31,  3.40s/it]
Skipping the first batches:  98%|█████████▊| 5868/6000 [5:48:33<07:37,  3.46s/it]
Skipping the first batches:  98%|█████████▊| 5869/6000 [5:48:36<07:26,  3.41s/it]
Skipping the first batches:  98%|█████████▊| 5870/6000 [5:48:40<07:20,  3.39s/it]
Skipping the first batches:  98%|█████████▊| 5871/6000 [5:48:43<07:25,  3.45s/it]
Skipping the first batches:  98%|█████████▊| 5872/6000 [5:48:47<07:31,  3.52s/it]
Skipping the first batches:  98%|█████████▊| 5873/6000 [5:48:50<07:20,  3.47s/it]
Skipping the first batches:  98%|█████████▊| 5874/6000 [5:48:54<07:11,  3.42s/it]
Skipping the first batches:  98%|█████████▊| 5875/6000 [5:48:57<07:04,  3.40s/it]
Skipping the first batches:  98%|█████████▊| 5876/6000 [5:49:01<07:13,  3.49s/it]
Skipping the first batches:  98%|█████████▊| 5877/6000 [5:49:04<07:03,  3.44s/it]
Skipping the first batches:  98%|█████████▊| 5878/6000 [5:49:09<07:33,  3.72s/it]
Skipping the first batches:  98%|█████████▊| 5879/6000 [5:49:12<07:31,  3.73s/it]
Skipping the first batches:  98%|█████████▊| 5880/6000 [5:49:16<07:20,  3.67s/it]
Skipping the first batches:  98%|█████████▊| 5881/6000 [5:49:19<07:14,  3.65s/it]
Skipping the first batches:  98%|█████████▊| 5882/6000 [5:49:23<07:03,  3.59s/it]
Skipping the first batches:  98%|█████████▊| 5883/6000 [5:49:26<06:44,  3.46s/it]
Skipping the first batches:  98%|█████████▊| 5884/6000 [5:49:30<07:07,  3.68s/it]
Skipping the first batches:  98%|█████████▊| 5885/6000 [5:49:33<06:46,  3.53s/it]
Skipping the first batches:  98%|█████████▊| 5886/6000 [5:49:37<06:49,  3.59s/it]
Skipping the first batches:  98%|█████████▊| 5887/6000 [5:49:42<07:38,  4.06s/it]
Skipping the first batches:  98%|█████████▊| 5888/6000 [5:49:45<07:01,  3.76s/it]
Skipping the first batches:  98%|█████████▊| 5889/6000 [5:49:49<06:44,  3.65s/it]
Skipping the first batches:  98%|█████████▊| 5890/6000 [5:49:53<06:50,  3.74s/it]
Skipping the first batches:  98%|█████████▊| 5891/6000 [5:49:56<06:39,  3.67s/it]
Skipping the first batches:  98%|█████████▊| 5892/6000 [5:50:00<06:25,  3.57s/it]
Skipping the first batches:  98%|█████████▊| 5893/6000 [5:50:03<06:23,  3.58s/it]
Skipping the first batches:  98%|█████████▊| 5894/6000 [5:50:06<06:09,  3.48s/it]
Skipping the first batches:  98%|█████████▊| 5895/6000 [5:50:10<05:56,  3.39s/it]
Skipping the first batches:  98%|█████████▊| 5896/6000 [5:50:13<05:49,  3.36s/it]
Skipping the first batches:  98%|█████████▊| 5897/6000 [5:50:17<05:55,  3.45s/it]
Skipping the first batches:  98%|█████████▊| 5898/6000 [5:50:22<06:42,  3.95s/it]
Skipping the first batches:  98%|█████████▊| 5899/6000 [5:50:25<06:23,  3.79s/it]
Skipping the first batches:  98%|█████████▊| 5900/6000 [5:50:29<06:14,  3.74s/it]
Skipping the first batches:  98%|█████████▊| 5901/6000 [5:50:32<05:59,  3.63s/it]
Skipping the first batches:  98%|█████████▊| 5902/6000 [5:50:36<05:50,  3.58s/it]
Skipping the first batches:  98%|█████████▊| 5903/6000 [5:50:39<05:52,  3.64s/it]
Skipping the first batches:  98%|█████████▊| 5904/6000 [5:50:42<05:33,  3.47s/it]
Skipping the first batches:  98%|█████████▊| 5905/6000 [5:50:46<05:24,  3.42s/it]
Skipping the first batches:  98%|█████████▊| 5906/6000 [5:50:50<05:47,  3.69s/it]
Skipping the first batches:  98%|█████████▊| 5907/6000 [5:50:53<05:25,  3.50s/it]
Skipping the first batches:  98%|█████████▊| 5908/6000 [5:50:57<05:42,  3.72s/it]
Skipping the first batches:  98%|█████████▊| 5909/6000 [5:51:01<05:32,  3.65s/it]
Skipping the first batches:  98%|█████████▊| 5910/6000 [5:51:04<05:17,  3.52s/it]
Skipping the first batches:  99%|█████████▊| 5911/6000 [5:51:08<05:21,  3.61s/it]
Skipping the first batches:  99%|█████████▊| 5912/6000 [5:51:11<05:13,  3.56s/it]
Skipping the first batches:  99%|█████████▊| 5913/6000 [5:51:15<05:21,  3.69s/it]
Skipping the first batches:  99%|█████████▊| 5914/6000 [5:51:18<05:02,  3.52s/it]
Skipping the first batches:  99%|█████████▊| 5915/6000 [5:51:22<05:01,  3.54s/it]
Skipping the first batches:  99%|█████████▊| 5916/6000 [5:51:26<05:10,  3.69s/it]
Skipping the first batches:  99%|█████████▊| 5917/6000 [5:51:29<04:52,  3.53s/it]
Skipping the first batches:  99%|█████████▊| 5918/6000 [5:51:33<04:48,  3.51s/it]
Skipping the first batches:  99%|█████████▊| 5919/6000 [5:51:38<05:21,  3.97s/it]
Skipping the first batches:  99%|█████████▊| 5920/6000 [5:51:41<04:57,  3.72s/it]
Skipping the first batches:  99%|█████████▊| 5921/6000 [5:51:45<04:57,  3.76s/it]
Skipping the first batches:  99%|█████████▊| 5922/6000 [5:51:48<04:47,  3.68s/it]
Skipping the first batches:  99%|█████████▊| 5923/6000 [5:51:52<04:54,  3.83s/it]
Skipping the first batches:  99%|█████████▊| 5924/6000 [5:51:56<04:39,  3.68s/it]
Skipping the first batches:  99%|█████████▉| 5925/6000 [5:51:59<04:27,  3.57s/it]
Skipping the first batches:  99%|█████████▉| 5926/6000 [5:52:02<04:18,  3.49s/it]
Skipping the first batches:  99%|█████████▉| 5927/6000 [5:52:06<04:09,  3.42s/it]
Skipping the first batches:  99%|█████████▉| 5928/6000 [5:52:09<04:03,  3.38s/it]
Skipping the first batches:  99%|█████████▉| 5929/6000 [5:52:12<03:54,  3.30s/it]
Skipping the first batches:  99%|█████████▉| 5930/6000 [5:52:16<04:14,  3.63s/it]
Skipping the first batches:  99%|█████████▉| 5931/6000 [5:52:20<04:03,  3.53s/it]
Skipping the first batches:  99%|█████████▉| 5932/6000 [5:52:23<03:55,  3.46s/it]
Skipping the first batches:  99%|█████████▉| 5933/6000 [5:52:27<03:55,  3.51s/it]
Skipping the first batches:  99%|█████████▉| 5934/6000 [5:52:30<03:51,  3.51s/it]
Skipping the first batches:  99%|█████████▉| 5935/6000 [5:52:33<03:43,  3.45s/it]
Skipping the first batches:  99%|█████████▉| 5936/6000 [5:52:37<03:40,  3.44s/it]
Skipping the first batches:  99%|█████████▉| 5937/6000 [5:52:40<03:36,  3.43s/it]
Skipping the first batches:  99%|█████████▉| 5938/6000 [5:52:44<03:37,  3.51s/it]
Skipping the first batches:  99%|█████████▉| 5939/6000 [5:52:47<03:26,  3.38s/it]
Skipping the first batches:  99%|█████████▉| 5940/6000 [5:52:51<03:34,  3.58s/it]
Skipping the first batches:  99%|█████████▉| 5941/6000 [5:52:55<03:35,  3.65s/it]
Skipping the first batches:  99%|█████████▉| 5942/6000 [5:52:58<03:29,  3.61s/it]
Skipping the first batches:  99%|█████████▉| 5943/6000 [5:53:02<03:34,  3.76s/it]
Skipping the first batches:  99%|█████████▉| 5944/6000 [5:53:07<03:44,  4.01s/it]
Skipping the first batches:  99%|█████████▉| 5945/6000 [5:53:12<03:49,  4.17s/it]
Skipping the first batches:  99%|█████████▉| 5946/6000 [5:53:15<03:29,  3.88s/it]
Skipping the first batches:  99%|█████████▉| 5947/6000 [5:53:18<03:14,  3.66s/it]
Skipping the first batches:  99%|█████████▉| 5948/6000 [5:53:23<03:24,  3.94s/it]
Skipping the first batches:  99%|█████████▉| 5949/6000 [5:53:26<03:17,  3.87s/it]
Skipping the first batches:  99%|█████████▉| 5950/6000 [5:53:30<03:11,  3.83s/it]
Skipping the first batches:  99%|█████████▉| 5951/6000 [5:53:36<03:35,  4.39s/it]
Skipping the first batches:  99%|█████████▉| 5952/6000 [5:53:41<03:37,  4.52s/it]
Skipping the first batches:  99%|█████████▉| 5953/6000 [5:53:45<03:37,  4.63s/it]
Skipping the first batches:  99%|█████████▉| 5954/6000 [5:53:51<03:45,  4.90s/it]
Skipping the first batches:  99%|█████████▉| 5955/6000 [5:53:55<03:22,  4.51s/it]
Skipping the first batches:  99%|█████████▉| 5956/6000 [5:53:58<03:02,  4.14s/it]
Skipping the first batches:  99%|█████████▉| 5957/6000 [5:54:02<02:53,  4.04s/it]
Skipping the first batches:  99%|█████████▉| 5958/6000 [5:54:06<02:48,  4.00s/it]
Skipping the first batches:  99%|█████████▉| 5959/6000 [5:54:09<02:34,  3.78s/it]
Skipping the first batches:  99%|█████████▉| 5960/6000 [5:54:12<02:27,  3.69s/it]
Skipping the first batches:  99%|█████████▉| 5961/6000 [5:54:16<02:22,  3.64s/it]
Skipping the first batches:  99%|█████████▉| 5962/6000 [5:54:21<02:39,  4.20s/it]
Skipping the first batches:  99%|█████████▉| 5963/6000 [5:54:26<02:41,  4.36s/it]
Skipping the first batches:  99%|█████████▉| 5964/6000 [5:54:30<02:30,  4.18s/it]
Skipping the first batches:  99%|█████████▉| 5965/6000 [5:54:34<02:21,  4.05s/it]
Skipping the first batches:  99%|█████████▉| 5966/6000 [5:54:41<02:57,  5.22s/it]
Skipping the first batches:  99%|█████████▉| 5967/6000 [5:54:45<02:39,  4.84s/it]
Skipping the first batches:  99%|█████████▉| 5968/6000 [5:54:49<02:22,  4.44s/it]
Skipping the first batches:  99%|█████████▉| 5969/6000 [5:54:52<02:05,  4.05s/it]
Skipping the first batches: 100%|█████████▉| 5970/6000 [5:54:57<02:11,  4.39s/it]
Skipping the first batches: 100%|█████████▉| 5971/6000 [5:55:02<02:06,  4.37s/it]
Skipping the first batches: 100%|█████████▉| 5972/6000 [5:55:06<02:00,  4.32s/it]
Skipping the first batches: 100%|█████████▉| 5973/6000 [5:55:11<02:03,  4.59s/it]
Skipping the first batches: 100%|█████████▉| 5974/6000 [5:55:15<01:57,  4.51s/it]
Skipping the first batches: 100%|█████████▉| 5975/6000 [5:55:20<01:57,  4.69s/it]
Skipping the first batches: 100%|█████████▉| 5976/6000 [5:55:24<01:44,  4.34s/it]
Skipping the first batches: 100%|█████████▉| 5977/6000 [5:55:28<01:36,  4.21s/it]
Skipping the first batches: 100%|█████████▉| 5978/6000 [5:55:32<01:30,  4.11s/it]
Skipping the first batches: 100%|█████████▉| 5979/6000 [5:55:39<01:45,  5.01s/it]
Skipping the first batches: 100%|█████████▉| 5980/6000 [5:55:43<01:36,  4.82s/it]
Skipping the first batches: 100%|█████████▉| 5981/6000 [5:55:48<01:31,  4.79s/it]
Skipping the first batches: 100%|█████████▉| 5982/6000 [5:55:52<01:19,  4.42s/it]
Skipping the first batches: 100%|█████████▉| 5983/6000 [5:55:56<01:13,  4.30s/it]
Skipping the first batches: 100%|█████████▉| 5984/6000 [5:56:00<01:09,  4.33s/it]
Skipping the first batches: 100%|█████████▉| 5985/6000 [5:56:03<01:00,  4.03s/it]
Skipping the first batches: 100%|█████████▉| 5986/6000 [5:56:07<00:53,  3.81s/it]
Skipping the first batches: 100%|█████████▉| 5987/6000 [5:56:11<00:50,  3.92s/it]
Skipping the first batches: 100%|█████████▉| 5988/6000 [5:56:14<00:44,  3.73s/it]
Skipping the first batches: 100%|█████████▉| 5989/6000 [5:56:18<00:41,  3.79s/it]
Skipping the first batches: 100%|█████████▉| 5990/6000 [5:56:21<00:35,  3.56s/it]
Skipping the first batches: 100%|█████████▉| 5991/6000 [5:56:24<00:31,  3.53s/it]
Skipping the first batches: 100%|█████████▉| 5992/6000 [5:56:29<00:30,  3.77s/it]
Skipping the first batches: 100%|█████████▉| 5993/6000 [5:56:32<00:25,  3.62s/it]
Skipping the first batches: 100%|█████████▉| 5994/6000 [5:56:36<00:22,  3.75s/it]
Skipping the first batches: 100%|█████████▉| 5995/6000 [5:56:39<00:17,  3.55s/it]
Skipping the first batches: 100%|█████████▉| 5996/6000 [5:56:44<00:15,  3.81s/it]
Skipping the first batches: 100%|█████████▉| 5997/6000 [5:56:47<00:11,  3.74s/it]
Skipping the first batches: 100%|█████████▉| 5998/6000 [5:56:50<00:07,  3.58s/it]
Skipping the first batches: 100%|█████████▉| 5999/6000 [5:56:54<00:03,  3.50s/it]
Skipping the first batches: 100%|██████████| 6000/6000 [5:56:58<00:00,  3.76s/it]
Skipping the first batches: 100%|██████████| 6000/6000 [5:57:01<00:00,  3.57s/it]


 30%|███       | 6001/20000 [5:57:08<13:53:07,  3.57s/it]

 30%|███       | 6002/20000 [5:57:17<13:53:23,  3.57s/it][2022-12-21 19:56:42,146] [INFO] [timer.py:197:stop] 0/3, RunningAvgSamplesPerSec=10.924076626426555, CurrSamplesPerSec=10.924076626426555, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6003/20000 [5:57:26<13:53:44,  3.57s/it][2022-12-21 19:56:52,514] [INFO] [timer.py:197:stop] 0/4, RunningAvgSamplesPerSec=10.876671393720088, CurrSamplesPerSec=10.829675815081648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6004/20000 [5:57:36<13:54:27,  3.58s/it][2022-12-21 19:57:02,207] [INFO] [timer.py:197:stop] 0/5, RunningAvgSamplesPerSec=10.899178027387538, CurrSamplesPerSec=10.944471888083012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6005/20000 [5:57:46<13:55:23,  3.58s/it][2022-12-21 19:57:12,310] [INFO] [timer.py:197:stop] 0/6, RunningAvgSamplesPerSec=10.940289275372077, CurrSamplesPerSec=11.065505156446154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6006/20000 [5:57:56<13:56:49,  3.59s/it][2022-12-21 19:57:22,578] [INFO] [timer.py:197:stop] 0/7, RunningAvgSamplesPerSec=10.954511238276568, CurrSamplesPerSec=11.011770782936045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6007/20000 [5:58:07<13:58:58,  3.60s/it][2022-12-21 19:57:32,953] [INFO] [timer.py:197:stop] 0/8, RunningAvgSamplesPerSec=10.973460072956104, CurrSamplesPerSec=11.069196141484403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6008/20000 [5:58:17<14:02:05,  3.61s/it][2022-12-21 19:57:42,871] [INFO] [timer.py:197:stop] 0/9, RunningAvgSamplesPerSec=10.973236670182159, CurrSamplesPerSec=10.97189644453691, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6009/20000 [5:58:27<14:06:14,  3.63s/it][2022-12-21 19:57:51,679] [INFO] [logging.py:68:log_dist] [Rank 0] step=6010, skipped=12, lr=[7.181025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-21 19:57:51,679] [INFO] [timer.py:197:stop] 0/10, RunningAvgSamplesPerSec=10.973812375087936, CurrSamplesPerSec=10.977844001476333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6010/20000 [5:58:36<14:11:06,  3.65s/it][2022-12-21 19:58:01,438] [INFO] [timer.py:197:stop] 0/11, RunningAvgSamplesPerSec=10.959913545161987, CurrSamplesPerSec=10.849977644076068, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6011/20000 [5:58:45<14:19:17,  3.69s/it][2022-12-21 19:58:11,534] [INFO] [timer.py:197:stop] 0/12, RunningAvgSamplesPerSec=10.947350813505643, CurrSamplesPerSec=10.83556899103459, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6012/20000 [5:58:55<14:31:28,  3.74s/it][2022-12-21 19:58:19,994] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 65536.0
[2022-12-21 19:58:19,996] [INFO] [timer.py:197:stop] 0/13, RunningAvgSamplesPerSec=11.014092894325405, CurrSamplesPerSec=11.729178967605918, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6013/20000 [5:59:04<14:44:10,  3.79s/it][2022-12-21 19:58:28,782] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0
[2022-12-21 19:58:28,784] [INFO] [timer.py:197:stop] 0/14, RunningAvgSamplesPerSec=11.068576128246466, CurrSamplesPerSec=11.705514378721837, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6014/20000 [5:59:13<15:03:03,  3.87s/it][2022-12-21 19:58:38,896] [INFO] [timer.py:197:stop] 0/15, RunningAvgSamplesPerSec=11.046811944501286, CurrSamplesPerSec=10.792163865483717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6015/20000 [5:59:23<15:36:01,  4.02s/it][2022-12-21 19:58:48,199] [INFO] [timer.py:197:stop] 0/16, RunningAvgSamplesPerSec=11.044762324353586, CurrSamplesPerSec=11.018186307861644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6016/20000 [5:59:32<16:14:42,  4.18s/it][2022-12-21 19:58:57,204] [INFO] [timer.py:197:stop] 0/17, RunningAvgSamplesPerSec=11.044727594721122, CurrSamplesPerSec=11.044241402798745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6017/20000 [5:59:41<17:02:56,  4.39s/it][2022-12-21 19:59:06,059] [INFO] [timer.py:197:stop] 0/18, RunningAvgSamplesPerSec=11.051905800773438, CurrSamplesPerSec=11.160709579359606, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6018/20000 [5:59:50<18:03:04,  4.65s/it][2022-12-21 19:59:15,669] [INFO] [timer.py:197:stop] 0/19, RunningAvgSamplesPerSec=11.062363131549825, CurrSamplesPerSec=11.232413165645458, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6019/20000 [6:00:00<19:31:16,  5.03s/it][2022-12-21 19:59:24,759] [INFO] [logging.py:68:log_dist] [Rank 0] step=6020, skipped=14, lr=[7.176923076923078e-06], mom=[[0.9, 0.999]]
[2022-12-21 19:59:24,760] [INFO] [timer.py:197:stop] 0/20, RunningAvgSamplesPerSec=11.07410773348072, CurrSamplesPerSec=11.277651583819717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6020/20000 [6:00:09<21:04:17,  5.43s/it][2022-12-21 19:59:33,731] [INFO] [timer.py:197:stop] 0/21, RunningAvgSamplesPerSec=11.064393355495831, CurrSamplesPerSec=10.892403637176512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6021/20000 [6:00:18<22:45:55,  5.86s/it][2022-12-21 19:59:43,695] [INFO] [timer.py:197:stop] 0/22, RunningAvgSamplesPerSec=11.068961782692492, CurrSamplesPerSec=11.156484352894667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6022/20000 [6:00:28<25:08:46,  6.48s/it][2022-12-21 19:59:52,516] [INFO] [timer.py:197:stop] 0/23, RunningAvgSamplesPerSec=11.071908265215216, CurrSamplesPerSec=11.131169098979969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6023/20000 [6:00:36<26:44:51,  6.89s/it][2022-12-21 20:00:03,061] [INFO] [timer.py:197:stop] 0/24, RunningAvgSamplesPerSec=11.06343332063652, CurrSamplesPerSec=10.888409115818144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6024/20000 [6:00:47<29:35:57,  7.62s/it][2022-12-21 20:00:14,653] [INFO] [timer.py:197:stop] 0/25, RunningAvgSamplesPerSec=11.068059104843405, CurrSamplesPerSec=11.17081410204739, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6025/20000 [6:00:59<33:01:58,  8.51s/it]

                                                         
{'loss': 0.1113, 'learning_rate': 7.174358974358975e-06, 'epoch': 0.3}


 30%|███       | 6025/20000 [6:00:59<33:01:58,  8.51s/it][2022-12-21 20:00:26,949] [INFO] [timer.py:197:stop] 0/26, RunningAvgSamplesPerSec=11.057934441793698, CurrSamplesPerSec=10.8300742907904, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6026/20000 [6:01:11<36:34:59,  9.42s/it][2022-12-21 20:00:37,426] [INFO] [timer.py:197:stop] 0/27, RunningAvgSamplesPerSec=11.045902441853368, CurrSamplesPerSec=10.764789655360893, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6027/20000 [6:01:21<37:37:43,  9.69s/it][2022-12-21 20:00:50,298] [INFO] [timer.py:197:stop] 0/28, RunningAvgSamplesPerSec=11.042764402741396, CurrSamplesPerSec=10.964888805632823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6028/20000 [6:01:34<40:56:02, 10.55s/it][2022-12-21 20:00:59,171] [INFO] [timer.py:197:stop] 0/29, RunningAvgSamplesPerSec=11.037245655951448, CurrSamplesPerSec=10.895669559644977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6029/20000 [6:01:43<39:07:53, 10.08s/it][2022-12-21 20:01:08,518] [INFO] [logging.py:68:log_dist] [Rank 0] step=6030, skipped=14, lr=[7.171794871794873e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:01:08,519] [INFO] [timer.py:197:stop] 0/30, RunningAvgSamplesPerSec=11.029918392598564, CurrSamplesPerSec=10.835694959286137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6030/20000 [6:01:52<38:19:09,  9.87s/it][2022-12-21 20:01:19,006] [INFO] [timer.py:197:stop] 0/31, RunningAvgSamplesPerSec=11.02707669984393, CurrSamplesPerSec=10.94809952596178, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6031/20000 [6:02:03<39:00:06, 10.05s/it][2022-12-21 20:01:28,383] [INFO] [timer.py:197:stop] 0/32, RunningAvgSamplesPerSec=11.029853450442195, CurrSamplesPerSec=11.110992013477128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6032/20000 [6:02:12<38:14:06,  9.85s/it][2022-12-21 20:01:37,811] [INFO] [timer.py:197:stop] 0/33, RunningAvgSamplesPerSec=11.027009287570596, CurrSamplesPerSec=10.942361224937445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6033/20000 [6:02:22<37:44:49,  9.73s/it][2022-12-21 20:01:47,759] [INFO] [timer.py:197:stop] 0/34, RunningAvgSamplesPerSec=11.01285525638994, CurrSamplesPerSec=10.591413068905995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6034/20000 [6:02:32<37:59:39,  9.79s/it][2022-12-21 20:01:57,276] [INFO] [timer.py:197:stop] 0/35, RunningAvgSamplesPerSec=11.000472157349337, CurrSamplesPerSec=10.618405872769298, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6035/20000 [6:02:41<37:40:20,  9.71s/it][2022-12-21 20:02:06,990] [INFO] [timer.py:197:stop] 0/36, RunningAvgSamplesPerSec=10.99451518603966, CurrSamplesPerSec=10.80149095611311, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6036/20000 [6:02:51<37:40:34,  9.71s/it][2022-12-21 20:02:17,046] [INFO] [timer.py:197:stop] 0/37, RunningAvgSamplesPerSec=11.000703804519544, CurrSamplesPerSec=11.215343036164745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6037/20000 [6:03:01<38:04:03,  9.81s/it][2022-12-21 20:02:26,105] [INFO] [timer.py:197:stop] 0/38, RunningAvgSamplesPerSec=11.005114332372763, CurrSamplesPerSec=11.16174260022027, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6038/20000 [6:03:10<37:11:19,  9.59s/it][2022-12-21 20:02:35,365] [INFO] [timer.py:197:stop] 0/39, RunningAvgSamplesPerSec=10.991081432136786, CurrSamplesPerSec=10.50868535389235, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6039/20000 [6:03:19<36:48:15,  9.49s/it][2022-12-21 20:02:45,708] [INFO] [logging.py:68:log_dist] [Rank 0] step=6040, skipped=14, lr=[7.166666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:02:45,709] [INFO] [timer.py:197:stop] 0/40, RunningAvgSamplesPerSec=10.979462679095874, CurrSamplesPerSec=10.566187674320053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6040/20000 [6:03:30<37:47:31,  9.75s/it][2022-12-21 20:02:54,995] [INFO] [timer.py:197:stop] 0/41, RunningAvgSamplesPerSec=10.98255270245278, CurrSamplesPerSec=11.10127633754572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6041/20000 [6:03:39<37:15:18,  9.61s/it][2022-12-21 20:03:04,505] [INFO] [timer.py:197:stop] 0/42, RunningAvgSamplesPerSec=10.987606996238553, CurrSamplesPerSec=11.188419398106697, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6042/20000 [6:03:48<37:08:20,  9.58s/it][2022-12-21 20:03:13,888] [INFO] [timer.py:197:stop] 0/43, RunningAvgSamplesPerSec=10.981953549688324, CurrSamplesPerSec=10.760490021865683, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6043/20000 [6:03:58<36:54:30,  9.52s/it][2022-12-21 20:03:22,923] [INFO] [timer.py:197:stop] 0/44, RunningAvgSamplesPerSec=10.983422114676381, CurrSamplesPerSec=11.0439733172693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6044/20000 [6:04:07<36:20:33,  9.37s/it][2022-12-21 20:03:32,026] [INFO] [timer.py:197:stop] 0/45, RunningAvgSamplesPerSec=10.98404615493834, CurrSamplesPerSec=11.010320032321111, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6045/20000 [6:04:16<36:01:26,  9.29s/it][2022-12-21 20:03:41,501] [INFO] [timer.py:197:stop] 0/46, RunningAvgSamplesPerSec=10.979339512095157, CurrSamplesPerSec=10.780700596755855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6046/20000 [6:04:25<36:13:58,  9.35s/it][2022-12-21 20:03:50,446] [INFO] [timer.py:197:stop] 0/47, RunningAvgSamplesPerSec=10.97406603366964, CurrSamplesPerSec=10.746944331455403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6047/20000 [6:04:34<35:45:43,  9.23s/it][2022-12-21 20:04:01,789] [INFO] [timer.py:197:stop] 0/48, RunningAvgSamplesPerSec=10.967961110663515, CurrSamplesPerSec=10.700098010156257, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6048/20000 [6:04:46<38:13:11,  9.86s/it][2022-12-21 20:04:10,630] [INFO] [timer.py:197:stop] 0/49, RunningAvgSamplesPerSec=10.968132973096575, CurrSamplesPerSec=10.976044471478403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6049/20000 [6:04:55<37:01:47,  9.56s/it][2022-12-21 20:04:19,741] [INFO] [logging.py:68:log_dist] [Rank 0] step=6050, skipped=14, lr=[7.161538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:04:19,742] [INFO] [timer.py:197:stop] 0/50, RunningAvgSamplesPerSec=10.959407514387186, CurrSamplesPerSec=10.564406226949988, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6050/20000 [6:05:04<36:30:40,  9.42s/it]

                                                         
{'loss': 0.1046, 'learning_rate': 7.161538461538462e-06, 'epoch': 0.3}


 30%|███       | 6050/20000 [6:05:04<36:30:40,  9.42s/it][2022-12-21 20:04:29,052] [INFO] [timer.py:197:stop] 0/51, RunningAvgSamplesPerSec=10.964243712446953, CurrSamplesPerSec=11.201509316680507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6051/20000 [6:05:13<36:22:41,  9.39s/it][2022-12-21 20:04:38,813] [INFO] [timer.py:197:stop] 0/52, RunningAvgSamplesPerSec=10.965115002258388, CurrSamplesPerSec=11.007978500041991, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6052/20000 [6:05:23<36:48:31,  9.50s/it][2022-12-21 20:04:48,412] [INFO] [timer.py:197:stop] 0/53, RunningAvgSamplesPerSec=10.959759534973637, CurrSamplesPerSec=10.698497107522831, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6053/20000 [6:05:32<36:55:15,  9.53s/it][2022-12-21 20:04:57,914] [INFO] [timer.py:197:stop] 0/54, RunningAvgSamplesPerSec=10.959387404745554, CurrSamplesPerSec=10.940442214258436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6054/20000 [6:05:42<36:53:10,  9.52s/it][2022-12-21 20:05:09,328] [INFO] [timer.py:197:stop] 0/55, RunningAvgSamplesPerSec=10.958862282899295, CurrSamplesPerSec=10.931625119217978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6055/20000 [6:05:53<39:04:56, 10.09s/it][2022-12-21 20:05:18,838] [INFO] [timer.py:197:stop] 0/56, RunningAvgSamplesPerSec=10.960599261190344, CurrSamplesPerSec=11.05345372539691, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6056/20000 [6:06:03<38:24:20,  9.92s/it][2022-12-21 20:05:27,605] [INFO] [timer.py:197:stop] 0/57, RunningAvgSamplesPerSec=10.962152621339847, CurrSamplesPerSec=11.046692944227248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6057/20000 [6:06:12<37:04:07,  9.57s/it][2022-12-21 20:05:40,595] [INFO] [timer.py:197:stop] 0/58, RunningAvgSamplesPerSec=10.962533737176436, CurrSamplesPerSec=10.983535996587207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6058/20000 [6:06:25<41:02:16, 10.60s/it][2022-12-21 20:05:50,587] [INFO] [timer.py:197:stop] 0/59, RunningAvgSamplesPerSec=10.956002577624345, CurrSamplesPerSec=10.602276952955766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6059/20000 [6:06:35<40:19:58, 10.42s/it][2022-12-21 20:05:59,504] [INFO] [logging.py:68:log_dist] [Rank 0] step=6060, skipped=14, lr=[7.156410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:05:59,504] [INFO] [timer.py:197:stop] 0/60, RunningAvgSamplesPerSec=10.960148017243643, CurrSamplesPerSec=11.201737892839985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6060/20000 [6:06:43<38:35:23,  9.97s/it][2022-12-21 20:06:09,292] [INFO] [timer.py:197:stop] 0/61, RunningAvgSamplesPerSec=10.961421889323926, CurrSamplesPerSec=11.035816567021007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6061/20000 [6:06:53<38:22:48,  9.91s/it][2022-12-21 20:06:18,160] [INFO] [timer.py:197:stop] 0/62, RunningAvgSamplesPerSec=10.963949189096365, CurrSamplesPerSec=11.115151088532244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6062/20000 [6:07:02<37:09:54,  9.60s/it][2022-12-21 20:06:28,324] [INFO] [timer.py:197:stop] 0/63, RunningAvgSamplesPerSec=10.958950521569923, CurrSamplesPerSec=10.667149459649504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6063/20000 [6:07:12<37:49:02,  9.77s/it][2022-12-21 20:06:38,060] [INFO] [timer.py:197:stop] 0/64, RunningAvgSamplesPerSec=10.962046441806958, CurrSamplesPerSec=11.1542633222757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6064/20000 [6:07:22<37:46:38,  9.76s/it][2022-12-21 20:06:47,256] [INFO] [timer.py:197:stop] 0/65, RunningAvgSamplesPerSec=10.964081239303768, CurrSamplesPerSec=11.091731169469803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6065/20000 [6:07:31<37:07:17,  9.59s/it][2022-12-21 20:06:57,921] [INFO] [timer.py:197:stop] 0/66, RunningAvgSamplesPerSec=10.964481103537908, CurrSamplesPerSec=10.98973148516797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6066/20000 [6:07:42<38:21:59,  9.91s/it][2022-12-21 20:07:06,792] [INFO] [timer.py:197:stop] 0/67, RunningAvgSamplesPerSec=10.966190478802028, CurrSamplesPerSec=11.076710281848536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6067/20000 [6:07:51<37:09:18,  9.60s/it][2022-12-21 20:07:16,356] [INFO] [timer.py:197:stop] 0/68, RunningAvgSamplesPerSec=10.968123497907396, CurrSamplesPerSec=11.095248434398151, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6068/20000 [6:08:00<37:06:36,  9.59s/it][2022-12-21 20:07:25,994] [INFO] [timer.py:197:stop] 0/69, RunningAvgSamplesPerSec=10.965840635036907, CurrSamplesPerSec=10.817244310735962, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6069/20000 [6:08:10<37:09:53,  9.60s/it][2022-12-21 20:07:35,134] [INFO] [logging.py:68:log_dist] [Rank 0] step=6070, skipped=14, lr=[7.151282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:07:35,135] [INFO] [timer.py:197:stop] 0/70, RunningAvgSamplesPerSec=10.966416326695809, CurrSamplesPerSec=11.005125849991659, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6070/20000 [6:08:19<36:37:26,  9.46s/it][2022-12-21 20:07:44,647] [INFO] [timer.py:197:stop] 0/71, RunningAvgSamplesPerSec=10.968916497783411, CurrSamplesPerSec=11.14164468550864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6071/20000 [6:08:29<36:40:34,  9.48s/it][2022-12-21 20:07:53,952] [INFO] [timer.py:197:stop] 0/72, RunningAvgSamplesPerSec=10.969454407026754, CurrSamplesPerSec=11.006697986782472, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6072/20000 [6:08:38<36:28:15,  9.43s/it][2022-12-21 20:08:05,523] [INFO] [timer.py:197:stop] 0/73, RunningAvgSamplesPerSec=10.969648031069346, CurrSamplesPerSec=10.983218721017636, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6073/20000 [6:08:49<38:57:26, 10.07s/it][2022-12-21 20:08:14,748] [INFO] [timer.py:197:stop] 0/74, RunningAvgSamplesPerSec=10.967997115002378, CurrSamplesPerSec=10.852038775794595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6074/20000 [6:08:59<37:58:27,  9.82s/it][2022-12-21 20:08:24,226] [INFO] [timer.py:197:stop] 0/75, RunningAvgSamplesPerSec=10.96788684901502, CurrSamplesPerSec=10.9599535202567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6075/20000 [6:09:08<37:34:42,  9.72s/it]

                                                         
{'loss': 0.1319, 'learning_rate': 7.1487179487179495e-06, 'epoch': 0.3}


 30%|███       | 6075/20000 [6:09:08<37:34:42,  9.72s/it][2022-12-21 20:08:34,446] [INFO] [timer.py:197:stop] 0/76, RunningAvgSamplesPerSec=10.969847365990608, CurrSamplesPerSec=11.114883231297497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6076/20000 [6:09:18<38:09:40,  9.87s/it][2022-12-21 20:08:43,208] [INFO] [timer.py:197:stop] 0/77, RunningAvgSamplesPerSec=10.972332137545976, CurrSamplesPerSec=11.159382154530544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6077/20000 [6:09:27<36:52:36,  9.54s/it][2022-12-21 20:08:52,075] [INFO] [timer.py:197:stop] 0/78, RunningAvgSamplesPerSec=10.971635848374973, CurrSamplesPerSec=10.919664825213252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6078/20000 [6:09:36<36:05:56,  9.33s/it][2022-12-21 20:09:02,186] [INFO] [timer.py:197:stop] 0/79, RunningAvgSamplesPerSec=10.96820424821113, CurrSamplesPerSec=10.713537764323323, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6079/20000 [6:09:46<36:59:50,  9.57s/it][2022-12-21 20:09:12,055] [INFO] [logging.py:68:log_dist] [Rank 0] step=6080, skipped=14, lr=[7.146153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:09:12,055] [INFO] [timer.py:197:stop] 0/80, RunningAvgSamplesPerSec=10.970777438735881, CurrSamplesPerSec=11.172605526179776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6080/20000 [6:09:56<37:20:41,  9.66s/it][2022-12-21 20:09:21,170] [INFO] [timer.py:197:stop] 0/81, RunningAvgSamplesPerSec=10.971990860329571, CurrSamplesPerSec=11.067471945664735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6081/20000 [6:10:05<36:42:42,  9.50s/it][2022-12-21 20:09:31,291] [INFO] [timer.py:197:stop] 0/82, RunningAvgSamplesPerSec=10.966310779724294, CurrSamplesPerSec=10.53543829542797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6082/20000 [6:10:15<37:26:04,  9.68s/it][2022-12-21 20:09:41,236] [INFO] [timer.py:197:stop] 0/83, RunningAvgSamplesPerSec=10.96757912732073, CurrSamplesPerSec=11.070006397816512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6083/20000 [6:10:25<37:44:10,  9.76s/it][2022-12-21 20:09:50,106] [INFO] [timer.py:197:stop] 0/84, RunningAvgSamplesPerSec=10.970055689197366, CurrSamplesPerSec=11.174440785617614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6084/20000 [6:10:34<36:41:59,  9.49s/it][2022-12-21 20:10:00,347] [INFO] [timer.py:197:stop] 0/85, RunningAvgSamplesPerSec=10.967449574954761, CurrSamplesPerSec=10.757881451782323, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6085/20000 [6:10:44<37:33:48,  9.72s/it][2022-12-21 20:10:09,104] [INFO] [timer.py:197:stop] 0/86, RunningAvgSamplesPerSec=10.969390527119039, CurrSamplesPerSec=11.132920125959568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6086/20000 [6:10:53<36:26:48,  9.43s/it][2022-12-21 20:10:19,194] [INFO] [timer.py:197:stop] 0/87, RunningAvgSamplesPerSec=10.966506480614333, CurrSamplesPerSec=10.72954361335129, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6087/20000 [6:11:03<37:12:31,  9.63s/it][2022-12-21 20:10:28,528] [INFO] [timer.py:197:stop] 0/88, RunningAvgSamplesPerSec=10.963761204301864, CurrSamplesPerSec=10.735331720926721, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6088/20000 [6:11:12<36:51:57,  9.54s/it][2022-12-21 20:10:37,349] [INFO] [timer.py:197:stop] 0/89, RunningAvgSamplesPerSec=10.963527176491242, CurrSamplesPerSec=10.94343809231332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6089/20000 [6:11:21<36:01:49,  9.32s/it][2022-12-21 20:10:46,934] [INFO] [logging.py:68:log_dist] [Rank 0] step=6090, skipped=14, lr=[7.1410256410256414e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:10:46,935] [INFO] [timer.py:197:stop] 0/90, RunningAvgSamplesPerSec=10.963333254764308, CurrSamplesPerSec=10.946488284767494, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6090/20000 [6:11:31<36:19:50,  9.40s/it][2022-12-21 20:10:57,219] [INFO] [timer.py:197:stop] 0/91, RunningAvgSamplesPerSec=10.96231935603402, CurrSamplesPerSec=10.873824716681922, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6091/20000 [6:11:41<37:20:57,  9.67s/it][2022-12-21 20:11:06,469] [INFO] [timer.py:197:stop] 0/92, RunningAvgSamplesPerSec=10.958329687181587, CurrSamplesPerSec=10.614514894934532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6092/20000 [6:11:50<36:51:49,  9.54s/it][2022-12-21 20:11:16,829] [INFO] [timer.py:197:stop] 0/93, RunningAvgSamplesPerSec=10.958485949488555, CurrSamplesPerSec=10.972567829941777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6093/20000 [6:12:01<37:48:32,  9.79s/it][2022-12-21 20:11:26,099] [INFO] [timer.py:197:stop] 0/94, RunningAvgSamplesPerSec=10.95846001722775, CurrSamplesPerSec=10.95610069514297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6094/20000 [6:12:10<37:12:26,  9.63s/it][2022-12-21 20:11:35,453] [INFO] [timer.py:197:stop] 0/95, RunningAvgSamplesPerSec=10.958714928202836, CurrSamplesPerSec=10.98221758062528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6095/20000 [6:12:19<36:52:55,  9.55s/it][2022-12-21 20:11:44,736] [INFO] [timer.py:197:stop] 0/96, RunningAvgSamplesPerSec=10.95533694010776, CurrSamplesPerSec=10.650033015105775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6096/20000 [6:12:29<36:34:17,  9.47s/it][2022-12-21 20:11:55,243] [INFO] [timer.py:197:stop] 0/97, RunningAvgSamplesPerSec=10.951040368914999, CurrSamplesPerSec=10.56167534204449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6097/20000 [6:12:39<37:46:15,  9.78s/it][2022-12-21 20:12:04,348] [INFO] [timer.py:197:stop] 0/98, RunningAvgSamplesPerSec=10.951344328039234, CurrSamplesPerSec=10.98029759139062, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6098/20000 [6:12:48<36:59:07,  9.58s/it][2022-12-21 20:12:13,307] [INFO] [timer.py:197:stop] 0/99, RunningAvgSamplesPerSec=10.948633369474228, CurrSamplesPerSec=10.694485442082469, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6099/20000 [6:12:57<36:16:02,  9.39s/it][2022-12-21 20:12:23,239] [INFO] [logging.py:68:log_dist] [Rank 0] step=6100, skipped=14, lr=[7.135897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:12:23,240] [INFO] [timer.py:197:stop] 0/100, RunningAvgSamplesPerSec=10.94632948782557, CurrSamplesPerSec=10.727369269563043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 30%|███       | 6100/20000 [6:13:07<36:53:24,  9.55s/it]

                                                         
{'loss': 0.1351, 'learning_rate': 7.135897435897436e-06, 'epoch': 0.3}


 30%|███       | 6100/20000 [6:13:07<36:53:24,  9.55s/it][2022-12-21 20:12:32,235] [INFO] [timer.py:197:stop] 0/101, RunningAvgSamplesPerSec=10.949149148030255, CurrSamplesPerSec=11.232705048877573, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6101/20000 [6:13:16<36:14:24,  9.39s/it][2022-12-21 20:12:41,000] [INFO] [timer.py:197:stop] 0/102, RunningAvgSamplesPerSec=10.949941301402232, CurrSamplesPerSec=11.028935957544698, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6102/20000 [6:13:25<35:31:02,  9.20s/it][2022-12-21 20:12:50,416] [INFO] [timer.py:197:stop] 0/103, RunningAvgSamplesPerSec=10.948647053411987, CurrSamplesPerSec=10.820749262903592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6103/20000 [6:13:34<35:45:53,  9.26s/it][2022-12-21 20:12:59,551] [INFO] [timer.py:197:stop] 0/104, RunningAvgSamplesPerSec=10.951605742405436, CurrSamplesPerSec=11.258901273861975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6104/20000 [6:13:44<35:36:44,  9.23s/it][2022-12-21 20:13:08,676] [INFO] [timer.py:197:stop] 0/105, RunningAvgSamplesPerSec=10.949534462836763, CurrSamplesPerSec=10.742301690348432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6105/20000 [6:13:53<35:29:30,  9.20s/it][2022-12-21 20:13:17,845] [INFO] [timer.py:197:stop] 0/106, RunningAvgSamplesPerSec=10.947127292388702, CurrSamplesPerSec=10.7047319831733, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6106/20000 [6:14:02<35:27:32,  9.19s/it][2022-12-21 20:13:27,548] [INFO] [timer.py:197:stop] 0/107, RunningAvgSamplesPerSec=10.949086641993762, CurrSamplesPerSec=11.15676117447888, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6107/20000 [6:14:12<36:03:13,  9.34s/it][2022-12-21 20:13:36,797] [INFO] [timer.py:197:stop] 0/108, RunningAvgSamplesPerSec=10.948533970139065, CurrSamplesPerSec=10.89081228155831, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6108/20000 [6:14:21<35:56:35,  9.31s/it][2022-12-21 20:13:45,915] [INFO] [timer.py:197:stop] 0/109, RunningAvgSamplesPerSec=10.948300090697789, CurrSamplesPerSec=10.923565407277568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6109/20000 [6:14:30<35:42:48,  9.26s/it][2022-12-21 20:13:55,025] [INFO] [logging.py:68:log_dist] [Rank 0] step=6110, skipped=14, lr=[7.130769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:13:55,025] [INFO] [timer.py:197:stop] 0/110, RunningAvgSamplesPerSec=10.948197280891533, CurrSamplesPerSec=10.937207776973667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6110/20000 [6:14:39<35:32:31,  9.21s/it][2022-12-21 20:14:04,502] [INFO] [timer.py:197:stop] 0/111, RunningAvgSamplesPerSec=10.947780992755542, CurrSamplesPerSec=10.90300744754951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6111/20000 [6:14:48<35:50:46,  9.29s/it][2022-12-21 20:14:13,997] [INFO] [timer.py:197:stop] 0/112, RunningAvgSamplesPerSec=10.946322848808927, CurrSamplesPerSec=10.789680430896743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6112/20000 [6:14:58<36:04:45,  9.35s/it][2022-12-21 20:14:22,964] [INFO] [timer.py:197:stop] 0/113, RunningAvgSamplesPerSec=10.946669857961924, CurrSamplesPerSec=10.984975651277182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6113/20000 [6:15:07<35:37:52,  9.24s/it][2022-12-21 20:14:32,822] [INFO] [timer.py:197:stop] 0/114, RunningAvgSamplesPerSec=10.947948820715226, CurrSamplesPerSec=11.091795791475668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6114/20000 [6:15:17<36:20:49,  9.42s/it][2022-12-21 20:14:41,842] [INFO] [timer.py:197:stop] 0/115, RunningAvgSamplesPerSec=10.94792809393771, CurrSamplesPerSec=10.94560719137424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6115/20000 [6:15:26<35:52:39,  9.30s/it][2022-12-21 20:14:50,939] [INFO] [timer.py:197:stop] 0/116, RunningAvgSamplesPerSec=10.944067529187128, CurrSamplesPerSec=10.524688603091333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6116/20000 [6:15:35<35:38:17,  9.24s/it][2022-12-21 20:15:00,292] [INFO] [timer.py:197:stop] 0/117, RunningAvgSamplesPerSec=10.94459817388671, CurrSamplesPerSec=11.005430856341068, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6117/20000 [6:15:44<35:45:57,  9.27s/it][2022-12-21 20:15:10,289] [INFO] [timer.py:197:stop] 0/118, RunningAvgSamplesPerSec=10.945273413062678, CurrSamplesPerSec=11.023485628981728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6118/20000 [6:15:54<36:35:55,  9.49s/it][2022-12-21 20:15:19,853] [INFO] [timer.py:197:stop] 0/119, RunningAvgSamplesPerSec=10.94543378423482, CurrSamplesPerSec=10.964068785624688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6119/20000 [6:16:04<36:40:48,  9.51s/it][2022-12-21 20:15:29,579] [INFO] [logging.py:68:log_dist] [Rank 0] step=6120, skipped=14, lr=[7.125641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:15:29,579] [INFO] [timer.py:197:stop] 0/120, RunningAvgSamplesPerSec=10.947567686216942, CurrSamplesPerSec=11.203111883521055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6120/20000 [6:16:14<36:55:29,  9.58s/it][2022-12-21 20:15:38,442] [INFO] [timer.py:197:stop] 0/121, RunningAvgSamplesPerSec=10.949601787596636, CurrSamplesPerSec=11.195051806767399, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6121/20000 [6:16:22<36:05:45,  9.36s/it][2022-12-21 20:15:48,337] [INFO] [timer.py:197:stop] 0/122, RunningAvgSamplesPerSec=10.951828840979971, CurrSamplesPerSec=11.223476947686063, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6122/20000 [6:16:32<36:42:30,  9.52s/it][2022-12-21 20:15:58,193] [INFO] [timer.py:197:stop] 0/123, RunningAvgSamplesPerSec=10.950778299156099, CurrSamplesPerSec=10.826159839155162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6123/20000 [6:16:42<37:05:31,  9.62s/it][2022-12-21 20:16:09,955] [INFO] [timer.py:197:stop] 0/124, RunningAvgSamplesPerSec=10.946403369795485, CurrSamplesPerSec=10.441648521641913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6124/20000 [6:16:54<39:33:46, 10.26s/it][2022-12-21 20:16:19,137] [INFO] [timer.py:197:stop] 0/125, RunningAvgSamplesPerSec=10.948399292006833, CurrSamplesPerSec=11.19748715525034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6125/20000 [6:17:03<38:18:33,  9.94s/it]

                                                         
{'loss': 0.1141, 'learning_rate': 7.123076923076924e-06, 'epoch': 0.31}


 31%|███       | 6125/20000 [6:17:03<38:18:33,  9.94s/it][2022-12-21 20:16:28,219] [INFO] [timer.py:197:stop] 0/126, RunningAvgSamplesPerSec=10.949384092426229, CurrSamplesPerSec=11.071880712695712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6126/20000 [6:17:12<37:18:53,  9.68s/it][2022-12-21 20:16:38,415] [INFO] [timer.py:197:stop] 0/127, RunningAvgSamplesPerSec=10.950578965262237, CurrSamplesPerSec=11.100792009676429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6127/20000 [6:17:22<37:54:19,  9.84s/it][2022-12-21 20:16:49,880] [INFO] [timer.py:197:stop] 0/128, RunningAvgSamplesPerSec=10.95001054647197, CurrSamplesPerSec=10.879419910080745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6128/20000 [6:17:34<39:47:09, 10.33s/it][2022-12-21 20:16:59,318] [INFO] [timer.py:197:stop] 0/129, RunningAvgSamplesPerSec=10.94918083222724, CurrSamplesPerSec=10.84563336678174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6129/20000 [6:17:43<38:45:26, 10.06s/it][2022-12-21 20:17:09,312] [INFO] [logging.py:68:log_dist] [Rank 0] step=6130, skipped=14, lr=[7.120512820512822e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:17:09,313] [INFO] [timer.py:197:stop] 0/130, RunningAvgSamplesPerSec=10.949298526382726, CurrSamplesPerSec=10.964266277865123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6130/20000 [6:17:53<38:40:52, 10.04s/it][2022-12-21 20:17:18,329] [INFO] [timer.py:197:stop] 0/131, RunningAvgSamplesPerSec=10.948151114446649, CurrSamplesPerSec=10.803241526360795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6131/20000 [6:18:02<37:29:44,  9.73s/it][2022-12-21 20:17:29,205] [INFO] [timer.py:197:stop] 0/132, RunningAvgSamplesPerSec=10.946537713563568, CurrSamplesPerSec=10.742321895098675, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6132/20000 [6:18:13<38:48:47, 10.08s/it][2022-12-21 20:17:38,842] [INFO] [timer.py:197:stop] 0/133, RunningAvgSamplesPerSec=10.947013200965722, CurrSamplesPerSec=11.009180295973312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6133/20000 [6:18:23<38:18:13,  9.94s/it][2022-12-21 20:17:47,668] [INFO] [timer.py:197:stop] 0/134, RunningAvgSamplesPerSec=10.949180148626773, CurrSamplesPerSec=11.240665063003688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6134/20000 [6:18:32<37:00:34,  9.61s/it][2022-12-21 20:17:56,778] [INFO] [timer.py:197:stop] 0/135, RunningAvgSamplesPerSec=10.949578639056387, CurrSamplesPerSec=11.002435217373092, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6135/20000 [6:18:41<36:25:51,  9.46s/it][2022-12-21 20:18:06,216] [INFO] [timer.py:197:stop] 0/136, RunningAvgSamplesPerSec=10.950315909755473, CurrSamplesPerSec=11.04926564194834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6136/20000 [6:18:50<36:24:12,  9.45s/it][2022-12-21 20:18:15,829] [INFO] [timer.py:197:stop] 0/137, RunningAvgSamplesPerSec=10.946631384496373, CurrSamplesPerSec=10.474364627763755, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6137/20000 [6:19:00<36:35:07,  9.50s/it][2022-12-21 20:18:24,769] [INFO] [timer.py:197:stop] 0/138, RunningAvgSamplesPerSec=10.949048334447731, CurrSamplesPerSec=11.285435370239512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6138/20000 [6:19:09<35:56:08,  9.33s/it][2022-12-21 20:18:33,599] [INFO] [timer.py:197:stop] 0/139, RunningAvgSamplesPerSec=10.948991582335024, CurrSamplesPerSec=10.941278771986559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6139/20000 [6:19:18<35:21:09,  9.18s/it][2022-12-21 20:18:45,575] [INFO] [logging.py:68:log_dist] [Rank 0] step=6140, skipped=14, lr=[7.115384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:18:45,576] [INFO] [timer.py:197:stop] 0/140, RunningAvgSamplesPerSec=10.951252420150059, CurrSamplesPerSec=11.270070156156763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6140/20000 [6:19:30<38:34:41, 10.02s/it][2022-12-21 20:18:54,359] [INFO] [timer.py:197:stop] 0/141, RunningAvgSamplesPerSec=10.952849817852139, CurrSamplesPerSec=11.177851988060267, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6141/20000 [6:19:38<37:08:48,  9.65s/it][2022-12-21 20:19:03,235] [INFO] [timer.py:197:stop] 0/142, RunningAvgSamplesPerSec=10.95219597564816, CurrSamplesPerSec=10.862065217681591, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6142/20000 [6:19:47<36:15:02,  9.42s/it][2022-12-21 20:19:13,847] [INFO] [timer.py:197:stop] 0/143, RunningAvgSamplesPerSec=10.951497545473076, CurrSamplesPerSec=10.85458874953215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6143/20000 [6:19:58<37:37:39,  9.78s/it][2022-12-21 20:19:22,996] [INFO] [timer.py:197:stop] 0/144, RunningAvgSamplesPerSec=10.951911318276908, CurrSamplesPerSec=11.010567969771369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6144/20000 [6:20:07<36:54:06,  9.59s/it][2022-12-21 20:19:32,132] [INFO] [timer.py:197:stop] 0/145, RunningAvgSamplesPerSec=10.952234222392944, CurrSamplesPerSec=10.998280741808982, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6145/20000 [6:20:16<36:22:39,  9.45s/it][2022-12-21 20:19:42,048] [INFO] [timer.py:197:stop] 0/146, RunningAvgSamplesPerSec=10.951739067342238, CurrSamplesPerSec=10.881389909897859, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6146/20000 [6:20:26<36:54:40,  9.59s/it][2022-12-21 20:19:52,101] [INFO] [timer.py:197:stop] 0/147, RunningAvgSamplesPerSec=10.951892806452626, CurrSamplesPerSec=10.974076392213359, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6147/20000 [6:20:36<37:26:26,  9.73s/it][2022-12-21 20:20:00,972] [INFO] [timer.py:197:stop] 0/148, RunningAvgSamplesPerSec=10.95130852585175, CurrSamplesPerSec=10.867242667806686, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6148/20000 [6:20:45<36:26:49,  9.47s/it][2022-12-21 20:20:10,528] [INFO] [timer.py:197:stop] 0/149, RunningAvgSamplesPerSec=10.950405735219807, CurrSamplesPerSec=10.82017657695235, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6149/20000 [6:20:54<36:32:28,  9.50s/it][2022-12-21 20:20:19,607] [INFO] [logging.py:68:log_dist] [Rank 0] step=6150, skipped=14, lr=[7.110256410256411e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:20:19,608] [INFO] [timer.py:197:stop] 0/150, RunningAvgSamplesPerSec=10.950474320511027, CurrSamplesPerSec=10.960565712610931, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6150/20000 [6:21:04<36:03:22,  9.37s/it]

                                                         
{'loss': 0.103, 'learning_rate': 7.110256410256411e-06, 'epoch': 0.31}


 31%|███       | 6150/20000 [6:21:04<36:03:22,  9.37s/it][2022-12-21 20:20:28,706] [INFO] [timer.py:197:stop] 0/151, RunningAvgSamplesPerSec=10.950483790364707, CurrSamplesPerSec=10.951885509325763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6151/20000 [6:21:13<35:44:16,  9.29s/it][2022-12-21 20:20:38,611] [INFO] [timer.py:197:stop] 0/152, RunningAvgSamplesPerSec=10.948741252559568, CurrSamplesPerSec=10.695156968946625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6152/20000 [6:21:23<36:26:38,  9.47s/it][2022-12-21 20:20:47,452] [INFO] [timer.py:197:stop] 0/153, RunningAvgSamplesPerSec=10.948650498970853, CurrSamplesPerSec=10.93505447801605, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6153/20000 [6:21:31<35:42:40,  9.28s/it][2022-12-21 20:20:57,125] [INFO] [timer.py:197:stop] 0/154, RunningAvgSamplesPerSec=10.948574828249638, CurrSamplesPerSec=10.93716054054706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6154/20000 [6:21:41<36:09:28,  9.40s/it][2022-12-21 20:21:07,274] [INFO] [timer.py:197:stop] 0/155, RunningAvgSamplesPerSec=10.947217289043659, CurrSamplesPerSec=10.744713470658038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6155/20000 [6:21:51<37:01:04,  9.63s/it][2022-12-21 20:21:17,689] [INFO] [timer.py:197:stop] 0/156, RunningAvgSamplesPerSec=10.94770904953724, CurrSamplesPerSec=11.023472501074997, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6156/20000 [6:22:02<37:55:32,  9.86s/it][2022-12-21 20:21:27,042] [INFO] [timer.py:197:stop] 0/157, RunningAvgSamplesPerSec=10.947920395080905, CurrSamplesPerSec=10.980565289429963, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6157/20000 [6:22:11<37:20:06,  9.71s/it][2022-12-21 20:21:36,451] [INFO] [timer.py:197:stop] 0/158, RunningAvgSamplesPerSec=10.947220519876149, CurrSamplesPerSec=10.839811095609123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6158/20000 [6:22:20<36:59:10,  9.62s/it][2022-12-21 20:21:45,419] [INFO] [timer.py:197:stop] 0/159, RunningAvgSamplesPerSec=10.948606800838276, CurrSamplesPerSec=11.169252828247986, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6159/20000 [6:22:29<36:13:55,  9.42s/it][2022-12-21 20:21:54,794] [INFO] [logging.py:68:log_dist] [Rank 0] step=6160, skipped=14, lr=[7.105128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:21:54,795] [INFO] [timer.py:197:stop] 0/160, RunningAvgSamplesPerSec=10.94772909081525, CurrSamplesPerSec=10.81165234238107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6160/20000 [6:22:39<36:10:27,  9.41s/it][2022-12-21 20:22:04,021] [INFO] [timer.py:197:stop] 0/161, RunningAvgSamplesPerSec=10.949434691921331, CurrSamplesPerSec=11.225763655703128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6161/20000 [6:22:48<35:57:38,  9.35s/it][2022-12-21 20:22:14,035] [INFO] [timer.py:197:stop] 0/162, RunningAvgSamplesPerSec=10.947941843691435, CurrSamplesPerSec=10.715647045584545, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6162/20000 [6:22:58<36:43:03,  9.55s/it][2022-12-21 20:22:23,042] [INFO] [timer.py:197:stop] 0/163, RunningAvgSamplesPerSec=10.94832238387522, CurrSamplesPerSec=11.00955145202709, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6163/20000 [6:23:07<36:05:10,  9.39s/it][2022-12-21 20:22:32,671] [INFO] [timer.py:197:stop] 0/164, RunningAvgSamplesPerSec=10.948040486864967, CurrSamplesPerSec=10.902843596987134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6164/20000 [6:23:17<36:21:41,  9.46s/it][2022-12-21 20:22:41,711] [INFO] [timer.py:197:stop] 0/165, RunningAvgSamplesPerSec=10.949796771212943, CurrSamplesPerSec=11.241953045582653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6165/20000 [6:23:26<35:52:23,  9.33s/it][2022-12-21 20:22:51,308] [INFO] [timer.py:197:stop] 0/166, RunningAvgSamplesPerSec=10.95106999371123, CurrSamplesPerSec=11.162639339388779, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6166/20000 [6:23:35<36:10:22,  9.41s/it][2022-12-21 20:23:00,228] [INFO] [timer.py:197:stop] 0/167, RunningAvgSamplesPerSec=10.950952484564887, CurrSamplesPerSec=10.93171504506212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6167/20000 [6:23:44<35:36:07,  9.27s/it][2022-12-21 20:23:10,820] [INFO] [timer.py:197:stop] 0/168, RunningAvgSamplesPerSec=10.950317333468048, CurrSamplesPerSec=10.84651684503409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6168/20000 [6:23:55<37:07:45,  9.66s/it][2022-12-21 20:23:19,817] [INFO] [timer.py:197:stop] 0/169, RunningAvgSamplesPerSec=10.949380683822804, CurrSamplesPerSec=10.796086766550259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6169/20000 [6:24:04<36:21:27,  9.46s/it][2022-12-21 20:23:30,537] [INFO] [logging.py:68:log_dist] [Rank 0] step=6170, skipped=14, lr=[7.100000000000001e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:23:30,538] [INFO] [timer.py:197:stop] 0/170, RunningAvgSamplesPerSec=10.94761071312408, CurrSamplesPerSec=10.659841880306582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6170/20000 [6:24:14<37:48:16,  9.84s/it][2022-12-21 20:23:39,428] [INFO] [timer.py:197:stop] 0/171, RunningAvgSamplesPerSec=10.947318042976393, CurrSamplesPerSec=10.898370608362185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6171/20000 [6:24:23<36:42:24,  9.56s/it][2022-12-21 20:23:49,868] [INFO] [timer.py:197:stop] 0/172, RunningAvgSamplesPerSec=10.946371690203858, CurrSamplesPerSec=10.788754586725107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6172/20000 [6:24:34<37:43:23,  9.82s/it][2022-12-21 20:23:59,998] [INFO] [timer.py:197:stop] 0/173, RunningAvgSamplesPerSec=10.948033875361354, CurrSamplesPerSec=11.23813703164897, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6173/20000 [6:24:44<38:04:35,  9.91s/it][2022-12-21 20:24:08,920] [INFO] [timer.py:197:stop] 0/174, RunningAvgSamplesPerSec=10.947395489868422, CurrSamplesPerSec=10.83931561105112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6174/20000 [6:24:53<36:55:50,  9.62s/it][2022-12-21 20:24:18,123] [INFO] [timer.py:197:stop] 0/175, RunningAvgSamplesPerSec=10.94743310826295, CurrSamplesPerSec=10.953907320883301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6175/20000 [6:25:02<36:27:10,  9.49s/it]

                                                         
{'loss': 0.0985, 'learning_rate': 7.0974358974358985e-06, 'epoch': 0.31}


 31%|███       | 6175/20000 [6:25:02<36:27:10,  9.49s/it][2022-12-21 20:24:27,977] [INFO] [timer.py:197:stop] 0/176, RunningAvgSamplesPerSec=10.947520031998605, CurrSamplesPerSec=10.962578642743305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6176/20000 [6:25:12<36:51:58,  9.60s/it][2022-12-21 20:24:37,844] [INFO] [timer.py:197:stop] 0/177, RunningAvgSamplesPerSec=10.946646899193977, CurrSamplesPerSec=10.796813237107447, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6177/20000 [6:25:22<37:10:15,  9.68s/it][2022-12-21 20:24:47,182] [INFO] [timer.py:197:stop] 0/178, RunningAvgSamplesPerSec=10.946679021371057, CurrSamplesPerSec=10.952303307068957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6178/20000 [6:25:31<36:46:23,  9.58s/it][2022-12-21 20:24:56,146] [INFO] [timer.py:197:stop] 0/179, RunningAvgSamplesPerSec=10.946016801286332, CurrSamplesPerSec=10.830700900717702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6179/20000 [6:25:40<36:03:52,  9.39s/it][2022-12-21 20:25:06,576] [INFO] [logging.py:68:log_dist] [Rank 0] step=6180, skipped=14, lr=[7.094871794871796e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:25:06,577] [INFO] [timer.py:197:stop] 0/180, RunningAvgSamplesPerSec=10.947770034232041, CurrSamplesPerSec=11.26719782556694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6180/20000 [6:25:51<37:15:20,  9.70s/it][2022-12-21 20:25:15,666] [INFO] [timer.py:197:stop] 0/181, RunningAvgSamplesPerSec=10.94626345091275, CurrSamplesPerSec=10.684539598762557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6181/20000 [6:26:00<36:32:38,  9.52s/it][2022-12-21 20:25:25,279] [INFO] [timer.py:197:stop] 0/182, RunningAvgSamplesPerSec=10.947552501020077, CurrSamplesPerSec=11.18328880744812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6182/20000 [6:26:09<36:38:52,  9.55s/it][2022-12-21 20:25:35,058] [INFO] [timer.py:197:stop] 0/183, RunningAvgSamplesPerSec=10.946861564279168, CurrSamplesPerSec=10.823897719128567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6183/20000 [6:26:19<36:54:43,  9.62s/it][2022-12-21 20:25:43,950] [INFO] [timer.py:197:stop] 0/184, RunningAvgSamplesPerSec=10.948100980820957, CurrSamplesPerSec=11.17715478135622, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6184/20000 [6:26:28<36:04:27,  9.40s/it][2022-12-21 20:25:53,215] [INFO] [timer.py:197:stop] 0/185, RunningAvgSamplesPerSec=10.949392263584096, CurrSamplesPerSec=11.189589553871967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6185/20000 [6:26:37<35:54:59,  9.36s/it][2022-12-21 20:26:04,434] [INFO] [timer.py:197:stop] 0/186, RunningAvgSamplesPerSec=10.949936094628875, CurrSamplesPerSec=11.050375027112862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6186/20000 [6:26:48<38:03:15,  9.92s/it][2022-12-21 20:26:13,712] [INFO] [timer.py:197:stop] 0/187, RunningAvgSamplesPerSec=10.949571319365726, CurrSamplesPerSec=10.882863796813444, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6187/20000 [6:26:58<37:18:56,  9.73s/it][2022-12-21 20:26:22,982] [INFO] [timer.py:197:stop] 0/188, RunningAvgSamplesPerSec=10.950765783123623, CurrSamplesPerSec=11.17631759665301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6188/20000 [6:27:07<36:47:20,  9.59s/it][2022-12-21 20:26:32,013] [INFO] [timer.py:197:stop] 0/189, RunningAvgSamplesPerSec=10.951114426504569, CurrSamplesPerSec=11.016350471317688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6189/20000 [6:27:16<36:08:38,  9.42s/it][2022-12-21 20:26:40,703] [INFO] [logging.py:68:log_dist] [Rank 0] step=6190, skipped=14, lr=[7.0897435897435904e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:26:40,704] [INFO] [timer.py:197:stop] 0/190, RunningAvgSamplesPerSec=10.952429867238173, CurrSamplesPerSec=11.20409992520039, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6190/20000 [6:27:25<35:18:02,  9.20s/it][2022-12-21 20:26:52,838] [INFO] [timer.py:197:stop] 0/191, RunningAvgSamplesPerSec=10.951822062842105, CurrSamplesPerSec=10.838740958225685, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6191/20000 [6:27:37<38:40:20, 10.08s/it][2022-12-21 20:27:01,914] [INFO] [timer.py:197:stop] 0/192, RunningAvgSamplesPerSec=10.9529657458632, CurrSamplesPerSec=11.173497035355993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6192/20000 [6:27:46<37:30:43,  9.78s/it][2022-12-21 20:27:11,110] [INFO] [timer.py:197:stop] 0/193, RunningAvgSamplesPerSec=10.951598147270506, CurrSamplesPerSec=10.697807681454034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6193/20000 [6:27:55<36:50:12,  9.60s/it][2022-12-21 20:27:20,815] [INFO] [timer.py:197:stop] 0/194, RunningAvgSamplesPerSec=10.95103618559551, CurrSamplesPerSec=10.844748718062666, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6194/20000 [6:28:05<36:57:01,  9.64s/it][2022-12-21 20:27:30,193] [INFO] [timer.py:197:stop] 0/195, RunningAvgSamplesPerSec=10.948430939215383, CurrSamplesPerSec=10.470187232458473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6195/20000 [6:28:14<36:39:05,  9.56s/it][2022-12-21 20:27:39,374] [INFO] [timer.py:197:stop] 0/196, RunningAvgSamplesPerSec=10.947555159549037, CurrSamplesPerSec=10.781112796430397, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6196/20000 [6:28:23<36:12:57,  9.44s/it][2022-12-21 20:27:48,278] [INFO] [timer.py:197:stop] 0/197, RunningAvgSamplesPerSec=10.948908873056945, CurrSamplesPerSec=11.218017400424097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6197/20000 [6:28:32<35:35:26,  9.28s/it][2022-12-21 20:27:57,338] [INFO] [timer.py:197:stop] 0/198, RunningAvgSamplesPerSec=10.950112207185674, CurrSamplesPerSec=11.189927727366994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6198/20000 [6:28:41<35:19:56,  9.22s/it][2022-12-21 20:28:06,747] [INFO] [timer.py:197:stop] 0/199, RunningAvgSamplesPerSec=10.949917488012762, CurrSamplesPerSec=10.91188576260572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6199/20000 [6:28:51<35:33:08,  9.27s/it][2022-12-21 20:28:15,933] [INFO] [logging.py:68:log_dist] [Rank 0] step=6200, skipped=14, lr=[7.084615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:28:15,934] [INFO] [timer.py:197:stop] 0/200, RunningAvgSamplesPerSec=10.95065965678296, CurrSamplesPerSec=11.09885557963022, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6200/20000 [6:29:00<35:26:58,  9.25s/it]

                                                         
{'loss': 0.1041, 'learning_rate': 7.084615384615385e-06, 'epoch': 0.31}


 31%|███       | 6200/20000 [6:29:00<35:26:58,  9.25s/it][2022-12-21 20:28:25,557] [INFO] [timer.py:197:stop] 0/201, RunningAvgSamplesPerSec=10.95182537682852, CurrSamplesPerSec=11.187632747027104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6201/20000 [6:29:10<35:52:41,  9.36s/it][2022-12-21 20:28:36,329] [INFO] [timer.py:197:stop] 0/202, RunningAvgSamplesPerSec=10.951069709256565, CurrSamplesPerSec=10.80273894552714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6202/20000 [6:29:20<37:30:02,  9.78s/it][2022-12-21 20:28:45,628] [INFO] [timer.py:197:stop] 0/203, RunningAvgSamplesPerSec=10.952050932834243, CurrSamplesPerSec=11.151894456192407, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6203/20000 [6:29:30<36:56:20,  9.64s/it][2022-12-21 20:28:54,499] [INFO] [timer.py:197:stop] 0/204, RunningAvgSamplesPerSec=10.95299236802901, CurrSamplesPerSec=11.145564348205548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6204/20000 [6:29:38<36:03:12,  9.41s/it][2022-12-21 20:29:04,762] [INFO] [timer.py:197:stop] 0/205, RunningAvgSamplesPerSec=10.953358252565511, CurrSamplesPerSec=11.02777152423768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6205/20000 [6:29:49<37:02:03,  9.66s/it][2022-12-21 20:29:13,955] [INFO] [timer.py:197:stop] 0/206, RunningAvgSamplesPerSec=10.95223250000206, CurrSamplesPerSec=10.728398231902545, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6206/20000 [6:29:58<36:29:22,  9.52s/it][2022-12-21 20:29:22,668] [INFO] [timer.py:197:stop] 0/207, RunningAvgSamplesPerSec=10.953365774027324, CurrSamplesPerSec=11.189563433735145, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6207/20000 [6:30:07<35:33:16,  9.28s/it][2022-12-21 20:29:32,180] [INFO] [timer.py:197:stop] 0/208, RunningAvgSamplesPerSec=10.952106317133781, CurrSamplesPerSec=10.699892433249502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6208/20000 [6:30:16<35:49:09,  9.35s/it][2022-12-21 20:29:40,837] [INFO] [timer.py:197:stop] 0/209, RunningAvgSamplesPerSec=10.953753135101085, CurrSamplesPerSec=11.303894367858463, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6209/20000 [6:30:25<35:01:17,  9.14s/it][2022-12-21 20:29:51,300] [INFO] [logging.py:68:log_dist] [Rank 0] step=6210, skipped=14, lr=[7.07948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:29:51,301] [INFO] [timer.py:197:stop] 0/210, RunningAvgSamplesPerSec=10.95450482283021, CurrSamplesPerSec=11.112357171876269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6210/20000 [6:30:35<36:32:14,  9.54s/it][2022-12-21 20:30:00,210] [INFO] [timer.py:197:stop] 0/211, RunningAvgSamplesPerSec=10.955671585440813, CurrSamplesPerSec=11.203882943235245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6211/20000 [6:30:44<35:48:44,  9.35s/it][2022-12-21 20:30:10,489] [INFO] [timer.py:197:stop] 0/212, RunningAvgSamplesPerSec=10.95499176534078, CurrSamplesPerSec=10.814737121577002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6212/20000 [6:30:54<36:52:36,  9.63s/it][2022-12-21 20:30:22,816] [INFO] [timer.py:197:stop] 0/213, RunningAvgSamplesPerSec=10.95386773800937, CurrSamplesPerSec=10.722824475888316, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6213/20000 [6:31:07<39:58:27, 10.44s/it][2022-12-21 20:30:31,716] [INFO] [timer.py:197:stop] 0/214, RunningAvgSamplesPerSec=10.954907987762708, CurrSamplesPerSec=11.178910065303864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6214/20000 [6:31:16<38:12:18,  9.98s/it][2022-12-21 20:30:40,680] [INFO] [timer.py:197:stop] 0/215, RunningAvgSamplesPerSec=10.956421534991872, CurrSamplesPerSec=11.287021227981757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6215/20000 [6:31:25<37:02:20,  9.67s/it][2022-12-21 20:30:49,814] [INFO] [timer.py:197:stop] 0/216, RunningAvgSamplesPerSec=10.955341339078288, CurrSamplesPerSec=10.730014101069697, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6216/20000 [6:31:34<36:25:01,  9.51s/it][2022-12-21 20:30:58,905] [INFO] [timer.py:197:stop] 0/217, RunningAvgSamplesPerSec=10.956184154241978, CurrSamplesPerSec=11.139579795355102, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6217/20000 [6:31:43<35:55:53,  9.38s/it][2022-12-21 20:31:08,777] [INFO] [timer.py:197:stop] 0/218, RunningAvgSamplesPerSec=10.956836414932402, CurrSamplesPerSec=11.098899175147306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6218/20000 [6:31:53<36:29:18,  9.53s/it][2022-12-21 20:31:18,286] [INFO] [timer.py:197:stop] 0/219, RunningAvgSamplesPerSec=10.95566447292872, CurrSamplesPerSec=10.708267765158974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6219/20000 [6:32:02<36:27:37,  9.52s/it][2022-12-21 20:31:27,342] [INFO] [logging.py:68:log_dist] [Rank 0] step=6220, skipped=14, lr=[7.074358974358974e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:31:27,343] [INFO] [timer.py:197:stop] 0/220, RunningAvgSamplesPerSec=10.956426155986824, CurrSamplesPerSec=11.124254858324141, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6220/20000 [6:32:11<35:55:13,  9.38s/it][2022-12-21 20:31:37,409] [INFO] [timer.py:197:stop] 0/221, RunningAvgSamplesPerSec=10.956364741810413, CurrSamplesPerSec=10.942992866265957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6221/20000 [6:32:21<36:42:04,  9.59s/it][2022-12-21 20:31:48,427] [INFO] [timer.py:197:stop] 0/222, RunningAvgSamplesPerSec=10.955492879199399, CurrSamplesPerSec=10.767840404137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6222/20000 [6:32:32<38:20:22, 10.02s/it][2022-12-21 20:31:58,973] [INFO] [timer.py:197:stop] 0/223, RunningAvgSamplesPerSec=10.955508527055905, CurrSamplesPerSec=10.9589521424861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6223/20000 [6:32:43<38:56:36, 10.18s/it][2022-12-21 20:32:10,235] [INFO] [timer.py:197:stop] 0/224, RunningAvgSamplesPerSec=10.955872371540696, CurrSamplesPerSec=11.036879235444294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6224/20000 [6:32:54<40:11:14, 10.50s/it][2022-12-21 20:32:20,839] [INFO] [timer.py:197:stop] 0/225, RunningAvgSamplesPerSec=10.955722709608839, CurrSamplesPerSec=10.922598667090003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6225/20000 [6:33:05<40:18:06, 10.53s/it]

                                                         
{'loss': 0.1041, 'learning_rate': 7.071794871794872e-06, 'epoch': 0.31}


 31%|███       | 6225/20000 [6:33:05<40:18:06, 10.53s/it][2022-12-21 20:32:31,007] [INFO] [timer.py:197:stop] 0/226, RunningAvgSamplesPerSec=10.956430302900174, CurrSamplesPerSec=11.116539826887317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6226/20000 [6:33:15<39:52:50, 10.42s/it][2022-12-21 20:32:40,367] [INFO] [timer.py:197:stop] 0/227, RunningAvgSamplesPerSec=10.956336356538754, CurrSamplesPerSec=10.93533289331629, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6227/20000 [6:33:24<38:39:23, 10.10s/it][2022-12-21 20:32:49,159] [INFO] [timer.py:197:stop] 0/228, RunningAvgSamplesPerSec=10.957500520369813, CurrSamplesPerSec=11.225881489586444, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6228/20000 [6:33:33<37:08:54,  9.71s/it][2022-12-21 20:32:58,479] [INFO] [timer.py:197:stop] 0/229, RunningAvgSamplesPerSec=10.958291788937466, CurrSamplesPerSec=11.14009848886928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6229/20000 [6:33:42<36:41:50,  9.59s/it][2022-12-21 20:33:07,626] [INFO] [logging.py:68:log_dist] [Rank 0] step=6230, skipped=14, lr=[7.069230769230769e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:33:07,627] [INFO] [timer.py:197:stop] 0/230, RunningAvgSamplesPerSec=10.9579710536018, CurrSamplesPerSec=10.885646786007449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6230/20000 [6:33:52<36:11:00,  9.46s/it][2022-12-21 20:33:18,548] [INFO] [timer.py:197:stop] 0/231, RunningAvgSamplesPerSec=10.957648760726666, CurrSamplesPerSec=10.884657615887944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6231/20000 [6:34:03<37:51:29,  9.90s/it][2022-12-21 20:33:28,687] [INFO] [timer.py:197:stop] 0/232, RunningAvgSamplesPerSec=10.957496344971563, CurrSamplesPerSec=10.922704444575105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6232/20000 [6:34:13<38:07:54,  9.97s/it][2022-12-21 20:33:37,856] [INFO] [timer.py:197:stop] 0/233, RunningAvgSamplesPerSec=10.956798050963213, CurrSamplesPerSec=10.798520588900233, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6233/20000 [6:34:22<37:12:31,  9.73s/it][2022-12-21 20:33:48,369] [INFO] [timer.py:197:stop] 0/234, RunningAvgSamplesPerSec=10.957725144165567, CurrSamplesPerSec=11.176171486107906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6234/20000 [6:34:32<38:06:19,  9.97s/it][2022-12-21 20:33:57,803] [INFO] [timer.py:197:stop] 0/235, RunningAvgSamplesPerSec=10.958751400797608, CurrSamplesPerSec=11.202153934739714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6235/20000 [6:34:42<37:29:33,  9.81s/it][2022-12-21 20:34:06,974] [INFO] [timer.py:197:stop] 0/236, RunningAvgSamplesPerSec=10.95855152560764, CurrSamplesPerSec=10.912178525026869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6236/20000 [6:34:51<36:45:43,  9.62s/it][2022-12-21 20:34:17,530] [INFO] [timer.py:197:stop] 0/237, RunningAvgSamplesPerSec=10.957520075042243, CurrSamplesPerSec=10.721384195507934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6237/20000 [6:35:01<37:50:16,  9.90s/it][2022-12-21 20:34:27,047] [INFO] [timer.py:197:stop] 0/238, RunningAvgSamplesPerSec=10.95878416825808, CurrSamplesPerSec=11.264159158498853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6238/20000 [6:35:11<37:23:57,  9.78s/it][2022-12-21 20:34:36,640] [INFO] [timer.py:197:stop] 0/239, RunningAvgSamplesPerSec=10.959592404986086, CurrSamplesPerSec=11.15372940546217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6239/20000 [6:35:21<37:10:42,  9.73s/it][2022-12-21 20:34:46,571] [INFO] [logging.py:68:log_dist] [Rank 0] step=6240, skipped=14, lr=[7.064102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:34:46,572] [INFO] [timer.py:197:stop] 0/240, RunningAvgSamplesPerSec=10.96033714971494, CurrSamplesPerSec=11.139742979817983, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6240/20000 [6:35:31<37:24:39,  9.79s/it][2022-12-21 20:34:56,087] [INFO] [timer.py:197:stop] 0/241, RunningAvgSamplesPerSec=10.959859719792957, CurrSamplesPerSec=10.847402220595058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6241/20000 [6:35:40<37:05:45,  9.71s/it][2022-12-21 20:35:05,852] [INFO] [timer.py:197:stop] 0/242, RunningAvgSamplesPerSec=10.959031965224804, CurrSamplesPerSec=10.764721017210372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6242/20000 [6:35:50<37:09:39,  9.72s/it][2022-12-21 20:35:14,950] [INFO] [timer.py:197:stop] 0/243, RunningAvgSamplesPerSec=10.958926239626754, CurrSamplesPerSec=10.933610954976091, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6243/20000 [6:35:59<36:26:25,  9.54s/it][2022-12-21 20:35:24,793] [INFO] [timer.py:197:stop] 0/244, RunningAvgSamplesPerSec=10.958556917508435, CurrSamplesPerSec=10.870270335937697, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6244/20000 [6:36:09<36:47:24,  9.63s/it][2022-12-21 20:35:33,784] [INFO] [timer.py:197:stop] 0/245, RunningAvgSamplesPerSec=10.958048061278763, CurrSamplesPerSec=10.836278912875635, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6245/20000 [6:36:18<36:03:28,  9.44s/it][2022-12-21 20:35:43,122] [INFO] [timer.py:197:stop] 0/246, RunningAvgSamplesPerSec=10.958063561783849, CurrSamplesPerSec=10.961831485000486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6246/20000 [6:36:27<35:56:28,  9.41s/it][2022-12-21 20:35:52,161] [INFO] [timer.py:197:stop] 0/247, RunningAvgSamplesPerSec=10.95882788476282, CurrSamplesPerSec=11.148564824328638, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6247/20000 [6:36:36<35:30:57,  9.30s/it][2022-12-21 20:36:01,889] [INFO] [timer.py:197:stop] 0/248, RunningAvgSamplesPerSec=10.958748801927896, CurrSamplesPerSec=10.939407842160794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6248/20000 [6:36:46<36:00:27,  9.43s/it][2022-12-21 20:36:10,918] [INFO] [timer.py:197:stop] 0/249, RunningAvgSamplesPerSec=10.957536588800547, CurrSamplesPerSec=10.667263912155319, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███       | 6249/20000 [6:36:55<35:32:59,  9.31s/it][2022-12-21 20:36:20,426] [INFO] [logging.py:68:log_dist] [Rank 0] step=6250, skipped=14, lr=[7.05897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:36:20,427] [INFO] [timer.py:197:stop] 0/250, RunningAvgSamplesPerSec=10.95628374738731, CurrSamplesPerSec=10.655365532182872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6250/20000 [6:37:04<35:46:46,  9.37s/it]

                                                         
{'loss': 0.0999, 'learning_rate': 7.05897435897436e-06, 'epoch': 0.31}


 31%|███▏      | 6250/20000 [6:37:04<35:46:46,  9.37s/it][2022-12-21 20:36:30,617] [INFO] [timer.py:197:stop] 0/251, RunningAvgSamplesPerSec=10.956386939574811, CurrSamplesPerSec=10.982038760576334, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6251/20000 [6:37:15<36:43:09,  9.61s/it][2022-12-21 20:36:39,471] [INFO] [timer.py:197:stop] 0/252, RunningAvgSamplesPerSec=10.956318873475439, CurrSamplesPerSec=10.939396696974926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6252/20000 [6:37:23<35:50:43,  9.39s/it][2022-12-21 20:36:49,561] [INFO] [timer.py:197:stop] 0/253, RunningAvgSamplesPerSec=10.957303069835527, CurrSamplesPerSec=11.209027303112236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6253/20000 [6:37:34<36:38:55,  9.60s/it][2022-12-21 20:36:58,790] [INFO] [timer.py:197:stop] 0/254, RunningAvgSamplesPerSec=10.955765612200958, CurrSamplesPerSec=10.583044637833282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6254/20000 [6:37:43<36:13:27,  9.49s/it][2022-12-21 20:37:08,065] [INFO] [timer.py:197:stop] 0/255, RunningAvgSamplesPerSec=10.956346799420535, CurrSamplesPerSec=11.104798281548469, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6255/20000 [6:37:52<35:58:46,  9.42s/it][2022-12-21 20:37:17,265] [INFO] [timer.py:197:stop] 0/256, RunningAvgSamplesPerSec=10.956646135258971, CurrSamplesPerSec=11.032907300431965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6256/20000 [6:38:01<35:43:09,  9.36s/it][2022-12-21 20:37:26,001] [INFO] [timer.py:197:stop] 0/257, RunningAvgSamplesPerSec=10.958260302242017, CurrSamplesPerSec=11.384260056796732, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6257/20000 [6:38:10<35:00:25,  9.17s/it][2022-12-21 20:37:35,261] [INFO] [timer.py:197:stop] 0/258, RunningAvgSamplesPerSec=10.958902949429325, CurrSamplesPerSec=11.12527560846059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6258/20000 [6:38:19<35:06:24,  9.20s/it][2022-12-21 20:37:44,426] [INFO] [timer.py:197:stop] 0/259, RunningAvgSamplesPerSec=10.959909614761601, CurrSamplesPerSec=11.223846268668574, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6259/20000 [6:38:28<35:04:03,  9.19s/it][2022-12-21 20:37:53,532] [INFO] [logging.py:68:log_dist] [Rank 0] step=6260, skipped=14, lr=[7.053846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:37:53,533] [INFO] [timer.py:197:stop] 0/260, RunningAvgSamplesPerSec=10.959228255602538, CurrSamplesPerSec=10.786883435633115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6260/20000 [6:38:37<34:58:22,  9.16s/it][2022-12-21 20:38:02,485] [INFO] [timer.py:197:stop] 0/261, RunningAvgSamplesPerSec=10.959159241827566, CurrSamplesPerSec=10.941382681744704, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6261/20000 [6:38:46<34:43:44,  9.10s/it][2022-12-21 20:38:12,475] [INFO] [timer.py:197:stop] 0/262, RunningAvgSamplesPerSec=10.959172167293875, CurrSamplesPerSec=10.962520889950909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6262/20000 [6:38:56<35:44:44,  9.37s/it][2022-12-21 20:38:21,438] [INFO] [timer.py:197:stop] 0/263, RunningAvgSamplesPerSec=10.959330135016305, CurrSamplesPerSec=11.000556839877145, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6263/20000 [6:39:05<35:16:50,  9.25s/it][2022-12-21 20:38:30,763] [INFO] [timer.py:197:stop] 0/264, RunningAvgSamplesPerSec=10.959376525094527, CurrSamplesPerSec=10.971497778258614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6264/20000 [6:39:15<35:22:08,  9.27s/it][2022-12-21 20:38:41,398] [INFO] [timer.py:197:stop] 0/265, RunningAvgSamplesPerSec=10.959543978774555, CurrSamplesPerSec=11.003593854919234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6265/20000 [6:39:25<36:55:42,  9.68s/it][2022-12-21 20:38:51,195] [INFO] [timer.py:197:stop] 0/266, RunningAvgSamplesPerSec=10.957259709946824, CurrSamplesPerSec=10.387835980243429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6266/20000 [6:39:35<37:03:38,  9.71s/it][2022-12-21 20:39:00,319] [INFO] [timer.py:197:stop] 0/267, RunningAvgSamplesPerSec=10.957553084872151, CurrSamplesPerSec=11.03555751023018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6267/20000 [6:39:44<36:22:57,  9.54s/it][2022-12-21 20:39:09,419] [INFO] [timer.py:197:stop] 0/268, RunningAvgSamplesPerSec=10.956676827659638, CurrSamplesPerSec=10.729305597451654, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6268/20000 [6:39:53<35:52:45,  9.41s/it][2022-12-21 20:39:19,146] [INFO] [timer.py:197:stop] 0/269, RunningAvgSamplesPerSec=10.956552368332767, CurrSamplesPerSec=10.923546293054766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6269/20000 [6:40:03<36:14:37,  9.50s/it][2022-12-21 20:39:28,120] [INFO] [logging.py:68:log_dist] [Rank 0] step=6270, skipped=14, lr=[7.048717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:39:28,121] [INFO] [timer.py:197:stop] 0/270, RunningAvgSamplesPerSec=10.955715745805547, CurrSamplesPerSec=10.736817407697865, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6270/20000 [6:40:12<35:38:13,  9.34s/it][2022-12-21 20:39:37,485] [INFO] [timer.py:197:stop] 0/271, RunningAvgSamplesPerSec=10.955960556681173, CurrSamplesPerSec=11.021966620827254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6271/20000 [6:40:21<35:39:29,  9.35s/it][2022-12-21 20:39:46,488] [INFO] [timer.py:197:stop] 0/272, RunningAvgSamplesPerSec=10.95702646552113, CurrSamplesPerSec=11.251490279749126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6272/20000 [6:40:30<35:15:30,  9.25s/it][2022-12-21 20:39:56,215] [INFO] [timer.py:197:stop] 0/273, RunningAvgSamplesPerSec=10.957726943718686, CurrSamplesPerSec=11.15019025510708, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6273/20000 [6:40:40<35:48:21,  9.39s/it][2022-12-21 20:40:05,823] [INFO] [timer.py:197:stop] 0/274, RunningAvgSamplesPerSec=10.958527200827499, CurrSamplesPerSec=11.179791871765566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6274/20000 [6:40:50<36:03:05,  9.46s/it][2022-12-21 20:40:15,694] [INFO] [timer.py:197:stop] 0/275, RunningAvgSamplesPerSec=10.959308958232237, CurrSamplesPerSec=11.176170090165707, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6275/20000 [6:41:00<36:31:30,  9.58s/it]

                                                         
{'loss': 0.1036, 'learning_rate': 7.046153846153847e-06, 'epoch': 0.31}


 31%|███▏      | 6275/20000 [6:41:00<36:31:30,  9.58s/it][2022-12-21 20:40:24,730] [INFO] [timer.py:197:stop] 0/276, RunningAvgSamplesPerSec=10.95862477953431, CurrSamplesPerSec=10.774985442244093, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6276/20000 [6:41:09<35:53:55,  9.42s/it][2022-12-21 20:40:33,496] [INFO] [timer.py:197:stop] 0/277, RunningAvgSamplesPerSec=10.95924387117331, CurrSamplesPerSec=11.131551757283942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6277/20000 [6:41:17<35:09:10,  9.22s/it][2022-12-21 20:40:42,953] [INFO] [timer.py:197:stop] 0/278, RunningAvgSamplesPerSec=10.95939574844447, CurrSamplesPerSec=11.00132236133259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6278/20000 [6:41:27<35:25:06,  9.29s/it][2022-12-21 20:40:51,902] [INFO] [timer.py:197:stop] 0/279, RunningAvgSamplesPerSec=10.960007855103886, CurrSamplesPerSec=11.13160391901791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6279/20000 [6:41:36<35:01:24,  9.19s/it][2022-12-21 20:41:00,994] [INFO] [logging.py:68:log_dist] [Rank 0] step=6280, skipped=14, lr=[7.043589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:41:00,995] [INFO] [timer.py:197:stop] 0/280, RunningAvgSamplesPerSec=10.95961437970325, CurrSamplesPerSec=10.851698782077916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6280/20000 [6:41:45<34:54:41,  9.16s/it][2022-12-21 20:41:10,421] [INFO] [timer.py:197:stop] 0/281, RunningAvgSamplesPerSec=10.959634651447992, CurrSamplesPerSec=10.965273106260703, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6281/20000 [6:41:54<35:12:44,  9.24s/it][2022-12-21 20:41:19,540] [INFO] [timer.py:197:stop] 0/282, RunningAvgSamplesPerSec=10.960583607607903, CurrSamplesPerSec=11.231920147746353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6282/20000 [6:42:04<35:04:17,  9.20s/it][2022-12-21 20:41:28,924] [INFO] [timer.py:197:stop] 0/283, RunningAvgSamplesPerSec=10.961316686343002, CurrSamplesPerSec=11.17051008656626, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6283/20000 [6:42:13<35:16:29,  9.26s/it][2022-12-21 20:41:37,833] [INFO] [timer.py:197:stop] 0/284, RunningAvgSamplesPerSec=10.961272460432157, CurrSamplesPerSec=10.948859103369356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6284/20000 [6:42:22<34:52:23,  9.15s/it][2022-12-21 20:41:48,534] [INFO] [timer.py:197:stop] 0/285, RunningAvgSamplesPerSec=10.961941956064287, CurrSamplesPerSec=11.154060316631254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6285/20000 [6:42:32<36:38:26,  9.62s/it][2022-12-21 20:41:57,452] [INFO] [timer.py:197:stop] 0/286, RunningAvgSamplesPerSec=10.961194839738685, CurrSamplesPerSec=10.753776023785301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6286/20000 [6:42:41<35:50:16,  9.41s/it][2022-12-21 20:42:06,482] [INFO] [timer.py:197:stop] 0/287, RunningAvgSamplesPerSec=10.959921325052498, CurrSamplesPerSec=10.609836651835542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6287/20000 [6:42:50<35:24:14,  9.29s/it][2022-12-21 20:42:16,139] [INFO] [timer.py:197:stop] 0/288, RunningAvgSamplesPerSec=10.96060079563545, CurrSamplesPerSec=11.15774523107843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6288/20000 [6:43:00<35:48:56,  9.40s/it][2022-12-21 20:42:27,062] [INFO] [timer.py:197:stop] 0/289, RunningAvgSamplesPerSec=10.959026333820352, CurrSamplesPerSec=10.526561940948298, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6289/20000 [6:43:11<37:32:59,  9.86s/it][2022-12-21 20:42:36,667] [INFO] [logging.py:68:log_dist] [Rank 0] step=6290, skipped=14, lr=[7.038461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:42:36,668] [INFO] [timer.py:197:stop] 0/290, RunningAvgSamplesPerSec=10.958475765219807, CurrSamplesPerSec=10.802716339183831, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6290/20000 [6:43:21<37:15:26,  9.78s/it][2022-12-21 20:42:46,373] [INFO] [timer.py:197:stop] 0/291, RunningAvgSamplesPerSec=10.957862747312179, CurrSamplesPerSec=10.784122549301417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6291/20000 [6:43:30<37:09:54,  9.76s/it][2022-12-21 20:42:55,525] [INFO] [timer.py:197:stop] 0/292, RunningAvgSamplesPerSec=10.95709075151951, CurrSamplesPerSec=10.738451279013042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6292/20000 [6:43:39<36:28:07,  9.58s/it][2022-12-21 20:43:04,985] [INFO] [timer.py:197:stop] 0/293, RunningAvgSamplesPerSec=10.956950505992815, CurrSamplesPerSec=10.916430229475024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6293/20000 [6:43:49<36:19:55,  9.54s/it][2022-12-21 20:43:14,545] [INFO] [timer.py:197:stop] 0/294, RunningAvgSamplesPerSec=10.957767802097235, CurrSamplesPerSec=11.200896086855398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6294/20000 [6:43:59<36:20:56,  9.55s/it][2022-12-21 20:43:23,632] [INFO] [timer.py:197:stop] 0/295, RunningAvgSamplesPerSec=10.957035142325072, CurrSamplesPerSec=10.747209377631398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6295/20000 [6:44:08<35:49:17,  9.41s/it][2022-12-21 20:43:33,031] [INFO] [timer.py:197:stop] 0/296, RunningAvgSamplesPerSec=10.956809223199064, CurrSamplesPerSec=10.891013771580042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6296/20000 [6:44:17<35:48:24,  9.41s/it][2022-12-21 20:43:43,101] [INFO] [timer.py:197:stop] 0/297, RunningAvgSamplesPerSec=10.957306098039677, CurrSamplesPerSec=11.105367954282045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6297/20000 [6:44:27<36:33:43,  9.61s/it][2022-12-21 20:43:52,740] [INFO] [timer.py:197:stop] 0/298, RunningAvgSamplesPerSec=10.957487166957566, CurrSamplesPerSec=11.01116505258593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6298/20000 [6:44:37<36:35:49,  9.62s/it][2022-12-21 20:44:01,636] [INFO] [timer.py:197:stop] 0/299, RunningAvgSamplesPerSec=10.958225351809688, CurrSamplesPerSec=11.181188893231, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 31%|███▏      | 6299/20000 [6:44:46<35:46:25,  9.40s/it][2022-12-21 20:44:10,740] [INFO] [logging.py:68:log_dist] [Rank 0] step=6300, skipped=14, lr=[7.033333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:44:10,741] [INFO] [timer.py:197:stop] 0/300, RunningAvgSamplesPerSec=10.957251025837447, CurrSamplesPerSec=10.675346225862796, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6300/20000 [6:44:55<35:26:02,  9.31s/it]

                                                         
{'loss': 0.1013, 'learning_rate': 7.033333333333334e-06, 'epoch': 0.32}


 32%|███▏      | 6300/20000 [6:44:55<35:26:02,  9.31s/it][2022-12-21 20:44:20,596] [INFO] [timer.py:197:stop] 0/301, RunningAvgSamplesPerSec=10.956624769935226, CurrSamplesPerSec=10.773136358132662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6301/20000 [6:45:05<36:03:07,  9.47s/it][2022-12-21 20:44:29,722] [INFO] [timer.py:197:stop] 0/302, RunningAvgSamplesPerSec=10.956257106824973, CurrSamplesPerSec=10.84742150761183, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6302/20000 [6:45:14<35:39:10,  9.37s/it][2022-12-21 20:44:38,708] [INFO] [timer.py:197:stop] 0/303, RunningAvgSamplesPerSec=10.956974089722001, CurrSamplesPerSec=11.176390653358194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6303/20000 [6:45:23<35:12:41,  9.25s/it][2022-12-21 20:44:48,786] [INFO] [timer.py:197:stop] 0/304, RunningAvgSamplesPerSec=10.957661670768157, CurrSamplesPerSec=11.168621284755194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6304/20000 [6:45:33<36:08:54,  9.50s/it][2022-12-21 20:44:57,585] [INFO] [timer.py:197:stop] 0/305, RunningAvgSamplesPerSec=10.95771735391424, CurrSamplesPerSec=10.974559596640903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6305/20000 [6:45:42<35:21:24,  9.29s/it][2022-12-21 20:45:07,185] [INFO] [timer.py:197:stop] 0/306, RunningAvgSamplesPerSec=10.957679457338722, CurrSamplesPerSec=10.946208854786319, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6306/20000 [6:45:51<35:41:23,  9.38s/it][2022-12-21 20:45:16,633] [INFO] [timer.py:197:stop] 0/307, RunningAvgSamplesPerSec=10.957648001268376, CurrSamplesPerSec=10.948093721249245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6307/20000 [6:46:01<35:45:45,  9.40s/it][2022-12-21 20:45:25,416] [INFO] [timer.py:197:stop] 0/308, RunningAvgSamplesPerSec=10.958161132427385, CurrSamplesPerSec=11.116941276964909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6308/20000 [6:46:09<35:03:09,  9.22s/it][2022-12-21 20:45:34,406] [INFO] [timer.py:197:stop] 0/309, RunningAvgSamplesPerSec=10.958054428324004, CurrSamplesPerSec=10.925500290480612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6309/20000 [6:46:18<34:47:33,  9.15s/it][2022-12-21 20:45:44,758] [INFO] [logging.py:68:log_dist] [Rank 0] step=6310, skipped=14, lr=[7.028205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:45:44,759] [INFO] [timer.py:197:stop] 0/310, RunningAvgSamplesPerSec=10.958069041575644, CurrSamplesPerSec=10.962557153261095, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6310/20000 [6:46:29<36:09:50,  9.51s/it][2022-12-21 20:45:53,776] [INFO] [timer.py:197:stop] 0/311, RunningAvgSamplesPerSec=10.958316688573102, CurrSamplesPerSec=11.035128346585523, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6311/20000 [6:46:38<35:35:55,  9.36s/it][2022-12-21 20:46:03,036] [INFO] [timer.py:197:stop] 0/312, RunningAvgSamplesPerSec=10.958891278796761, CurrSamplesPerSec=11.139373163532618, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6312/20000 [6:46:47<35:28:48,  9.33s/it][2022-12-21 20:46:12,111] [INFO] [timer.py:197:stop] 0/313, RunningAvgSamplesPerSec=10.958705804881587, CurrSamplesPerSec=10.901509948039886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6313/20000 [6:46:56<35:11:06,  9.25s/it][2022-12-21 20:46:21,668] [INFO] [timer.py:197:stop] 0/314, RunningAvgSamplesPerSec=10.958604325507121, CurrSamplesPerSec=10.927135160659368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6314/20000 [6:47:06<35:31:40,  9.35s/it][2022-12-21 20:46:30,945] [INFO] [timer.py:197:stop] 0/315, RunningAvgSamplesPerSec=10.959060457787723, CurrSamplesPerSec=11.103252190338047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6315/20000 [6:47:15<35:26:46,  9.32s/it][2022-12-21 20:46:39,814] [INFO] [timer.py:197:stop] 0/316, RunningAvgSamplesPerSec=10.959312957222982, CurrSamplesPerSec=11.038921203945424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6316/20000 [6:47:24<34:55:28,  9.19s/it][2022-12-21 20:46:49,677] [INFO] [timer.py:197:stop] 0/317, RunningAvgSamplesPerSec=10.959355853395984, CurrSamplesPerSec=10.97284187926056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6317/20000 [6:47:34<35:41:29,  9.39s/it][2022-12-21 20:47:00,095] [INFO] [timer.py:197:stop] 0/318, RunningAvgSamplesPerSec=10.960086100334747, CurrSamplesPerSec=11.195061144527124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6318/20000 [6:47:44<36:51:39,  9.70s/it][2022-12-21 20:47:09,145] [INFO] [timer.py:197:stop] 0/319, RunningAvgSamplesPerSec=10.959582416102021, CurrSamplesPerSec=10.802703731841158, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6319/20000 [6:47:53<36:07:07,  9.50s/it][2022-12-21 20:47:18,672] [INFO] [logging.py:68:log_dist] [Rank 0] step=6320, skipped=14, lr=[7.023076923076923e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:47:18,673] [INFO] [timer.py:197:stop] 0/320, RunningAvgSamplesPerSec=10.959649482989475, CurrSamplesPerSec=10.980951138930937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6320/20000 [6:48:03<36:08:35,  9.51s/it][2022-12-21 20:47:27,823] [INFO] [timer.py:197:stop] 0/321, RunningAvgSamplesPerSec=10.959746912776495, CurrSamplesPerSec=10.990817696858995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6321/20000 [6:48:12<35:43:42,  9.40s/it][2022-12-21 20:47:37,081] [INFO] [timer.py:197:stop] 0/322, RunningAvgSamplesPerSec=10.959516340199617, CurrSamplesPerSec=10.886455558427766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6322/20000 [6:48:21<35:33:37,  9.36s/it][2022-12-21 20:47:46,909] [INFO] [timer.py:197:stop] 0/323, RunningAvgSamplesPerSec=10.959742130645049, CurrSamplesPerSec=11.032476075758604, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6323/20000 [6:48:31<36:05:33,  9.50s/it][2022-12-21 20:47:57,100] [INFO] [timer.py:197:stop] 0/324, RunningAvgSamplesPerSec=10.959751587773132, CurrSamplesPerSec=10.962788169610159, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6324/20000 [6:48:41<36:52:34,  9.71s/it][2022-12-21 20:48:05,946] [INFO] [timer.py:197:stop] 0/325, RunningAvgSamplesPerSec=10.959863302399075, CurrSamplesPerSec=10.99595423632821, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6325/20000 [6:48:50<35:53:34,  9.45s/it]

                                                         
{'loss': 0.1192, 'learning_rate': 7.020512820512821e-06, 'epoch': 0.32}


 32%|███▏      | 6325/20000 [6:48:50<35:53:34,  9.45s/it][2022-12-21 20:48:15,097] [INFO] [timer.py:197:stop] 0/326, RunningAvgSamplesPerSec=10.96048814750147, CurrSamplesPerSec=11.166111152523241, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6326/20000 [6:48:59<35:33:02,  9.36s/it][2022-12-21 20:48:24,429] [INFO] [timer.py:197:stop] 0/327, RunningAvgSamplesPerSec=10.96048158787567, CurrSamplesPerSec=10.958356682422599, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6327/20000 [6:49:08<35:31:01,  9.35s/it][2022-12-21 20:48:36,899] [INFO] [timer.py:197:stop] 0/328, RunningAvgSamplesPerSec=10.960464901693657, CurrSamplesPerSec=10.955044582652219, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6328/20000 [6:49:21<39:04:00, 10.29s/it][2022-12-21 20:48:46,383] [INFO] [timer.py:197:stop] 0/329, RunningAvgSamplesPerSec=10.960303531004156, CurrSamplesPerSec=10.907948747539534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6329/20000 [6:49:30<38:08:59, 10.05s/it][2022-12-21 20:48:55,809] [INFO] [logging.py:68:log_dist] [Rank 0] step=6330, skipped=14, lr=[7.017948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:48:55,810] [INFO] [timer.py:197:stop] 0/330, RunningAvgSamplesPerSec=10.959722672470813, CurrSamplesPerSec=10.773027404783772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6330/20000 [6:49:40<37:26:29,  9.86s/it][2022-12-21 20:49:05,532] [INFO] [timer.py:197:stop] 0/331, RunningAvgSamplesPerSec=10.959133909132042, CurrSamplesPerSec=10.769373555990276, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6331/20000 [6:49:49<37:16:52,  9.82s/it][2022-12-21 20:49:15,097] [INFO] [timer.py:197:stop] 0/332, RunningAvgSamplesPerSec=10.959103175371652, CurrSamplesPerSec=10.949001117189008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6332/20000 [6:49:59<36:59:25,  9.74s/it][2022-12-21 20:49:25,024] [INFO] [timer.py:197:stop] 0/333, RunningAvgSamplesPerSec=10.958961351411233, CurrSamplesPerSec=10.912359069684097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6333/20000 [6:50:09<37:11:47,  9.80s/it][2022-12-21 20:49:34,425] [INFO] [timer.py:197:stop] 0/334, RunningAvgSamplesPerSec=10.958995329103608, CurrSamplesPerSec=10.970253533863568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6334/20000 [6:50:18<36:44:30,  9.68s/it][2022-12-21 20:49:44,145] [INFO] [timer.py:197:stop] 0/335, RunningAvgSamplesPerSec=10.959591513597916, CurrSamplesPerSec=11.161176410568272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6335/20000 [6:50:28<36:47:10,  9.69s/it][2022-12-21 20:49:54,831] [INFO] [timer.py:197:stop] 0/336, RunningAvgSamplesPerSec=10.95932780314872, CurrSamplesPerSec=10.872212363774572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6336/20000 [6:50:39<37:54:58,  9.99s/it][2022-12-21 20:50:03,779] [INFO] [timer.py:197:stop] 0/337, RunningAvgSamplesPerSec=10.959444658359624, CurrSamplesPerSec=10.998614210151823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6337/20000 [6:50:48<36:43:41,  9.68s/it][2022-12-21 20:50:13,190] [INFO] [timer.py:197:stop] 0/338, RunningAvgSamplesPerSec=10.958853275465948, CurrSamplesPerSec=10.76426820002742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6338/20000 [6:50:57<36:25:16,  9.60s/it][2022-12-21 20:50:22,685] [INFO] [timer.py:197:stop] 0/339, RunningAvgSamplesPerSec=10.958726920564342, CurrSamplesPerSec=10.916436000659942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6339/20000 [6:51:07<36:18:08,  9.57s/it][2022-12-21 20:50:32,374] [INFO] [logging.py:68:log_dist] [Rank 0] step=6340, skipped=14, lr=[7.012820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:50:32,375] [INFO] [timer.py:197:stop] 0/340, RunningAvgSamplesPerSec=10.958134992732441, CurrSamplesPerSec=10.76223207275623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6340/20000 [6:51:16<36:26:26,  9.60s/it][2022-12-21 20:50:41,565] [INFO] [timer.py:197:stop] 0/341, RunningAvgSamplesPerSec=10.959259987650317, CurrSamplesPerSec=11.353217674946514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6341/20000 [6:51:26<35:57:59,  9.48s/it][2022-12-21 20:50:50,519] [INFO] [timer.py:197:stop] 0/342, RunningAvgSamplesPerSec=10.959816021982716, CurrSamplesPerSec=11.151620192418141, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6342/20000 [6:51:34<35:21:57,  9.32s/it][2022-12-21 20:50:59,304] [INFO] [timer.py:197:stop] 0/343, RunningAvgSamplesPerSec=10.960109674725913, CurrSamplesPerSec=11.060872210934123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6343/20000 [6:51:43<34:45:09,  9.16s/it][2022-12-21 20:51:08,623] [INFO] [timer.py:197:stop] 0/344, RunningAvgSamplesPerSec=10.960374855757461, CurrSamplesPerSec=11.051556068884588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6344/20000 [6:51:53<34:55:48,  9.21s/it][2022-12-21 20:51:17,706] [INFO] [timer.py:197:stop] 0/345, RunningAvgSamplesPerSec=10.960301124616416, CurrSamplesPerSec=10.935143123909278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6345/20000 [6:52:02<34:47:08,  9.17s/it][2022-12-21 20:51:27,894] [INFO] [timer.py:197:stop] 0/346, RunningAvgSamplesPerSec=10.960580816905173, CurrSamplesPerSec=11.057364861444269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6346/20000 [6:52:12<35:56:24,  9.48s/it][2022-12-21 20:51:38,233] [INFO] [timer.py:197:stop] 0/347, RunningAvgSamplesPerSec=10.960861343402284, CurrSamplesPerSec=11.058222129597356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6347/20000 [6:52:22<36:55:08,  9.73s/it][2022-12-21 20:51:47,094] [INFO] [timer.py:197:stop] 0/348, RunningAvgSamplesPerSec=10.9616936558144, CurrSamplesPerSec=11.256588774008666, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6348/20000 [6:52:31<35:55:20,  9.47s/it][2022-12-21 20:51:56,640] [INFO] [timer.py:197:stop] 0/349, RunningAvgSamplesPerSec=10.962286451833462, CurrSamplesPerSec=11.171316182190088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6349/20000 [6:52:41<36:00:11,  9.49s/it][2022-12-21 20:52:05,912] [INFO] [logging.py:68:log_dist] [Rank 0] step=6350, skipped=14, lr=[7.007692307692309e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:52:05,913] [INFO] [timer.py:197:stop] 0/350, RunningAvgSamplesPerSec=10.962173372295672, CurrSamplesPerSec=10.923075126385138, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6350/20000 [6:52:50<35:44:53,  9.43s/it]

                                                         
{'loss': 0.1138, 'learning_rate': 7.007692307692309e-06, 'epoch': 0.32}


 32%|███▏      | 6350/20000 [6:52:50<35:44:53,  9.43s/it][2022-12-21 20:52:15,033] [INFO] [timer.py:197:stop] 0/351, RunningAvgSamplesPerSec=10.961404274720666, CurrSamplesPerSec=10.700155590166581, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6351/20000 [6:52:59<35:23:45,  9.34s/it][2022-12-21 20:52:24,547] [INFO] [timer.py:197:stop] 0/352, RunningAvgSamplesPerSec=10.961896923584144, CurrSamplesPerSec=11.136579070759463, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6352/20000 [6:53:09<35:35:46,  9.39s/it][2022-12-21 20:52:34,187] [INFO] [timer.py:197:stop] 0/353, RunningAvgSamplesPerSec=10.961266232284888, CurrSamplesPerSec=10.744894107524251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6353/20000 [6:53:18<35:52:39,  9.46s/it][2022-12-21 20:52:44,599] [INFO] [timer.py:197:stop] 0/354, RunningAvgSamplesPerSec=10.961265825144682, CurrSamplesPerSec=10.96112292080079, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6354/20000 [6:53:29<36:57:12,  9.75s/it][2022-12-21 20:52:54,504] [INFO] [timer.py:197:stop] 0/355, RunningAvgSamplesPerSec=10.96143251384051, CurrSamplesPerSec=11.020423599673503, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6355/20000 [6:53:38<37:07:41,  9.80s/it][2022-12-21 20:53:03,672] [INFO] [timer.py:197:stop] 0/356, RunningAvgSamplesPerSec=10.961954675185677, CurrSamplesPerSec=11.149439071213243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6356/20000 [6:53:48<36:24:41,  9.61s/it][2022-12-21 20:53:13,098] [INFO] [timer.py:197:stop] 0/357, RunningAvgSamplesPerSec=10.96178401042272, CurrSamplesPerSec=10.901700765584936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6357/20000 [6:53:57<36:12:08,  9.55s/it][2022-12-21 20:53:22,586] [INFO] [timer.py:197:stop] 0/358, RunningAvgSamplesPerSec=10.961650118152521, CurrSamplesPerSec=10.914324154490474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6358/20000 [6:54:07<36:07:34,  9.53s/it][2022-12-21 20:53:31,883] [INFO] [timer.py:197:stop] 0/359, RunningAvgSamplesPerSec=10.96155535735946, CurrSamplesPerSec=10.92792430733276, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6359/20000 [6:54:16<35:51:23,  9.46s/it][2022-12-21 20:53:41,083] [INFO] [logging.py:68:log_dist] [Rank 0] step=6360, skipped=14, lr=[7.002564102564104e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:53:41,084] [INFO] [timer.py:197:stop] 0/360, RunningAvgSamplesPerSec=10.96123509813172, CurrSamplesPerSec=10.848086074901717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6360/20000 [6:54:25<35:33:15,  9.38s/it][2022-12-21 20:53:52,042] [INFO] [timer.py:197:stop] 0/361, RunningAvgSamplesPerSec=10.961151124617555, CurrSamplesPerSec=10.931171060818802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6361/20000 [6:54:36<37:20:26,  9.86s/it][2022-12-21 20:54:01,523] [INFO] [timer.py:197:stop] 0/362, RunningAvgSamplesPerSec=10.96025674258509, CurrSamplesPerSec=10.648336809849633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6362/20000 [6:54:45<36:54:42,  9.74s/it][2022-12-21 20:54:10,498] [INFO] [timer.py:197:stop] 0/363, RunningAvgSamplesPerSec=10.959695728412305, CurrSamplesPerSec=10.761395058646468, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6363/20000 [6:54:54<36:02:10,  9.51s/it][2022-12-21 20:54:19,892] [INFO] [timer.py:197:stop] 0/364, RunningAvgSamplesPerSec=10.960019112908647, CurrSamplesPerSec=11.078021310736494, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6364/20000 [6:55:04<35:53:53,  9.48s/it][2022-12-21 20:54:29,364] [INFO] [timer.py:197:stop] 0/365, RunningAvgSamplesPerSec=10.95995942630951, CurrSamplesPerSec=10.938395506135715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6365/20000 [6:55:13<35:53:23,  9.48s/it][2022-12-21 20:54:38,363] [INFO] [timer.py:197:stop] 0/366, RunningAvgSamplesPerSec=10.959312034119131, CurrSamplesPerSec=10.729255422474582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6366/20000 [6:55:22<35:20:43,  9.33s/it][2022-12-21 20:54:48,387] [INFO] [timer.py:197:stop] 0/367, RunningAvgSamplesPerSec=10.958199457641824, CurrSamplesPerSec=10.567693058041135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6367/20000 [6:55:32<36:07:41,  9.54s/it][2022-12-21 20:54:57,787] [INFO] [timer.py:197:stop] 0/368, RunningAvgSamplesPerSec=10.958404052000933, CurrSamplesPerSec=11.03359479033205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6368/20000 [6:55:42<35:57:58,  9.50s/it][2022-12-21 20:55:07,312] [INFO] [timer.py:197:stop] 0/369, RunningAvgSamplesPerSec=10.958391620000832, CurrSamplesPerSec=10.953843401621771, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6369/20000 [6:55:51<35:59:36,  9.51s/it][2022-12-21 20:55:16,224] [INFO] [logging.py:68:log_dist] [Rank 0] step=6370, skipped=14, lr=[6.997435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:55:16,224] [INFO] [timer.py:197:stop] 0/370, RunningAvgSamplesPerSec=10.958020782399796, CurrSamplesPerSec=10.823597454709994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6370/20000 [6:56:00<35:18:59,  9.33s/it][2022-12-21 20:55:25,937] [INFO] [timer.py:197:stop] 0/371, RunningAvgSamplesPerSec=10.957116410551974, CurrSamplesPerSec=10.634144111413363, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6371/20000 [6:56:10<35:45:05,  9.44s/it][2022-12-21 20:55:34,740] [INFO] [timer.py:197:stop] 0/372, RunningAvgSamplesPerSec=10.957320740744967, CurrSamplesPerSec=11.033242418381025, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6372/20000 [6:56:19<35:01:15,  9.25s/it][2022-12-21 20:55:44,030] [INFO] [timer.py:197:stop] 0/373, RunningAvgSamplesPerSec=10.957914221707375, CurrSamplesPerSec=11.182004915266678, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6373/20000 [6:56:28<35:03:45,  9.26s/it][2022-12-21 20:55:54,368] [INFO] [timer.py:197:stop] 0/374, RunningAvgSamplesPerSec=10.958140402024346, CurrSamplesPerSec=11.042702587184793, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6374/20000 [6:56:38<36:16:49,  9.59s/it][2022-12-21 20:56:03,197] [INFO] [timer.py:197:stop] 0/375, RunningAvgSamplesPerSec=10.958297329828627, CurrSamplesPerSec=11.016987970824761, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6375/20000 [6:56:47<35:25:10,  9.36s/it]

                                                         
{'loss': 0.1082, 'learning_rate': 6.994871794871796e-06, 'epoch': 0.32}


 32%|███▏      | 6375/20000 [6:56:47<35:25:10,  9.36s/it][2022-12-21 20:56:13,373] [INFO] [timer.py:197:stop] 0/376, RunningAvgSamplesPerSec=10.957241478683567, CurrSamplesPerSec=10.577108620162406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6376/20000 [6:56:57<36:20:40,  9.60s/it][2022-12-21 20:56:22,953] [INFO] [timer.py:197:stop] 0/377, RunningAvgSamplesPerSec=10.956552913046874, CurrSamplesPerSec=10.704958664337994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6377/20000 [6:57:07<36:18:54,  9.60s/it][2022-12-21 20:56:32,196] [INFO] [timer.py:197:stop] 0/378, RunningAvgSamplesPerSec=10.956513622956766, CurrSamplesPerSec=10.941799678523147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6378/20000 [6:57:16<35:54:41,  9.49s/it][2022-12-21 20:56:41,087] [INFO] [timer.py:197:stop] 0/379, RunningAvgSamplesPerSec=10.957083730643399, CurrSamplesPerSec=11.17573317739333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6379/20000 [6:57:25<35:13:39,  9.31s/it][2022-12-21 20:56:50,152] [INFO] [logging.py:68:log_dist] [Rank 0] step=6380, skipped=14, lr=[6.992307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:56:50,153] [INFO] [timer.py:197:stop] 0/380, RunningAvgSamplesPerSec=10.957292480556662, CurrSamplesPerSec=11.036562046970733, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6380/20000 [6:57:34<34:56:51,  9.24s/it][2022-12-21 20:56:58,893] [INFO] [timer.py:197:stop] 0/381, RunningAvgSamplesPerSec=10.957827282068953, CurrSamplesPerSec=11.163792037208612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6381/20000 [6:57:43<34:22:51,  9.09s/it][2022-12-21 20:57:08,965] [INFO] [timer.py:197:stop] 0/382, RunningAvgSamplesPerSec=10.957868842617415, CurrSamplesPerSec=10.97364302499616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6382/20000 [6:57:53<35:29:40,  9.38s/it][2022-12-21 20:57:17,849] [INFO] [timer.py:197:stop] 0/383, RunningAvgSamplesPerSec=10.958406040664359, CurrSamplesPerSec=11.166426541169947, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6383/20000 [6:58:02<34:55:32,  9.23s/it][2022-12-21 20:57:27,055] [INFO] [timer.py:197:stop] 0/384, RunningAvgSamplesPerSec=10.958155711895309, CurrSamplesPerSec=10.863605536469414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6384/20000 [6:58:11<34:53:31,  9.23s/it][2022-12-21 20:57:37,702] [INFO] [timer.py:197:stop] 0/385, RunningAvgSamplesPerSec=10.957927750135017, CurrSamplesPerSec=10.871534710525706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6385/20000 [6:58:22<36:30:09,  9.65s/it][2022-12-21 20:57:47,461] [INFO] [timer.py:197:stop] 0/386, RunningAvgSamplesPerSec=10.957833142897224, CurrSamplesPerSec=10.921718304571046, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6386/20000 [6:58:31<36:37:16,  9.68s/it][2022-12-21 20:57:56,568] [INFO] [timer.py:197:stop] 0/387, RunningAvgSamplesPerSec=10.956944143771889, CurrSamplesPerSec=10.625909099833619, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6387/20000 [6:58:41<35:57:55,  9.51s/it][2022-12-21 20:58:06,301] [INFO] [timer.py:197:stop] 0/388, RunningAvgSamplesPerSec=10.956235099022841, CurrSamplesPerSec=10.689905884306611, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6388/20000 [6:58:50<36:12:48,  9.58s/it][2022-12-21 20:58:16,519] [INFO] [timer.py:197:stop] 0/389, RunningAvgSamplesPerSec=10.956253136992032, CurrSamplesPerSec=10.963220232131453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6389/20000 [6:59:00<36:56:12,  9.77s/it][2022-12-21 20:58:25,562] [INFO] [logging.py:68:log_dist] [Rank 0] step=6390, skipped=14, lr=[6.9871794871794876e-06], mom=[[0.9, 0.999]]
[2022-12-21 20:58:25,562] [INFO] [timer.py:197:stop] 0/390, RunningAvgSamplesPerSec=10.95654712907609, CurrSamplesPerSec=11.071519041507969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6390/20000 [6:59:10<36:06:38,  9.55s/it][2022-12-21 20:58:34,826] [INFO] [timer.py:197:stop] 0/391, RunningAvgSamplesPerSec=10.956589124845365, CurrSamplesPerSec=10.97290781460933, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6391/20000 [6:59:19<35:46:55,  9.47s/it][2022-12-21 20:58:45,986] [INFO] [timer.py:197:stop] 0/392, RunningAvgSamplesPerSec=10.956636168923874, CurrSamplesPerSec=10.974967010965544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6392/20000 [6:59:30<37:42:00,  9.97s/it][2022-12-21 20:58:55,159] [INFO] [timer.py:197:stop] 0/393, RunningAvgSamplesPerSec=10.956362899412293, CurrSamplesPerSec=10.850817091191255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6393/20000 [6:59:39<36:47:24,  9.73s/it][2022-12-21 20:59:04,429] [INFO] [timer.py:197:stop] 0/394, RunningAvgSamplesPerSec=10.957096985786196, CurrSamplesPerSec=11.251866163065456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6394/20000 [6:59:48<36:15:43,  9.59s/it][2022-12-21 20:59:15,563] [INFO] [timer.py:197:stop] 0/395, RunningAvgSamplesPerSec=10.95720490085435, CurrSamplesPerSec=10.999671979344656, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6395/20000 [7:00:00<38:00:15, 10.06s/it][2022-12-21 20:59:24,971] [INFO] [timer.py:197:stop] 0/396, RunningAvgSamplesPerSec=10.957207492379586, CurrSamplesPerSec=10.95822605671374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6396/20000 [7:00:09<37:16:01,  9.86s/it][2022-12-21 20:59:35,306] [INFO] [timer.py:197:stop] 0/397, RunningAvgSamplesPerSec=10.956686015785184, CurrSamplesPerSec=10.755015596519025, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6397/20000 [7:00:19<37:48:00, 10.00s/it][2022-12-21 20:59:44,181] [INFO] [timer.py:197:stop] 0/398, RunningAvgSamplesPerSec=10.956805226596165, CurrSamplesPerSec=11.004097255008448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6398/20000 [7:00:28<36:31:06,  9.67s/it][2022-12-21 20:59:55,136] [INFO] [timer.py:197:stop] 0/399, RunningAvgSamplesPerSec=10.957356216060163, CurrSamplesPerSec=11.17999255570818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6399/20000 [7:00:39<37:58:36, 10.05s/it][2022-12-21 21:00:04,445] [INFO] [logging.py:68:log_dist] [Rank 0] step=6400, skipped=14, lr=[6.982051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:00:04,446] [INFO] [timer.py:197:stop] 0/400, RunningAvgSamplesPerSec=10.956988646816662, CurrSamplesPerSec=10.812986308635987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6400/20000 [7:00:48<37:07:58,  9.83s/it]

                                                         
{'loss': 0.1008, 'learning_rate': 6.982051282051283e-06, 'epoch': 0.32}


 32%|███▏      | 6400/20000 [7:00:48<37:07:58,  9.83s/it][2022-12-21 21:00:13,337] [INFO] [timer.py:197:stop] 0/401, RunningAvgSamplesPerSec=10.957138200791672, CurrSamplesPerSec=11.016986614364507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6401/20000 [7:00:57<36:04:02,  9.55s/it][2022-12-21 21:00:24,188] [INFO] [timer.py:197:stop] 0/402, RunningAvgSamplesPerSec=10.957030990607617, CurrSamplesPerSec=10.914420896289819, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6402/20000 [7:01:08<37:32:29,  9.94s/it][2022-12-21 21:00:33,893] [INFO] [timer.py:197:stop] 0/403, RunningAvgSamplesPerSec=10.95688522039465, CurrSamplesPerSec=10.898886552136286, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6403/20000 [7:01:18<37:16:24,  9.87s/it][2022-12-21 21:00:44,030] [INFO] [timer.py:197:stop] 0/404, RunningAvgSamplesPerSec=10.957369298305872, CurrSamplesPerSec=11.154994296494994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6404/20000 [7:01:28<37:34:29,  9.95s/it][2022-12-21 21:00:54,759] [INFO] [timer.py:197:stop] 0/405, RunningAvgSamplesPerSec=10.957177231049409, CurrSamplesPerSec=10.880507798052184, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6405/20000 [7:01:39<38:27:18, 10.18s/it][2022-12-21 21:01:03,838] [INFO] [timer.py:197:stop] 0/406, RunningAvgSamplesPerSec=10.957331004263272, CurrSamplesPerSec=11.019654965330645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6406/20000 [7:01:48<37:12:06,  9.85s/it][2022-12-21 21:01:14,108] [INFO] [timer.py:197:stop] 0/407, RunningAvgSamplesPerSec=10.956590253869898, CurrSamplesPerSec=10.665302874857137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6407/20000 [7:01:58<37:40:21,  9.98s/it][2022-12-21 21:01:23,632] [INFO] [timer.py:197:stop] 0/408, RunningAvgSamplesPerSec=10.957036505834909, CurrSamplesPerSec=11.140807263178926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6408/20000 [7:02:08<37:09:23,  9.84s/it][2022-12-21 21:01:32,747] [INFO] [timer.py:197:stop] 0/409, RunningAvgSamplesPerSec=10.957122200171934, CurrSamplesPerSec=10.992025200680335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6409/20000 [7:02:17<36:19:53,  9.62s/it][2022-12-21 21:01:41,706] [INFO] [logging.py:68:log_dist] [Rank 0] step=6410, skipped=14, lr=[6.976923076923078e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:01:41,707] [INFO] [timer.py:197:stop] 0/410, RunningAvgSamplesPerSec=10.95660942555617, CurrSamplesPerSec=10.751820518621104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6410/20000 [7:02:26<35:34:37,  9.42s/it][2022-12-21 21:01:51,331] [INFO] [timer.py:197:stop] 0/411, RunningAvgSamplesPerSec=10.95597477410286, CurrSamplesPerSec=10.703029833266907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6411/20000 [7:02:35<35:48:02,  9.48s/it][2022-12-21 21:02:00,686] [INFO] [timer.py:197:stop] 0/412, RunningAvgSamplesPerSec=10.956408108789258, CurrSamplesPerSec=11.136563361994718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6412/20000 [7:02:45<35:39:03,  9.45s/it][2022-12-21 21:02:09,910] [INFO] [timer.py:197:stop] 0/413, RunningAvgSamplesPerSec=10.955284452974412, CurrSamplesPerSec=10.513220861428202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6413/20000 [7:02:54<35:23:54,  9.38s/it][2022-12-21 21:02:19,176] [INFO] [timer.py:197:stop] 0/414, RunningAvgSamplesPerSec=10.956086269604883, CurrSamplesPerSec=11.295878331686165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6414/20000 [7:03:03<35:16:01,  9.35s/it][2022-12-21 21:02:28,388] [INFO] [timer.py:197:stop] 0/415, RunningAvgSamplesPerSec=10.955771979138001, CurrSamplesPerSec=10.827800489356779, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6415/20000 [7:03:12<35:06:49,  9.31s/it][2022-12-21 21:02:37,414] [INFO] [timer.py:197:stop] 0/416, RunningAvgSamplesPerSec=10.955370875685732, CurrSamplesPerSec=10.792188597130437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6416/20000 [7:03:21<34:47:45,  9.22s/it][2022-12-21 21:02:46,585] [INFO] [timer.py:197:stop] 0/417, RunningAvgSamplesPerSec=10.955070517852592, CurrSamplesPerSec=10.832121310190736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6417/20000 [7:03:31<34:44:10,  9.21s/it][2022-12-21 21:02:56,096] [INFO] [timer.py:197:stop] 0/418, RunningAvgSamplesPerSec=10.95502872304096, CurrSamplesPerSec=10.937711360466684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6418/20000 [7:03:40<35:04:42,  9.30s/it][2022-12-21 21:03:05,417] [INFO] [timer.py:197:stop] 0/419, RunningAvgSamplesPerSec=10.954542551516598, CurrSamplesPerSec=10.755970137292802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6419/20000 [7:03:49<35:06:07,  9.30s/it][2022-12-21 21:03:15,190] [INFO] [logging.py:68:log_dist] [Rank 0] step=6420, skipped=14, lr=[6.971794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:03:15,191] [INFO] [timer.py:197:stop] 0/420, RunningAvgSamplesPerSec=10.95486396933627, CurrSamplesPerSec=11.090559396065768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6420/20000 [7:03:59<35:37:46,  9.45s/it][2022-12-21 21:03:24,150] [INFO] [timer.py:197:stop] 0/421, RunningAvgSamplesPerSec=10.955480101752896, CurrSamplesPerSec=11.219238770707712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6421/20000 [7:04:08<35:04:38,  9.30s/it][2022-12-21 21:03:33,437] [INFO] [timer.py:197:stop] 0/422, RunningAvgSamplesPerSec=10.955209757928243, CurrSamplesPerSec=10.84309767225726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6422/20000 [7:04:17<35:03:36,  9.30s/it][2022-12-21 21:03:43,979] [INFO] [timer.py:197:stop] 0/423, RunningAvgSamplesPerSec=10.955539472029248, CurrSamplesPerSec=11.095796488636, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6423/20000 [7:04:28<36:28:05,  9.67s/it][2022-12-21 21:03:53,482] [INFO] [timer.py:197:stop] 0/424, RunningAvgSamplesPerSec=10.956190566348589, CurrSamplesPerSec=11.237352312070792, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6424/20000 [7:04:37<36:16:34,  9.62s/it][2022-12-21 21:04:02,921] [INFO] [timer.py:197:stop] 0/425, RunningAvgSamplesPerSec=10.956269613638614, CurrSamplesPerSec=10.989729685492472, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6425/20000 [7:04:47<36:04:12,  9.57s/it]

                                                         
{'loss': 0.1291, 'learning_rate': 6.96923076923077e-06, 'epoch': 0.32}


 32%|███▏      | 6425/20000 [7:04:47<36:04:12,  9.57s/it][2022-12-21 21:04:12,448] [INFO] [timer.py:197:stop] 0/426, RunningAvgSamplesPerSec=10.95582528258122, CurrSamplesPerSec=10.771050630171699, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6426/20000 [7:04:56<36:01:26,  9.55s/it][2022-12-21 21:04:21,448] [INFO] [timer.py:197:stop] 0/427, RunningAvgSamplesPerSec=10.955376759815323, CurrSamplesPerSec=10.768455513218418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6427/20000 [7:05:05<35:23:40,  9.39s/it][2022-12-21 21:04:30,795] [INFO] [timer.py:197:stop] 0/428, RunningAvgSamplesPerSec=10.955265937422702, CurrSamplesPerSec=10.908368519079382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6428/20000 [7:05:15<35:20:43,  9.38s/it][2022-12-21 21:04:41,846] [INFO] [timer.py:197:stop] 0/429, RunningAvgSamplesPerSec=10.954462038999775, CurrSamplesPerSec=10.622406470866121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6429/20000 [7:05:26<37:14:17,  9.88s/it][2022-12-21 21:04:51,642] [INFO] [logging.py:68:log_dist] [Rank 0] step=6430, skipped=14, lr=[6.966666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:04:51,643] [INFO] [timer.py:197:stop] 0/430, RunningAvgSamplesPerSec=10.954374972231813, CurrSamplesPerSec=10.91732350394265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6430/20000 [7:05:36<37:08:36,  9.85s/it][2022-12-21 21:05:01,120] [INFO] [timer.py:197:stop] 0/431, RunningAvgSamplesPerSec=10.953833830519727, CurrSamplesPerSec=10.727031898634467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6431/20000 [7:05:45<36:42:52,  9.74s/it][2022-12-21 21:05:10,081] [INFO] [timer.py:197:stop] 0/432, RunningAvgSamplesPerSec=10.95404260265481, CurrSamplesPerSec=11.044345914242848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6432/20000 [7:05:54<35:49:46,  9.51s/it][2022-12-21 21:05:19,913] [INFO] [timer.py:197:stop] 0/433, RunningAvgSamplesPerSec=10.953533334356479, CurrSamplesPerSec=10.738849943474465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6433/20000 [7:06:04<36:11:41,  9.60s/it][2022-12-21 21:05:29,143] [INFO] [timer.py:197:stop] 0/434, RunningAvgSamplesPerSec=10.952860954118279, CurrSamplesPerSec=10.670551866958814, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6434/20000 [7:06:13<35:46:08,  9.49s/it][2022-12-21 21:05:39,840] [INFO] [timer.py:197:stop] 0/435, RunningAvgSamplesPerSec=10.95305808732116, CurrSamplesPerSec=11.038888519238233, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6435/20000 [7:06:24<37:07:44,  9.85s/it][2022-12-21 21:05:49,605] [INFO] [timer.py:197:stop] 0/436, RunningAvgSamplesPerSec=10.953138490507541, CurrSamplesPerSec=10.98806433848985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6436/20000 [7:06:34<37:01:34,  9.83s/it][2022-12-21 21:05:59,638] [INFO] [timer.py:197:stop] 0/437, RunningAvgSamplesPerSec=10.953283325907162, CurrSamplesPerSec=11.016505544194176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6437/20000 [7:06:44<37:15:21,  9.89s/it][2022-12-21 21:06:09,063] [INFO] [timer.py:197:stop] 0/438, RunningAvgSamplesPerSec=10.952942002954785, CurrSamplesPerSec=10.806456802184709, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6438/20000 [7:06:53<36:43:45,  9.75s/it][2022-12-21 21:06:18,080] [INFO] [timer.py:197:stop] 0/439, RunningAvgSamplesPerSec=10.952594782803544, CurrSamplesPerSec=10.803275439208432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6439/20000 [7:07:02<35:53:56,  9.53s/it][2022-12-21 21:06:29,354] [INFO] [logging.py:68:log_dist] [Rank 0] step=6440, skipped=14, lr=[6.961538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:06:29,355] [INFO] [timer.py:197:stop] 0/440, RunningAvgSamplesPerSec=10.952978327983331, CurrSamplesPerSec=11.123198344105472, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6440/20000 [7:07:13<37:52:01, 10.05s/it][2022-12-21 21:06:39,143] [INFO] [timer.py:197:stop] 0/441, RunningAvgSamplesPerSec=10.952683452181974, CurrSamplesPerSec=10.82503651858287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6441/20000 [7:07:23<37:33:56,  9.97s/it][2022-12-21 21:06:48,812] [INFO] [timer.py:197:stop] 0/442, RunningAvgSamplesPerSec=10.95271467908065, CurrSamplesPerSec=10.966440506216587, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6442/20000 [7:07:33<37:13:04,  9.88s/it][2022-12-21 21:06:58,073] [INFO] [timer.py:197:stop] 0/443, RunningAvgSamplesPerSec=10.952822812525811, CurrSamplesPerSec=11.000609584404408, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6443/20000 [7:07:42<36:30:49,  9.70s/it][2022-12-21 21:07:07,186] [INFO] [timer.py:197:stop] 0/444, RunningAvgSamplesPerSec=10.953324532975314, CurrSamplesPerSec=11.179155411422913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6444/20000 [7:07:51<35:51:06,  9.52s/it][2022-12-21 21:07:17,492] [INFO] [timer.py:197:stop] 0/445, RunningAvgSamplesPerSec=10.953417681380502, CurrSamplesPerSec=10.994744968510402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6445/20000 [7:08:01<36:44:08,  9.76s/it][2022-12-21 21:07:26,990] [INFO] [timer.py:197:stop] 0/446, RunningAvgSamplesPerSec=10.9522143525473, CurrSamplesPerSec=10.443934896502954, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6446/20000 [7:08:11<36:26:29,  9.68s/it][2022-12-21 21:07:36,223] [INFO] [timer.py:197:stop] 0/447, RunningAvgSamplesPerSec=10.952122563898321, CurrSamplesPerSec=10.911519831669356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6447/20000 [7:08:20<35:56:06,  9.55s/it][2022-12-21 21:07:45,519] [INFO] [timer.py:197:stop] 0/448, RunningAvgSamplesPerSec=10.95223941854877, CurrSamplesPerSec=11.004488369128042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6448/20000 [7:08:29<35:39:03,  9.47s/it][2022-12-21 21:07:55,304] [INFO] [timer.py:197:stop] 0/449, RunningAvgSamplesPerSec=10.952203313410102, CurrSamplesPerSec=10.93612411562112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6449/20000 [7:08:39<36:00:15,  9.57s/it][2022-12-21 21:08:05,154] [INFO] [logging.py:68:log_dist] [Rank 0] step=6450, skipped=14, lr=[6.956410256410256e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:08:05,155] [INFO] [timer.py:197:stop] 0/450, RunningAvgSamplesPerSec=10.951828707931089, CurrSamplesPerSec=10.786907276154121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6450/20000 [7:08:49<36:19:23,  9.65s/it]

                                                         
{'loss': 0.1273, 'learning_rate': 6.956410256410256e-06, 'epoch': 0.32}


 32%|███▏      | 6450/20000 [7:08:49<36:19:23,  9.65s/it][2022-12-21 21:08:15,557] [INFO] [timer.py:197:stop] 0/451, RunningAvgSamplesPerSec=10.95112672588382, CurrSamplesPerSec=10.64543698049624, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6451/20000 [7:09:00<37:10:09,  9.88s/it][2022-12-21 21:08:24,779] [INFO] [timer.py:197:stop] 0/452, RunningAvgSamplesPerSec=10.951607129245938, CurrSamplesPerSec=11.171651857235325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6452/20000 [7:09:09<36:25:44,  9.68s/it][2022-12-21 21:08:33,849] [INFO] [timer.py:197:stop] 0/453, RunningAvgSamplesPerSec=10.95198755490799, CurrSamplesPerSec=11.125903642671904, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6453/20000 [7:09:18<35:44:15,  9.50s/it][2022-12-21 21:08:43,636] [INFO] [timer.py:197:stop] 0/454, RunningAvgSamplesPerSec=10.952443423058227, CurrSamplesPerSec=11.16198208788401, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6454/20000 [7:09:28<36:03:41,  9.58s/it][2022-12-21 21:08:52,917] [INFO] [timer.py:197:stop] 0/455, RunningAvgSamplesPerSec=10.951839936277553, CurrSamplesPerSec=10.685707111290474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6455/20000 [7:09:37<35:43:02,  9.49s/it][2022-12-21 21:09:02,218] [INFO] [timer.py:197:stop] 0/456, RunningAvgSamplesPerSec=10.95127438461886, CurrSamplesPerSec=10.700948551261417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6456/20000 [7:09:46<35:29:55,  9.44s/it][2022-12-21 21:09:11,114] [INFO] [timer.py:197:stop] 0/457, RunningAvgSamplesPerSec=10.95140164917337, CurrSamplesPerSec=11.009486881718402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6457/20000 [7:09:55<34:53:10,  9.27s/it][2022-12-21 21:09:20,643] [INFO] [timer.py:197:stop] 0/458, RunningAvgSamplesPerSec=10.951198729729324, CurrSamplesPerSec=10.85964396723701, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6458/20000 [7:10:05<35:10:22,  9.35s/it][2022-12-21 21:09:29,976] [INFO] [timer.py:197:stop] 0/459, RunningAvgSamplesPerSec=10.951221640265963, CurrSamplesPerSec=10.96167884277275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6459/20000 [7:10:14<35:09:00,  9.35s/it][2022-12-21 21:09:39,637] [INFO] [logging.py:68:log_dist] [Rank 0] step=6460, skipped=14, lr=[6.951282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:09:39,637] [INFO] [timer.py:197:stop] 0/460, RunningAvgSamplesPerSec=10.951341137122576, CurrSamplesPerSec=11.006225486296927, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6460/20000 [7:10:24<35:30:16,  9.44s/it][2022-12-21 21:09:49,180] [INFO] [timer.py:197:stop] 0/461, RunningAvgSamplesPerSec=10.951940582057537, CurrSamplesPerSec=11.233561515252484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6461/20000 [7:10:33<35:37:05,  9.47s/it][2022-12-21 21:09:58,484] [INFO] [timer.py:197:stop] 0/462, RunningAvgSamplesPerSec=10.951430128608914, CurrSamplesPerSec=10.722050111134708, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6462/20000 [7:10:42<35:25:38,  9.42s/it][2022-12-21 21:10:07,932] [INFO] [timer.py:197:stop] 0/463, RunningAvgSamplesPerSec=10.951873588500698, CurrSamplesPerSec=11.159745413478602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6463/20000 [7:10:52<35:27:18,  9.43s/it][2022-12-21 21:10:17,609] [INFO] [timer.py:197:stop] 0/464, RunningAvgSamplesPerSec=10.952166103560605, CurrSamplesPerSec=11.088700281039117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6464/20000 [7:11:02<35:43:57,  9.50s/it][2022-12-21 21:10:26,447] [INFO] [timer.py:197:stop] 0/465, RunningAvgSamplesPerSec=10.952328703806602, CurrSamplesPerSec=11.027969958913502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6465/20000 [7:11:10<34:58:47,  9.30s/it][2022-12-21 21:10:36,043] [INFO] [timer.py:197:stop] 0/466, RunningAvgSamplesPerSec=10.95250156413562, CurrSamplesPerSec=11.033126326502714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6466/20000 [7:11:20<35:18:24,  9.39s/it][2022-12-21 21:10:46,933] [INFO] [timer.py:197:stop] 0/467, RunningAvgSamplesPerSec=10.952413867965227, CurrSamplesPerSec=10.911873786295684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6467/20000 [7:11:31<36:59:36,  9.84s/it][2022-12-21 21:10:55,950] [INFO] [timer.py:197:stop] 0/468, RunningAvgSamplesPerSec=10.952032747965252, CurrSamplesPerSec=10.777639961229712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6468/20000 [7:11:40<36:03:40,  9.59s/it][2022-12-21 21:11:05,164] [INFO] [timer.py:197:stop] 0/469, RunningAvgSamplesPerSec=10.952102311991345, CurrSamplesPerSec=10.984615589849346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6469/20000 [7:11:49<35:37:51,  9.48s/it][2022-12-21 21:11:14,621] [INFO] [logging.py:68:log_dist] [Rank 0] step=6470, skipped=14, lr=[6.946153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:11:14,622] [INFO] [timer.py:197:stop] 0/470, RunningAvgSamplesPerSec=10.952237377540115, CurrSamplesPerSec=11.015679142026409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6470/20000 [7:11:59<35:36:14,  9.47s/it][2022-12-21 21:11:23,534] [INFO] [timer.py:197:stop] 0/471, RunningAvgSamplesPerSec=10.952711098267308, CurrSamplesPerSec=11.179002708967579, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6471/20000 [7:12:07<34:58:04,  9.30s/it][2022-12-21 21:11:32,658] [INFO] [timer.py:197:stop] 0/472, RunningAvgSamplesPerSec=10.9528559281291, CurrSamplesPerSec=11.021205916226332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6472/20000 [7:12:17<34:45:43,  9.25s/it][2022-12-21 21:11:42,701] [INFO] [timer.py:197:stop] 0/473, RunningAvgSamplesPerSec=10.9520042817543, CurrSamplesPerSec=10.56587284171646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6473/20000 [7:12:27<35:39:10,  9.49s/it][2022-12-21 21:11:52,452] [INFO] [timer.py:197:stop] 0/474, RunningAvgSamplesPerSec=10.952527068040673, CurrSamplesPerSec=11.204434767310161, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6474/20000 [7:12:36<35:56:43,  9.57s/it][2022-12-21 21:12:01,799] [INFO] [timer.py:197:stop] 0/475, RunningAvgSamplesPerSec=10.953093045142156, CurrSamplesPerSec=11.22692708024231, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6475/20000 [7:12:46<35:41:43,  9.50s/it]

                                                         
{'loss': 0.1468, 'learning_rate': 6.943589743589744e-06, 'epoch': 0.32}


 32%|███▏      | 6475/20000 [7:12:46<35:41:43,  9.50s/it][2022-12-21 21:12:11,624] [INFO] [timer.py:197:stop] 0/476, RunningAvgSamplesPerSec=10.953151505583762, CurrSamplesPerSec=10.98087342782864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6476/20000 [7:12:56<36:03:25,  9.60s/it][2022-12-21 21:12:20,995] [INFO] [timer.py:197:stop] 0/477, RunningAvgSamplesPerSec=10.953603400275968, CurrSamplesPerSec=11.172082871255588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6477/20000 [7:13:05<35:47:55,  9.53s/it][2022-12-21 21:12:30,215] [INFO] [timer.py:197:stop] 0/478, RunningAvgSamplesPerSec=10.953547780514961, CurrSamplesPerSec=10.927192096401253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6478/20000 [7:13:14<35:26:48,  9.44s/it][2022-12-21 21:12:39,366] [INFO] [timer.py:197:stop] 0/479, RunningAvgSamplesPerSec=10.953971090018067, CurrSamplesPerSec=11.15925040361718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6479/20000 [7:13:23<35:07:16,  9.35s/it][2022-12-21 21:12:49,320] [INFO] [logging.py:68:log_dist] [Rank 0] step=6480, skipped=14, lr=[6.941025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:12:49,321] [INFO] [timer.py:197:stop] 0/480, RunningAvgSamplesPerSec=10.951957699222111, CurrSamplesPerSec=10.069147073215424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6480/20000 [7:13:33<35:47:58,  9.53s/it][2022-12-21 21:12:58,288] [INFO] [timer.py:197:stop] 0/481, RunningAvgSamplesPerSec=10.951564278294155, CurrSamplesPerSec=10.76669028688437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6481/20000 [7:13:42<35:09:35,  9.36s/it][2022-12-21 21:13:07,695] [INFO] [timer.py:197:stop] 0/482, RunningAvgSamplesPerSec=10.951636550354925, CurrSamplesPerSec=10.986364873487272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6482/20000 [7:13:52<35:12:24,  9.38s/it][2022-12-21 21:13:18,881] [INFO] [timer.py:197:stop] 0/483, RunningAvgSamplesPerSec=10.95077580394595, CurrSamplesPerSec=10.552668867181461, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6483/20000 [7:14:03<37:14:37,  9.92s/it][2022-12-21 21:13:31,178] [INFO] [timer.py:197:stop] 0/484, RunningAvgSamplesPerSec=10.949946854400453, CurrSamplesPerSec=10.56525903447468, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6484/20000 [7:14:15<39:55:05, 10.63s/it][2022-12-21 21:13:39,970] [INFO] [timer.py:197:stop] 0/485, RunningAvgSamplesPerSec=10.950425563475516, CurrSamplesPerSec=11.186140419108987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6485/20000 [7:14:24<37:50:34, 10.08s/it][2022-12-21 21:13:49,384] [INFO] [timer.py:197:stop] 0/486, RunningAvgSamplesPerSec=10.950384519078279, CurrSamplesPerSec=10.930595974325776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6486/20000 [7:14:33<37:05:23,  9.88s/it][2022-12-21 21:13:58,458] [INFO] [timer.py:197:stop] 0/487, RunningAvgSamplesPerSec=10.95010075185634, CurrSamplesPerSec=10.814462199019768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6487/20000 [7:14:42<36:10:43,  9.64s/it][2022-12-21 21:14:08,432] [INFO] [timer.py:197:stop] 0/488, RunningAvgSamplesPerSec=10.949850926540922, CurrSamplesPerSec=10.83001443017744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6488/20000 [7:14:52<36:33:16,  9.74s/it][2022-12-21 21:14:18,013] [INFO] [timer.py:197:stop] 0/489, RunningAvgSamplesPerSec=10.94974191085928, CurrSamplesPerSec=10.897015935389717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6489/20000 [7:15:02<36:22:26,  9.69s/it][2022-12-21 21:14:26,850] [INFO] [logging.py:68:log_dist] [Rank 0] step=6490, skipped=14, lr=[6.9358974358974366e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:14:26,851] [INFO] [timer.py:197:stop] 0/490, RunningAvgSamplesPerSec=10.950109014405383, CurrSamplesPerSec=11.131861965229055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6490/20000 [7:15:11<35:24:33,  9.44s/it][2022-12-21 21:14:35,595] [INFO] [timer.py:197:stop] 0/491, RunningAvgSamplesPerSec=10.950581875341282, CurrSamplesPerSec=11.186315692223758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6491/20000 [7:15:20<34:37:43,  9.23s/it][2022-12-21 21:14:44,936] [INFO] [timer.py:197:stop] 0/492, RunningAvgSamplesPerSec=10.950644704366052, CurrSamplesPerSec=10.98145471556205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6492/20000 [7:15:29<34:45:09,  9.26s/it][2022-12-21 21:14:54,316] [INFO] [timer.py:197:stop] 0/493, RunningAvgSamplesPerSec=10.951125653905942, CurrSamplesPerSec=11.191984728877877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6493/20000 [7:15:38<34:53:01,  9.30s/it][2022-12-21 21:15:05,009] [INFO] [timer.py:197:stop] 0/494, RunningAvgSamplesPerSec=10.950675137536198, CurrSamplesPerSec=10.733860180027525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6494/20000 [7:15:49<36:27:06,  9.72s/it][2022-12-21 21:15:14,051] [INFO] [timer.py:197:stop] 0/495, RunningAvgSamplesPerSec=10.951072804095864, CurrSamplesPerSec=11.150291223420826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6495/20000 [7:15:58<35:41:23,  9.51s/it][2022-12-21 21:15:23,121] [INFO] [timer.py:197:stop] 0/496, RunningAvgSamplesPerSec=10.951222854803717, CurrSamplesPerSec=11.025701977262534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6496/20000 [7:16:07<35:11:16,  9.38s/it][2022-12-21 21:15:32,955] [INFO] [timer.py:197:stop] 0/497, RunningAvgSamplesPerSec=10.951775700587516, CurrSamplesPerSec=11.231880670586929, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6497/20000 [7:16:17<35:41:42,  9.52s/it][2022-12-21 21:15:42,301] [INFO] [timer.py:197:stop] 0/498, RunningAvgSamplesPerSec=10.951754047826652, CurrSamplesPerSec=10.941046431556266, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6498/20000 [7:16:26<35:30:06,  9.47s/it][2022-12-21 21:15:51,413] [INFO] [timer.py:197:stop] 0/499, RunningAvgSamplesPerSec=10.952123518731792, CurrSamplesPerSec=11.138506040638061, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▏      | 6499/20000 [7:16:35<35:06:07,  9.36s/it][2022-12-21 21:16:01,585] [INFO] [logging.py:68:log_dist] [Rank 0] step=6500, skipped=14, lr=[6.930769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:16:01,586] [INFO] [timer.py:197:stop] 0/500, RunningAvgSamplesPerSec=10.951968190604928, CurrSamplesPerSec=10.875311535103108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 32%|███▎      | 6500/20000 [7:16:46<36:00:48,  9.60s/it]

                                                         
{'loss': 0.0954, 'learning_rate': 6.930769230769231e-06, 'epoch': 0.33}


 32%|███▎      | 6500/20000 [7:16:46<36:00:48,  9.60s/it][2022-12-21 21:16:10,645] [INFO] [timer.py:197:stop] 0/501, RunningAvgSamplesPerSec=10.952395891061398, CurrSamplesPerSec=11.169623701640337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6501/20000 [7:16:55<35:23:50,  9.44s/it][2022-12-21 21:16:19,870] [INFO] [timer.py:197:stop] 0/502, RunningAvgSamplesPerSec=10.952899129278654, CurrSamplesPerSec=11.209919485073295, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6502/20000 [7:17:04<35:09:08,  9.38s/it][2022-12-21 21:16:29,135] [INFO] [timer.py:197:stop] 0/503, RunningAvgSamplesPerSec=10.952914432754318, CurrSamplesPerSec=10.960571530556377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6503/20000 [7:17:13<35:01:34,  9.34s/it][2022-12-21 21:16:38,045] [INFO] [timer.py:197:stop] 0/504, RunningAvgSamplesPerSec=10.953513197227227, CurrSamplesPerSec=11.261958366213083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6504/20000 [7:17:22<34:32:15,  9.21s/it][2022-12-21 21:16:47,559] [INFO] [timer.py:197:stop] 0/505, RunningAvgSamplesPerSec=10.953312280952915, CurrSamplesPerSec=10.853374389573274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6505/20000 [7:17:32<34:52:23,  9.30s/it][2022-12-21 21:16:57,438] [INFO] [timer.py:197:stop] 0/506, RunningAvgSamplesPerSec=10.953679373800078, CurrSamplesPerSec=11.141499480125116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6506/20000 [7:17:41<35:31:05,  9.48s/it][2022-12-21 21:17:07,723] [INFO] [timer.py:197:stop] 0/507, RunningAvgSamplesPerSec=10.953688903575863, CurrSamplesPerSec=10.958494021714548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6507/20000 [7:17:52<36:25:33,  9.72s/it][2022-12-21 21:17:17,181] [INFO] [timer.py:197:stop] 0/508, RunningAvgSamplesPerSec=10.953801061859947, CurrSamplesPerSec=11.010735977450498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6508/20000 [7:18:01<36:07:48,  9.64s/it][2022-12-21 21:17:26,181] [INFO] [timer.py:197:stop] 0/509, RunningAvgSamplesPerSec=10.954299546566348, CurrSamplesPerSec=11.212489631696647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6509/20000 [7:18:10<35:24:27,  9.45s/it][2022-12-21 21:17:35,807] [INFO] [logging.py:68:log_dist] [Rank 0] step=6510, skipped=14, lr=[6.925641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:17:35,808] [INFO] [timer.py:197:stop] 0/510, RunningAvgSamplesPerSec=10.95366984915587, CurrSamplesPerSec=10.643472143043327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6510/20000 [7:18:20<35:36:21,  9.50s/it][2022-12-21 21:17:45,270] [INFO] [timer.py:197:stop] 0/511, RunningAvgSamplesPerSec=10.953300120211203, CurrSamplesPerSec=10.76865034121161, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6511/20000 [7:18:29<35:33:28,  9.49s/it][2022-12-21 21:17:54,532] [INFO] [timer.py:197:stop] 0/512, RunningAvgSamplesPerSec=10.953223247350287, CurrSamplesPerSec=10.914234514537455, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6512/20000 [7:18:38<35:17:58,  9.42s/it][2022-12-21 21:18:05,455] [INFO] [timer.py:197:stop] 0/513, RunningAvgSamplesPerSec=10.952814069493773, CurrSamplesPerSec=10.74804246501582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6513/20000 [7:18:49<36:59:02,  9.87s/it][2022-12-21 21:18:14,509] [INFO] [timer.py:197:stop] 0/514, RunningAvgSamplesPerSec=10.952334051441579, CurrSamplesPerSec=10.712428287291406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6514/20000 [7:18:58<36:03:45,  9.63s/it][2022-12-21 21:18:23,999] [INFO] [timer.py:197:stop] 0/515, RunningAvgSamplesPerSec=10.952683441819675, CurrSamplesPerSec=11.134547463657805, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6515/20000 [7:19:08<35:54:22,  9.59s/it][2022-12-21 21:18:34,300] [INFO] [timer.py:197:stop] 0/516, RunningAvgSamplesPerSec=10.952473876190373, CurrSamplesPerSec=10.846013735607496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6516/20000 [7:19:18<36:42:25,  9.80s/it][2022-12-21 21:18:43,559] [INFO] [timer.py:197:stop] 0/517, RunningAvgSamplesPerSec=10.952452386650986, CurrSamplesPerSec=10.941417913398295, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6517/20000 [7:19:28<36:05:50,  9.64s/it][2022-12-21 21:18:52,966] [INFO] [timer.py:197:stop] 0/518, RunningAvgSamplesPerSec=10.952228702816052, CurrSamplesPerSec=10.838232881083952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6518/20000 [7:19:37<35:50:03,  9.57s/it][2022-12-21 21:19:02,086] [INFO] [timer.py:197:stop] 0/519, RunningAvgSamplesPerSec=10.951618417926268, CurrSamplesPerSec=10.645529858650875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6519/20000 [7:19:46<35:19:37,  9.43s/it][2022-12-21 21:19:11,655] [INFO] [logging.py:68:log_dist] [Rank 0] step=6520, skipped=14, lr=[6.920512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:19:11,656] [INFO] [timer.py:197:stop] 0/520, RunningAvgSamplesPerSec=10.951741859412245, CurrSamplesPerSec=11.015935910166485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6520/20000 [7:19:56<35:28:37,  9.47s/it][2022-12-21 21:19:20,463] [INFO] [timer.py:197:stop] 0/521, RunningAvgSamplesPerSec=10.951994373964377, CurrSamplesPerSec=11.08438109361716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6521/20000 [7:20:04<34:43:30,  9.27s/it][2022-12-21 21:19:31,375] [INFO] [timer.py:197:stop] 0/522, RunningAvgSamplesPerSec=10.951890909042257, CurrSamplesPerSec=10.898455120677749, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6522/20000 [7:20:15<36:33:43,  9.77s/it][2022-12-21 21:19:41,052] [INFO] [timer.py:197:stop] 0/523, RunningAvgSamplesPerSec=10.95092667668107, CurrSamplesPerSec=10.47151832603291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6523/20000 [7:20:25<36:27:32,  9.74s/it][2022-12-21 21:19:50,844] [INFO] [timer.py:197:stop] 0/524, RunningAvgSamplesPerSec=10.950857439913161, CurrSamplesPerSec=10.914903743386612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6524/20000 [7:20:35<36:30:57,  9.75s/it][2022-12-21 21:20:02,191] [INFO] [timer.py:197:stop] 0/525, RunningAvgSamplesPerSec=10.950717802958359, CurrSamplesPerSec=10.87831019748617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6525/20000 [7:20:46<38:18:05, 10.23s/it]

                                                         
{'loss': 0.0813, 'learning_rate': 6.917948717948718e-06, 'epoch': 0.33}


 33%|███▎      | 6525/20000 [7:20:46<38:18:05, 10.23s/it][2022-12-21 21:20:13,038] [INFO] [timer.py:197:stop] 0/526, RunningAvgSamplesPerSec=10.950676366007041, CurrSamplesPerSec=10.92904772565981, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6526/20000 [7:20:57<38:59:17, 10.42s/it][2022-12-21 21:20:22,289] [INFO] [timer.py:197:stop] 0/527, RunningAvgSamplesPerSec=10.951075192161039, CurrSamplesPerSec=11.16413376059756, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6527/20000 [7:21:06<37:40:32, 10.07s/it][2022-12-21 21:20:31,585] [INFO] [timer.py:197:stop] 0/528, RunningAvgSamplesPerSec=10.95114960751235, CurrSamplesPerSec=10.990357808037484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6528/20000 [7:21:16<36:48:29,  9.84s/it][2022-12-21 21:20:42,067] [INFO] [timer.py:197:stop] 0/529, RunningAvgSamplesPerSec=10.950631267233575, CurrSamplesPerSec=10.684619976692773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6529/20000 [7:21:26<37:31:48, 10.03s/it][2022-12-21 21:20:52,847] [INFO] [logging.py:68:log_dist] [Rank 0] step=6530, skipped=14, lr=[6.915384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:20:52,848] [INFO] [timer.py:197:stop] 0/530, RunningAvgSamplesPerSec=10.950256834962609, CurrSamplesPerSec=10.756430445941811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6530/20000 [7:21:37<38:22:15, 10.26s/it][2022-12-21 21:21:02,044] [INFO] [timer.py:197:stop] 0/531, RunningAvgSamplesPerSec=10.950183618851085, CurrSamplesPerSec=10.91166176560375, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6531/20000 [7:21:46<37:10:45,  9.94s/it][2022-12-21 21:21:12,578] [INFO] [timer.py:197:stop] 0/532, RunningAvgSamplesPerSec=10.949500088959363, CurrSamplesPerSec=10.599492973649959, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6532/20000 [7:21:57<37:50:49, 10.12s/it][2022-12-21 21:21:22,246] [INFO] [timer.py:197:stop] 0/533, RunningAvgSamplesPerSec=10.949149783259042, CurrSamplesPerSec=10.766589236878398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6533/20000 [7:22:06<37:20:26,  9.98s/it][2022-12-21 21:21:31,520] [INFO] [timer.py:197:stop] 0/534, RunningAvgSamplesPerSec=10.949292634979589, CurrSamplesPerSec=11.025677069522253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6534/20000 [7:22:15<36:32:35,  9.77s/it][2022-12-21 21:21:41,066] [INFO] [timer.py:197:stop] 0/535, RunningAvgSamplesPerSec=10.948866355038918, CurrSamplesPerSec=10.72669583484349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6535/20000 [7:22:25<36:17:22,  9.70s/it][2022-12-21 21:21:49,928] [INFO] [timer.py:197:stop] 0/536, RunningAvgSamplesPerSec=10.948887900234714, CurrSamplesPerSec=10.960383569288668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6536/20000 [7:22:34<35:20:38,  9.45s/it][2022-12-21 21:21:59,212] [INFO] [timer.py:197:stop] 0/537, RunningAvgSamplesPerSec=10.949291087910282, CurrSamplesPerSec=11.168920085614857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6537/20000 [7:22:43<35:09:17,  9.40s/it][2022-12-21 21:22:09,540] [INFO] [timer.py:197:stop] 0/538, RunningAvgSamplesPerSec=10.949469550286924, CurrSamplesPerSec=11.045788374189122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6538/20000 [7:22:54<36:11:33,  9.68s/it][2022-12-21 21:22:18,794] [INFO] [timer.py:197:stop] 0/539, RunningAvgSamplesPerSec=10.94961433890943, CurrSamplesPerSec=11.027776054630072, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6539/20000 [7:23:03<35:42:48,  9.55s/it][2022-12-21 21:22:28,454] [INFO] [logging.py:68:log_dist] [Rank 0] step=6540, skipped=14, lr=[6.910256410256411e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:22:28,455] [INFO] [timer.py:197:stop] 0/540, RunningAvgSamplesPerSec=10.949707818634122, CurrSamplesPerSec=11.00013805726586, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6540/20000 [7:23:12<35:50:02,  9.58s/it][2022-12-21 21:22:37,623] [INFO] [timer.py:197:stop] 0/541, RunningAvgSamplesPerSec=10.95018823025367, CurrSamplesPerSec=11.214909614921513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6541/20000 [7:23:22<35:21:54,  9.46s/it][2022-12-21 21:22:47,697] [INFO] [timer.py:197:stop] 0/542, RunningAvgSamplesPerSec=10.9502481074126, CurrSamplesPerSec=10.98261747567604, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6542/20000 [7:23:32<36:03:05,  9.64s/it][2022-12-21 21:22:56,772] [INFO] [timer.py:197:stop] 0/543, RunningAvgSamplesPerSec=10.950181538402813, CurrSamplesPerSec=10.914352111806753, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6543/20000 [7:23:41<35:24:41,  9.47s/it][2022-12-21 21:23:05,976] [INFO] [timer.py:197:stop] 0/544, RunningAvgSamplesPerSec=10.950572145086086, CurrSamplesPerSec=11.16605634453133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6544/20000 [7:23:50<35:06:24,  9.39s/it][2022-12-21 21:23:15,819] [INFO] [timer.py:197:stop] 0/545, RunningAvgSamplesPerSec=10.950648384450075, CurrSamplesPerSec=10.992126925753404, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6545/20000 [7:24:00<35:36:34,  9.53s/it][2022-12-21 21:23:28,052] [INFO] [timer.py:197:stop] 0/546, RunningAvgSamplesPerSec=10.950284798083693, CurrSamplesPerSec=10.75636019029511, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6546/20000 [7:24:12<38:38:21, 10.34s/it][2022-12-21 21:23:38,931] [INFO] [timer.py:197:stop] 0/547, RunningAvgSamplesPerSec=10.950868073239814, CurrSamplesPerSec=11.277655848045006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6547/20000 [7:24:23<39:14:30, 10.50s/it][2022-12-21 21:23:49,028] [INFO] [timer.py:197:stop] 0/548, RunningAvgSamplesPerSec=10.95042782891528, CurrSamplesPerSec=10.715648328855098, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6548/20000 [7:24:33<38:47:09, 10.38s/it][2022-12-21 21:23:58,144] [INFO] [timer.py:197:stop] 0/549, RunningAvgSamplesPerSec=10.94990305943237, CurrSamplesPerSec=10.670698205571913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6549/20000 [7:24:42<37:22:00, 10.00s/it][2022-12-21 21:24:07,776] [INFO] [logging.py:68:log_dist] [Rank 0] step=6550, skipped=14, lr=[6.905128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:24:07,776] [INFO] [timer.py:197:stop] 0/550, RunningAvgSamplesPerSec=10.94915614565053, CurrSamplesPerSec=10.555317065559601, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6550/20000 [7:24:52<36:57:02,  9.89s/it]

                                                         
{'loss': 0.0983, 'learning_rate': 6.905128205128205e-06, 'epoch': 0.33}


 33%|███▎      | 6550/20000 [7:24:52<36:57:02,  9.89s/it][2022-12-21 21:24:18,361] [INFO] [timer.py:197:stop] 0/551, RunningAvgSamplesPerSec=10.94866471988314, CurrSamplesPerSec=10.68583982831668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6551/20000 [7:25:02<37:43:36, 10.10s/it][2022-12-21 21:24:29,047] [INFO] [timer.py:197:stop] 0/552, RunningAvgSamplesPerSec=10.948735014401109, CurrSamplesPerSec=10.98746346199288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6552/20000 [7:25:13<38:22:53, 10.27s/it][2022-12-21 21:24:39,058] [INFO] [timer.py:197:stop] 0/553, RunningAvgSamplesPerSec=10.94925473276432, CurrSamplesPerSec=11.24277654875596, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6553/20000 [7:25:23<38:05:00, 10.20s/it][2022-12-21 21:24:48,334] [INFO] [timer.py:197:stop] 0/554, RunningAvgSamplesPerSec=10.950094508941861, CurrSamplesPerSec=11.433265530757364, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6554/20000 [7:25:32<37:03:00,  9.92s/it][2022-12-21 21:24:58,014] [INFO] [timer.py:197:stop] 0/555, RunningAvgSamplesPerSec=10.94993565651373, CurrSamplesPerSec=10.862946979148001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6555/20000 [7:25:42<36:46:43,  9.85s/it][2022-12-21 21:25:07,806] [INFO] [timer.py:197:stop] 0/556, RunningAvgSamplesPerSec=10.950257115425176, CurrSamplesPerSec=11.13096277906249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6556/20000 [7:25:52<36:42:56,  9.83s/it][2022-12-21 21:25:20,118] [INFO] [timer.py:197:stop] 0/557, RunningAvgSamplesPerSec=10.950620821320888, CurrSamplesPerSec=11.155897833286323, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6557/20000 [7:26:04<39:29:21, 10.58s/it][2022-12-21 21:25:29,200] [INFO] [timer.py:197:stop] 0/558, RunningAvgSamplesPerSec=10.950997528585013, CurrSamplesPerSec=11.164146761356958, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6558/20000 [7:26:13<37:48:52, 10.13s/it][2022-12-21 21:25:41,413] [INFO] [timer.py:197:stop] 0/559, RunningAvgSamplesPerSec=10.95076931431715, CurrSamplesPerSec=10.825338172529065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6559/20000 [7:26:25<40:08:50, 10.75s/it][2022-12-21 21:25:53,162] [INFO] [logging.py:68:log_dist] [Rank 0] step=6560, skipped=14, lr=[6.9e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:25:53,163] [INFO] [timer.py:197:stop] 0/560, RunningAvgSamplesPerSec=10.951166949027026, CurrSamplesPerSec=11.177229710615443, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6560/20000 [7:26:37<41:15:40, 11.05s/it][2022-12-21 21:26:03,490] [INFO] [timer.py:197:stop] 0/561, RunningAvgSamplesPerSec=10.950821259320467, CurrSamplesPerSec=10.761271243387242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6561/20000 [7:26:47<40:26:46, 10.83s/it][2022-12-21 21:26:12,589] [INFO] [timer.py:197:stop] 0/562, RunningAvgSamplesPerSec=10.950718904508038, CurrSamplesPerSec=10.893800489028076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6562/20000 [7:26:57<38:29:59, 10.31s/it][2022-12-21 21:26:23,716] [INFO] [timer.py:197:stop] 0/563, RunningAvgSamplesPerSec=10.950811130919513, CurrSamplesPerSec=11.002703093974446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6563/20000 [7:27:08<39:24:26, 10.56s/it][2022-12-21 21:26:32,964] [INFO] [timer.py:197:stop] 0/564, RunningAvgSamplesPerSec=10.95088789778851, CurrSamplesPerSec=10.994124449419271, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6564/20000 [7:27:17<37:56:13, 10.16s/it][2022-12-21 21:26:41,956] [INFO] [timer.py:197:stop] 0/565, RunningAvgSamplesPerSec=10.950577638359812, CurrSamplesPerSec=10.77894953254891, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6565/20000 [7:27:26<36:37:23,  9.81s/it][2022-12-21 21:26:51,289] [INFO] [timer.py:197:stop] 0/566, RunningAvgSamplesPerSec=10.950463189562129, CurrSamplesPerSec=10.88640611037666, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6566/20000 [7:27:35<36:04:50,  9.67s/it][2022-12-21 21:27:00,437] [INFO] [timer.py:197:stop] 0/567, RunningAvgSamplesPerSec=10.950959065453645, CurrSamplesPerSec=11.237976126976376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6567/20000 [7:27:44<35:29:44,  9.51s/it][2022-12-21 21:27:10,775] [INFO] [timer.py:197:stop] 0/568, RunningAvgSamplesPerSec=10.9506200729655, CurrSamplesPerSec=10.762387409285038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6568/20000 [7:27:55<36:24:59,  9.76s/it][2022-12-21 21:27:19,641] [INFO] [timer.py:197:stop] 0/569, RunningAvgSamplesPerSec=10.95069740009145, CurrSamplesPerSec=10.99464049304859, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6569/20000 [7:28:04<35:24:46,  9.49s/it][2022-12-21 21:27:30,115] [INFO] [logging.py:68:log_dist] [Rank 0] step=6570, skipped=14, lr=[6.894871794871796e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:27:30,116] [INFO] [timer.py:197:stop] 0/570, RunningAvgSamplesPerSec=10.950759306387939, CurrSamplesPerSec=10.985973248104791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6570/20000 [7:28:14<36:30:35,  9.79s/it][2022-12-21 21:27:39,332] [INFO] [timer.py:197:stop] 0/571, RunningAvgSamplesPerSec=10.950442093691185, CurrSamplesPerSec=10.773186944365204, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6571/20000 [7:28:23<35:52:09,  9.62s/it][2022-12-21 21:27:48,255] [INFO] [timer.py:197:stop] 0/572, RunningAvgSamplesPerSec=10.950618682286288, CurrSamplesPerSec=11.052029739372884, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6572/20000 [7:28:32<35:05:29,  9.41s/it][2022-12-21 21:27:59,379] [INFO] [timer.py:197:stop] 0/573, RunningAvgSamplesPerSec=10.950577205744127, CurrSamplesPerSec=10.926986596751874, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6573/20000 [7:28:43<37:00:29,  9.92s/it][2022-12-21 21:28:09,550] [INFO] [timer.py:197:stop] 0/574, RunningAvgSamplesPerSec=10.950183306435603, CurrSamplesPerSec=10.729801368604456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6574/20000 [7:28:54<37:17:03, 10.00s/it][2022-12-21 21:28:18,808] [INFO] [timer.py:197:stop] 0/575, RunningAvgSamplesPerSec=10.950514796216329, CurrSamplesPerSec=11.14347395004896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6575/20000 [7:29:03<36:27:16,  9.78s/it]

                                                         
{'loss': 0.0891, 'learning_rate': 6.892307692307693e-06, 'epoch': 0.33}


 33%|███▎      | 6575/20000 [7:29:03<36:27:16,  9.78s/it][2022-12-21 21:28:28,992] [INFO] [timer.py:197:stop] 0/576, RunningAvgSamplesPerSec=10.95050783173292, CurrSamplesPerSec=10.946518639043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6576/20000 [7:29:13<36:54:31,  9.90s/it][2022-12-21 21:28:37,918] [INFO] [timer.py:197:stop] 0/577, RunningAvgSamplesPerSec=10.950716637664527, CurrSamplesPerSec=11.071899892888155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6577/20000 [7:29:22<35:49:03,  9.61s/it][2022-12-21 21:28:47,373] [INFO] [timer.py:197:stop] 0/578, RunningAvgSamplesPerSec=10.950621922573562, CurrSamplesPerSec=10.896430725288594, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6578/20000 [7:29:31<35:38:47,  9.56s/it][2022-12-21 21:28:56,660] [INFO] [timer.py:197:stop] 0/579, RunningAvgSamplesPerSec=10.950498089165128, CurrSamplesPerSec=10.879632443447772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6579/20000 [7:29:41<35:20:15,  9.48s/it][2022-12-21 21:29:05,836] [INFO] [logging.py:68:log_dist] [Rank 0] step=6580, skipped=14, lr=[6.889743589743591e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:29:05,837] [INFO] [timer.py:197:stop] 0/580, RunningAvgSamplesPerSec=10.950716244015155, CurrSamplesPerSec=11.078057885029075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6580/20000 [7:29:50<34:59:48,  9.39s/it][2022-12-21 21:29:14,805] [INFO] [timer.py:197:stop] 0/581, RunningAvgSamplesPerSec=10.950520732591912, CurrSamplesPerSec=10.838671373786493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6581/20000 [7:29:59<34:31:28,  9.26s/it][2022-12-21 21:29:25,088] [INFO] [timer.py:197:stop] 0/582, RunningAvgSamplesPerSec=10.950845906803702, CurrSamplesPerSec=11.142421182348619, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6582/20000 [7:30:09<35:39:50,  9.57s/it][2022-12-21 21:29:34,502] [INFO] [timer.py:197:stop] 0/583, RunningAvgSamplesPerSec=10.950623229088718, CurrSamplesPerSec=10.822978211956803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6583/20000 [7:30:18<35:29:18,  9.52s/it][2022-12-21 21:29:44,108] [INFO] [timer.py:197:stop] 0/584, RunningAvgSamplesPerSec=10.950680105383878, CurrSamplesPerSec=10.983825425416644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6584/20000 [7:30:28<35:34:47,  9.55s/it][2022-12-21 21:29:53,176] [INFO] [timer.py:197:stop] 0/585, RunningAvgSamplesPerSec=10.950030702299197, CurrSamplesPerSec=10.58470925250712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6585/20000 [7:30:37<35:02:26,  9.40s/it][2022-12-21 21:30:03,471] [INFO] [timer.py:197:stop] 0/586, RunningAvgSamplesPerSec=10.949915148601638, CurrSamplesPerSec=10.882959981700878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6586/20000 [7:30:47<36:02:08,  9.67s/it][2022-12-21 21:30:12,672] [INFO] [timer.py:197:stop] 0/587, RunningAvgSamplesPerSec=10.95033111497065, CurrSamplesPerSec=11.198776474161319, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6587/20000 [7:30:57<35:30:23,  9.53s/it][2022-12-21 21:30:21,980] [INFO] [timer.py:197:stop] 0/588, RunningAvgSamplesPerSec=10.95034475930172, CurrSamplesPerSec=10.958332525378722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6588/20000 [7:31:06<35:15:20,  9.46s/it][2022-12-21 21:30:31,192] [INFO] [timer.py:197:stop] 0/589, RunningAvgSamplesPerSec=10.950478577341771, CurrSamplesPerSec=11.029462525242382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6589/20000 [7:31:15<34:58:23,  9.39s/it][2022-12-21 21:30:41,124] [INFO] [logging.py:68:log_dist] [Rank 0] step=6590, skipped=14, lr=[6.8846153846153855e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:30:41,125] [INFO] [timer.py:197:stop] 0/590, RunningAvgSamplesPerSec=10.950746490361817, CurrSamplesPerSec=11.110306800977114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6590/20000 [7:31:25<35:34:43,  9.55s/it][2022-12-21 21:30:50,424] [INFO] [timer.py:197:stop] 0/591, RunningAvgSamplesPerSec=10.950715207343597, CurrSamplesPerSec=10.932351691122197, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6591/20000 [7:31:34<35:17:39,  9.48s/it][2022-12-21 21:30:59,133] [INFO] [timer.py:197:stop] 0/592, RunningAvgSamplesPerSec=10.951241483136085, CurrSamplesPerSec=11.270263211116252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6592/20000 [7:31:43<34:26:06,  9.25s/it][2022-12-21 21:31:08,911] [INFO] [timer.py:197:stop] 0/593, RunningAvgSamplesPerSec=10.950732771838561, CurrSamplesPerSec=10.658613144201556, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6593/20000 [7:31:53<35:01:37,  9.41s/it][2022-12-21 21:31:18,584] [INFO] [timer.py:197:stop] 0/594, RunningAvgSamplesPerSec=10.950157987059523, CurrSamplesPerSec=10.620698042991291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6594/20000 [7:32:03<35:19:24,  9.49s/it][2022-12-21 21:31:27,561] [INFO] [timer.py:197:stop] 0/595, RunningAvgSamplesPerSec=10.9505950652022, CurrSamplesPerSec=11.215618100318558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6595/20000 [7:32:12<34:45:08,  9.33s/it][2022-12-21 21:31:36,818] [INFO] [timer.py:197:stop] 0/596, RunningAvgSamplesPerSec=10.950389665291945, CurrSamplesPerSec=10.82992966518595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6596/20000 [7:32:21<34:39:55,  9.31s/it][2022-12-21 21:31:45,948] [INFO] [timer.py:197:stop] 0/597, RunningAvgSamplesPerSec=10.95039615426098, CurrSamplesPerSec=10.954251961364184, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6597/20000 [7:32:30<34:27:40,  9.26s/it][2022-12-21 21:31:55,034] [INFO] [timer.py:197:stop] 0/598, RunningAvgSamplesPerSec=10.950205725768123, CurrSamplesPerSec=10.838063095035643, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6598/20000 [7:32:39<34:16:08,  9.21s/it][2022-12-21 21:32:04,675] [INFO] [timer.py:197:stop] 0/599, RunningAvgSamplesPerSec=10.950591636959325, CurrSamplesPerSec=11.185537726618897, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6599/20000 [7:32:49<34:45:09,  9.34s/it][2022-12-21 21:32:13,638] [INFO] [logging.py:68:log_dist] [Rank 0] step=6600, skipped=14, lr=[6.87948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:32:13,639] [INFO] [timer.py:197:stop] 0/600, RunningAvgSamplesPerSec=10.950935586998188, CurrSamplesPerSec=11.160204276271534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6600/20000 [7:32:58<34:20:04,  9.22s/it]

                                                         
{'loss': 0.082, 'learning_rate': 6.87948717948718e-06, 'epoch': 0.33}


 33%|███▎      | 6600/20000 [7:32:58<34:20:04,  9.22s/it][2022-12-21 21:32:23,022] [INFO] [timer.py:197:stop] 0/601, RunningAvgSamplesPerSec=10.9506369498199, CurrSamplesPerSec=10.774922296539117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6601/20000 [7:33:07<34:30:37,  9.27s/it][2022-12-21 21:32:33,099] [INFO] [timer.py:197:stop] 0/602, RunningAvgSamplesPerSec=10.950757506660178, CurrSamplesPerSec=11.023451224878762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6602/20000 [7:33:17<35:24:19,  9.51s/it][2022-12-21 21:32:42,122] [INFO] [timer.py:197:stop] 0/603, RunningAvgSamplesPerSec=10.95063264329871, CurrSamplesPerSec=10.876224532930086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6603/20000 [7:33:26<34:51:20,  9.37s/it][2022-12-21 21:32:51,607] [INFO] [timer.py:197:stop] 0/604, RunningAvgSamplesPerSec=10.95035762767883, CurrSamplesPerSec=10.787534969963456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6604/20000 [7:33:36<34:59:10,  9.40s/it][2022-12-21 21:33:00,562] [INFO] [timer.py:197:stop] 0/605, RunningAvgSamplesPerSec=10.95032315840703, CurrSamplesPerSec=10.929611968999017, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6605/20000 [7:33:45<34:29:02,  9.27s/it][2022-12-21 21:33:11,523] [INFO] [timer.py:197:stop] 0/606, RunningAvgSamplesPerSec=10.950845101849366, CurrSamplesPerSec=11.274906092311559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6606/20000 [7:33:55<36:22:16,  9.78s/it][2022-12-21 21:33:20,836] [INFO] [timer.py:197:stop] 0/607, RunningAvgSamplesPerSec=10.950854609430223, CurrSamplesPerSec=10.956600206221367, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6607/20000 [7:34:05<35:51:08,  9.64s/it][2022-12-21 21:33:29,562] [INFO] [timer.py:197:stop] 0/608, RunningAvgSamplesPerSec=10.951293333186001, CurrSamplesPerSec=11.223325378256384, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6608/20000 [7:34:14<34:49:57,  9.36s/it][2022-12-21 21:33:38,755] [INFO] [timer.py:197:stop] 0/609, RunningAvgSamplesPerSec=10.95171284234829, CurrSamplesPerSec=11.211987121951887, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6609/20000 [7:34:23<34:38:23,  9.31s/it][2022-12-21 21:33:48,584] [INFO] [logging.py:68:log_dist] [Rank 0] step=6610, skipped=14, lr=[6.8743589743589745e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:33:48,585] [INFO] [timer.py:197:stop] 0/610, RunningAvgSamplesPerSec=10.951521840753097, CurrSamplesPerSec=10.836800368822397, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6610/20000 [7:34:33<35:12:52,  9.47s/it][2022-12-21 21:33:57,438] [INFO] [timer.py:197:stop] 0/611, RunningAvgSamplesPerSec=10.952034880932294, CurrSamplesPerSec=11.273123375765465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6611/20000 [7:34:41<34:31:35,  9.28s/it][2022-12-21 21:34:06,567] [INFO] [timer.py:197:stop] 0/612, RunningAvgSamplesPerSec=10.9517857546191, CurrSamplesPerSec=10.802144256297968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6612/20000 [7:34:51<34:21:04,  9.24s/it][2022-12-21 21:34:16,419] [INFO] [timer.py:197:stop] 0/613, RunningAvgSamplesPerSec=10.951306341538329, CurrSamplesPerSec=10.666482716659743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6613/20000 [7:35:00<35:02:06,  9.42s/it][2022-12-21 21:34:25,637] [INFO] [timer.py:197:stop] 0/614, RunningAvgSamplesPerSec=10.951460114426462, CurrSamplesPerSec=11.04622973131291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6614/20000 [7:35:10<34:48:17,  9.36s/it][2022-12-21 21:34:36,320] [INFO] [timer.py:197:stop] 0/615, RunningAvgSamplesPerSec=10.950606281571872, CurrSamplesPerSec=10.451897078298003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6615/20000 [7:35:20<36:16:41,  9.76s/it][2022-12-21 21:34:45,715] [INFO] [timer.py:197:stop] 0/616, RunningAvgSamplesPerSec=10.950411293662066, CurrSamplesPerSec=10.832176385875416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6616/20000 [7:35:30<35:52:17,  9.65s/it][2022-12-21 21:34:55,283] [INFO] [timer.py:197:stop] 0/617, RunningAvgSamplesPerSec=10.94979531007705, CurrSamplesPerSec=10.58422888502464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6617/20000 [7:35:39<35:46:44,  9.62s/it][2022-12-21 21:35:04,329] [INFO] [timer.py:197:stop] 0/618, RunningAvgSamplesPerSec=10.949995935612261, CurrSamplesPerSec=11.074789097278842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6618/20000 [7:35:48<35:07:50,  9.45s/it][2022-12-21 21:35:13,073] [INFO] [timer.py:197:stop] 0/619, RunningAvgSamplesPerSec=10.950424220805434, CurrSamplesPerSec=11.22077183781037, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6619/20000 [7:35:57<34:20:24,  9.24s/it][2022-12-21 21:35:22,486] [INFO] [logging.py:68:log_dist] [Rank 0] step=6620, skipped=14, lr=[6.86923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:35:22,486] [INFO] [timer.py:197:stop] 0/620, RunningAvgSamplesPerSec=10.950765944976709, CurrSamplesPerSec=11.165755839087437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6620/20000 [7:36:06<34:31:55,  9.29s/it][2022-12-21 21:35:31,426] [INFO] [timer.py:197:stop] 0/621, RunningAvgSamplesPerSec=10.9507958046887, CurrSamplesPerSec=10.969280305530113, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6621/20000 [7:36:15<34:08:15,  9.19s/it][2022-12-21 21:35:40,610] [INFO] [timer.py:197:stop] 0/622, RunningAvgSamplesPerSec=10.951160945460934, CurrSamplesPerSec=11.18195414329781, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6622/20000 [7:36:25<34:08:00,  9.19s/it][2022-12-21 21:35:50,988] [INFO] [timer.py:197:stop] 0/623, RunningAvgSamplesPerSec=10.950703339655371, CurrSamplesPerSec=10.674163998080495, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6623/20000 [7:36:35<35:27:37,  9.54s/it][2022-12-21 21:36:00,173] [INFO] [timer.py:197:stop] 0/624, RunningAvgSamplesPerSec=10.951029136882886, CurrSamplesPerSec=11.157163679949571, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6624/20000 [7:36:44<35:03:30,  9.44s/it][2022-12-21 21:36:09,062] [INFO] [timer.py:197:stop] 0/625, RunningAvgSamplesPerSec=10.95093753247474, CurrSamplesPerSec=10.894254985157726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6625/20000 [7:36:53<34:26:47,  9.27s/it]

                                                         
{'loss': 0.0896, 'learning_rate': 6.866666666666667e-06, 'epoch': 0.33}


 33%|███▎      | 6625/20000 [7:36:53<34:26:47,  9.27s/it][2022-12-21 21:36:18,876] [INFO] [timer.py:197:stop] 0/626, RunningAvgSamplesPerSec=10.950554487122453, CurrSamplesPerSec=10.717014758621945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6626/20000 [7:37:03<35:02:55,  9.43s/it][2022-12-21 21:36:28,810] [INFO] [timer.py:197:stop] 0/627, RunningAvgSamplesPerSec=10.95092350641139, CurrSamplesPerSec=11.186145546701907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6627/20000 [7:37:13<35:36:09,  9.58s/it][2022-12-21 21:36:37,950] [INFO] [timer.py:197:stop] 0/628, RunningAvgSamplesPerSec=10.951020150309626, CurrSamplesPerSec=11.011758134641246, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6628/20000 [7:37:22<35:06:16,  9.45s/it][2022-12-21 21:36:47,349] [INFO] [timer.py:197:stop] 0/629, RunningAvgSamplesPerSec=10.950635284770216, CurrSamplesPerSec=10.714904083539667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6629/20000 [7:37:31<35:02:41,  9.44s/it][2022-12-21 21:36:56,299] [INFO] [logging.py:68:log_dist] [Rank 0] step=6630, skipped=14, lr=[6.864102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:36:56,300] [INFO] [timer.py:197:stop] 0/630, RunningAvgSamplesPerSec=10.950508447605403, CurrSamplesPerSec=10.871555844633425, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6630/20000 [7:37:40<34:30:07,  9.29s/it][2022-12-21 21:37:05,966] [INFO] [timer.py:197:stop] 0/631, RunningAvgSamplesPerSec=10.950351785833117, CurrSamplesPerSec=10.852845633244586, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6631/20000 [7:37:50<34:55:06,  9.40s/it][2022-12-21 21:37:15,061] [INFO] [timer.py:197:stop] 0/632, RunningAvgSamplesPerSec=10.95053292791524, CurrSamplesPerSec=11.065671195599974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6632/20000 [7:37:59<34:34:21,  9.31s/it][2022-12-21 21:37:23,947] [INFO] [timer.py:197:stop] 0/633, RunningAvgSamplesPerSec=10.950469621081087, CurrSamplesPerSec=10.910731278495643, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6633/20000 [7:38:08<34:05:51,  9.18s/it][2022-12-21 21:37:33,750] [INFO] [timer.py:197:stop] 0/634, RunningAvgSamplesPerSec=10.950137193585533, CurrSamplesPerSec=10.744324261862555, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6634/20000 [7:38:18<34:47:07,  9.37s/it][2022-12-21 21:37:43,321] [INFO] [timer.py:197:stop] 0/635, RunningAvgSamplesPerSec=10.950171304150885, CurrSamplesPerSec=10.971771774128415, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6635/20000 [7:38:27<35:00:28,  9.43s/it][2022-12-21 21:37:53,027] [INFO] [timer.py:197:stop] 0/636, RunningAvgSamplesPerSec=10.94999107512252, CurrSamplesPerSec=10.837084303438491, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6636/20000 [7:38:37<35:18:46,  9.51s/it][2022-12-21 21:38:02,562] [INFO] [timer.py:197:stop] 0/637, RunningAvgSamplesPerSec=10.949967701621011, CurrSamplesPerSec=10.935168960671263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6637/20000 [7:38:47<35:20:04,  9.52s/it][2022-12-21 21:38:15,574] [INFO] [timer.py:197:stop] 0/638, RunningAvgSamplesPerSec=10.949471688929837, CurrSamplesPerSec=10.643324018218616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6638/20000 [7:39:00<39:13:19, 10.57s/it][2022-12-21 21:38:24,693] [INFO] [timer.py:197:stop] 0/639, RunningAvgSamplesPerSec=10.949907355816993, CurrSamplesPerSec=11.234196663290017, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6639/20000 [7:39:09<37:36:22, 10.13s/it][2022-12-21 21:38:33,949] [INFO] [logging.py:68:log_dist] [Rank 0] step=6640, skipped=14, lr=[6.858974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:38:33,949] [INFO] [timer.py:197:stop] 0/640, RunningAvgSamplesPerSec=10.949875932549798, CurrSamplesPerSec=10.929895892648723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6640/20000 [7:39:18<36:37:39,  9.87s/it][2022-12-21 21:38:43,233] [INFO] [timer.py:197:stop] 0/641, RunningAvgSamplesPerSec=10.949864408331091, CurrSamplesPerSec=10.942516898126312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6641/20000 [7:39:27<35:58:21,  9.69s/it][2022-12-21 21:38:52,389] [INFO] [timer.py:197:stop] 0/642, RunningAvgSamplesPerSec=10.94954187731931, CurrSamplesPerSec=10.747257999534053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6642/20000 [7:39:36<35:22:16,  9.53s/it][2022-12-21 21:39:01,682] [INFO] [timer.py:197:stop] 0/643, RunningAvgSamplesPerSec=10.949545899255417, CurrSamplesPerSec=10.952120544561838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6643/20000 [7:39:46<35:06:08,  9.46s/it][2022-12-21 21:39:10,892] [INFO] [timer.py:197:stop] 0/644, RunningAvgSamplesPerSec=10.94962114600379, CurrSamplesPerSec=10.998068053644145, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6644/20000 [7:39:55<34:49:10,  9.39s/it][2022-12-21 21:39:20,688] [INFO] [timer.py:197:stop] 0/645, RunningAvgSamplesPerSec=10.949683149335653, CurrSamplesPerSec=10.989634753445475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6645/20000 [7:40:05<35:16:29,  9.51s/it][2022-12-21 21:39:29,844] [INFO] [timer.py:197:stop] 0/646, RunningAvgSamplesPerSec=10.949847708106049, CurrSamplesPerSec=11.056693078402853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6646/20000 [7:40:14<34:52:44,  9.40s/it][2022-12-21 21:39:38,907] [INFO] [timer.py:197:stop] 0/647, RunningAvgSamplesPerSec=10.949597827357023, CurrSamplesPerSec=10.791008980439015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6647/20000 [7:40:23<34:29:53,  9.30s/it][2022-12-21 21:39:50,046] [INFO] [timer.py:197:stop] 0/648, RunningAvgSamplesPerSec=10.94963665943826, CurrSamplesPerSec=10.974740865358493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6648/20000 [7:40:34<36:32:27,  9.85s/it][2022-12-21 21:39:59,626] [INFO] [timer.py:197:stop] 0/649, RunningAvgSamplesPerSec=10.949925558117368, CurrSamplesPerSec=11.139795218347459, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6649/20000 [7:40:44<36:14:07,  9.77s/it][2022-12-21 21:40:08,570] [INFO] [logging.py:68:log_dist] [Rank 0] step=6650, skipped=14, lr=[6.853846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:40:08,571] [INFO] [timer.py:197:stop] 0/650, RunningAvgSamplesPerSec=10.949828965598513, CurrSamplesPerSec=10.887688814495002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6650/20000 [7:40:53<35:18:52,  9.52s/it]

                                                         
{'loss': 0.097, 'learning_rate': 6.853846153846154e-06, 'epoch': 0.33}


 33%|███▎      | 6650/20000 [7:40:53<35:18:52,  9.52s/it][2022-12-21 21:40:17,639] [INFO] [timer.py:197:stop] 0/651, RunningAvgSamplesPerSec=10.949850424086936, CurrSamplesPerSec=10.963773232297509, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6651/20000 [7:41:02<34:48:20,  9.39s/it][2022-12-21 21:40:27,535] [INFO] [timer.py:197:stop] 0/652, RunningAvgSamplesPerSec=10.948972527937594, CurrSamplesPerSec=10.407441159490144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6652/20000 [7:41:11<35:22:12,  9.54s/it][2022-12-21 21:40:39,834] [INFO] [timer.py:197:stop] 0/653, RunningAvgSamplesPerSec=10.949296121585999, CurrSamplesPerSec=11.163758144588918, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6653/20000 [7:41:24<38:26:12, 10.37s/it][2022-12-21 21:40:49,396] [INFO] [timer.py:197:stop] 0/654, RunningAvgSamplesPerSec=10.948918034246283, CurrSamplesPerSec=10.70820283603838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6654/20000 [7:41:33<37:32:15, 10.13s/it][2022-12-21 21:40:59,942] [INFO] [timer.py:197:stop] 0/655, RunningAvgSamplesPerSec=10.949275876864531, CurrSamplesPerSec=11.187677042755663, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6655/20000 [7:41:44<38:00:10, 10.25s/it][2022-12-21 21:41:10,548] [INFO] [timer.py:197:stop] 0/656, RunningAvgSamplesPerSec=10.94926395271619, CurrSamplesPerSec=10.941483025659036, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6656/20000 [7:41:55<38:23:37, 10.36s/it][2022-12-21 21:41:19,566] [INFO] [timer.py:197:stop] 0/657, RunningAvgSamplesPerSec=10.949211514274472, CurrSamplesPerSec=10.915024018013428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6657/20000 [7:42:04<36:54:02,  9.96s/it][2022-12-21 21:41:28,975] [INFO] [timer.py:197:stop] 0/658, RunningAvgSamplesPerSec=10.949502763686267, CurrSamplesPerSec=11.143658991288337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6658/20000 [7:42:13<36:17:23,  9.79s/it][2022-12-21 21:41:38,409] [INFO] [timer.py:197:stop] 0/659, RunningAvgSamplesPerSec=10.949498686748301, CurrSamplesPerSec=10.946824869532225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6659/20000 [7:42:22<35:53:21,  9.68s/it][2022-12-21 21:41:47,833] [INFO] [logging.py:68:log_dist] [Rank 0] step=6660, skipped=14, lr=[6.848717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:41:47,834] [INFO] [timer.py:197:stop] 0/660, RunningAvgSamplesPerSec=10.949135183423264, CurrSamplesPerSec=10.715419056061144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6660/20000 [7:42:32<35:35:52,  9.61s/it][2022-12-21 21:41:57,260] [INFO] [timer.py:197:stop] 0/661, RunningAvgSamplesPerSec=10.948970633939624, CurrSamplesPerSec=10.841758893924776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6661/20000 [7:42:41<35:23:41,  9.55s/it][2022-12-21 21:42:06,286] [INFO] [timer.py:197:stop] 0/662, RunningAvgSamplesPerSec=10.948705831638382, CurrSamplesPerSec=10.77694289360114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6662/20000 [7:42:50<34:48:24,  9.39s/it][2022-12-21 21:42:15,893] [INFO] [timer.py:197:stop] 0/663, RunningAvgSamplesPerSec=10.948358319851874, CurrSamplesPerSec=10.723713762759743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6663/20000 [7:43:00<35:02:25,  9.46s/it][2022-12-21 21:42:25,008] [INFO] [timer.py:197:stop] 0/664, RunningAvgSamplesPerSec=10.948495211963545, CurrSamplesPerSec=11.039736114420059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6664/20000 [7:43:09<34:39:19,  9.36s/it][2022-12-21 21:42:34,017] [INFO] [timer.py:197:stop] 0/665, RunningAvgSamplesPerSec=10.948830760860428, CurrSamplesPerSec=11.175571263124878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6665/20000 [7:43:18<34:16:06,  9.25s/it][2022-12-21 21:42:43,564] [INFO] [timer.py:197:stop] 0/666, RunningAvgSamplesPerSec=10.948877344519216, CurrSamplesPerSec=10.97984981025857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6666/20000 [7:43:28<34:35:41,  9.34s/it][2022-12-21 21:42:52,520] [INFO] [timer.py:197:stop] 0/667, RunningAvgSamplesPerSec=10.949213849326464, CurrSamplesPerSec=11.17731487987535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6667/20000 [7:43:36<34:09:56,  9.22s/it][2022-12-21 21:43:02,037] [INFO] [timer.py:197:stop] 0/668, RunningAvgSamplesPerSec=10.949434494408045, CurrSamplesPerSec=11.098159474453315, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6668/20000 [7:43:46<34:29:12,  9.31s/it][2022-12-21 21:43:11,095] [INFO] [timer.py:197:stop] 0/669, RunningAvgSamplesPerSec=10.949772371740014, CurrSamplesPerSec=11.179527408338943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6669/20000 [7:43:55<34:12:08,  9.24s/it][2022-12-21 21:43:20,173] [INFO] [logging.py:68:log_dist] [Rank 0] step=6670, skipped=14, lr=[6.843589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:43:20,173] [INFO] [timer.py:197:stop] 0/670, RunningAvgSamplesPerSec=10.94952722564207, CurrSamplesPerSec=10.788424183391204, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6670/20000 [7:44:04<34:01:24,  9.19s/it][2022-12-21 21:43:30,109] [INFO] [timer.py:197:stop] 0/671, RunningAvgSamplesPerSec=10.949459737066963, CurrSamplesPerSec=10.90456250166045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6671/20000 [7:44:14<34:51:02,  9.41s/it][2022-12-21 21:43:39,310] [INFO] [timer.py:197:stop] 0/672, RunningAvgSamplesPerSec=10.949003768735233, CurrSamplesPerSec=10.652241214887168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6672/20000 [7:44:23<34:36:46,  9.35s/it][2022-12-21 21:43:49,340] [INFO] [timer.py:197:stop] 0/673, RunningAvgSamplesPerSec=10.949260244765865, CurrSamplesPerSec=11.123843199557227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6673/20000 [7:44:33<35:21:58,  9.55s/it][2022-12-21 21:43:59,034] [INFO] [timer.py:197:stop] 0/674, RunningAvgSamplesPerSec=10.94926544245817, CurrSamplesPerSec=10.952754206919897, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6674/20000 [7:44:43<35:31:14,  9.60s/it][2022-12-21 21:44:07,899] [INFO] [timer.py:197:stop] 0/675, RunningAvgSamplesPerSec=10.94937798985474, CurrSamplesPerSec=11.02553668254534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6675/20000 [7:44:52<34:42:23,  9.38s/it]

                                                         
{'loss': 0.086, 'learning_rate': 6.841025641025642e-06, 'epoch': 0.33}


 33%|███▎      | 6675/20000 [7:44:52<34:42:23,  9.38s/it][2022-12-21 21:44:17,433] [INFO] [timer.py:197:stop] 0/676, RunningAvgSamplesPerSec=10.949182307236834, CurrSamplesPerSec=10.819055369722205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6676/20000 [7:45:01<34:52:41,  9.42s/it][2022-12-21 21:44:26,653] [INFO] [timer.py:197:stop] 0/677, RunningAvgSamplesPerSec=10.94925271994133, CurrSamplesPerSec=10.996917787553436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6677/20000 [7:45:11<34:38:57,  9.36s/it][2022-12-21 21:44:35,694] [INFO] [timer.py:197:stop] 0/678, RunningAvgSamplesPerSec=10.949236063653078, CurrSamplesPerSec=10.93800461894442, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6678/20000 [7:45:20<34:17:23,  9.27s/it][2022-12-21 21:44:45,139] [INFO] [timer.py:197:stop] 0/679, RunningAvgSamplesPerSec=10.948901974418003, CurrSamplesPerSec=10.72762863521265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6679/20000 [7:45:29<34:29:09,  9.32s/it][2022-12-21 21:44:54,098] [INFO] [logging.py:68:log_dist] [Rank 0] step=6680, skipped=14, lr=[6.83846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:44:54,099] [INFO] [timer.py:197:stop] 0/680, RunningAvgSamplesPerSec=10.948699529611956, CurrSamplesPerSec=10.813341304500813, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6680/20000 [7:45:38<34:05:00,  9.21s/it][2022-12-21 21:45:03,431] [INFO] [timer.py:197:stop] 0/681, RunningAvgSamplesPerSec=10.948702578840095, CurrSamplesPerSec=10.950770346538352, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6681/20000 [7:45:47<34:12:50,  9.25s/it][2022-12-21 21:45:13,745] [INFO] [timer.py:197:stop] 0/682, RunningAvgSamplesPerSec=10.9484317181149, CurrSamplesPerSec=10.767560086300783, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6682/20000 [7:45:58<35:23:44,  9.57s/it][2022-12-21 21:45:23,177] [INFO] [timer.py:197:stop] 0/683, RunningAvgSamplesPerSec=10.948410170659967, CurrSamplesPerSec=10.933777513004955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6683/20000 [7:46:07<35:14:30,  9.53s/it][2022-12-21 21:45:32,094] [INFO] [timer.py:197:stop] 0/684, RunningAvgSamplesPerSec=10.948364778298442, CurrSamplesPerSec=10.917539740960676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6684/20000 [7:46:16<34:33:43,  9.34s/it][2022-12-21 21:45:41,477] [INFO] [timer.py:197:stop] 0/685, RunningAvgSamplesPerSec=10.948403004173812, CurrSamplesPerSec=10.974535368107576, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6685/20000 [7:46:25<34:36:13,  9.36s/it][2022-12-21 21:45:50,594] [INFO] [timer.py:197:stop] 0/686, RunningAvgSamplesPerSec=10.948151292754375, CurrSamplesPerSec=10.778894131149366, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6686/20000 [7:46:35<34:20:07,  9.28s/it][2022-12-21 21:45:59,471] [INFO] [timer.py:197:stop] 0/687, RunningAvgSamplesPerSec=10.948251929082765, CurrSamplesPerSec=11.017523346553435, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6687/20000 [7:46:43<33:52:53,  9.16s/it][2022-12-21 21:46:08,703] [INFO] [timer.py:197:stop] 0/688, RunningAvgSamplesPerSec=10.948301577143763, CurrSamplesPerSec=10.982416625869895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6688/20000 [7:46:53<33:57:23,  9.18s/it][2022-12-21 21:46:17,921] [INFO] [timer.py:197:stop] 0/689, RunningAvgSamplesPerSec=10.948387312490865, CurrSamplesPerSec=11.00751988226954, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6689/20000 [7:47:02<33:59:34,  9.19s/it][2022-12-21 21:46:27,007] [INFO] [logging.py:68:log_dist] [Rank 0] step=6690, skipped=14, lr=[6.833333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:46:27,007] [INFO] [timer.py:197:stop] 0/690, RunningAvgSamplesPerSec=10.94868045993651, CurrSamplesPerSec=11.153852220341424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6690/20000 [7:47:11<33:52:16,  9.16s/it][2022-12-21 21:46:36,757] [INFO] [timer.py:197:stop] 0/691, RunningAvgSamplesPerSec=10.949002012962028, CurrSamplesPerSec=11.174799443215475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6691/20000 [7:47:21<34:31:18,  9.34s/it][2022-12-21 21:46:45,798] [INFO] [timer.py:197:stop] 0/692, RunningAvgSamplesPerSec=10.949322497410938, CurrSamplesPerSec=11.17468779635914, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6692/20000 [7:47:30<34:11:22,  9.25s/it][2022-12-21 21:46:55,207] [INFO] [timer.py:197:stop] 0/693, RunningAvgSamplesPerSec=10.949531426321238, CurrSamplesPerSec=11.095618537056538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6693/20000 [7:47:39<34:21:51,  9.30s/it][2022-12-21 21:47:04,763] [INFO] [timer.py:197:stop] 0/694, RunningAvgSamplesPerSec=10.949370566823193, CurrSamplesPerSec=10.839335307010876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6694/20000 [7:47:49<34:38:56,  9.37s/it][2022-12-21 21:47:13,593] [INFO] [timer.py:197:stop] 0/695, RunningAvgSamplesPerSec=10.949485727595215, CurrSamplesPerSec=11.029762084037412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6695/20000 [7:47:58<34:02:36,  9.21s/it][2022-12-21 21:47:22,395] [INFO] [timer.py:197:stop] 0/696, RunningAvgSamplesPerSec=10.949633079985402, CurrSamplesPerSec=11.052710967827313, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6696/20000 [7:48:06<33:35:14,  9.09s/it][2022-12-21 21:47:32,193] [INFO] [timer.py:197:stop] 0/697, RunningAvgSamplesPerSec=10.949315681824322, CurrSamplesPerSec=10.733391500844544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6697/20000 [7:48:16<34:22:14,  9.30s/it][2022-12-21 21:47:41,276] [INFO] [timer.py:197:stop] 0/698, RunningAvgSamplesPerSec=10.949567245008023, CurrSamplesPerSec=11.127244793000479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6698/20000 [7:48:25<34:07:33,  9.24s/it][2022-12-21 21:47:49,984] [INFO] [timer.py:197:stop] 0/699, RunningAvgSamplesPerSec=10.949984775785682, CurrSamplesPerSec=11.248520411524137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 33%|███▎      | 6699/20000 [7:48:34<33:32:19,  9.08s/it][2022-12-21 21:47:59,701] [INFO] [logging.py:68:log_dist] [Rank 0] step=6700, skipped=14, lr=[6.828205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:47:59,702] [INFO] [timer.py:197:stop] 0/700, RunningAvgSamplesPerSec=10.949729553512476, CurrSamplesPerSec=10.774687452912126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6700/20000 [7:48:44<34:14:46,  9.27s/it]

                                                         
{'loss': 0.0813, 'learning_rate': 6.828205128205129e-06, 'epoch': 0.34}


 34%|███▎      | 6700/20000 [7:48:44<34:14:46,  9.27s/it][2022-12-21 21:48:08,636] [INFO] [timer.py:197:stop] 0/701, RunningAvgSamplesPerSec=10.949723750906138, CurrSamplesPerSec=10.945675031417768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6701/20000 [7:48:53<33:52:19,  9.17s/it][2022-12-21 21:48:18,101] [INFO] [timer.py:197:stop] 0/702, RunningAvgSamplesPerSec=10.949858169040859, CurrSamplesPerSec=11.044630831573482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6702/20000 [7:49:02<34:11:50,  9.26s/it][2022-12-21 21:48:27,916] [INFO] [timer.py:197:stop] 0/703, RunningAvgSamplesPerSec=10.949967777104243, CurrSamplesPerSec=11.027235605083376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6703/20000 [7:49:12<34:48:43,  9.42s/it][2022-12-21 21:48:37,033] [INFO] [timer.py:197:stop] 0/704, RunningAvgSamplesPerSec=10.949976809532542, CurrSamplesPerSec=10.956312210388917, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6704/20000 [7:49:21<34:28:04,  9.33s/it][2022-12-21 21:48:46,247] [INFO] [timer.py:197:stop] 0/705, RunningAvgSamplesPerSec=10.950013917196733, CurrSamplesPerSec=10.976125704690524, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6705/20000 [7:49:30<34:20:02,  9.30s/it][2022-12-21 21:48:56,579] [INFO] [timer.py:197:stop] 0/706, RunningAvgSamplesPerSec=10.949801840165364, CurrSamplesPerSec=10.802717208656825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6706/20000 [7:49:41<35:28:41,  9.61s/it][2022-12-21 21:49:05,670] [INFO] [timer.py:197:stop] 0/707, RunningAvgSamplesPerSec=10.94983202095427, CurrSamplesPerSec=10.971120663934876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6707/20000 [7:49:50<34:54:13,  9.45s/it][2022-12-21 21:49:14,773] [INFO] [timer.py:197:stop] 0/708, RunningAvgSamplesPerSec=10.949809780212663, CurrSamplesPerSec=10.934152509814183, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6708/20000 [7:49:59<34:30:51,  9.35s/it][2022-12-21 21:49:23,923] [INFO] [timer.py:197:stop] 0/709, RunningAvgSamplesPerSec=10.949894174470023, CurrSamplesPerSec=11.009802967373412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6709/20000 [7:50:08<34:17:29,  9.29s/it][2022-12-21 21:49:33,513] [INFO] [logging.py:68:log_dist] [Rank 0] step=6710, skipped=14, lr=[6.8230769230769235e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:49:33,514] [INFO] [timer.py:197:stop] 0/710, RunningAvgSamplesPerSec=10.94996698697552, CurrSamplesPerSec=11.00168892964386, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6710/20000 [7:50:17<34:37:27,  9.38s/it][2022-12-21 21:49:42,353] [INFO] [timer.py:197:stop] 0/711, RunningAvgSamplesPerSec=10.95005411546727, CurrSamplesPerSec=11.012091065512507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6711/20000 [7:50:26<34:01:25,  9.22s/it][2022-12-21 21:49:51,637] [INFO] [timer.py:197:stop] 0/712, RunningAvgSamplesPerSec=10.950111128841385, CurrSamplesPerSec=10.990683596143434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6712/20000 [7:50:36<34:05:43,  9.24s/it][2022-12-21 21:50:01,154] [INFO] [timer.py:197:stop] 0/713, RunningAvgSamplesPerSec=10.949832886340182, CurrSamplesPerSec=10.755786542025009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6713/20000 [7:50:45<34:24:11,  9.32s/it][2022-12-21 21:50:10,422] [INFO] [timer.py:197:stop] 0/714, RunningAvgSamplesPerSec=10.949570597521335, CurrSamplesPerSec=10.76621053215034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6714/20000 [7:50:54<34:20:31,  9.31s/it][2022-12-21 21:50:19,802] [INFO] [timer.py:197:stop] 0/715, RunningAvgSamplesPerSec=10.949863420983384, CurrSamplesPerSec=11.162406321877867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6715/20000 [7:51:04<34:25:17,  9.33s/it][2022-12-21 21:50:29,879] [INFO] [timer.py:197:stop] 0/716, RunningAvgSamplesPerSec=10.94986048096377, CurrSamplesPerSec=10.94776464876612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6716/20000 [7:51:14<35:14:54,  9.55s/it][2022-12-21 21:50:38,902] [INFO] [timer.py:197:stop] 0/717, RunningAvgSamplesPerSec=10.949830008745554, CurrSamplesPerSec=10.928116050708066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6717/20000 [7:51:23<34:39:35,  9.39s/it][2022-12-21 21:50:48,213] [INFO] [timer.py:197:stop] 0/718, RunningAvgSamplesPerSec=10.94956341489073, CurrSamplesPerSec=10.762214813418709, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6718/20000 [7:51:32<34:33:57,  9.37s/it][2022-12-21 21:50:57,637] [INFO] [timer.py:197:stop] 0/719, RunningAvgSamplesPerSec=10.949576387890108, CurrSamplesPerSec=10.958872952856739, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6719/20000 [7:51:42<34:37:24,  9.39s/it][2022-12-21 21:51:06,892] [INFO] [logging.py:68:log_dist] [Rank 0] step=6720, skipped=14, lr=[6.817948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:51:06,893] [INFO] [timer.py:197:stop] 0/720, RunningAvgSamplesPerSec=10.949295051670981, CurrSamplesPerSec=10.751230991528676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6720/20000 [7:51:51<34:28:41,  9.35s/it][2022-12-21 21:51:16,684] [INFO] [timer.py:197:stop] 0/721, RunningAvgSamplesPerSec=10.948920134661599, CurrSamplesPerSec=10.686198010591474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6721/20000 [7:52:01<34:58:05,  9.48s/it][2022-12-21 21:51:26,118] [INFO] [timer.py:197:stop] 0/722, RunningAvgSamplesPerSec=10.948937292388171, CurrSamplesPerSec=10.961287632543522, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6722/20000 [7:52:10<34:54:51,  9.47s/it][2022-12-21 21:51:35,923] [INFO] [timer.py:197:stop] 0/723, RunningAvgSamplesPerSec=10.948912957538337, CurrSamplesPerSec=10.931419897956212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6723/20000 [7:52:20<35:17:09,  9.57s/it][2022-12-21 21:51:45,960] [INFO] [timer.py:197:stop] 0/724, RunningAvgSamplesPerSec=10.94890229176742, CurrSamplesPerSec=10.941217675754029, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6724/20000 [7:52:30<35:48:12,  9.71s/it][2022-12-21 21:51:55,068] [INFO] [timer.py:197:stop] 0/725, RunningAvgSamplesPerSec=10.949067584781494, CurrSamplesPerSec=11.06972610417892, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6725/20000 [7:52:39<35:08:09,  9.53s/it]

                                                         
{'loss': 0.0909, 'learning_rate': 6.815384615384616e-06, 'epoch': 0.34}


 34%|███▎      | 6725/20000 [7:52:39<35:08:09,  9.53s/it][2022-12-21 21:52:05,172] [INFO] [timer.py:197:stop] 0/726, RunningAvgSamplesPerSec=10.949070671576411, CurrSamplesPerSec=10.951302879922382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6726/20000 [7:52:49<35:46:13,  9.70s/it][2022-12-21 21:52:14,486] [INFO] [timer.py:197:stop] 0/727, RunningAvgSamplesPerSec=10.949279500219136, CurrSamplesPerSec=11.102591351628131, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6727/20000 [7:52:58<35:20:21,  9.59s/it][2022-12-21 21:52:23,800] [INFO] [timer.py:197:stop] 0/728, RunningAvgSamplesPerSec=10.949299933510453, CurrSamplesPerSec=10.964134167755482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6728/20000 [7:53:08<35:02:13,  9.50s/it][2022-12-21 21:52:33,661] [INFO] [timer.py:197:stop] 0/729, RunningAvgSamplesPerSec=10.949382398036716, CurrSamplesPerSec=11.00958125396348, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6729/20000 [7:53:18<35:25:47,  9.61s/it][2022-12-21 21:52:42,572] [INFO] [logging.py:68:log_dist] [Rank 0] step=6730, skipped=14, lr=[6.812820512820514e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:52:42,573] [INFO] [timer.py:197:stop] 0/730, RunningAvgSamplesPerSec=10.949667502119244, CurrSamplesPerSec=11.160942990082376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6730/20000 [7:53:27<34:39:13,  9.40s/it][2022-12-21 21:52:52,374] [INFO] [timer.py:197:stop] 0/731, RunningAvgSamplesPerSec=10.949680088396999, CurrSamplesPerSec=10.95885058311225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6731/20000 [7:53:36<35:05:33,  9.52s/it][2022-12-21 21:53:01,959] [INFO] [timer.py:197:stop] 0/732, RunningAvgSamplesPerSec=10.949507925010067, CurrSamplesPerSec=10.825425048491216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6732/20000 [7:53:46<35:09:42,  9.54s/it][2022-12-21 21:53:11,058] [INFO] [timer.py:197:stop] 0/733, RunningAvgSamplesPerSec=10.949664850839218, CurrSamplesPerSec=11.065433542195347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6733/20000 [7:53:55<34:40:13,  9.41s/it][2022-12-21 21:53:19,944] [INFO] [timer.py:197:stop] 0/734, RunningAvgSamplesPerSec=10.949749009680252, CurrSamplesPerSec=11.011617198464911, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6734/20000 [7:54:04<34:05:29,  9.25s/it][2022-12-21 21:53:30,039] [INFO] [timer.py:197:stop] 0/735, RunningAvgSamplesPerSec=10.949611069605128, CurrSamplesPerSec=10.849562792887378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6735/20000 [7:54:14<35:01:13,  9.50s/it][2022-12-21 21:53:39,368] [INFO] [timer.py:197:stop] 0/736, RunningAvgSamplesPerSec=10.949244335333647, CurrSamplesPerSec=10.686878282700583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6736/20000 [7:54:23<34:49:29,  9.45s/it][2022-12-21 21:53:50,144] [INFO] [timer.py:197:stop] 0/737, RunningAvgSamplesPerSec=10.949172987820283, CurrSamplesPerSec=10.897053536071324, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6737/20000 [7:54:34<36:17:08,  9.85s/it][2022-12-21 21:53:59,744] [INFO] [timer.py:197:stop] 0/738, RunningAvgSamplesPerSec=10.949144242701992, CurrSamplesPerSec=10.928057325804065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6738/20000 [7:54:44<36:00:33,  9.77s/it][2022-12-21 21:54:09,111] [INFO] [timer.py:197:stop] 0/739, RunningAvgSamplesPerSec=10.94878181189381, CurrSamplesPerSec=10.688385485353649, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6739/20000 [7:54:53<35:33:14,  9.65s/it][2022-12-21 21:54:18,333] [INFO] [logging.py:68:log_dist] [Rank 0] step=6740, skipped=14, lr=[6.807692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:54:18,334] [INFO] [timer.py:197:stop] 0/740, RunningAvgSamplesPerSec=10.948921804445515, CurrSamplesPerSec=11.053079148287448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6740/20000 [7:55:02<35:04:43,  9.52s/it][2022-12-21 21:54:27,262] [INFO] [timer.py:197:stop] 0/741, RunningAvgSamplesPerSec=10.948967048934206, CurrSamplesPerSec=10.982459760779289, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6741/20000 [7:55:11<34:24:58,  9.34s/it][2022-12-21 21:54:36,751] [INFO] [timer.py:197:stop] 0/742, RunningAvgSamplesPerSec=10.948926259538847, CurrSamplesPerSec=10.918865767552026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6742/20000 [7:55:21<34:34:25,  9.39s/it][2022-12-21 21:54:46,039] [INFO] [timer.py:197:stop] 0/743, RunningAvgSamplesPerSec=10.948911714914122, CurrSamplesPerSec=10.938159276784896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6743/20000 [7:55:30<34:27:39,  9.36s/it][2022-12-21 21:54:58,224] [INFO] [timer.py:197:stop] 0/744, RunningAvgSamplesPerSec=10.949018778593244, CurrSamplesPerSec=11.028932785602487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6744/20000 [7:55:42<37:34:52, 10.21s/it][2022-12-21 21:55:07,520] [INFO] [timer.py:197:stop] 0/745, RunningAvgSamplesPerSec=10.949283868336142, CurrSamplesPerSec=11.149583557417008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6745/20000 [7:55:51<36:34:21,  9.93s/it][2022-12-21 21:55:17,471] [INFO] [timer.py:197:stop] 0/746, RunningAvgSamplesPerSec=10.949188400124793, CurrSamplesPerSec=10.878712701156655, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6746/20000 [7:56:01<36:35:23,  9.94s/it][2022-12-21 21:55:26,848] [INFO] [timer.py:197:stop] 0/747, RunningAvgSamplesPerSec=10.94897731128926, CurrSamplesPerSec=10.794151002370338, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6747/20000 [7:56:11<35:58:00,  9.77s/it][2022-12-21 21:55:36,363] [INFO] [timer.py:197:stop] 0/748, RunningAvgSamplesPerSec=10.948946252728907, CurrSamplesPerSec=10.925856486828328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6748/20000 [7:56:20<35:40:57,  9.69s/it][2022-12-21 21:55:45,804] [INFO] [timer.py:197:stop] 0/749, RunningAvgSamplesPerSec=10.948955456976135, CurrSamplesPerSec=10.95582613996456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▎      | 6749/20000 [7:56:30<35:24:04,  9.62s/it][2022-12-21 21:55:55,264] [INFO] [logging.py:68:log_dist] [Rank 0] step=6750, skipped=14, lr=[6.802564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:55:55,265] [INFO] [timer.py:197:stop] 0/750, RunningAvgSamplesPerSec=10.948919333892489, CurrSamplesPerSec=10.922001818248694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6750/20000 [7:56:39<35:13:33,  9.57s/it]

                                                         
{'loss': 0.0981, 'learning_rate': 6.802564102564103e-06, 'epoch': 0.34}


 34%|███▍      | 6750/20000 [7:56:39<35:13:33,  9.57s/it][2022-12-21 21:56:04,366] [INFO] [timer.py:197:stop] 0/751, RunningAvgSamplesPerSec=10.948648680079563, CurrSamplesPerSec=10.749879930810993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6751/20000 [7:56:48<34:42:13,  9.43s/it][2022-12-21 21:56:14,760] [INFO] [timer.py:197:stop] 0/752, RunningAvgSamplesPerSec=10.948386025644462, CurrSamplesPerSec=10.755134958714791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6752/20000 [7:56:59<35:46:00,  9.72s/it][2022-12-21 21:56:24,542] [INFO] [timer.py:197:stop] 0/753, RunningAvgSamplesPerSec=10.948442115383946, CurrSamplesPerSec=10.990671896236213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6753/20000 [7:57:09<35:49:57,  9.74s/it][2022-12-21 21:56:33,432] [INFO] [timer.py:197:stop] 0/754, RunningAvgSamplesPerSec=10.948494788162657, CurrSamplesPerSec=10.988195676536002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6754/20000 [7:57:17<34:53:40,  9.48s/it][2022-12-21 21:56:44,245] [INFO] [timer.py:197:stop] 0/755, RunningAvgSamplesPerSec=10.94847008204117, CurrSamplesPerSec=10.92992259469126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6755/20000 [7:57:28<36:21:32,  9.88s/it][2022-12-21 21:56:53,752] [INFO] [timer.py:197:stop] 0/756, RunningAvgSamplesPerSec=10.948316021499725, CurrSamplesPerSec=10.833526352341105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6756/20000 [7:57:38<35:56:31,  9.77s/it][2022-12-21 21:57:02,766] [INFO] [timer.py:197:stop] 0/757, RunningAvgSamplesPerSec=10.948399428909543, CurrSamplesPerSec=11.01165243217078, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6757/20000 [7:57:47<35:06:18,  9.54s/it][2022-12-21 21:57:12,373] [INFO] [timer.py:197:stop] 0/758, RunningAvgSamplesPerSec=10.948443372840986, CurrSamplesPerSec=10.981722020762696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6758/20000 [7:57:56<35:10:21,  9.56s/it][2022-12-21 21:57:22,510] [INFO] [timer.py:197:stop] 0/759, RunningAvgSamplesPerSec=10.948523219354838, CurrSamplesPerSec=11.0092222868261, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6759/20000 [7:58:06<35:48:15,  9.73s/it][2022-12-21 21:57:31,806] [INFO] [logging.py:68:log_dist] [Rank 0] step=6760, skipped=14, lr=[6.797435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:57:31,807] [INFO] [timer.py:197:stop] 0/760, RunningAvgSamplesPerSec=10.947921176712137, CurrSamplesPerSec=10.510411842526276, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6760/20000 [7:58:16<35:19:08,  9.60s/it][2022-12-21 21:57:40,838] [INFO] [timer.py:197:stop] 0/761, RunningAvgSamplesPerSec=10.948226186357047, CurrSamplesPerSec=11.184417813990951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6761/20000 [7:58:25<34:41:04,  9.43s/it][2022-12-21 21:57:49,938] [INFO] [timer.py:197:stop] 0/762, RunningAvgSamplesPerSec=10.948173411442298, CurrSamplesPerSec=10.908263462347284, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6762/20000 [7:58:34<34:19:01,  9.33s/it][2022-12-21 21:57:58,912] [INFO] [timer.py:197:stop] 0/763, RunningAvgSamplesPerSec=10.948412734328773, CurrSamplesPerSec=11.133374938342149, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6763/20000 [7:58:43<33:55:06,  9.22s/it][2022-12-21 21:58:08,174] [INFO] [timer.py:197:stop] 0/764, RunningAvgSamplesPerSec=10.948227736321204, CurrSamplesPerSec=10.809233925462056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6764/20000 [7:58:52<33:57:28,  9.24s/it][2022-12-21 21:58:16,940] [INFO] [timer.py:197:stop] 0/765, RunningAvgSamplesPerSec=10.948606215818334, CurrSamplesPerSec=11.244820525537953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6765/20000 [7:59:01<33:26:11,  9.09s/it][2022-12-21 21:58:27,497] [INFO] [timer.py:197:stop] 0/766, RunningAvgSamplesPerSec=10.948358687049748, CurrSamplesPerSec=10.762701116446667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6766/20000 [7:59:11<35:02:45,  9.53s/it][2022-12-21 21:58:36,417] [INFO] [timer.py:197:stop] 0/767, RunningAvgSamplesPerSec=10.948576749252162, CurrSamplesPerSec=11.117753933814862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6767/20000 [7:59:20<34:22:03,  9.35s/it][2022-12-21 21:58:45,175] [INFO] [timer.py:197:stop] 0/768, RunningAvgSamplesPerSec=10.948919476924091, CurrSamplesPerSec=11.217547208603776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6768/20000 [7:59:29<33:42:43,  9.17s/it][2022-12-21 21:58:55,608] [INFO] [timer.py:197:stop] 0/769, RunningAvgSamplesPerSec=10.948565114691025, CurrSamplesPerSec=10.683698892576304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6769/20000 [7:59:40<35:06:01,  9.55s/it][2022-12-21 21:59:05,149] [INFO] [logging.py:68:log_dist] [Rank 0] step=6770, skipped=14, lr=[6.792307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-21 21:59:05,150] [INFO] [timer.py:197:stop] 0/770, RunningAvgSamplesPerSec=10.948509365039628, CurrSamplesPerSec=10.90591595013957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6770/20000 [7:59:49<35:05:18,  9.55s/it][2022-12-21 21:59:14,874] [INFO] [timer.py:197:stop] 0/771, RunningAvgSamplesPerSec=10.948908278334207, CurrSamplesPerSec=11.26410480175633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6771/20000 [7:59:59<35:16:46,  9.60s/it][2022-12-21 21:59:24,076] [INFO] [timer.py:197:stop] 0/772, RunningAvgSamplesPerSec=10.949019810787822, CurrSamplesPerSec=11.035466321504456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6772/20000 [8:00:08<34:50:14,  9.48s/it][2022-12-21 21:59:33,136] [INFO] [timer.py:197:stop] 0/773, RunningAvgSamplesPerSec=10.948968188940736, CurrSamplesPerSec=10.909363333750441, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6773/20000 [8:00:17<34:22:14,  9.35s/it][2022-12-21 21:59:42,237] [INFO] [timer.py:197:stop] 0/774, RunningAvgSamplesPerSec=10.948749716435676, CurrSamplesPerSec=10.782862831058754, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6774/20000 [8:00:26<34:05:20,  9.28s/it][2022-12-21 21:59:51,420] [INFO] [timer.py:197:stop] 0/775, RunningAvgSamplesPerSec=10.949028547020001, CurrSamplesPerSec=11.16860827357246, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6775/20000 [8:00:35<33:58:50,  9.25s/it]

                                                         
{'loss': 0.0829, 'learning_rate': 6.789743589743591e-06, 'epoch': 0.34}


 34%|███▍      | 6775/20000 [8:00:35<33:58:50,  9.25s/it][2022-12-21 22:00:01,353] [INFO] [timer.py:197:stop] 0/776, RunningAvgSamplesPerSec=10.94927624843372, CurrSamplesPerSec=11.144161871898838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6776/20000 [8:00:45<34:43:51,  9.45s/it][2022-12-21 22:00:10,592] [INFO] [timer.py:197:stop] 0/777, RunningAvgSamplesPerSec=10.949273266183061, CurrSamplesPerSec=10.946965491313339, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6777/20000 [8:00:55<34:29:25,  9.39s/it][2022-12-21 22:00:20,019] [INFO] [timer.py:197:stop] 0/778, RunningAvgSamplesPerSec=10.94928797196243, CurrSamplesPerSec=10.960696841649753, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6778/20000 [8:01:04<34:31:42,  9.40s/it][2022-12-21 22:00:28,991] [INFO] [timer.py:197:stop] 0/779, RunningAvgSamplesPerSec=10.949069618911011, CurrSamplesPerSec=10.78221316021839, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6779/20000 [8:01:13<34:03:11,  9.27s/it][2022-12-21 22:00:39,039] [INFO] [logging.py:68:log_dist] [Rank 0] step=6780, skipped=14, lr=[6.787179487179489e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:00:39,040] [INFO] [timer.py:197:stop] 0/780, RunningAvgSamplesPerSec=10.948999678686794, CurrSamplesPerSec=10.894924861329253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6780/20000 [8:01:23<34:54:22,  9.51s/it][2022-12-21 22:00:48,567] [INFO] [timer.py:197:stop] 0/781, RunningAvgSamplesPerSec=10.948909296964265, CurrSamplesPerSec=10.879041603595608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6781/20000 [8:01:33<34:55:35,  9.51s/it][2022-12-21 22:00:57,441] [INFO] [timer.py:197:stop] 0/782, RunningAvgSamplesPerSec=10.949191066718052, CurrSamplesPerSec=11.17318589783879, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6782/20000 [8:01:41<34:13:18,  9.32s/it][2022-12-21 22:01:06,678] [INFO] [timer.py:197:stop] 0/783, RunningAvgSamplesPerSec=10.948891437810078, CurrSamplesPerSec=10.72007144918379, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6783/20000 [8:01:51<34:07:36,  9.30s/it][2022-12-21 22:01:15,937] [INFO] [timer.py:197:stop] 0/784, RunningAvgSamplesPerSec=10.948320706882111, CurrSamplesPerSec=10.520038889218087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6784/20000 [8:02:00<34:05:06,  9.28s/it][2022-12-21 22:01:25,561] [INFO] [timer.py:197:stop] 0/785, RunningAvgSamplesPerSec=10.947948795899249, CurrSamplesPerSec=10.664649920901713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6785/20000 [8:02:10<34:27:21,  9.39s/it][2022-12-21 22:01:35,031] [INFO] [timer.py:197:stop] 0/786, RunningAvgSamplesPerSec=10.948045875890056, CurrSamplesPerSec=11.024591654229702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6786/20000 [8:02:19<34:32:42,  9.41s/it][2022-12-21 22:01:45,473] [INFO] [timer.py:197:stop] 0/787, RunningAvgSamplesPerSec=10.948214651661955, CurrSamplesPerSec=11.082155734584235, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6787/20000 [8:02:29<35:40:39,  9.72s/it][2022-12-21 22:01:54,853] [INFO] [timer.py:197:stop] 0/788, RunningAvgSamplesPerSec=10.94858069088411, CurrSamplesPerSec=11.243675995367413, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6788/20000 [8:02:39<35:17:56,  9.62s/it][2022-12-21 22:02:03,767] [INFO] [timer.py:197:stop] 0/789, RunningAvgSamplesPerSec=10.948550404864816, CurrSamplesPerSec=10.924797304422205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6789/20000 [8:02:48<34:31:18,  9.41s/it][2022-12-21 22:02:12,528] [INFO] [logging.py:68:log_dist] [Rank 0] step=6790, skipped=14, lr=[6.782051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:02:12,529] [INFO] [timer.py:197:stop] 0/790, RunningAvgSamplesPerSec=10.948781570402037, CurrSamplesPerSec=11.133786841112773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6790/20000 [8:02:56<33:48:30,  9.21s/it][2022-12-21 22:02:22,707] [INFO] [timer.py:197:stop] 0/791, RunningAvgSamplesPerSec=10.948892513093408, CurrSamplesPerSec=11.037019911418644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6791/20000 [8:03:07<34:52:03,  9.50s/it][2022-12-21 22:02:31,922] [INFO] [timer.py:197:stop] 0/792, RunningAvgSamplesPerSec=10.949257817561499, CurrSamplesPerSec=11.245285469151959, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6792/20000 [8:03:16<34:32:54,  9.42s/it][2022-12-21 22:02:40,828] [INFO] [timer.py:197:stop] 0/793, RunningAvgSamplesPerSec=10.94951801744276, CurrSamplesPerSec=11.159013816476428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6793/20000 [8:03:25<33:59:00,  9.26s/it][2022-12-21 22:02:49,595] [INFO] [timer.py:197:stop] 0/794, RunningAvgSamplesPerSec=10.949881599269057, CurrSamplesPerSec=11.245242129317866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6794/20000 [8:03:34<33:26:04,  9.11s/it][2022-12-21 22:03:00,530] [INFO] [timer.py:197:stop] 0/795, RunningAvgSamplesPerSec=10.949679635518823, CurrSamplesPerSec=10.792030229774753, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6795/20000 [8:03:44<35:26:08,  9.66s/it][2022-12-21 22:03:09,955] [INFO] [timer.py:197:stop] 0/796, RunningAvgSamplesPerSec=10.949718838511227, CurrSamplesPerSec=10.980895438376024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6796/20000 [8:03:54<35:10:25,  9.59s/it][2022-12-21 22:03:18,874] [INFO] [timer.py:197:stop] 0/797, RunningAvgSamplesPerSec=10.949546873037107, CurrSamplesPerSec=10.814690065694593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6797/20000 [8:04:03<34:26:00,  9.39s/it][2022-12-21 22:03:28,264] [INFO] [timer.py:197:stop] 0/798, RunningAvgSamplesPerSec=10.949536993784916, CurrSamplesPerSec=10.941688624938985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6798/20000 [8:04:12<34:25:54,  9.39s/it][2022-12-21 22:03:37,252] [INFO] [timer.py:197:stop] 0/799, RunningAvgSamplesPerSec=10.949555313160925, CurrSamplesPerSec=10.964157006902749, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6799/20000 [8:04:21<33:59:15,  9.27s/it][2022-12-21 22:03:46,822] [INFO] [logging.py:68:log_dist] [Rank 0] step=6800, skipped=14, lr=[6.776923076923078e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:03:46,823] [INFO] [timer.py:197:stop] 0/800, RunningAvgSamplesPerSec=10.949048556123413, CurrSamplesPerSec=10.559548973274573, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6800/20000 [8:04:31<34:19:04,  9.36s/it]

                                                         
{'loss': 0.0816, 'learning_rate': 6.776923076923078e-06, 'epoch': 0.34}


 34%|███▍      | 6800/20000 [8:04:31<34:19:04,  9.36s/it][2022-12-21 22:03:56,198] [INFO] [timer.py:197:stop] 0/801, RunningAvgSamplesPerSec=10.949318375850243, CurrSamplesPerSec=11.168959121433572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6801/20000 [8:04:40<34:20:00,  9.36s/it][2022-12-21 22:04:08,371] [INFO] [timer.py:197:stop] 0/802, RunningAvgSamplesPerSec=10.949196632815475, CurrSamplesPerSec=10.852781571661712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6802/20000 [8:04:52<37:25:08, 10.21s/it][2022-12-21 22:04:18,512] [INFO] [timer.py:197:stop] 0/803, RunningAvgSamplesPerSec=10.949542734592447, CurrSamplesPerSec=11.233616517830447, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6803/20000 [8:05:02<37:20:35, 10.19s/it][2022-12-21 22:04:27,993] [INFO] [timer.py:197:stop] 0/804, RunningAvgSamplesPerSec=10.949483930809253, CurrSamplesPerSec=10.902584103199555, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6804/20000 [8:05:12<36:33:51,  9.98s/it][2022-12-21 22:04:37,552] [INFO] [timer.py:197:stop] 0/805, RunningAvgSamplesPerSec=10.949778061732772, CurrSamplesPerSec=11.190871456132784, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6805/20000 [8:05:22<36:06:16,  9.85s/it][2022-12-21 22:04:46,977] [INFO] [timer.py:197:stop] 0/806, RunningAvgSamplesPerSec=10.94965007221861, CurrSamplesPerSec=10.847831372933006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6806/20000 [8:05:31<35:38:01,  9.72s/it][2022-12-21 22:04:56,077] [INFO] [timer.py:197:stop] 0/807, RunningAvgSamplesPerSec=10.949713875943132, CurrSamplesPerSec=11.001253829746199, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6807/20000 [8:05:40<34:56:45,  9.54s/it][2022-12-21 22:05:05,151] [INFO] [timer.py:197:stop] 0/808, RunningAvgSamplesPerSec=10.949995202372767, CurrSamplesPerSec=11.181251767406199, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6808/20000 [8:05:49<34:26:07,  9.40s/it][2022-12-21 22:05:14,350] [INFO] [timer.py:197:stop] 0/809, RunningAvgSamplesPerSec=10.950294688543384, CurrSamplesPerSec=11.197128441045853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6809/20000 [8:05:58<34:12:56,  9.34s/it][2022-12-21 22:05:23,171] [INFO] [logging.py:68:log_dist] [Rank 0] step=6810, skipped=14, lr=[6.7717948717948725e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:05:23,172] [INFO] [timer.py:197:stop] 0/810, RunningAvgSamplesPerSec=10.950401657604074, CurrSamplesPerSec=11.037412461730854, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6810/20000 [8:06:07<33:38:46,  9.18s/it][2022-12-21 22:05:32,130] [INFO] [timer.py:197:stop] 0/811, RunningAvgSamplesPerSec=10.950147657841608, CurrSamplesPerSec=10.74869620200299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6811/20000 [8:06:16<33:23:43,  9.12s/it][2022-12-21 22:05:42,789] [INFO] [timer.py:197:stop] 0/812, RunningAvgSamplesPerSec=10.950143594646823, CurrSamplesPerSec=10.946857457750365, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6812/20000 [8:06:27<35:05:22,  9.58s/it][2022-12-21 22:05:52,266] [INFO] [timer.py:197:stop] 0/813, RunningAvgSamplesPerSec=10.949620869587907, CurrSamplesPerSec=10.54199536833968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6813/20000 [8:06:36<34:58:30,  9.55s/it][2022-12-21 22:06:01,267] [INFO] [timer.py:197:stop] 0/814, RunningAvgSamplesPerSec=10.949703107281936, CurrSamplesPerSec=11.01680711240428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6814/20000 [8:06:45<34:22:20,  9.38s/it][2022-12-21 22:06:11,020] [INFO] [timer.py:197:stop] 0/815, RunningAvgSamplesPerSec=10.949283906132639, CurrSamplesPerSec=10.619167859154315, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6815/20000 [8:06:55<34:46:27,  9.49s/it][2022-12-21 22:06:21,777] [INFO] [timer.py:197:stop] 0/816, RunningAvgSamplesPerSec=10.949055807745504, CurrSamplesPerSec=10.766704105836038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6816/20000 [8:07:06<36:09:29,  9.87s/it][2022-12-21 22:06:30,597] [INFO] [timer.py:197:stop] 0/817, RunningAvgSamplesPerSec=10.949262105202884, CurrSamplesPerSec=11.119807054577372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6817/20000 [8:07:15<34:59:55,  9.56s/it][2022-12-21 22:06:40,147] [INFO] [timer.py:197:stop] 0/818, RunningAvgSamplesPerSec=10.949088529148337, CurrSamplesPerSec=10.809430667104248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6818/20000 [8:07:24<34:59:14,  9.56s/it][2022-12-21 22:06:49,068] [INFO] [timer.py:197:stop] 0/819, RunningAvgSamplesPerSec=10.949109527606748, CurrSamplesPerSec=10.966271159574937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6819/20000 [8:07:33<34:17:19,  9.36s/it][2022-12-21 22:06:58,325] [INFO] [logging.py:68:log_dist] [Rank 0] step=6820, skipped=14, lr=[6.7666666666666665e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:06:58,326] [INFO] [timer.py:197:stop] 0/820, RunningAvgSamplesPerSec=10.949192303141851, CurrSamplesPerSec=11.017240730415532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6820/20000 [8:07:42<34:10:07,  9.33s/it][2022-12-21 22:07:07,799] [INFO] [timer.py:197:stop] 0/821, RunningAvgSamplesPerSec=10.949468190778182, CurrSamplesPerSec=11.17989943001289, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6821/20000 [8:07:52<34:19:11,  9.37s/it][2022-12-21 22:07:17,127] [INFO] [timer.py:197:stop] 0/822, RunningAvgSamplesPerSec=10.948979998418144, CurrSamplesPerSec=10.563253430095275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6822/20000 [8:08:01<34:15:55,  9.36s/it][2022-12-21 22:07:28,016] [INFO] [timer.py:197:stop] 0/823, RunningAvgSamplesPerSec=10.948785835605081, CurrSamplesPerSec=10.791857115708765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6823/20000 [8:08:12<35:56:27,  9.82s/it][2022-12-21 22:07:37,430] [INFO] [timer.py:197:stop] 0/824, RunningAvgSamplesPerSec=10.948578346310969, CurrSamplesPerSec=10.780842611572004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6824/20000 [8:08:21<35:29:35,  9.70s/it][2022-12-21 22:07:47,826] [INFO] [timer.py:197:stop] 0/825, RunningAvgSamplesPerSec=10.948804831050769, CurrSamplesPerSec=11.138199621708074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6825/20000 [8:08:32<36:15:26,  9.91s/it]

                                                         
{'loss': 0.0854, 'learning_rate': 6.764102564102564e-06, 'epoch': 0.34}


 34%|███▍      | 6825/20000 [8:08:32<36:15:26,  9.91s/it][2022-12-21 22:07:57,669] [INFO] [timer.py:197:stop] 0/826, RunningAvgSamplesPerSec=10.948780986282918, CurrSamplesPerSec=10.929191895861328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6826/20000 [8:08:42<36:11:06,  9.89s/it][2022-12-21 22:08:07,076] [INFO] [timer.py:197:stop] 0/827, RunningAvgSamplesPerSec=10.948732790761458, CurrSamplesPerSec=10.909163380938796, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6827/20000 [8:08:51<35:39:14,  9.74s/it][2022-12-21 22:08:16,105] [INFO] [timer.py:197:stop] 0/828, RunningAvgSamplesPerSec=10.948771400586901, CurrSamplesPerSec=10.980717559742512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6828/20000 [8:09:00<34:51:59,  9.53s/it][2022-12-21 22:08:25,039] [INFO] [timer.py:197:stop] 0/829, RunningAvgSamplesPerSec=10.948982230293131, CurrSamplesPerSec=11.125945606368704, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6829/20000 [8:09:09<34:12:36,  9.35s/it][2022-12-21 22:08:35,506] [INFO] [logging.py:68:log_dist] [Rank 0] step=6830, skipped=14, lr=[6.7615384615384614e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:08:35,507] [INFO] [timer.py:197:stop] 0/830, RunningAvgSamplesPerSec=10.949285258364396, CurrSamplesPerSec=11.205766851399641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6830/20000 [8:09:19<35:26:01,  9.69s/it][2022-12-21 22:08:45,972] [INFO] [timer.py:197:stop] 0/831, RunningAvgSamplesPerSec=10.94901174485928, CurrSamplesPerSec=10.727137351562263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6831/20000 [8:09:30<36:17:10,  9.92s/it][2022-12-21 22:08:55,059] [INFO] [timer.py:197:stop] 0/832, RunningAvgSamplesPerSec=10.94890249591071, CurrSamplesPerSec=10.859079017682507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6832/20000 [8:09:39<35:22:13,  9.67s/it][2022-12-21 22:09:03,840] [INFO] [timer.py:197:stop] 0/833, RunningAvgSamplesPerSec=10.94902260353686, CurrSamplesPerSec=11.04962904453462, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6833/20000 [8:09:48<34:23:33,  9.40s/it][2022-12-21 22:09:13,873] [INFO] [timer.py:197:stop] 0/834, RunningAvgSamplesPerSec=10.949063600443166, CurrSamplesPerSec=10.983238494030289, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6834/20000 [8:09:58<35:04:50,  9.59s/it][2022-12-21 22:09:23,828] [INFO] [timer.py:197:stop] 0/835, RunningAvgSamplesPerSec=10.949180577522654, CurrSamplesPerSec=11.047379425384973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6835/20000 [8:10:08<35:28:32,  9.70s/it][2022-12-21 22:09:33,334] [INFO] [timer.py:197:stop] 0/836, RunningAvgSamplesPerSec=10.949689186071462, CurrSamplesPerSec=11.390434105346326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6836/20000 [8:10:17<35:15:32,  9.64s/it][2022-12-21 22:09:42,289] [INFO] [timer.py:197:stop] 0/837, RunningAvgSamplesPerSec=10.94945119210845, CurrSamplesPerSec=10.754502412352165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6837/20000 [8:10:26<34:30:08,  9.44s/it][2022-12-21 22:09:51,496] [INFO] [timer.py:197:stop] 0/838, RunningAvgSamplesPerSec=10.949461440087688, CurrSamplesPerSec=10.958025203394744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6838/20000 [8:10:35<34:14:56,  9.37s/it][2022-12-21 22:10:00,204] [INFO] [timer.py:197:stop] 0/839, RunningAvgSamplesPerSec=10.949768974186012, CurrSamplesPerSec=11.213056824017066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6839/20000 [8:10:44<33:31:20,  9.17s/it][2022-12-21 22:10:10,011] [INFO] [logging.py:68:log_dist] [Rank 0] step=6840, skipped=14, lr=[6.756410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:10:10,012] [INFO] [timer.py:197:stop] 0/840, RunningAvgSamplesPerSec=10.949464642476334, CurrSamplesPerSec=10.700536913431215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6840/20000 [8:10:54<34:13:12,  9.36s/it][2022-12-21 22:10:19,116] [INFO] [timer.py:197:stop] 0/841, RunningAvgSamplesPerSec=10.948962580694957, CurrSamplesPerSec=10.543821447392986, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6841/20000 [8:11:03<33:56:07,  9.28s/it][2022-12-21 22:10:28,641] [INFO] [timer.py:197:stop] 0/842, RunningAvgSamplesPerSec=10.94884245398952, CurrSamplesPerSec=10.848976529819893, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6842/20000 [8:11:13<34:11:52,  9.36s/it][2022-12-21 22:10:37,548] [INFO] [timer.py:197:stop] 0/843, RunningAvgSamplesPerSec=10.9492547071343, CurrSamplesPerSec=11.306871167639123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6843/20000 [8:11:22<33:42:08,  9.22s/it][2022-12-21 22:10:46,905] [INFO] [timer.py:197:stop] 0/844, RunningAvgSamplesPerSec=10.949364237240228, CurrSamplesPerSec=11.04226151186767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6844/20000 [8:11:31<33:50:52,  9.26s/it][2022-12-21 22:10:56,088] [INFO] [timer.py:197:stop] 0/845, RunningAvgSamplesPerSec=10.949702758423573, CurrSamplesPerSec=11.242365017510059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6845/20000 [8:11:40<33:45:29,  9.24s/it][2022-12-21 22:11:05,479] [INFO] [timer.py:197:stop] 0/846, RunningAvgSamplesPerSec=10.95006822659824, CurrSamplesPerSec=11.267088108114166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6846/20000 [8:11:49<33:55:23,  9.28s/it][2022-12-21 22:11:14,835] [INFO] [timer.py:197:stop] 0/847, RunningAvgSamplesPerSec=10.94984751794963, CurrSamplesPerSec=10.76668899135947, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6847/20000 [8:11:59<33:59:59,  9.31s/it][2022-12-21 22:11:24,813] [INFO] [timer.py:197:stop] 0/848, RunningAvgSamplesPerSec=10.950095524949191, CurrSamplesPerSec=11.163755358903302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6848/20000 [8:12:09<34:44:02,  9.51s/it][2022-12-21 22:11:34,073] [INFO] [timer.py:197:stop] 0/849, RunningAvgSamplesPerSec=10.949948098288687, CurrSamplesPerSec=10.826631415121629, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6849/20000 [8:12:18<34:27:37,  9.43s/it][2022-12-21 22:11:43,086] [INFO] [logging.py:68:log_dist] [Rank 0] step=6850, skipped=14, lr=[6.751282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:11:43,087] [INFO] [timer.py:197:stop] 0/850, RunningAvgSamplesPerSec=10.950324883469722, CurrSamplesPerSec=11.279053740113328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6850/20000 [8:12:27<33:59:50,  9.31s/it]

                                                         
{'loss': 0.0752, 'learning_rate': 6.751282051282052e-06, 'epoch': 0.34}


 34%|███▍      | 6850/20000 [8:12:27<33:59:50,  9.31s/it][2022-12-21 22:11:52,784] [INFO] [timer.py:197:stop] 0/851, RunningAvgSamplesPerSec=10.950541473835571, CurrSamplesPerSec=11.13734700617535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6851/20000 [8:12:37<34:25:20,  9.42s/it][2022-12-21 22:12:05,063] [INFO] [timer.py:197:stop] 0/852, RunningAvgSamplesPerSec=10.950728058816715, CurrSamplesPerSec=11.111466653155848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6852/20000 [8:12:49<37:32:52, 10.28s/it][2022-12-21 22:12:14,952] [INFO] [timer.py:197:stop] 0/853, RunningAvgSamplesPerSec=10.950771514032555, CurrSamplesPerSec=10.98783360493657, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6853/20000 [8:12:59<37:06:54, 10.16s/it][2022-12-21 22:12:24,185] [INFO] [timer.py:197:stop] 0/854, RunningAvgSamplesPerSec=10.950428260866424, CurrSamplesPerSec=10.665918190816045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6854/20000 [8:13:08<36:05:36,  9.88s/it][2022-12-21 22:12:33,664] [INFO] [timer.py:197:stop] 0/855, RunningAvgSamplesPerSec=10.95031426482819, CurrSamplesPerSec=10.854044514142682, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6855/20000 [8:13:18<35:38:49,  9.76s/it][2022-12-21 22:12:44,831] [INFO] [timer.py:197:stop] 0/856, RunningAvgSamplesPerSec=10.950572111444298, CurrSamplesPerSec=11.175028791464538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6856/20000 [8:13:29<37:10:58, 10.18s/it][2022-12-21 22:12:54,045] [INFO] [timer.py:197:stop] 0/857, RunningAvgSamplesPerSec=10.950206962893002, CurrSamplesPerSec=10.647014440386677, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6857/20000 [8:13:38<36:07:02,  9.89s/it][2022-12-21 22:13:04,535] [INFO] [timer.py:197:stop] 0/858, RunningAvgSamplesPerSec=10.950152951516229, CurrSamplesPerSec=10.90416738464618, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6858/20000 [8:13:48<36:46:05, 10.07s/it][2022-12-21 22:13:14,056] [INFO] [timer.py:197:stop] 0/859, RunningAvgSamplesPerSec=10.949946179824483, CurrSamplesPerSec=10.775768337451524, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6859/20000 [8:13:58<36:09:46,  9.91s/it][2022-12-21 22:13:24,492] [INFO] [logging.py:68:log_dist] [Rank 0] step=6860, skipped=14, lr=[6.746153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:13:24,493] [INFO] [timer.py:197:stop] 0/860, RunningAvgSamplesPerSec=10.95003276940261, CurrSamplesPerSec=11.024746959210457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6860/20000 [8:14:08<36:44:24, 10.07s/it][2022-12-21 22:13:33,618] [INFO] [timer.py:197:stop] 0/861, RunningAvgSamplesPerSec=10.950322131591722, CurrSamplesPerSec=11.20436134351432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6861/20000 [8:14:18<35:42:25,  9.78s/it][2022-12-21 22:13:42,502] [INFO] [timer.py:197:stop] 0/862, RunningAvgSamplesPerSec=10.950452974790705, CurrSamplesPerSec=11.064014220408836, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6862/20000 [8:14:26<34:43:09,  9.51s/it][2022-12-21 22:13:51,716] [INFO] [timer.py:197:stop] 0/863, RunningAvgSamplesPerSec=10.950663685960807, CurrSamplesPerSec=11.134928044847092, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6863/20000 [8:14:36<34:23:20,  9.42s/it][2022-12-21 22:14:01,667] [INFO] [timer.py:197:stop] 0/864, RunningAvgSamplesPerSec=10.950655421415146, CurrSamplesPerSec=10.943544273815016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6864/20000 [8:14:46<34:57:48,  9.58s/it][2022-12-21 22:14:11,303] [INFO] [timer.py:197:stop] 0/865, RunningAvgSamplesPerSec=10.95048844312114, CurrSamplesPerSec=10.808422659482297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6865/20000 [8:14:55<35:01:12,  9.60s/it][2022-12-21 22:14:20,094] [INFO] [timer.py:197:stop] 0/866, RunningAvgSamplesPerSec=10.950691440562924, CurrSamplesPerSec=11.128729751568999, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6866/20000 [8:15:04<34:08:00,  9.36s/it][2022-12-21 22:14:30,632] [INFO] [timer.py:197:stop] 0/867, RunningAvgSamplesPerSec=10.950461642613321, CurrSamplesPerSec=10.75545600014873, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6867/20000 [8:15:15<35:25:30,  9.71s/it][2022-12-21 22:14:40,441] [INFO] [timer.py:197:stop] 0/868, RunningAvgSamplesPerSec=10.950480729431822, CurrSamplesPerSec=10.967015786249554, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6868/20000 [8:15:24<35:31:49,  9.74s/it][2022-12-21 22:14:49,615] [INFO] [timer.py:197:stop] 0/869, RunningAvgSamplesPerSec=10.950187254104977, CurrSamplesPerSec=10.701809040598313, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6869/20000 [8:15:34<34:54:28,  9.57s/it][2022-12-21 22:14:58,658] [INFO] [logging.py:68:log_dist] [Rank 0] step=6870, skipped=14, lr=[6.741025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:14:58,659] [INFO] [timer.py:197:stop] 0/870, RunningAvgSamplesPerSec=10.950051195019316, CurrSamplesPerSec=10.833346657988757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6870/20000 [8:15:43<34:19:43,  9.41s/it][2022-12-21 22:15:08,493] [INFO] [timer.py:197:stop] 0/871, RunningAvgSamplesPerSec=10.950212859555384, CurrSamplesPerSec=11.092361380738899, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6871/20000 [8:15:52<34:47:16,  9.54s/it][2022-12-21 22:15:17,196] [INFO] [timer.py:197:stop] 0/872, RunningAvgSamplesPerSec=10.950583574663368, CurrSamplesPerSec=11.282511101445001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6872/20000 [8:16:01<33:52:12,  9.29s/it][2022-12-21 22:15:27,815] [INFO] [timer.py:197:stop] 0/873, RunningAvgSamplesPerSec=10.950846252944135, CurrSamplesPerSec=11.184252852055671, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6873/20000 [8:16:12<35:19:24,  9.69s/it][2022-12-21 22:15:37,184] [INFO] [timer.py:197:stop] 0/874, RunningAvgSamplesPerSec=10.950904627242567, CurrSamplesPerSec=11.001986079817474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6874/20000 [8:16:21<34:58:23,  9.59s/it][2022-12-21 22:15:45,955] [INFO] [timer.py:197:stop] 0/875, RunningAvgSamplesPerSec=10.951203083541095, CurrSamplesPerSec=11.217799879069368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6875/20000 [8:16:30<34:04:22,  9.35s/it]

                                                         
{'loss': 0.0848, 'learning_rate': 6.738461538461539e-06, 'epoch': 0.34}


 34%|███▍      | 6875/20000 [8:16:30<34:04:22,  9.35s/it][2022-12-21 22:15:55,542] [INFO] [timer.py:197:stop] 0/876, RunningAvgSamplesPerSec=10.950935539578893, CurrSamplesPerSec=10.722252685801203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6876/20000 [8:16:40<34:20:01,  9.42s/it][2022-12-21 22:16:06,018] [INFO] [timer.py:197:stop] 0/877, RunningAvgSamplesPerSec=10.95094423520353, CurrSamplesPerSec=10.958549495238477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6877/20000 [8:16:50<35:29:18,  9.74s/it][2022-12-21 22:16:15,365] [INFO] [timer.py:197:stop] 0/878, RunningAvgSamplesPerSec=10.950814938061626, CurrSamplesPerSec=10.838838115352402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6878/20000 [8:16:59<35:03:38,  9.62s/it][2022-12-21 22:16:24,590] [INFO] [timer.py:197:stop] 0/879, RunningAvgSamplesPerSec=10.951097296145313, CurrSamplesPerSec=11.20416539554725, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6879/20000 [8:17:09<34:37:39,  9.50s/it][2022-12-21 22:16:33,820] [INFO] [logging.py:68:log_dist] [Rank 0] step=6880, skipped=14, lr=[6.735897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:16:33,821] [INFO] [timer.py:197:stop] 0/880, RunningAvgSamplesPerSec=10.951065571695771, CurrSamplesPerSec=10.923313816118013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6880/20000 [8:17:18<34:19:47,  9.42s/it][2022-12-21 22:16:43,229] [INFO] [timer.py:197:stop] 0/881, RunningAvgSamplesPerSec=10.950919614807775, CurrSamplesPerSec=10.82425343182103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6881/20000 [8:17:27<34:18:53,  9.42s/it][2022-12-21 22:16:51,988] [INFO] [timer.py:197:stop] 0/882, RunningAvgSamplesPerSec=10.951111759786762, CurrSamplesPerSec=11.122655875303487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6882/20000 [8:17:36<33:35:37,  9.22s/it][2022-12-21 22:17:02,209] [INFO] [timer.py:197:stop] 0/883, RunningAvgSamplesPerSec=10.951132416260597, CurrSamplesPerSec=10.969340370818527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6883/20000 [8:17:46<34:41:08,  9.52s/it][2022-12-21 22:17:11,197] [INFO] [timer.py:197:stop] 0/884, RunningAvgSamplesPerSec=10.951194148325161, CurrSamplesPerSec=11.00585184701689, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6884/20000 [8:17:55<34:06:05,  9.36s/it][2022-12-21 22:17:20,343] [INFO] [timer.py:197:stop] 0/885, RunningAvgSamplesPerSec=10.951021697869692, CurrSamplesPerSec=10.801006356663201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6885/20000 [8:18:04<33:51:54,  9.30s/it][2022-12-21 22:17:30,917] [INFO] [timer.py:197:stop] 0/886, RunningAvgSamplesPerSec=10.950846801330622, CurrSamplesPerSec=10.798563160152998, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6886/20000 [8:18:15<35:15:33,  9.68s/it][2022-12-21 22:17:39,806] [INFO] [timer.py:197:stop] 0/887, RunningAvgSamplesPerSec=10.950890550726891, CurrSamplesPerSec=10.98970224051414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6887/20000 [8:18:24<34:23:35,  9.44s/it][2022-12-21 22:17:49,680] [INFO] [timer.py:197:stop] 0/888, RunningAvgSamplesPerSec=10.9510241182709, CurrSamplesPerSec=11.07052274133119, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6888/20000 [8:18:34<34:51:44,  9.57s/it][2022-12-21 22:17:59,431] [INFO] [timer.py:197:stop] 0/889, RunningAvgSamplesPerSec=10.95110521322301, CurrSamplesPerSec=11.023430401447081, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6889/20000 [8:18:43<35:03:20,  9.63s/it][2022-12-21 22:18:08,598] [INFO] [logging.py:68:log_dist] [Rank 0] step=6890, skipped=14, lr=[6.730769230769232e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:18:08,599] [INFO] [timer.py:197:stop] 0/890, RunningAvgSamplesPerSec=10.950873587948326, CurrSamplesPerSec=10.749209693064904, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6890/20000 [8:18:53<34:33:12,  9.49s/it][2022-12-21 22:18:18,274] [INFO] [timer.py:197:stop] 0/891, RunningAvgSamplesPerSec=10.950988269356515, CurrSamplesPerSec=11.053782354654446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6891/20000 [8:19:02<34:45:16,  9.54s/it][2022-12-21 22:18:27,341] [INFO] [timer.py:197:stop] 0/892, RunningAvgSamplesPerSec=10.951057717282094, CurrSamplesPerSec=11.013147362090344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6892/20000 [8:19:11<34:13:48,  9.40s/it][2022-12-21 22:18:36,862] [INFO] [timer.py:197:stop] 0/893, RunningAvgSamplesPerSec=10.950588137058796, CurrSamplesPerSec=10.548042068083097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6893/20000 [8:19:21<34:21:32,  9.44s/it][2022-12-21 22:18:46,282] [INFO] [timer.py:197:stop] 0/894, RunningAvgSamplesPerSec=10.950869716811889, CurrSamplesPerSec=11.207646713831378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6894/20000 [8:19:30<34:20:14,  9.43s/it][2022-12-21 22:18:55,217] [INFO] [timer.py:197:stop] 0/895, RunningAvgSamplesPerSec=10.950898777451172, CurrSamplesPerSec=10.976882443098578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6895/20000 [8:19:39<33:47:33,  9.28s/it][2022-12-21 22:19:05,808] [INFO] [timer.py:197:stop] 0/896, RunningAvgSamplesPerSec=10.951098956085927, CurrSamplesPerSec=11.132828244518107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6896/20000 [8:19:50<35:13:07,  9.68s/it][2022-12-21 22:19:14,842] [INFO] [timer.py:197:stop] 0/897, RunningAvgSamplesPerSec=10.95095946723037, CurrSamplesPerSec=10.827662038923128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6897/20000 [8:19:59<34:30:53,  9.48s/it][2022-12-21 22:19:24,193] [INFO] [timer.py:197:stop] 0/898, RunningAvgSamplesPerSec=10.950852575216368, CurrSamplesPerSec=10.85601367579991, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6898/20000 [8:20:08<34:22:04,  9.44s/it][2022-12-21 22:19:34,076] [INFO] [timer.py:197:stop] 0/899, RunningAvgSamplesPerSec=10.950666990987013, CurrSamplesPerSec=10.786873465991942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6899/20000 [8:20:18<34:50:47,  9.58s/it][2022-12-21 22:19:45,244] [INFO] [logging.py:68:log_dist] [Rank 0] step=6900, skipped=14, lr=[6.725641025641027e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:19:45,245] [INFO] [timer.py:197:stop] 0/900, RunningAvgSamplesPerSec=10.950645487170048, CurrSamplesPerSec=10.93139051766858, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 34%|███▍      | 6900/20000 [8:20:29<36:34:59, 10.05s/it]

                                                         
{'loss': 0.0751, 'learning_rate': 6.725641025641027e-06, 'epoch': 0.34}


 34%|███▍      | 6900/20000 [8:20:29<36:34:59, 10.05s/it][2022-12-21 22:19:55,384] [INFO] [timer.py:197:stop] 0/901, RunningAvgSamplesPerSec=10.950422955169202, CurrSamplesPerSec=10.754174534425578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6901/20000 [8:20:39<36:40:26, 10.08s/it][2022-12-21 22:20:04,566] [INFO] [timer.py:197:stop] 0/902, RunningAvgSamplesPerSec=10.950198631714647, CurrSamplesPerSec=10.752182707206227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6902/20000 [8:20:49<35:41:29,  9.81s/it][2022-12-21 22:20:14,291] [INFO] [timer.py:197:stop] 0/903, RunningAvgSamplesPerSec=10.950079566079571, CurrSamplesPerSec=10.843960148458606, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6903/20000 [8:20:58<35:35:46,  9.78s/it][2022-12-21 22:20:23,633] [INFO] [timer.py:197:stop] 0/904, RunningAvgSamplesPerSec=10.950264618433545, CurrSamplesPerSec=11.119577664299056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6904/20000 [8:21:08<35:06:40,  9.65s/it][2022-12-21 22:20:32,779] [INFO] [timer.py:197:stop] 0/905, RunningAvgSamplesPerSec=10.950104495411129, CurrSamplesPerSec=10.807555818846451, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6905/20000 [8:21:17<34:33:21,  9.50s/it][2022-12-21 22:20:41,999] [INFO] [timer.py:197:stop] 0/906, RunningAvgSamplesPerSec=10.950349158847057, CurrSamplesPerSec=11.17583460883667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6906/20000 [8:21:26<34:14:55,  9.42s/it][2022-12-21 22:20:51,034] [INFO] [timer.py:197:stop] 0/907, RunningAvgSamplesPerSec=10.950589836702072, CurrSamplesPerSec=11.172578090230125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6907/20000 [8:21:35<33:49:50,  9.30s/it][2022-12-21 22:21:00,542] [INFO] [timer.py:197:stop] 0/908, RunningAvgSamplesPerSec=10.950579516830866, CurrSamplesPerSec=10.941248000806056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6908/20000 [8:21:45<34:03:05,  9.36s/it][2022-12-21 22:21:09,901] [INFO] [timer.py:197:stop] 0/909, RunningAvgSamplesPerSec=10.950502992582487, CurrSamplesPerSec=10.881608695770261, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6909/20000 [8:21:54<34:02:39,  9.36s/it][2022-12-21 22:21:19,128] [INFO] [logging.py:68:log_dist] [Rank 0] step=6910, skipped=14, lr=[6.7205128205128215e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:21:19,129] [INFO] [timer.py:197:stop] 0/910, RunningAvgSamplesPerSec=10.950307277626651, CurrSamplesPerSec=10.77562861908327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6910/20000 [8:22:03<33:53:44,  9.32s/it][2022-12-21 22:21:31,333] [INFO] [timer.py:197:stop] 0/911, RunningAvgSamplesPerSec=10.950111032696965, CurrSamplesPerSec=10.774776977728258, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6911/20000 [8:22:15<37:02:13, 10.19s/it][2022-12-21 22:21:41,027] [INFO] [timer.py:197:stop] 0/912, RunningAvgSamplesPerSec=10.950110149123677, CurrSamplesPerSec=10.949307039976212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6912/20000 [8:22:25<36:29:46, 10.04s/it][2022-12-21 22:21:49,919] [INFO] [timer.py:197:stop] 0/913, RunningAvgSamplesPerSec=10.950231826527254, CurrSamplesPerSec=11.062090599083088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6913/20000 [8:22:34<35:14:34,  9.69s/it][2022-12-21 22:21:59,446] [INFO] [timer.py:197:stop] 0/914, RunningAvgSamplesPerSec=10.949959255851441, CurrSamplesPerSec=10.7071593793077, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6914/20000 [8:22:43<35:03:27,  9.64s/it][2022-12-21 22:22:09,494] [INFO] [timer.py:197:stop] 0/915, RunningAvgSamplesPerSec=10.950029169295798, CurrSamplesPerSec=11.014164092076589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6915/20000 [8:22:53<35:29:54,  9.77s/it][2022-12-21 22:22:19,684] [INFO] [timer.py:197:stop] 0/916, RunningAvgSamplesPerSec=10.950088561725272, CurrSamplesPerSec=11.004584009106198, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6916/20000 [8:23:04<35:57:15,  9.89s/it][2022-12-21 22:22:29,825] [INFO] [timer.py:197:stop] 0/917, RunningAvgSamplesPerSec=10.950142961741504, CurrSamplesPerSec=11.00009162800342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6917/20000 [8:23:14<36:13:19,  9.97s/it][2022-12-21 22:22:39,188] [INFO] [timer.py:197:stop] 0/918, RunningAvgSamplesPerSec=10.949985108027096, CurrSamplesPerSec=10.807431374225764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6918/20000 [8:23:23<35:33:35,  9.79s/it][2022-12-21 22:22:48,280] [INFO] [timer.py:197:stop] 0/919, RunningAvgSamplesPerSec=10.950311004876477, CurrSamplesPerSec=11.257208117320848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6919/20000 [8:23:32<34:48:08,  9.58s/it][2022-12-21 22:22:57,689] [INFO] [logging.py:68:log_dist] [Rank 0] step=6920, skipped=14, lr=[6.7153846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:22:57,690] [INFO] [timer.py:197:stop] 0/920, RunningAvgSamplesPerSec=10.950583323713953, CurrSamplesPerSec=11.20613360430449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6920/20000 [8:23:42<34:36:55,  9.53s/it][2022-12-21 22:23:07,183] [INFO] [timer.py:197:stop] 0/921, RunningAvgSamplesPerSec=10.950551387831936, CurrSamplesPerSec=10.921312612323822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6921/20000 [8:23:51<34:34:34,  9.52s/it][2022-12-21 22:23:16,676] [INFO] [timer.py:197:stop] 0/922, RunningAvgSamplesPerSec=10.950533311931467, CurrSamplesPerSec=10.933946748285157, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6922/20000 [8:24:01<34:32:49,  9.51s/it][2022-12-21 22:23:25,868] [INFO] [timer.py:197:stop] 0/923, RunningAvgSamplesPerSec=10.949913874638606, CurrSamplesPerSec=10.408252669689883, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6923/20000 [8:24:10<34:11:52,  9.41s/it][2022-12-21 22:23:35,254] [INFO] [timer.py:197:stop] 0/924, RunningAvgSamplesPerSec=10.950035385389295, CurrSamplesPerSec=11.063103619893614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6924/20000 [8:24:19<34:09:51,  9.41s/it][2022-12-21 22:23:44,658] [INFO] [timer.py:197:stop] 0/925, RunningAvgSamplesPerSec=10.950041507348049, CurrSamplesPerSec=10.955688867535464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6925/20000 [8:24:29<34:09:34,  9.41s/it]

                                                         
{'loss': 0.0752, 'learning_rate': 6.712820512820513e-06, 'epoch': 0.35}


 35%|███▍      | 6925/20000 [8:24:29<34:09:34,  9.41s/it][2022-12-21 22:23:53,567] [INFO] [timer.py:197:stop] 0/926, RunningAvgSamplesPerSec=10.950186647995809, CurrSamplesPerSec=11.085812513287589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6926/20000 [8:24:38<33:36:58,  9.26s/it][2022-12-21 22:24:04,276] [INFO] [timer.py:197:stop] 0/927, RunningAvgSamplesPerSec=10.950005456776514, CurrSamplesPerSec=10.785108696442625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6927/20000 [8:24:48<35:11:45,  9.69s/it][2022-12-21 22:24:13,534] [INFO] [timer.py:197:stop] 0/928, RunningAvgSamplesPerSec=10.950212152773501, CurrSamplesPerSec=11.144807309562934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6928/20000 [8:24:57<34:43:13,  9.56s/it][2022-12-21 22:24:23,056] [INFO] [timer.py:197:stop] 0/929, RunningAvgSamplesPerSec=10.950269540102722, CurrSamplesPerSec=11.003669632632967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6929/20000 [8:25:07<34:40:30,  9.55s/it][2022-12-21 22:24:32,271] [INFO] [logging.py:68:log_dist] [Rank 0] step=6930, skipped=14, lr=[6.7102564102564104e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:24:32,272] [INFO] [timer.py:197:stop] 0/930, RunningAvgSamplesPerSec=10.95039087175401, CurrSamplesPerSec=11.064033829379522, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6930/20000 [8:25:16<34:18:26,  9.45s/it][2022-12-21 22:24:42,262] [INFO] [timer.py:197:stop] 0/931, RunningAvgSamplesPerSec=10.950575815646125, CurrSamplesPerSec=11.124939487120999, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6931/20000 [8:25:26<34:53:39,  9.61s/it][2022-12-21 22:24:51,594] [INFO] [timer.py:197:stop] 0/932, RunningAvgSamplesPerSec=10.95023789280138, CurrSamplesPerSec=10.645065906223964, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6932/20000 [8:25:36<34:35:10,  9.53s/it][2022-12-21 22:25:00,876] [INFO] [timer.py:197:stop] 0/933, RunningAvgSamplesPerSec=10.95021399125513, CurrSamplesPerSec=10.928030632874526, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6933/20000 [8:25:45<34:18:57,  9.45s/it][2022-12-21 22:25:10,170] [INFO] [timer.py:197:stop] 0/934, RunningAvgSamplesPerSec=10.949762398328884, CurrSamplesPerSec=10.54489171602712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6934/20000 [8:25:54<34:08:21,  9.41s/it][2022-12-21 22:25:19,205] [INFO] [timer.py:197:stop] 0/935, RunningAvgSamplesPerSec=10.949934645299717, CurrSamplesPerSec=11.112859991615121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6935/20000 [8:26:03<33:43:56,  9.29s/it][2022-12-21 22:25:28,301] [INFO] [timer.py:197:stop] 0/936, RunningAvgSamplesPerSec=10.94948832184194, CurrSamplesPerSec=10.54834091680089, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6936/20000 [8:26:12<33:30:46,  9.24s/it][2022-12-21 22:25:38,052] [INFO] [timer.py:197:stop] 0/937, RunningAvgSamplesPerSec=10.949189610127437, CurrSamplesPerSec=10.677132586902527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6937/20000 [8:26:22<34:04:21,  9.39s/it][2022-12-21 22:25:47,691] [INFO] [timer.py:197:stop] 0/938, RunningAvgSamplesPerSec=10.949251952000084, CurrSamplesPerSec=11.007853911118481, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6938/20000 [8:26:32<34:20:26,  9.46s/it][2022-12-21 22:25:57,511] [INFO] [timer.py:197:stop] 0/939, RunningAvgSamplesPerSec=10.94925949545656, CurrSamplesPerSec=10.95632473163203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6939/20000 [8:26:41<34:43:28,  9.57s/it][2022-12-21 22:26:06,709] [INFO] [logging.py:68:log_dist] [Rank 0] step=6940, skipped=14, lr=[6.705128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:26:06,710] [INFO] [timer.py:197:stop] 0/940, RunningAvgSamplesPerSec=10.94959888357475, CurrSamplesPerSec=11.277128056216872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6940/20000 [8:26:51<34:19:00,  9.46s/it][2022-12-21 22:26:15,849] [INFO] [timer.py:197:stop] 0/941, RunningAvgSamplesPerSec=10.949382452808667, CurrSamplesPerSec=10.750069782125188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6941/20000 [8:27:00<33:57:55,  9.36s/it][2022-12-21 22:26:25,342] [INFO] [timer.py:197:stop] 0/942, RunningAvgSamplesPerSec=10.949159070795467, CurrSamplesPerSec=10.743350288295185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6942/20000 [8:27:09<34:06:17,  9.40s/it][2022-12-21 22:26:35,889] [INFO] [timer.py:197:stop] 0/943, RunningAvgSamplesPerSec=10.949356392826989, CurrSamplesPerSec=11.138038793179458, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6943/20000 [8:27:20<35:20:48,  9.75s/it][2022-12-21 22:26:44,837] [INFO] [timer.py:197:stop] 0/944, RunningAvgSamplesPerSec=10.949566009364224, CurrSamplesPerSec=11.15043758440647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6944/20000 [8:27:29<34:28:33,  9.51s/it][2022-12-21 22:26:54,076] [INFO] [timer.py:197:stop] 0/945, RunningAvgSamplesPerSec=10.949609227231642, CurrSamplesPerSec=10.990472551644919, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6945/20000 [8:27:38<34:10:59,  9.43s/it][2022-12-21 22:27:03,268] [INFO] [timer.py:197:stop] 0/946, RunningAvgSamplesPerSec=10.949630285769015, CurrSamplesPerSec=10.969524605022594, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6946/20000 [8:27:47<33:55:33,  9.36s/it][2022-12-21 22:27:12,037] [INFO] [timer.py:197:stop] 0/947, RunningAvgSamplesPerSec=10.949874780046052, CurrSamplesPerSec=11.185652387008789, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6947/20000 [8:27:56<33:17:05,  9.18s/it][2022-12-21 22:27:21,304] [INFO] [timer.py:197:stop] 0/948, RunningAvgSamplesPerSec=10.949938305420693, CurrSamplesPerSec=11.010301064888539, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6948/20000 [8:28:05<33:22:37,  9.21s/it][2022-12-21 22:27:31,310] [INFO] [timer.py:197:stop] 0/949, RunningAvgSamplesPerSec=10.949928732348813, CurrSamplesPerSec=10.940880097923431, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6949/20000 [8:28:15<34:14:38,  9.45s/it][2022-12-21 22:27:40,294] [INFO] [logging.py:68:log_dist] [Rank 0] step=6950, skipped=14, lr=[6.700000000000001e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:27:40,295] [INFO] [timer.py:197:stop] 0/950, RunningAvgSamplesPerSec=10.950114890588486, CurrSamplesPerSec=11.129294499658142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6950/20000 [8:28:24<33:44:25,  9.31s/it]

                                                         
{'loss': 0.08, 'learning_rate': 6.700000000000001e-06, 'epoch': 0.35}


 35%|███▍      | 6950/20000 [8:28:24<33:44:25,  9.31s/it][2022-12-21 22:27:49,345] [INFO] [timer.py:197:stop] 0/951, RunningAvgSamplesPerSec=10.950153036197404, CurrSamplesPerSec=10.986435018295074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6951/20000 [8:28:33<33:27:27,  9.23s/it][2022-12-21 22:27:58,398] [INFO] [timer.py:197:stop] 0/952, RunningAvgSamplesPerSec=10.950180835021436, CurrSamplesPerSec=10.9766256969022, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6952/20000 [8:28:42<33:15:45,  9.18s/it][2022-12-21 22:28:09,056] [INFO] [timer.py:197:stop] 0/953, RunningAvgSamplesPerSec=10.950109566544137, CurrSamplesPerSec=10.882820999497243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6953/20000 [8:28:53<34:52:09,  9.62s/it][2022-12-21 22:28:18,485] [INFO] [timer.py:197:stop] 0/954, RunningAvgSamplesPerSec=10.95013463571409, CurrSamplesPerSec=10.974027490886607, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6954/20000 [8:29:02<34:39:26,  9.56s/it][2022-12-21 22:28:29,494] [INFO] [timer.py:197:stop] 0/955, RunningAvgSamplesPerSec=10.949940767693981, CurrSamplesPerSec=10.768440825806248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6955/20000 [8:29:13<36:13:36, 10.00s/it][2022-12-21 22:28:38,926] [INFO] [timer.py:197:stop] 0/956, RunningAvgSamplesPerSec=10.949888769243152, CurrSamplesPerSec=10.900557731092771, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6956/20000 [8:29:23<35:36:33,  9.83s/it][2022-12-21 22:28:47,816] [INFO] [timer.py:197:stop] 0/957, RunningAvgSamplesPerSec=10.949855226410504, CurrSamplesPerSec=10.917948705434094, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6957/20000 [8:29:32<34:35:13,  9.55s/it][2022-12-21 22:28:57,434] [INFO] [timer.py:197:stop] 0/958, RunningAvgSamplesPerSec=10.949684068970818, CurrSamplesPerSec=10.788635344342905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6958/20000 [8:29:41<34:39:45,  9.57s/it][2022-12-21 22:29:07,037] [INFO] [timer.py:197:stop] 0/959, RunningAvgSamplesPerSec=10.94971854007476, CurrSamplesPerSec=10.982772499005995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6959/20000 [8:29:51<34:41:50,  9.58s/it][2022-12-21 22:29:16,003] [INFO] [logging.py:68:log_dist] [Rank 0] step=6960, skipped=14, lr=[6.694871794871796e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:29:16,004] [INFO] [timer.py:197:stop] 0/960, RunningAvgSamplesPerSec=10.949531684048749, CurrSamplesPerSec=10.773586894980353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6960/20000 [8:30:00<34:01:48,  9.39s/it][2022-12-21 22:29:25,921] [INFO] [timer.py:197:stop] 0/961, RunningAvgSamplesPerSec=10.948835241970597, CurrSamplesPerSec=10.320003014088558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6961/20000 [8:30:10<34:35:43,  9.55s/it][2022-12-21 22:29:34,931] [INFO] [timer.py:197:stop] 0/962, RunningAvgSamplesPerSec=10.949034946495955, CurrSamplesPerSec=11.143964785405094, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6962/20000 [8:30:19<34:00:17,  9.39s/it][2022-12-21 22:29:44,747] [INFO] [timer.py:197:stop] 0/963, RunningAvgSamplesPerSec=10.949076957641083, CurrSamplesPerSec=10.98955691938886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6963/20000 [8:30:29<34:27:56,  9.52s/it][2022-12-21 22:29:54,217] [INFO] [timer.py:197:stop] 0/964, RunningAvgSamplesPerSec=10.949064631773005, CurrSamplesPerSec=10.93723228660108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6964/20000 [8:30:38<34:24:39,  9.50s/it][2022-12-21 22:30:03,854] [INFO] [timer.py:197:stop] 0/965, RunningAvgSamplesPerSec=10.948974211011294, CurrSamplesPerSec=10.862675754120767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6965/20000 [8:30:48<34:33:15,  9.54s/it][2022-12-21 22:30:12,884] [INFO] [timer.py:197:stop] 0/966, RunningAvgSamplesPerSec=10.949058895787008, CurrSamplesPerSec=11.031222949540219, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6966/20000 [8:30:57<33:59:40,  9.39s/it][2022-12-21 22:30:22,011] [INFO] [timer.py:197:stop] 0/967, RunningAvgSamplesPerSec=10.948908479907633, CurrSamplesPerSec=10.805804720216742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6967/20000 [8:31:06<33:42:23,  9.31s/it][2022-12-21 22:30:31,458] [INFO] [timer.py:197:stop] 0/968, RunningAvgSamplesPerSec=10.948244157182955, CurrSamplesPerSec=10.342668773508018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6968/20000 [8:31:15<33:51:10,  9.35s/it][2022-12-21 22:30:41,031] [INFO] [timer.py:197:stop] 0/969, RunningAvgSamplesPerSec=10.94826736982509, CurrSamplesPerSec=10.970736850055394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6969/20000 [8:31:25<34:05:26,  9.42s/it][2022-12-21 22:30:50,557] [INFO] [logging.py:68:log_dist] [Rank 0] step=6970, skipped=14, lr=[6.68974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:30:50,558] [INFO] [timer.py:197:stop] 0/970, RunningAvgSamplesPerSec=10.948093262739953, CurrSamplesPerSec=10.782284187085196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6970/20000 [8:31:35<34:12:22,  9.45s/it][2022-12-21 22:30:59,790] [INFO] [timer.py:197:stop] 0/971, RunningAvgSamplesPerSec=10.947656668083033, CurrSamplesPerSec=10.54075722431452, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6971/20000 [8:31:44<33:57:58,  9.39s/it][2022-12-21 22:31:09,086] [INFO] [timer.py:197:stop] 0/972, RunningAvgSamplesPerSec=10.947766130466277, CurrSamplesPerSec=11.054873980992824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6972/20000 [8:31:53<33:51:58,  9.36s/it][2022-12-21 22:31:18,918] [INFO] [timer.py:197:stop] 0/973, RunningAvgSamplesPerSec=10.947703757348776, CurrSamplesPerSec=10.887534697405044, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6973/20000 [8:32:03<34:22:43,  9.50s/it][2022-12-21 22:31:28,063] [INFO] [timer.py:197:stop] 0/974, RunningAvgSamplesPerSec=10.947688402067268, CurrSamplesPerSec=10.93279872329597, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6974/20000 [8:32:12<33:59:24,  9.39s/it][2022-12-21 22:31:37,853] [INFO] [timer.py:197:stop] 0/975, RunningAvgSamplesPerSec=10.947663219091009, CurrSamplesPerSec=10.92324003009598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6975/20000 [8:32:22<34:25:02,  9.51s/it]

                                                         
{'loss': 0.0732, 'learning_rate': 6.687179487179488e-06, 'epoch': 0.35}


 35%|███▍      | 6975/20000 [8:32:22<34:25:02,  9.51s/it][2022-12-21 22:31:47,524] [INFO] [timer.py:197:stop] 0/976, RunningAvgSamplesPerSec=10.947671019300046, CurrSamplesPerSec=10.95526589334229, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6976/20000 [8:32:31<34:35:11,  9.56s/it][2022-12-21 22:31:57,398] [INFO] [timer.py:197:stop] 0/977, RunningAvgSamplesPerSec=10.947896589080361, CurrSamplesPerSec=11.172105655014903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6977/20000 [8:32:41<34:55:26,  9.65s/it][2022-12-21 22:32:07,322] [INFO] [timer.py:197:stop] 0/978, RunningAvgSamplesPerSec=10.948105577271349, CurrSamplesPerSec=11.155737420481714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6978/20000 [8:32:51<35:12:53,  9.74s/it][2022-12-21 22:32:16,346] [INFO] [timer.py:197:stop] 0/979, RunningAvgSamplesPerSec=10.94817830631362, CurrSamplesPerSec=11.019625561202117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6979/20000 [8:33:00<34:26:22,  9.52s/it][2022-12-21 22:32:25,632] [INFO] [logging.py:68:log_dist] [Rank 0] step=6980, skipped=14, lr=[6.684615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:32:25,633] [INFO] [timer.py:197:stop] 0/980, RunningAvgSamplesPerSec=10.947973259558719, CurrSamplesPerSec=10.75124606263592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6980/20000 [8:33:10<34:10:55,  9.45s/it][2022-12-21 22:32:36,136] [INFO] [timer.py:197:stop] 0/981, RunningAvgSamplesPerSec=10.948011982501471, CurrSamplesPerSec=10.986014612498035, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6981/20000 [8:33:20<35:19:13,  9.77s/it][2022-12-21 22:32:45,394] [INFO] [timer.py:197:stop] 0/982, RunningAvgSamplesPerSec=10.948098869400186, CurrSamplesPerSec=11.033827903323058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6982/20000 [8:33:29<34:45:58,  9.61s/it][2022-12-21 22:32:54,800] [INFO] [timer.py:197:stop] 0/983, RunningAvgSamplesPerSec=10.947907534024438, CurrSamplesPerSec=10.763559481641874, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6983/20000 [8:33:39<34:32:14,  9.55s/it][2022-12-21 22:33:03,529] [INFO] [timer.py:197:stop] 0/984, RunningAvgSamplesPerSec=10.948169089322661, CurrSamplesPerSec=11.210919028597766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6984/20000 [8:33:47<33:38:34,  9.31s/it][2022-12-21 22:33:12,529] [INFO] [timer.py:197:stop] 0/985, RunningAvgSamplesPerSec=10.948078139994033, CurrSamplesPerSec=10.859489325124148, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6985/20000 [8:33:56<33:18:31,  9.21s/it][2022-12-21 22:33:22,324] [INFO] [timer.py:197:stop] 0/986, RunningAvgSamplesPerSec=10.947778360632126, CurrSamplesPerSec=10.660827020784954, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6986/20000 [8:34:06<33:56:15,  9.39s/it][2022-12-21 22:33:32,616] [INFO] [timer.py:197:stop] 0/987, RunningAvgSamplesPerSec=10.947485170842816, CurrSamplesPerSec=10.666401339879085, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6987/20000 [8:34:17<34:54:53,  9.66s/it][2022-12-21 22:33:41,662] [INFO] [timer.py:197:stop] 0/988, RunningAvgSamplesPerSec=10.94725894197246, CurrSamplesPerSec=10.72887333612018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6988/20000 [8:34:26<34:14:51,  9.48s/it][2022-12-21 22:33:52,250] [INFO] [timer.py:197:stop] 0/989, RunningAvgSamplesPerSec=10.947269765150427, CurrSamplesPerSec=10.957951842325613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6989/20000 [8:34:36<35:27:05,  9.81s/it][2022-12-21 22:34:01,399] [INFO] [logging.py:68:log_dist] [Rank 0] step=6990, skipped=14, lr=[6.67948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:34:01,400] [INFO] [timer.py:197:stop] 0/990, RunningAvgSamplesPerSec=10.947094780509293, CurrSamplesPerSec=10.777070098471906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6990/20000 [8:34:45<34:44:02,  9.61s/it][2022-12-21 22:34:10,876] [INFO] [timer.py:197:stop] 0/991, RunningAvgSamplesPerSec=10.947130701864845, CurrSamplesPerSec=10.982736551177416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6991/20000 [8:34:55<34:35:06,  9.57s/it][2022-12-21 22:34:19,845] [INFO] [timer.py:197:stop] 0/992, RunningAvgSamplesPerSec=10.94710375195222, CurrSamplesPerSec=10.920515090573382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6992/20000 [8:35:04<33:55:49,  9.39s/it][2022-12-21 22:34:30,243] [INFO] [timer.py:197:stop] 0/993, RunningAvgSamplesPerSec=10.94711333941773, CurrSamplesPerSec=10.956613175334043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6993/20000 [8:35:14<35:01:10,  9.69s/it][2022-12-21 22:34:39,715] [INFO] [timer.py:197:stop] 0/994, RunningAvgSamplesPerSec=10.946859815381549, CurrSamplesPerSec=10.701259966723637, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6994/20000 [8:35:24<34:46:42,  9.63s/it][2022-12-21 22:34:48,720] [INFO] [timer.py:197:stop] 0/995, RunningAvgSamplesPerSec=10.946680207231662, CurrSamplesPerSec=10.77136527480006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6995/20000 [8:35:33<34:06:04,  9.44s/it][2022-12-21 22:34:58,250] [INFO] [timer.py:197:stop] 0/996, RunningAvgSamplesPerSec=10.946749123625581, CurrSamplesPerSec=11.015614047780193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6996/20000 [8:35:42<34:11:47,  9.47s/it][2022-12-21 22:35:07,121] [INFO] [timer.py:197:stop] 0/997, RunningAvgSamplesPerSec=10.946964969961817, CurrSamplesPerSec=11.165809715225853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6997/20000 [8:35:51<33:32:55,  9.29s/it][2022-12-21 22:35:17,001] [INFO] [timer.py:197:stop] 0/998, RunningAvgSamplesPerSec=10.946979877751858, CurrSamplesPerSec=10.961833275550378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6998/20000 [8:36:01<34:11:13,  9.47s/it][2022-12-21 22:35:27,243] [INFO] [timer.py:197:stop] 0/999, RunningAvgSamplesPerSec=10.947400533874601, CurrSamplesPerSec=11.383064279993519, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▍      | 6999/20000 [8:36:11<35:01:33,  9.70s/it][2022-12-21 22:35:36,052] [INFO] [logging.py:68:log_dist] [Rank 0] step=7000, skipped=14, lr=[6.6743589743589756e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:35:36,053] [INFO] [timer.py:197:stop] 0/1000, RunningAvgSamplesPerSec=10.947570407905596, CurrSamplesPerSec=11.119598852562575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7000/20000 [8:36:20<34:03:37,  9.43s/it]

                                                         
{'loss': 0.0782, 'learning_rate': 6.6743589743589756e-06, 'epoch': 0.35}


 35%|███▌      | 7000/20000 [8:36:20<34:03:37,  9.43s/it][INFO|trainer.py:2955] 2022-12-21 22:35:36,059 >> ***** Running Evaluation *****
[INFO|trainer.py:2959] 2022-12-21 22:35:36,059 >>   Num examples: Unknown
[INFO|trainer.py:2960] 2022-12-21 22:35:36,059 >>   Batch size = 32
[INFO|trainer_utils.py:689] 2022-12-21 22:35:38,835 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: duration, age, input_length, gender, speaker_id. If duration, age, input_length, gender, speaker_id are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
[INFO|configuration_utils.py:523] 2022-12-21 22:35:38,846 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:35:44,197 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:35:49,870 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:35:55,496 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:00,933 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:05,845 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:11,342 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:16,439 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:22,813 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:27,962 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:34,307 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:40,749 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:46,120 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:51,949 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:36:56,607 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:02,204 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:08,843 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:14,514 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:19,845 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:25,246 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:31,673 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:37,546 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:43,192 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:49,751 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:37:55,453 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:01,157 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:07,034 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:12,431 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:17,419 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:22,449 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:27,931 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-21 22:38:31,882 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}



                                                         
{'eval_loss': 0.163330078125, 'eval_wer': 11.221412415179694, 'eval_runtime': 212.6202, 'eval_samples_per_second': 4.703, 'eval_steps_per_second': 0.151, 'epoch': 0.35}


 35%|███▌      | 7000/20000 [8:39:53<34:03:37,  9.43s/it][2022-12-21 22:39:18,322] [INFO] [timer.py:197:stop] 0/1001, RunningAvgSamplesPerSec=10.947843408877931, CurrSamplesPerSec=11.227259061970132, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7001/20000 [8:40:02<264:36:47, 73.28s/it][2022-12-21 22:39:27,228] [INFO] [timer.py:197:stop] 0/1002, RunningAvgSamplesPerSec=10.94791124744417, CurrSamplesPerSec=11.01610453378403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7002/20000 [8:40:11<194:51:39, 53.97s/it][2022-12-21 22:39:36,345] [INFO] [timer.py:197:stop] 0/1003, RunningAvgSamplesPerSec=10.948195293232269, CurrSamplesPerSec=11.239814572580016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7003/20000 [8:40:20<146:16:01, 40.51s/it][2022-12-21 22:39:45,739] [INFO] [timer.py:197:stop] 0/1004, RunningAvgSamplesPerSec=10.948047429043045, CurrSamplesPerSec=10.802011677347737, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7004/20000 [8:40:30<112:33:11, 31.18s/it][2022-12-21 22:39:54,599] [INFO] [timer.py:197:stop] 0/1005, RunningAvgSamplesPerSec=10.948087646318555, CurrSamplesPerSec=10.988534381259802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7005/20000 [8:40:39<88:22:32, 24.48s/it] [2022-12-21 22:40:04,037] [INFO] [timer.py:197:stop] 0/1006, RunningAvgSamplesPerSec=10.94812037485707, CurrSamplesPerSec=10.981045921012774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7006/20000 [8:40:48<72:04:38, 19.97s/it][2022-12-21 22:40:13,296] [INFO] [timer.py:197:stop] 0/1007, RunningAvgSamplesPerSec=10.948349009126876, CurrSamplesPerSec=11.182818727080905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7007/20000 [8:40:57<60:28:34, 16.76s/it][2022-12-21 22:40:22,515] [INFO] [timer.py:197:stop] 0/1008, RunningAvgSamplesPerSec=10.948160263650696, CurrSamplesPerSec=10.761704824980823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7008/20000 [8:41:06<52:18:37, 14.49s/it][2022-12-21 22:40:31,886] [INFO] [timer.py:197:stop] 0/1009, RunningAvgSamplesPerSec=10.948070623068281, CurrSamplesPerSec=10.858629647999127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7009/20000 [8:41:16<46:45:34, 12.96s/it][2022-12-21 22:40:40,985] [INFO] [logging.py:68:log_dist] [Rank 0] step=7010, skipped=14, lr=[6.6692307692307705e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:40:40,986] [INFO] [timer.py:197:stop] 0/1010, RunningAvgSamplesPerSec=10.94801530463361, CurrSamplesPerSec=10.89259192606027, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7010/20000 [8:41:25<42:34:46, 11.80s/it][2022-12-21 22:40:51,315] [INFO] [timer.py:197:stop] 0/1011, RunningAvgSamplesPerSec=10.948094688627151, CurrSamplesPerSec=11.028703504326735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7011/20000 [8:41:35<40:59:02, 11.36s/it][2022-12-21 22:41:00,584] [INFO] [timer.py:197:stop] 0/1012, RunningAvgSamplesPerSec=10.947927364694515, CurrSamplesPerSec=10.781664032858043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7012/20000 [8:41:45<38:43:08, 10.73s/it][2022-12-21 22:41:10,684] [INFO] [timer.py:197:stop] 0/1013, RunningAvgSamplesPerSec=10.948010338644073, CurrSamplesPerSec=11.032461112731559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7013/20000 [8:41:55<38:01:53, 10.54s/it][2022-12-21 22:41:19,820] [INFO] [timer.py:197:stop] 0/1014, RunningAvgSamplesPerSec=10.947913010513675, CurrSamplesPerSec=10.850391649826664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7014/20000 [8:42:04<36:30:24, 10.12s/it][2022-12-21 22:41:28,986] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 65536.0
[2022-12-21 22:41:28,988] [INFO] [timer.py:197:stop] 0/1015, RunningAvgSamplesPerSec=10.948785688200207, CurrSamplesPerSec=11.909505569243318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7015/20000 [8:42:13<35:28:22,  9.83s/it][2022-12-21 22:41:37,590] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0
[2022-12-21 22:41:37,591] [INFO] [timer.py:197:stop] 0/1016, RunningAvgSamplesPerSec=10.949619582119334, CurrSamplesPerSec=11.865046644602245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7016/20000 [8:42:22<34:08:15,  9.47s/it][2022-12-21 22:41:46,373] [INFO] [timer.py:197:stop] 0/1017, RunningAvgSamplesPerSec=10.94966166164054, CurrSamplesPerSec=10.99249738297229, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7017/20000 [8:42:30<33:23:47,  9.26s/it][2022-12-21 22:41:57,514] [INFO] [timer.py:197:stop] 0/1018, RunningAvgSamplesPerSec=10.94938330398982, CurrSamplesPerSec=10.673964085264483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7018/20000 [8:42:41<35:25:40,  9.82s/it][2022-12-21 22:42:07,172] [INFO] [timer.py:197:stop] 0/1019, RunningAvgSamplesPerSec=10.949383174983955, CurrSamplesPerSec=10.949252106596061, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7019/20000 [8:42:51<35:14:43,  9.77s/it][2022-12-21 22:42:15,917] [INFO] [logging.py:68:log_dist] [Rank 0] step=7020, skipped=16, lr=[6.665128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:42:15,918] [INFO] [timer.py:197:stop] 0/1020, RunningAvgSamplesPerSec=10.94955512360682, CurrSamplesPerSec=11.127267855496608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7020/20000 [8:43:00<34:07:47,  9.47s/it][2022-12-21 22:42:26,201] [INFO] [timer.py:197:stop] 0/1021, RunningAvgSamplesPerSec=10.949364759692367, CurrSamplesPerSec=10.758947755173924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7021/20000 [8:43:10<35:00:40,  9.71s/it][2022-12-21 22:42:35,198] [INFO] [timer.py:197:stop] 0/1022, RunningAvgSamplesPerSec=10.949614588639456, CurrSamplesPerSec=11.210256079591325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7022/20000 [8:43:19<34:14:10,  9.50s/it][2022-12-21 22:42:44,228] [INFO] [timer.py:197:stop] 0/1023, RunningAvgSamplesPerSec=10.949721293110398, CurrSamplesPerSec=11.059653635481835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7023/20000 [8:43:28<33:43:45,  9.36s/it][2022-12-21 22:42:53,044] [INFO] [timer.py:197:stop] 0/1024, RunningAvgSamplesPerSec=10.949893972168761, CurrSamplesPerSec=11.129087326423265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7024/20000 [8:43:37<33:08:26,  9.19s/it][2022-12-21 22:43:05,211] [INFO] [timer.py:197:stop] 0/1025, RunningAvgSamplesPerSec=10.949689810781665, CurrSamplesPerSec=10.744942278381014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7025/20000 [8:43:49<36:21:11, 10.09s/it]

                                                         
{'loss': 0.0736, 'learning_rate': 6.662564102564103e-06, 'epoch': 0.35}


 35%|███▌      | 7025/20000 [8:43:49<36:21:11, 10.09s/it][2022-12-21 22:43:14,537] [INFO] [timer.py:197:stop] 0/1026, RunningAvgSamplesPerSec=10.94999925817851, CurrSamplesPerSec=11.275997781391819, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7026/20000 [8:43:58<35:31:40,  9.86s/it][2022-12-21 22:43:23,443] [INFO] [timer.py:197:stop] 0/1027, RunningAvgSamplesPerSec=10.949849995292569, CurrSamplesPerSec=10.799110969180294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7027/20000 [8:44:07<34:29:45,  9.57s/it][2022-12-21 22:43:33,064] [INFO] [timer.py:197:stop] 0/1028, RunningAvgSamplesPerSec=10.94946939393257, CurrSamplesPerSec=10.572786838666286, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7028/20000 [8:44:17<34:32:44,  9.59s/it][2022-12-21 22:43:42,336] [INFO] [timer.py:197:stop] 0/1029, RunningAvgSamplesPerSec=10.949666947463726, CurrSamplesPerSec=11.156183435131144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7029/20000 [8:44:26<34:12:07,  9.49s/it][2022-12-21 22:43:51,235] [INFO] [logging.py:68:log_dist] [Rank 0] step=7030, skipped=16, lr=[6.660000000000001e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:43:51,235] [INFO] [timer.py:197:stop] 0/1030, RunningAvgSamplesPerSec=10.949915150616404, CurrSamplesPerSec=11.210901236569473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7030/20000 [8:44:35<33:33:29,  9.31s/it][2022-12-21 22:44:00,655] [INFO] [timer.py:197:stop] 0/1031, RunningAvgSamplesPerSec=10.949765868748202, CurrSamplesPerSec=10.798427193960437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7031/20000 [8:44:45<33:40:07,  9.35s/it][2022-12-21 22:44:09,984] [INFO] [timer.py:197:stop] 0/1032, RunningAvgSamplesPerSec=10.949715534577942, CurrSamplesPerSec=10.898165748869191, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7032/20000 [8:44:54<33:38:54,  9.34s/it][2022-12-21 22:44:18,858] [INFO] [timer.py:197:stop] 0/1033, RunningAvgSamplesPerSec=10.949690267327611, CurrSamplesPerSec=10.923726769545302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7033/20000 [8:45:03<33:08:27,  9.20s/it][2022-12-21 22:44:28,548] [INFO] [timer.py:197:stop] 0/1034, RunningAvgSamplesPerSec=10.94977521733513, CurrSamplesPerSec=11.038065563946182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7034/20000 [8:45:13<33:40:03,  9.35s/it][2022-12-21 22:44:38,560] [INFO] [timer.py:197:stop] 0/1035, RunningAvgSamplesPerSec=10.94978796610822, CurrSamplesPerSec=10.962960542802337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7035/20000 [8:45:23<34:22:56,  9.55s/it][2022-12-21 22:44:47,527] [INFO] [timer.py:197:stop] 0/1036, RunningAvgSamplesPerSec=10.949597310332093, CurrSamplesPerSec=10.756133051018127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7036/20000 [8:45:31<33:45:09,  9.37s/it][2022-12-21 22:44:56,996] [INFO] [timer.py:197:stop] 0/1037, RunningAvgSamplesPerSec=10.949821851716688, CurrSamplesPerSec=11.187032224815978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7037/20000 [8:45:41<33:51:15,  9.40s/it][2022-12-21 22:45:07,081] [INFO] [timer.py:197:stop] 0/1038, RunningAvgSamplesPerSec=10.949687126920214, CurrSamplesPerSec=10.812002024847887, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7038/20000 [8:45:51<34:35:20,  9.61s/it][2022-12-21 22:45:15,886] [INFO] [timer.py:197:stop] 0/1039, RunningAvgSamplesPerSec=10.949818786588201, CurrSamplesPerSec=11.087940413248802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7039/20000 [8:46:00<33:43:14,  9.37s/it][2022-12-21 22:45:25,581] [INFO] [logging.py:68:log_dist] [Rank 0] step=7040, skipped=16, lr=[6.6548717948717955e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:45:25,582] [INFO] [timer.py:197:stop] 0/1040, RunningAvgSamplesPerSec=10.949892389167124, CurrSamplesPerSec=11.026754545357825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7040/20000 [8:46:10<34:04:29,  9.47s/it][2022-12-21 22:45:34,748] [INFO] [timer.py:197:stop] 0/1041, RunningAvgSamplesPerSec=10.949926921788549, CurrSamplesPerSec=10.985889621043826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7041/20000 [8:46:19<33:44:55,  9.38s/it][2022-12-21 22:45:43,840] [INFO] [timer.py:197:stop] 0/1042, RunningAvgSamplesPerSec=10.949789680384338, CurrSamplesPerSec=10.80903066230513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7042/20000 [8:46:28<33:26:25,  9.29s/it][2022-12-21 22:45:53,135] [INFO] [timer.py:197:stop] 0/1043, RunningAvgSamplesPerSec=10.949737447112183, CurrSamplesPerSec=10.89568326941624, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7043/20000 [8:46:37<33:26:32,  9.29s/it][2022-12-21 22:46:02,914] [INFO] [timer.py:197:stop] 0/1044, RunningAvgSamplesPerSec=10.94989564215175, CurrSamplesPerSec=11.117093669850192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7044/20000 [8:46:47<33:57:58,  9.44s/it][2022-12-21 22:46:12,019] [INFO] [timer.py:197:stop] 0/1045, RunningAvgSamplesPerSec=10.949600763860845, CurrSamplesPerSec=10.650732355388785, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7045/20000 [8:46:56<33:36:16,  9.34s/it][2022-12-21 22:46:21,340] [INFO] [timer.py:197:stop] 0/1046, RunningAvgSamplesPerSec=10.949575927684764, CurrSamplesPerSec=10.923732992978929, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7046/20000 [8:47:05<33:34:59,  9.33s/it][2022-12-21 22:46:30,622] [INFO] [timer.py:197:stop] 0/1047, RunningAvgSamplesPerSec=10.949273176827505, CurrSamplesPerSec=10.64207756978471, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7047/20000 [8:47:15<33:31:31,  9.32s/it][2022-12-21 22:46:40,185] [INFO] [timer.py:197:stop] 0/1048, RunningAvgSamplesPerSec=10.949344197538242, CurrSamplesPerSec=11.024067815181192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7048/20000 [8:47:24<33:47:12,  9.39s/it][2022-12-21 22:46:49,626] [INFO] [timer.py:197:stop] 0/1049, RunningAvgSamplesPerSec=10.949333919274773, CurrSamplesPerSec=10.93859341178605, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7049/20000 [8:47:34<33:50:20,  9.41s/it][2022-12-21 22:46:59,009] [INFO] [logging.py:68:log_dist] [Rank 0] step=7050, skipped=16, lr=[6.64974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:46:59,010] [INFO] [timer.py:197:stop] 0/1050, RunningAvgSamplesPerSec=10.948908810599626, CurrSamplesPerSec=10.521222685228135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7050/20000 [8:47:43<33:48:43,  9.40s/it]

                                                         
{'loss': 0.082, 'learning_rate': 6.64974358974359e-06, 'epoch': 0.35}


 35%|███▌      | 7050/20000 [8:47:43<33:48:43,  9.40s/it][2022-12-21 22:47:08,643] [INFO] [timer.py:197:stop] 0/1051, RunningAvgSamplesPerSec=10.94891213025205, CurrSamplesPerSec=10.95239223284191, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7051/20000 [8:47:53<34:03:40,  9.47s/it][2022-12-21 22:47:18,597] [INFO] [timer.py:197:stop] 0/1052, RunningAvgSamplesPerSec=10.948590245018652, CurrSamplesPerSec=10.6210438869722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7052/20000 [8:48:03<34:34:53,  9.61s/it][2022-12-21 22:47:28,191] [INFO] [timer.py:197:stop] 0/1053, RunningAvgSamplesPerSec=10.948381105457859, CurrSamplesPerSec=10.73310653644218, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7053/20000 [8:48:12<34:33:24,  9.61s/it][2022-12-21 22:47:37,453] [INFO] [timer.py:197:stop] 0/1054, RunningAvgSamplesPerSec=10.948343942797575, CurrSamplesPerSec=10.909424961482706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7054/20000 [8:48:21<34:10:51,  9.51s/it][2022-12-21 22:47:46,527] [INFO] [timer.py:197:stop] 0/1055, RunningAvgSamplesPerSec=10.948351828064247, CurrSamplesPerSec=10.956653424499915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7055/20000 [8:48:30<33:42:41,  9.38s/it][2022-12-21 22:47:55,484] [INFO] [timer.py:197:stop] 0/1056, RunningAvgSamplesPerSec=10.94820262227433, CurrSamplesPerSec=10.7933137899905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7056/20000 [8:48:39<33:15:30,  9.25s/it][2022-12-21 22:48:05,183] [INFO] [timer.py:197:stop] 0/1057, RunningAvgSamplesPerSec=10.94818378111558, CurrSamplesPerSec=10.9283611895098, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7057/20000 [8:48:49<33:44:25,  9.38s/it][2022-12-21 22:48:14,735] [INFO] [timer.py:197:stop] 0/1058, RunningAvgSamplesPerSec=10.948165932175849, CurrSamplesPerSec=10.929367664060956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7058/20000 [8:48:59<33:55:09,  9.44s/it][2022-12-21 22:48:24,125] [INFO] [timer.py:197:stop] 0/1059, RunningAvgSamplesPerSec=10.948048965056591, CurrSamplesPerSec=10.825910968401468, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7059/20000 [8:49:08<33:51:58,  9.42s/it][2022-12-21 22:48:33,579] [INFO] [logging.py:68:log_dist] [Rank 0] step=7060, skipped=16, lr=[6.644615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:48:33,580] [INFO] [timer.py:197:stop] 0/1060, RunningAvgSamplesPerSec=10.947819723790053, CurrSamplesPerSec=10.710763434117855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7060/20000 [8:49:18<33:54:01,  9.43s/it][2022-12-21 22:48:42,748] [INFO] [timer.py:197:stop] 0/1061, RunningAvgSamplesPerSec=10.9479748252927, CurrSamplesPerSec=11.114571667904194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7061/20000 [8:49:27<33:36:50,  9.35s/it][2022-12-21 22:48:52,414] [INFO] [timer.py:197:stop] 0/1062, RunningAvgSamplesPerSec=10.947877547690824, CurrSamplesPerSec=10.845821795008236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7062/20000 [8:49:36<33:56:58,  9.45s/it][2022-12-21 22:49:02,817] [INFO] [timer.py:197:stop] 0/1063, RunningAvgSamplesPerSec=10.947916899095507, CurrSamplesPerSec=10.989789075095175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7063/20000 [8:49:47<34:58:40,  9.73s/it][2022-12-21 22:49:12,093] [INFO] [timer.py:197:stop] 0/1064, RunningAvgSamplesPerSec=10.948016563220252, CurrSamplesPerSec=11.054792488511165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7064/20000 [8:49:56<34:29:16,  9.60s/it][2022-12-21 22:49:22,896] [INFO] [timer.py:197:stop] 0/1065, RunningAvgSamplesPerSec=10.947811001941094, CurrSamplesPerSec=10.733776913519858, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7065/20000 [8:50:07<35:46:43,  9.96s/it][2022-12-21 22:49:32,635] [INFO] [timer.py:197:stop] 0/1066, RunningAvgSamplesPerSec=10.94780309313795, CurrSamplesPerSec=10.939402492468744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7066/20000 [8:50:17<35:32:26,  9.89s/it][2022-12-21 22:49:42,366] [INFO] [timer.py:197:stop] 0/1067, RunningAvgSamplesPerSec=10.947788506018485, CurrSamplesPerSec=10.932289804090653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7067/20000 [8:50:26<35:21:49,  9.84s/it][2022-12-21 22:49:51,159] [INFO] [timer.py:197:stop] 0/1068, RunningAvgSamplesPerSec=10.948006847747095, CurrSamplesPerSec=11.185591793826935, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7068/20000 [8:50:35<34:13:42,  9.53s/it][2022-12-21 22:50:02,632] [INFO] [timer.py:197:stop] 0/1069, RunningAvgSamplesPerSec=10.948261528509851, CurrSamplesPerSec=11.226661321184267, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7069/20000 [8:50:47<36:19:18, 10.11s/it][2022-12-21 22:50:12,005] [INFO] [logging.py:68:log_dist] [Rank 0] step=7070, skipped=16, lr=[6.639487179487179e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:50:12,006] [INFO] [timer.py:197:stop] 0/1070, RunningAvgSamplesPerSec=10.948370469983951, CurrSamplesPerSec=11.065859592212625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7070/20000 [8:50:56<35:31:21,  9.89s/it][2022-12-21 22:50:21,061] [INFO] [timer.py:197:stop] 0/1071, RunningAvgSamplesPerSec=10.94857666580842, CurrSamplesPerSec=11.173318443093011, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7071/20000 [8:51:05<34:37:12,  9.64s/it][2022-12-21 22:50:30,111] [INFO] [timer.py:197:stop] 0/1072, RunningAvgSamplesPerSec=10.948772497449253, CurrSamplesPerSec=11.162201163119054, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7072/20000 [8:51:14<33:58:56,  9.46s/it][2022-12-21 22:50:39,106] [INFO] [timer.py:197:stop] 0/1073, RunningAvgSamplesPerSec=10.948562415631159, CurrSamplesPerSec=10.728301329530165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7073/20000 [8:51:23<33:28:32,  9.32s/it][2022-12-21 22:50:48,708] [INFO] [timer.py:197:stop] 0/1074, RunningAvgSamplesPerSec=10.948806130745123, CurrSamplesPerSec=11.216205761276292, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7074/20000 [8:51:33<33:46:28,  9.41s/it][2022-12-21 22:50:58,423] [INFO] [timer.py:197:stop] 0/1075, RunningAvgSamplesPerSec=10.948638269113886, CurrSamplesPerSec=10.77160299927851, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7075/20000 [8:51:42<34:06:15,  9.50s/it]

                                                         
{'loss': 0.0735, 'learning_rate': 6.636923076923077e-06, 'epoch': 0.35}


 35%|███▌      | 7075/20000 [8:51:42<34:06:15,  9.50s/it][2022-12-21 22:51:08,198] [INFO] [timer.py:197:stop] 0/1076, RunningAvgSamplesPerSec=10.948688614061057, CurrSamplesPerSec=11.002976846670693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7076/20000 [8:51:52<34:23:56,  9.58s/it][2022-12-21 22:51:17,914] [INFO] [timer.py:197:stop] 0/1077, RunningAvgSamplesPerSec=10.948534541365154, CurrSamplesPerSec=10.785526433525153, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7077/20000 [8:52:02<34:32:24,  9.62s/it][2022-12-21 22:51:26,857] [INFO] [timer.py:197:stop] 0/1078, RunningAvgSamplesPerSec=10.948868416366121, CurrSamplesPerSec=11.319960142472654, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7078/20000 [8:52:11<33:48:24,  9.42s/it][2022-12-21 22:51:36,391] [INFO] [timer.py:197:stop] 0/1079, RunningAvgSamplesPerSec=10.948972673162041, CurrSamplesPerSec=11.062315344211186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7079/20000 [8:52:20<33:55:43,  9.45s/it][2022-12-21 22:51:45,620] [INFO] [logging.py:68:log_dist] [Rank 0] step=7080, skipped=16, lr=[6.634358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:51:45,621] [INFO] [timer.py:197:stop] 0/1080, RunningAvgSamplesPerSec=10.94895137025723, CurrSamplesPerSec=10.92605616260513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7080/20000 [8:52:30<33:41:08,  9.39s/it][2022-12-21 22:51:54,749] [INFO] [timer.py:197:stop] 0/1081, RunningAvgSamplesPerSec=10.949167879132718, CurrSamplesPerSec=11.18765279662921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7081/20000 [8:52:39<33:24:17,  9.31s/it][2022-12-21 22:52:04,021] [INFO] [timer.py:197:stop] 0/1082, RunningAvgSamplesPerSec=10.949092924070944, CurrSamplesPerSec=10.868809979586018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7082/20000 [8:52:48<33:21:47,  9.30s/it][2022-12-21 22:52:14,120] [INFO] [timer.py:197:stop] 0/1083, RunningAvgSamplesPerSec=10.949328386235887, CurrSamplesPerSec=11.209679808391575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7083/20000 [8:52:58<34:13:21,  9.54s/it][2022-12-21 22:52:23,172] [INFO] [timer.py:197:stop] 0/1084, RunningAvgSamplesPerSec=10.949440880431304, CurrSamplesPerSec=11.07241412948765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7084/20000 [8:53:07<33:41:49,  9.39s/it][2022-12-21 22:52:32,734] [INFO] [timer.py:197:stop] 0/1085, RunningAvgSamplesPerSec=10.949300883454613, CurrSamplesPerSec=10.799893029199593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7085/20000 [8:53:17<33:52:38,  9.44s/it][2022-12-21 22:52:42,149] [INFO] [timer.py:197:stop] 0/1086, RunningAvgSamplesPerSec=10.949263053510883, CurrSamplesPerSec=10.908446093914517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7086/20000 [8:53:26<33:50:38,  9.43s/it][2022-12-21 22:52:53,085] [INFO] [timer.py:197:stop] 0/1087, RunningAvgSamplesPerSec=10.949319721389623, CurrSamplesPerSec=11.011094591637308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7087/20000 [8:53:37<35:27:28,  9.89s/it][2022-12-21 22:53:02,722] [INFO] [timer.py:197:stop] 0/1088, RunningAvgSamplesPerSec=10.949354002617703, CurrSamplesPerSec=10.986676035486369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7088/20000 [8:53:47<35:11:15,  9.81s/it][2022-12-21 22:53:12,238] [INFO] [timer.py:197:stop] 0/1089, RunningAvgSamplesPerSec=10.949369789550175, CurrSamplesPerSec=10.966541310272213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7089/20000 [8:53:56<34:52:02,  9.72s/it][2022-12-21 22:53:21,836] [INFO] [logging.py:68:log_dist] [Rank 0] step=7090, skipped=16, lr=[6.62923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:53:21,837] [INFO] [timer.py:197:stop] 0/1090, RunningAvgSamplesPerSec=10.94907049877136, CurrSamplesPerSec=10.633137360602593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7090/20000 [8:54:06<34:43:55,  9.69s/it][2022-12-21 22:53:32,221] [INFO] [timer.py:197:stop] 0/1091, RunningAvgSamplesPerSec=10.94913840744226, CurrSamplesPerSec=11.02352546557977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7091/20000 [8:54:16<35:28:53,  9.89s/it][2022-12-21 22:53:42,257] [INFO] [timer.py:197:stop] 0/1092, RunningAvgSamplesPerSec=10.949030593036436, CurrSamplesPerSec=10.832867502191206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7092/20000 [8:54:26<35:37:50,  9.94s/it][2022-12-21 22:53:51,515] [INFO] [timer.py:197:stop] 0/1093, RunningAvgSamplesPerSec=10.948882257144682, CurrSamplesPerSec=10.789551193456543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7093/20000 [8:54:35<34:53:50,  9.73s/it][2022-12-21 22:54:00,593] [INFO] [timer.py:197:stop] 0/1094, RunningAvgSamplesPerSec=10.949159414003857, CurrSamplesPerSec=11.26013345270966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7094/20000 [8:54:45<34:11:20,  9.54s/it][2022-12-21 22:54:09,795] [INFO] [timer.py:197:stop] 0/1095, RunningAvgSamplesPerSec=10.949051176371668, CurrSamplesPerSec=10.832119124659245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7095/20000 [8:54:54<33:49:37,  9.44s/it][2022-12-21 22:54:22,370] [INFO] [timer.py:197:stop] 0/1096, RunningAvgSamplesPerSec=10.949077157238928, CurrSamplesPerSec=10.977548153950329, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7096/20000 [8:55:06<37:11:59, 10.38s/it][2022-12-21 22:54:32,352] [INFO] [timer.py:197:stop] 0/1097, RunningAvgSamplesPerSec=10.949131723724877, CurrSamplesPerSec=11.009155011313242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7097/20000 [8:55:16<36:46:13, 10.26s/it][2022-12-21 22:54:41,577] [INFO] [timer.py:197:stop] 0/1098, RunningAvgSamplesPerSec=10.94919741459214, CurrSamplesPerSec=11.021605035469156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7098/20000 [8:55:26<35:39:21,  9.95s/it][2022-12-21 22:54:50,455] [INFO] [timer.py:197:stop] 0/1099, RunningAvgSamplesPerSec=10.949278514496546, CurrSamplesPerSec=11.038892150862807, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 35%|███▌      | 7099/20000 [8:55:34<34:30:05,  9.63s/it][2022-12-21 22:55:03,333] [INFO] [logging.py:68:log_dist] [Rank 0] step=7100, skipped=16, lr=[6.624102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:55:03,334] [INFO] [timer.py:197:stop] 0/1100, RunningAvgSamplesPerSec=10.949474032229638, CurrSamplesPerSec=11.168246296035264, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7100/20000 [8:55:47<37:59:37, 10.60s/it]

                                                         
{'loss': 0.0672, 'learning_rate': 6.624102564102565e-06, 'epoch': 0.35}


 36%|███▌      | 7100/20000 [8:55:47<37:59:37, 10.60s/it][2022-12-21 22:55:15,669] [INFO] [timer.py:197:stop] 0/1101, RunningAvgSamplesPerSec=10.949372090520699, CurrSamplesPerSec=10.838573782021706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7101/20000 [8:56:00<39:51:10, 11.12s/it][2022-12-21 22:55:24,535] [INFO] [timer.py:197:stop] 0/1102, RunningAvgSamplesPerSec=10.949548785067877, CurrSamplesPerSec=11.147245378677638, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7102/20000 [8:56:08<37:25:30, 10.45s/it][2022-12-21 22:55:34,135] [INFO] [timer.py:197:stop] 0/1103, RunningAvgSamplesPerSec=10.94960910127258, CurrSamplesPerSec=11.016361773857973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7103/20000 [8:56:18<36:30:47, 10.19s/it][2022-12-21 22:55:43,177] [INFO] [timer.py:197:stop] 0/1104, RunningAvgSamplesPerSec=10.94981625956946, CurrSamplesPerSec=11.182753971832014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7104/20000 [8:56:27<35:16:25,  9.85s/it][2022-12-21 22:55:51,914] [INFO] [timer.py:197:stop] 0/1105, RunningAvgSamplesPerSec=10.950120726233203, CurrSamplesPerSec=11.296258612785524, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7105/20000 [8:56:36<34:04:44,  9.51s/it][2022-12-21 22:56:02,833] [INFO] [timer.py:197:stop] 0/1106, RunningAvgSamplesPerSec=10.94975779226784, CurrSamplesPerSec=10.563573095032133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7106/20000 [8:56:47<35:35:07,  9.94s/it][2022-12-21 22:56:12,861] [INFO] [timer.py:197:stop] 0/1107, RunningAvgSamplesPerSec=10.950046732625422, CurrSamplesPerSec=11.278617276265297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7107/20000 [8:56:57<35:40:54,  9.96s/it][2022-12-21 22:56:22,497] [INFO] [timer.py:197:stop] 0/1108, RunningAvgSamplesPerSec=10.95022699412612, CurrSamplesPerSec=11.153109810880872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7108/20000 [8:57:06<35:19:39,  9.87s/it][2022-12-21 22:56:31,469] [INFO] [timer.py:197:stop] 0/1109, RunningAvgSamplesPerSec=10.950496681097034, CurrSamplesPerSec=11.257130223599813, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7109/20000 [8:57:15<34:22:00,  9.60s/it][2022-12-21 22:56:40,785] [INFO] [logging.py:68:log_dist] [Rank 0] step=7110, skipped=16, lr=[6.618974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:56:40,785] [INFO] [timer.py:197:stop] 0/1110, RunningAvgSamplesPerSec=10.950314316968646, CurrSamplesPerSec=10.752094849469525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7110/20000 [8:57:25<34:03:40,  9.51s/it][2022-12-21 22:56:50,111] [INFO] [timer.py:197:stop] 0/1111, RunningAvgSamplesPerSec=10.95033503338866, CurrSamplesPerSec=10.9733370865583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7111/20000 [8:57:34<33:51:25,  9.46s/it][2022-12-21 22:56:59,539] [INFO] [timer.py:197:stop] 0/1112, RunningAvgSamplesPerSec=10.950120611011691, CurrSamplesPerSec=10.717384875495329, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7112/20000 [8:57:44<33:49:26,  9.45s/it][2022-12-21 22:57:08,892] [INFO] [timer.py:197:stop] 0/1113, RunningAvgSamplesPerSec=10.94998191214332, CurrSamplesPerSec=10.798162656132313, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7113/20000 [8:57:53<33:43:10,  9.42s/it][2022-12-21 22:57:18,382] [INFO] [timer.py:197:stop] 0/1114, RunningAvgSamplesPerSec=10.950082698650176, CurrSamplesPerSec=11.063214416052565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7114/20000 [8:58:02<33:47:33,  9.44s/it][2022-12-21 22:57:27,582] [INFO] [timer.py:197:stop] 0/1115, RunningAvgSamplesPerSec=10.95037021110046, CurrSamplesPerSec=11.279708262240428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7115/20000 [8:58:12<33:31:52,  9.37s/it][2022-12-21 22:57:37,410] [INFO] [timer.py:197:stop] 0/1116, RunningAvgSamplesPerSec=10.950375230572611, CurrSamplesPerSec=10.955964757308662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7116/20000 [8:58:21<34:01:19,  9.51s/it][2022-12-21 22:57:46,831] [INFO] [timer.py:197:stop] 0/1117, RunningAvgSamplesPerSec=10.95035584913274, CurrSamplesPerSec=10.928807450442838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7117/20000 [8:58:31<33:55:39,  9.48s/it][2022-12-21 22:57:55,813] [INFO] [timer.py:197:stop] 0/1118, RunningAvgSamplesPerSec=10.950511648958452, CurrSamplesPerSec=11.127031238827547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7118/20000 [8:58:40<33:23:24,  9.33s/it][2022-12-21 22:58:05,820] [INFO] [timer.py:197:stop] 0/1119, RunningAvgSamplesPerSec=10.950720953206512, CurrSamplesPerSec=11.18940018564281, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7119/20000 [8:58:50<34:06:45,  9.53s/it][2022-12-21 22:58:15,457] [INFO] [logging.py:68:log_dist] [Rank 0] step=7120, skipped=16, lr=[6.613846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:58:15,458] [INFO] [timer.py:197:stop] 0/1120, RunningAvgSamplesPerSec=10.950313027816788, CurrSamplesPerSec=10.512878709818763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7120/20000 [8:58:59<34:13:17,  9.57s/it][2022-12-21 22:58:24,916] [INFO] [timer.py:197:stop] 0/1121, RunningAvgSamplesPerSec=10.950356700416572, CurrSamplesPerSec=10.999401546047702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7121/20000 [8:59:09<34:06:15,  9.53s/it][2022-12-21 22:58:34,002] [INFO] [timer.py:197:stop] 0/1122, RunningAvgSamplesPerSec=10.950377825799062, CurrSamplesPerSec=10.974068316734863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7122/20000 [8:59:18<33:37:17,  9.40s/it][2022-12-21 22:58:43,546] [INFO] [timer.py:197:stop] 0/1123, RunningAvgSamplesPerSec=10.950365943238372, CurrSamplesPerSec=10.937073644412866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7123/20000 [8:59:28<33:46:30,  9.44s/it][2022-12-21 22:58:52,822] [INFO] [timer.py:197:stop] 0/1124, RunningAvgSamplesPerSec=10.950592713142253, CurrSamplesPerSec=11.210848797235647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7124/20000 [8:59:37<33:35:37,  9.39s/it][2022-12-21 22:59:02,957] [INFO] [timer.py:197:stop] 0/1125, RunningAvgSamplesPerSec=10.950628762979447, CurrSamplesPerSec=10.991226769257555, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7125/20000 [8:59:47<34:23:16,  9.62s/it]

                                                         
{'loss': 0.0948, 'learning_rate': 6.611282051282052e-06, 'epoch': 0.36}


 36%|███▌      | 7125/20000 [8:59:47<34:23:16,  9.62s/it][2022-12-21 22:59:13,120] [INFO] [timer.py:197:stop] 0/1126, RunningAvgSamplesPerSec=10.950589881504918, CurrSamplesPerSec=10.907099551437735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7126/20000 [8:59:57<34:58:21,  9.78s/it][2022-12-21 22:59:24,020] [INFO] [timer.py:197:stop] 0/1127, RunningAvgSamplesPerSec=10.950628803032904, CurrSamplesPerSec=10.994552230843633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7127/20000 [9:00:08<36:10:21, 10.12s/it][2022-12-21 22:59:33,498] [INFO] [timer.py:197:stop] 0/1128, RunningAvgSamplesPerSec=10.950934344583509, CurrSamplesPerSec=11.305817776479811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7128/20000 [9:00:17<35:29:04,  9.92s/it][2022-12-21 22:59:43,598] [INFO] [timer.py:197:stop] 0/1129, RunningAvgSamplesPerSec=10.95096286473194, CurrSamplesPerSec=10.983171086324955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7129/20000 [9:00:28<35:40:17,  9.98s/it][2022-12-21 22:59:53,128] [INFO] [logging.py:68:log_dist] [Rank 0] step=7130, skipped=16, lr=[6.60871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-21 22:59:53,129] [INFO] [timer.py:197:stop] 0/1130, RunningAvgSamplesPerSec=10.950783884035278, CurrSamplesPerSec=10.752724097589473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7130/20000 [9:00:37<35:11:21,  9.84s/it][2022-12-21 23:00:02,060] [INFO] [timer.py:197:stop] 0/1131, RunningAvgSamplesPerSec=10.950962292196975, CurrSamplesPerSec=11.155977577784483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7131/20000 [9:00:46<34:12:32,  9.57s/it][2022-12-21 23:00:11,428] [INFO] [timer.py:197:stop] 0/1132, RunningAvgSamplesPerSec=10.950874778239744, CurrSamplesPerSec=10.85295576828151, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7132/20000 [9:00:55<33:59:21,  9.51s/it][2022-12-21 23:00:20,550] [INFO] [timer.py:197:stop] 0/1133, RunningAvgSamplesPerSec=10.951092313705502, CurrSamplesPerSec=11.202556917143037, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7133/20000 [9:01:05<33:34:21,  9.39s/it][2022-12-21 23:00:29,563] [INFO] [timer.py:197:stop] 0/1134, RunningAvgSamplesPerSec=10.951048982153646, CurrSamplesPerSec=10.902259531942203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7134/20000 [9:01:14<33:09:41,  9.28s/it][2022-12-21 23:00:39,244] [INFO] [timer.py:197:stop] 0/1135, RunningAvgSamplesPerSec=10.950662408195289, CurrSamplesPerSec=10.529890111338487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7135/20000 [9:01:23<33:35:25,  9.40s/it][2022-12-21 23:00:49,166] [INFO] [timer.py:197:stop] 0/1136, RunningAvgSamplesPerSec=10.950753027923083, CurrSamplesPerSec=11.054397790532583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7136/20000 [9:01:33<34:08:52,  9.56s/it][2022-12-21 23:00:58,082] [INFO] [timer.py:197:stop] 0/1137, RunningAvgSamplesPerSec=10.950911217701664, CurrSamplesPerSec=11.133288590392478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7137/20000 [9:01:42<33:27:32,  9.36s/it][2022-12-21 23:01:07,025] [INFO] [timer.py:197:stop] 0/1138, RunningAvgSamplesPerSec=10.950905793307278, CurrSamplesPerSec=10.94475256811974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7138/20000 [9:01:51<33:00:15,  9.24s/it][2022-12-21 23:01:16,696] [INFO] [timer.py:197:stop] 0/1139, RunningAvgSamplesPerSec=10.951001933948856, CurrSamplesPerSec=11.061318876511288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7139/20000 [9:02:01<33:27:57,  9.37s/it][2022-12-21 23:01:26,297] [INFO] [logging.py:68:log_dist] [Rank 0] step=7140, skipped=16, lr=[6.6035897435897445e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:01:26,298] [INFO] [timer.py:197:stop] 0/1140, RunningAvgSamplesPerSec=10.950996553521852, CurrSamplesPerSec=10.944882426552985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7140/20000 [9:02:10<33:42:52,  9.44s/it][2022-12-21 23:01:35,549] [INFO] [timer.py:197:stop] 0/1141, RunningAvgSamplesPerSec=10.950910508428713, CurrSamplesPerSec=10.853859749859664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7141/20000 [9:02:20<33:30:43,  9.38s/it][2022-12-21 23:01:45,462] [INFO] [timer.py:197:stop] 0/1142, RunningAvgSamplesPerSec=10.950873694830877, CurrSamplesPerSec=10.909103086185649, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7142/20000 [9:02:29<34:04:41,  9.54s/it][2022-12-21 23:01:55,085] [INFO] [timer.py:197:stop] 0/1143, RunningAvgSamplesPerSec=10.950693241338172, CurrSamplesPerSec=10.748772813649426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7143/20000 [9:02:39<34:09:47,  9.57s/it][2022-12-21 23:02:03,954] [INFO] [timer.py:197:stop] 0/1144, RunningAvgSamplesPerSec=10.950655921119898, CurrSamplesPerSec=10.908238639111207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7144/20000 [9:02:48<33:24:49,  9.36s/it][2022-12-21 23:02:13,313] [INFO] [timer.py:197:stop] 0/1145, RunningAvgSamplesPerSec=10.950672074435403, CurrSamplesPerSec=10.969150315740265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7145/20000 [9:02:57<33:24:49,  9.36s/it][2022-12-21 23:02:23,450] [INFO] [timer.py:197:stop] 0/1146, RunningAvgSamplesPerSec=10.950362460358209, CurrSamplesPerSec=10.607561742061097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7146/20000 [9:03:07<34:14:48,  9.59s/it][2022-12-21 23:02:32,889] [INFO] [timer.py:197:stop] 0/1147, RunningAvgSamplesPerSec=10.950104278647478, CurrSamplesPerSec=10.66250857277182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7147/20000 [9:03:17<34:04:51,  9.55s/it][2022-12-21 23:02:42,487] [INFO] [timer.py:197:stop] 0/1148, RunningAvgSamplesPerSec=10.949971344225565, CurrSamplesPerSec=10.79985001295489, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7148/20000 [9:03:26<34:08:06,  9.56s/it][2022-12-21 23:02:52,033] [INFO] [timer.py:197:stop] 0/1149, RunningAvgSamplesPerSec=10.949900952274616, CurrSamplesPerSec=10.8698222403308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7149/20000 [9:03:36<34:06:56,  9.56s/it][2022-12-21 23:03:01,737] [INFO] [logging.py:68:log_dist] [Rank 0] step=7150, skipped=16, lr=[6.598461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:03:01,738] [INFO] [timer.py:197:stop] 0/1150, RunningAvgSamplesPerSec=10.949882018233764, CurrSamplesPerSec=10.928207698410233, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7150/20000 [9:03:46<34:16:12,  9.60s/it]

                                                         
{'loss': 0.0995, 'learning_rate': 6.598461538461539e-06, 'epoch': 0.36}


 36%|███▌      | 7150/20000 [9:03:46<34:16:12,  9.60s/it][2022-12-21 23:03:11,233] [INFO] [timer.py:197:stop] 0/1151, RunningAvgSamplesPerSec=10.949788548363438, CurrSamplesPerSec=10.843527360111826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7151/20000 [9:03:55<34:09:14,  9.57s/it][2022-12-21 23:03:20,461] [INFO] [timer.py:197:stop] 0/1152, RunningAvgSamplesPerSec=10.949705987030557, CurrSamplesPerSec=10.855658506681111, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7152/20000 [9:04:04<33:47:09,  9.47s/it][2022-12-21 23:03:29,950] [INFO] [timer.py:197:stop] 0/1153, RunningAvgSamplesPerSec=10.949735849547611, CurrSamplesPerSec=10.984185884509339, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7153/20000 [9:04:14<33:48:26,  9.47s/it][2022-12-21 23:03:39,322] [INFO] [timer.py:197:stop] 0/1154, RunningAvgSamplesPerSec=10.949576963420718, CurrSamplesPerSec=10.76970581804249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7154/20000 [9:04:23<33:41:45,  9.44s/it][2022-12-21 23:03:49,872] [INFO] [timer.py:197:stop] 0/1155, RunningAvgSamplesPerSec=10.949360522103655, CurrSamplesPerSec=10.70557642991298, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7155/20000 [9:04:34<34:52:40,  9.78s/it][2022-12-21 23:03:59,355] [INFO] [timer.py:197:stop] 0/1156, RunningAvgSamplesPerSec=10.949528642560447, CurrSamplesPerSec=11.146868120941496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7156/20000 [9:04:43<34:33:47,  9.69s/it][2022-12-21 23:04:08,583] [INFO] [timer.py:197:stop] 0/1157, RunningAvgSamplesPerSec=10.94934092443908, CurrSamplesPerSec=10.736920476366716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7157/20000 [9:04:53<34:04:07,  9.55s/it][2022-12-21 23:04:18,577] [INFO] [timer.py:197:stop] 0/1158, RunningAvgSamplesPerSec=10.949006888480948, CurrSamplesPerSec=10.576338489536658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7158/20000 [9:05:03<34:32:28,  9.68s/it][2022-12-21 23:04:27,648] [INFO] [timer.py:197:stop] 0/1159, RunningAvgSamplesPerSec=10.948971303808536, CurrSamplesPerSec=10.907989526462359, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7159/20000 [9:05:12<33:53:03,  9.50s/it][2022-12-21 23:04:36,613] [INFO] [logging.py:68:log_dist] [Rank 0] step=7160, skipped=16, lr=[6.5933333333333335e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:04:36,614] [INFO] [timer.py:197:stop] 0/1160, RunningAvgSamplesPerSec=10.949113579611945, CurrSamplesPerSec=11.116241520378402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7160/20000 [9:05:21<33:18:36,  9.34s/it][2022-12-21 23:04:45,792] [INFO] [timer.py:197:stop] 0/1161, RunningAvgSamplesPerSec=10.949236617052371, CurrSamplesPerSec=11.093594051808754, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7161/20000 [9:05:30<33:08:07,  9.29s/it][2022-12-21 23:04:55,601] [INFO] [timer.py:197:stop] 0/1162, RunningAvgSamplesPerSec=10.949513855929059, CurrSamplesPerSec=11.280556742131497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7162/20000 [9:05:40<33:41:12,  9.45s/it][2022-12-21 23:05:04,659] [INFO] [timer.py:197:stop] 0/1163, RunningAvgSamplesPerSec=10.949532853375272, CurrSamplesPerSec=10.97161437057308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7163/20000 [9:05:49<33:16:04,  9.33s/it][2022-12-21 23:05:13,780] [INFO] [timer.py:197:stop] 0/1164, RunningAvgSamplesPerSec=10.94948712721205, CurrSamplesPerSec=10.896655424378615, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7164/20000 [9:05:58<33:02:33,  9.27s/it][2022-12-21 23:05:23,166] [INFO] [timer.py:197:stop] 0/1165, RunningAvgSamplesPerSec=10.949322951477868, CurrSamplesPerSec=10.761820452639952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7165/20000 [9:06:07<33:10:00,  9.30s/it][2022-12-21 23:05:33,420] [INFO] [timer.py:197:stop] 0/1166, RunningAvgSamplesPerSec=10.949293710987693, CurrSamplesPerSec=10.91539240328853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7166/20000 [9:06:17<34:10:55,  9.59s/it][2022-12-21 23:05:42,624] [INFO] [timer.py:197:stop] 0/1167, RunningAvgSamplesPerSec=10.948979388034717, CurrSamplesPerSec=10.594947974585745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7167/20000 [9:06:27<33:46:06,  9.47s/it][2022-12-21 23:05:51,764] [INFO] [timer.py:197:stop] 0/1168, RunningAvgSamplesPerSec=10.949265942349662, CurrSamplesPerSec=11.293609536403869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7168/20000 [9:06:36<33:24:35,  9.37s/it][2022-12-21 23:06:01,409] [INFO] [timer.py:197:stop] 0/1169, RunningAvgSamplesPerSec=10.949185582303027, CurrSamplesPerSec=10.8562814948306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7169/20000 [9:06:45<33:41:52,  9.45s/it][2022-12-21 23:06:13,752] [INFO] [logging.py:68:log_dist] [Rank 0] step=7170, skipped=16, lr=[6.588205128205128e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:06:13,753] [INFO] [timer.py:197:stop] 0/1170, RunningAvgSamplesPerSec=10.948916292103748, CurrSamplesPerSec=10.64343036382917, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7170/20000 [9:06:58<36:47:03, 10.32s/it][2022-12-21 23:06:25,209] [INFO] [timer.py:197:stop] 0/1171, RunningAvgSamplesPerSec=10.948807418163407, CurrSamplesPerSec=10.823103887630056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7171/20000 [9:07:09<37:59:39, 10.66s/it][2022-12-21 23:06:34,958] [INFO] [timer.py:197:stop] 0/1172, RunningAvgSamplesPerSec=10.948639985021245, CurrSamplesPerSec=10.75635113902086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7172/20000 [9:07:19<37:00:56, 10.39s/it][2022-12-21 23:06:44,853] [INFO] [timer.py:197:stop] 0/1173, RunningAvgSamplesPerSec=10.948815577579428, CurrSamplesPerSec=11.158190942474903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7173/20000 [9:07:29<36:29:09, 10.24s/it][2022-12-21 23:06:53,748] [INFO] [timer.py:197:stop] 0/1174, RunningAvgSamplesPerSec=10.948820687080069, CurrSamplesPerSec=10.954807186579636, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7174/20000 [9:07:38<35:02:41,  9.84s/it][2022-12-21 23:07:05,988] [INFO] [timer.py:197:stop] 0/1175, RunningAvgSamplesPerSec=10.94903485559736, CurrSamplesPerSec=11.205934787569133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7175/20000 [9:07:50<37:36:39, 10.56s/it]

                                                         
{'loss': 0.0758, 'learning_rate': 6.585641025641026e-06, 'epoch': 0.36}


 36%|███▌      | 7175/20000 [9:07:50<37:36:39, 10.56s/it][2022-12-21 23:07:14,788] [INFO] [timer.py:197:stop] 0/1176, RunningAvgSamplesPerSec=10.949229370967911, CurrSamplesPerSec=11.182255987100946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7176/20000 [9:07:59<35:43:50, 10.03s/it][2022-12-21 23:07:24,503] [INFO] [timer.py:197:stop] 0/1177, RunningAvgSamplesPerSec=10.949333306327736, CurrSamplesPerSec=11.072729728175641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7177/20000 [9:08:08<35:23:24,  9.94s/it][2022-12-21 23:07:33,508] [INFO] [timer.py:197:stop] 0/1178, RunningAvgSamplesPerSec=10.94916641993293, CurrSamplesPerSec=10.756527857129862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7178/20000 [9:08:17<34:23:39,  9.66s/it][2022-12-21 23:07:43,071] [INFO] [timer.py:197:stop] 0/1179, RunningAvgSamplesPerSec=10.94903611866013, CurrSamplesPerSec=10.797918545694786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7179/20000 [9:08:27<34:17:26,  9.63s/it][2022-12-21 23:07:52,066] [INFO] [logging.py:68:log_dist] [Rank 0] step=7180, skipped=16, lr=[6.583076923076923e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:07:52,066] [INFO] [timer.py:197:stop] 0/1180, RunningAvgSamplesPerSec=10.94921592405314, CurrSamplesPerSec=11.165021596305682, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7180/20000 [9:08:36<33:36:40,  9.44s/it][2022-12-21 23:08:01,055] [INFO] [timer.py:197:stop] 0/1181, RunningAvgSamplesPerSec=10.949147209414061, CurrSamplesPerSec=10.86879589728806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7181/20000 [9:08:45<33:07:41,  9.30s/it][2022-12-21 23:08:10,893] [INFO] [timer.py:197:stop] 0/1182, RunningAvgSamplesPerSec=10.948944408105412, CurrSamplesPerSec=10.71495583518535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7182/20000 [9:08:55<33:41:49,  9.46s/it][2022-12-21 23:08:20,373] [INFO] [timer.py:197:stop] 0/1183, RunningAvgSamplesPerSec=10.948670457623937, CurrSamplesPerSec=10.634687162014936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7183/20000 [9:09:04<33:42:38,  9.47s/it][2022-12-21 23:08:30,441] [INFO] [timer.py:197:stop] 0/1184, RunningAvgSamplesPerSec=10.948733627192563, CurrSamplesPerSec=11.023849148612536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7184/20000 [9:09:14<34:20:55,  9.65s/it][2022-12-21 23:08:40,411] [INFO] [timer.py:197:stop] 0/1185, RunningAvgSamplesPerSec=10.94876007971919, CurrSamplesPerSec=10.98011658820029, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7185/20000 [9:09:24<34:41:23,  9.75s/it][2022-12-21 23:08:49,407] [INFO] [timer.py:197:stop] 0/1186, RunningAvgSamplesPerSec=10.948910343594012, CurrSamplesPerSec=11.129608734809407, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7186/20000 [9:09:33<33:53:10,  9.52s/it][2022-12-21 23:08:58,610] [INFO] [timer.py:197:stop] 0/1187, RunningAvgSamplesPerSec=10.948737735217971, CurrSamplesPerSec=10.748117345930833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7187/20000 [9:09:43<33:32:42,  9.43s/it][2022-12-21 23:09:08,042] [INFO] [timer.py:197:stop] 0/1188, RunningAvgSamplesPerSec=10.948904661348378, CurrSamplesPerSec=11.150354676920648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7188/20000 [9:09:52<33:32:59,  9.43s/it][2022-12-21 23:09:16,887] [INFO] [timer.py:197:stop] 0/1189, RunningAvgSamplesPerSec=10.949007616640644, CurrSamplesPerSec=11.072490858048834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7189/20000 [9:10:01<32:55:34,  9.25s/it][2022-12-21 23:09:26,109] [INFO] [logging.py:68:log_dist] [Rank 0] step=7190, skipped=16, lr=[6.577948717948719e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:09:26,109] [INFO] [timer.py:197:stop] 0/1190, RunningAvgSamplesPerSec=10.949068262126236, CurrSamplesPerSec=11.021531273159505, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7190/20000 [9:10:10<32:53:28,  9.24s/it][2022-12-21 23:09:35,459] [INFO] [timer.py:197:stop] 0/1191, RunningAvgSamplesPerSec=10.949017648560844, CurrSamplesPerSec=10.889217415319122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7191/20000 [9:10:19<33:00:06,  9.28s/it][2022-12-21 23:09:44,242] [INFO] [timer.py:197:stop] 0/1192, RunningAvgSamplesPerSec=10.94924547762265, CurrSamplesPerSec=11.227012069451396, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7192/20000 [9:10:28<32:28:28,  9.13s/it][2022-12-21 23:09:53,443] [INFO] [timer.py:197:stop] 0/1193, RunningAvgSamplesPerSec=10.949375900880932, CurrSamplesPerSec=11.106813071869464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7193/20000 [9:10:37<32:33:00,  9.15s/it][2022-12-21 23:10:04,034] [INFO] [timer.py:197:stop] 0/1194, RunningAvgSamplesPerSec=10.94960776331587, CurrSamplesPerSec=11.232906696878246, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7194/20000 [9:10:48<34:05:07,  9.58s/it][2022-12-21 23:10:14,414] [INFO] [timer.py:197:stop] 0/1195, RunningAvgSamplesPerSec=10.949595493910694, CurrSamplesPerSec=10.934989887692446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7195/20000 [9:10:58<34:56:03,  9.82s/it][2022-12-21 23:10:23,727] [INFO] [timer.py:197:stop] 0/1196, RunningAvgSamplesPerSec=10.949506509239406, CurrSamplesPerSec=10.84436799986297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7196/20000 [9:11:08<34:23:19,  9.67s/it][2022-12-21 23:10:32,900] [INFO] [timer.py:197:stop] 0/1197, RunningAvgSamplesPerSec=10.94937966978835, CurrSamplesPerSec=10.800001223087449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7197/20000 [9:11:17<33:51:26,  9.52s/it][2022-12-21 23:10:42,593] [INFO] [timer.py:197:stop] 0/1198, RunningAvgSamplesPerSec=10.94913521685331, CurrSamplesPerSec=10.664611364796986, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7198/20000 [9:11:27<34:02:22,  9.57s/it][2022-12-21 23:10:53,288] [INFO] [timer.py:197:stop] 0/1199, RunningAvgSamplesPerSec=10.949186428740244, CurrSamplesPerSec=11.01078069003537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7199/20000 [9:11:37<35:14:04,  9.91s/it][2022-12-21 23:11:02,125] [INFO] [logging.py:68:log_dist] [Rank 0] step=7200, skipped=16, lr=[6.572820512820514e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:11:02,126] [INFO] [timer.py:197:stop] 0/1200, RunningAvgSamplesPerSec=10.94932284637056, CurrSamplesPerSec=11.115088955549451, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7200/20000 [9:11:46<34:05:25,  9.59s/it]

                                                         
{'loss': 0.0699, 'learning_rate': 6.572820512820514e-06, 'epoch': 0.36}


 36%|███▌      | 7200/20000 [9:11:46<34:05:25,  9.59s/it][2022-12-21 23:11:11,778] [INFO] [timer.py:197:stop] 0/1201, RunningAvgSamplesPerSec=10.94936399729202, CurrSamplesPerSec=10.998885956740834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7201/20000 [9:11:56<34:09:18,  9.61s/it][2022-12-21 23:11:20,988] [INFO] [timer.py:197:stop] 0/1202, RunningAvgSamplesPerSec=10.94933736559682, CurrSamplesPerSec=10.917498890600815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7202/20000 [9:12:05<33:43:43,  9.49s/it][2022-12-21 23:11:30,050] [INFO] [timer.py:197:stop] 0/1203, RunningAvgSamplesPerSec=10.94924995870068, CurrSamplesPerSec=10.845357747517948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7203/20000 [9:12:14<33:16:19,  9.36s/it][2022-12-21 23:11:40,556] [INFO] [timer.py:197:stop] 0/1204, RunningAvgSamplesPerSec=10.94923572359108, CurrSamplesPerSec=10.932166032129562, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7204/20000 [9:12:25<34:29:29,  9.70s/it][2022-12-21 23:11:49,996] [INFO] [timer.py:197:stop] 0/1205, RunningAvgSamplesPerSec=10.94921449787999, CurrSamplesPerSec=10.923760553984511, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7205/20000 [9:12:34<34:12:28,  9.62s/it][2022-12-21 23:11:59,010] [INFO] [timer.py:197:stop] 0/1206, RunningAvgSamplesPerSec=10.949158351443288, CurrSamplesPerSec=10.882028648142878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7206/20000 [9:12:43<33:33:14,  9.44s/it][2022-12-21 23:12:08,539] [INFO] [timer.py:197:stop] 0/1207, RunningAvgSamplesPerSec=10.949058456697198, CurrSamplesPerSec=10.830093079294414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7207/20000 [9:12:53<33:38:40,  9.47s/it][2022-12-21 23:12:17,674] [INFO] [timer.py:197:stop] 0/1208, RunningAvgSamplesPerSec=10.94928819366668, CurrSamplesPerSec=11.233308134263822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7208/20000 [9:13:02<33:17:12,  9.37s/it][2022-12-21 23:12:27,388] [INFO] [timer.py:197:stop] 0/1209, RunningAvgSamplesPerSec=10.949246221477692, CurrSamplesPerSec=10.898860886540142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7209/20000 [9:13:11<33:39:15,  9.47s/it][2022-12-21 23:12:38,111] [INFO] [logging.py:68:log_dist] [Rank 0] step=7210, skipped=16, lr=[6.567692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:12:38,112] [INFO] [timer.py:197:stop] 0/1210, RunningAvgSamplesPerSec=10.948874522180805, CurrSamplesPerSec=10.517907408796926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7210/20000 [9:13:22<34:59:07,  9.85s/it][2022-12-21 23:12:46,892] [INFO] [timer.py:197:stop] 0/1211, RunningAvgSamplesPerSec=10.949033246284946, CurrSamplesPerSec=11.144192407049722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7211/20000 [9:13:31<33:50:42,  9.53s/it][2022-12-21 23:12:56,785] [INFO] [timer.py:197:stop] 0/1212, RunningAvgSamplesPerSec=10.949240773033189, CurrSamplesPerSec=11.206029750917937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7212/20000 [9:13:41<34:13:58,  9.64s/it][2022-12-21 23:13:05,660] [INFO] [timer.py:197:stop] 0/1213, RunningAvgSamplesPerSec=10.949217570539169, CurrSamplesPerSec=10.92121441533572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7213/20000 [9:13:50<33:25:06,  9.41s/it][2022-12-21 23:13:15,464] [INFO] [timer.py:197:stop] 0/1214, RunningAvgSamplesPerSec=10.949333485033277, CurrSamplesPerSec=11.091530433573215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7214/20000 [9:13:59<33:50:14,  9.53s/it][2022-12-21 23:13:26,596] [INFO] [timer.py:197:stop] 0/1215, RunningAvgSamplesPerSec=10.949064487333139, CurrSamplesPerSec=10.63247402022454, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7215/20000 [9:14:11<35:32:37, 10.01s/it][2022-12-21 23:13:35,946] [INFO] [timer.py:197:stop] 0/1216, RunningAvgSamplesPerSec=10.949084810437911, CurrSamplesPerSec=10.973792411692774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7216/20000 [9:14:20<34:50:21,  9.81s/it][2022-12-21 23:13:44,772] [INFO] [timer.py:197:stop] 0/1217, RunningAvgSamplesPerSec=10.949156245317498, CurrSamplesPerSec=11.03657112221018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7217/20000 [9:14:29<33:47:17,  9.52s/it][2022-12-21 23:13:55,184] [INFO] [timer.py:197:stop] 0/1218, RunningAvgSamplesPerSec=10.949209866798007, CurrSamplesPerSec=11.01475026573063, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7218/20000 [9:14:39<34:44:23,  9.78s/it][2022-12-21 23:14:04,141] [INFO] [timer.py:197:stop] 0/1219, RunningAvgSamplesPerSec=10.949220992934578, CurrSamplesPerSec=10.962767127020289, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7219/20000 [9:14:48<33:51:23,  9.54s/it][2022-12-21 23:14:13,444] [INFO] [logging.py:68:log_dist] [Rank 0] step=7220, skipped=16, lr=[6.562564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:14:13,445] [INFO] [timer.py:197:stop] 0/1220, RunningAvgSamplesPerSec=10.949227836040151, CurrSamplesPerSec=10.957562239937692, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7220/20000 [9:14:57<33:36:20,  9.47s/it][2022-12-21 23:14:22,866] [INFO] [timer.py:197:stop] 0/1221, RunningAvgSamplesPerSec=10.949297305681126, CurrSamplesPerSec=11.034570846625789, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7221/20000 [9:15:07<33:33:20,  9.45s/it][2022-12-21 23:14:31,798] [INFO] [timer.py:197:stop] 0/1222, RunningAvgSamplesPerSec=10.949478765072335, CurrSamplesPerSec=11.175242331055797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7222/20000 [9:15:16<32:59:53,  9.30s/it][2022-12-21 23:14:40,641] [INFO] [timer.py:197:stop] 0/1223, RunningAvgSamplesPerSec=10.949614474512423, CurrSamplesPerSec=11.117724003835026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7223/20000 [9:15:25<32:30:44,  9.16s/it][2022-12-21 23:14:50,395] [INFO] [timer.py:197:stop] 0/1224, RunningAvgSamplesPerSec=10.949588226846119, CurrSamplesPerSec=10.91763343152754, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7224/20000 [9:15:34<33:08:29,  9.34s/it][2022-12-21 23:15:00,602] [INFO] [timer.py:197:stop] 0/1225, RunningAvgSamplesPerSec=10.94955389185475, CurrSamplesPerSec=10.907756824747162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7225/20000 [9:15:45<34:03:49,  9.60s/it]

                                                         
{'loss': 0.0644, 'learning_rate': 6.560000000000001e-06, 'epoch': 0.36}


 36%|███▌      | 7225/20000 [9:15:45<34:03:49,  9.60s/it][2022-12-21 23:15:09,598] [INFO] [timer.py:197:stop] 0/1226, RunningAvgSamplesPerSec=10.949760382911117, CurrSamplesPerSec=11.20826583096226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7226/20000 [9:15:54<33:25:08,  9.42s/it][2022-12-21 23:15:19,588] [INFO] [timer.py:197:stop] 0/1227, RunningAvgSamplesPerSec=10.949771809551134, CurrSamplesPerSec=10.963775919074168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7227/20000 [9:16:04<34:01:26,  9.59s/it][2022-12-21 23:15:29,578] [INFO] [timer.py:197:stop] 0/1228, RunningAvgSamplesPerSec=10.949476041223775, CurrSamplesPerSec=10.598773981741008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7228/20000 [9:16:14<34:26:54,  9.71s/it][2022-12-21 23:15:38,734] [INFO] [timer.py:197:stop] 0/1229, RunningAvgSamplesPerSec=10.949361976819521, CurrSamplesPerSec=10.811283959168549, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7229/20000 [9:16:23<33:51:22,  9.54s/it][2022-12-21 23:15:47,919] [INFO] [logging.py:68:log_dist] [Rank 0] step=7230, skipped=16, lr=[6.557435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:15:47,920] [INFO] [timer.py:197:stop] 0/1230, RunningAvgSamplesPerSec=10.94943176920732, CurrSamplesPerSec=11.035742614367445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7230/20000 [9:16:32<33:28:22,  9.44s/it][2022-12-21 23:15:57,537] [INFO] [timer.py:197:stop] 0/1231, RunningAvgSamplesPerSec=10.949294591094473, CurrSamplesPerSec=10.783394320022849, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7231/20000 [9:16:41<33:39:45,  9.49s/it][2022-12-21 23:16:06,302] [INFO] [timer.py:197:stop] 0/1232, RunningAvgSamplesPerSec=10.94950781420527, CurrSamplesPerSec=11.217989740990603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7232/20000 [9:16:50<32:53:15,  9.27s/it][2022-12-21 23:16:16,032] [INFO] [timer.py:197:stop] 0/1233, RunningAvgSamplesPerSec=10.949723057600336, CurrSamplesPerSec=11.22103778716252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7233/20000 [9:17:00<33:22:16,  9.41s/it][2022-12-21 23:16:26,707] [INFO] [timer.py:197:stop] 0/1234, RunningAvgSamplesPerSec=10.949634361343112, CurrSamplesPerSec=10.841528133684395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7234/20000 [9:17:11<34:42:52,  9.79s/it][2022-12-21 23:16:35,563] [INFO] [timer.py:197:stop] 0/1235, RunningAvgSamplesPerSec=10.949703132703288, CurrSamplesPerSec=11.03509069428561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7235/20000 [9:17:20<33:43:06,  9.51s/it][2022-12-21 23:16:45,541] [INFO] [timer.py:197:stop] 0/1236, RunningAvgSamplesPerSec=10.949760909113403, CurrSamplesPerSec=11.021466109731877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7236/20000 [9:17:30<34:12:54,  9.65s/it][2022-12-21 23:16:55,889] [INFO] [timer.py:197:stop] 0/1237, RunningAvgSamplesPerSec=10.9496416607351, CurrSamplesPerSec=10.804442083845242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7237/20000 [9:17:40<34:57:13,  9.86s/it][2022-12-21 23:17:05,444] [INFO] [timer.py:197:stop] 0/1238, RunningAvgSamplesPerSec=10.949669433862184, CurrSamplesPerSec=10.984077115058845, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7238/20000 [9:17:49<34:37:39,  9.77s/it][2022-12-21 23:17:14,256] [INFO] [timer.py:197:stop] 0/1239, RunningAvgSamplesPerSec=10.94986799451742, CurrSamplesPerSec=11.200920390418185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7239/20000 [9:17:58<33:36:30,  9.48s/it][2022-12-21 23:17:23,779] [INFO] [logging.py:68:log_dist] [Rank 0] step=7240, skipped=16, lr=[6.5523076923076935e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:17:23,780] [INFO] [timer.py:197:stop] 0/1240, RunningAvgSamplesPerSec=10.94990765946186, CurrSamplesPerSec=10.999194222858575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7240/20000 [9:18:08<33:39:03,  9.49s/it][2022-12-21 23:17:32,926] [INFO] [timer.py:197:stop] 0/1241, RunningAvgSamplesPerSec=10.949704579325354, CurrSamplesPerSec=10.703938888103346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7241/20000 [9:18:17<33:16:42,  9.39s/it][2022-12-21 23:17:41,941] [INFO] [timer.py:197:stop] 0/1242, RunningAvgSamplesPerSec=10.949710709535745, CurrSamplesPerSec=10.9573113166728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7242/20000 [9:18:26<32:52:38,  9.28s/it][2022-12-21 23:17:51,747] [INFO] [timer.py:197:stop] 0/1243, RunningAvgSamplesPerSec=10.949725514512753, CurrSamplesPerSec=10.968114541676313, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7243/20000 [9:18:36<33:26:18,  9.44s/it][2022-12-21 23:18:00,870] [INFO] [timer.py:197:stop] 0/1244, RunningAvgSamplesPerSec=10.94977182059761, CurrSamplesPerSec=11.007541097012467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7244/20000 [9:18:45<33:06:06,  9.34s/it][2022-12-21 23:18:09,889] [INFO] [timer.py:197:stop] 0/1245, RunningAvgSamplesPerSec=10.949607235345477, CurrSamplesPerSec=10.748941535283485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7245/20000 [9:18:54<32:45:18,  9.24s/it][2022-12-21 23:18:19,746] [INFO] [timer.py:197:stop] 0/1246, RunningAvgSamplesPerSec=10.949779737470656, CurrSamplesPerSec=11.168486062871436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7246/20000 [9:19:04<33:24:14,  9.43s/it][2022-12-21 23:18:28,634] [INFO] [timer.py:197:stop] 0/1247, RunningAvgSamplesPerSec=10.949953314367358, CurrSamplesPerSec=11.170230258195895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7247/20000 [9:19:13<32:49:33,  9.27s/it][2022-12-21 23:18:37,676] [INFO] [timer.py:197:stop] 0/1248, RunningAvgSamplesPerSec=10.950168699971048, CurrSamplesPerSec=11.225060928892443, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7248/20000 [9:19:22<32:35:06,  9.20s/it][2022-12-21 23:18:47,312] [INFO] [timer.py:197:stop] 0/1249, RunningAvgSamplesPerSec=10.950361817553777, CurrSamplesPerSec=11.196397071569562, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▌      | 7249/20000 [9:19:31<33:02:50,  9.33s/it][2022-12-21 23:18:56,225] [INFO] [logging.py:68:log_dist] [Rank 0] step=7250, skipped=16, lr=[6.547179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:18:56,226] [INFO] [timer.py:197:stop] 0/1250, RunningAvgSamplesPerSec=10.950572613190108, CurrSamplesPerSec=11.219905127417086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7250/20000 [9:19:40<32:36:08,  9.21s/it]

                                                         
{'loss': 0.0661, 'learning_rate': 6.547179487179488e-06, 'epoch': 0.36}


 36%|███▋      | 7250/20000 [9:19:40<32:36:08,  9.21s/it][2022-12-21 23:19:05,624] [INFO] [timer.py:197:stop] 0/1251, RunningAvgSamplesPerSec=10.950204379312419, CurrSamplesPerSec=10.50917246578393, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7251/20000 [9:19:50<32:48:15,  9.26s/it][2022-12-21 23:19:18,573] [INFO] [timer.py:197:stop] 0/1252, RunningAvgSamplesPerSec=10.95005352866578, CurrSamplesPerSec=10.76483066599434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7252/20000 [9:20:03<36:43:01, 10.37s/it][2022-12-21 23:19:27,631] [INFO] [timer.py:197:stop] 0/1253, RunningAvgSamplesPerSec=10.950201478134467, CurrSamplesPerSec=11.13831793531492, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7253/20000 [9:20:12<35:19:20,  9.98s/it][2022-12-21 23:19:36,621] [INFO] [timer.py:197:stop] 0/1254, RunningAvgSamplesPerSec=10.950120807100651, CurrSamplesPerSec=10.850123682752114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7254/20000 [9:20:21<34:16:20,  9.68s/it][2022-12-21 23:19:46,199] [INFO] [timer.py:197:stop] 0/1255, RunningAvgSamplesPerSec=10.950265910295455, CurrSamplesPerSec=11.135002409015838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7255/20000 [9:20:30<34:09:39,  9.65s/it][2022-12-21 23:19:56,631] [INFO] [timer.py:197:stop] 0/1256, RunningAvgSamplesPerSec=10.950090522649322, CurrSamplesPerSec=10.734656856870139, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7256/20000 [9:20:41<34:59:23,  9.88s/it][2022-12-21 23:20:05,597] [INFO] [timer.py:197:stop] 0/1257, RunningAvgSamplesPerSec=10.95007224366993, CurrSamplesPerSec=10.927198323784017, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7257/20000 [9:20:50<34:00:45,  9.61s/it][2022-12-21 23:20:15,234] [INFO] [timer.py:197:stop] 0/1258, RunningAvgSamplesPerSec=10.95011962504262, CurrSamplesPerSec=11.00990818276757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7258/20000 [9:20:59<34:02:21,  9.62s/it][2022-12-21 23:20:24,574] [INFO] [timer.py:197:stop] 0/1259, RunningAvgSamplesPerSec=10.950027276029214, CurrSamplesPerSec=10.83525364585978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7259/20000 [9:21:09<33:44:34,  9.53s/it][2022-12-21 23:20:33,752] [INFO] [logging.py:68:log_dist] [Rank 0] step=7260, skipped=16, lr=[6.5420512820512824e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:20:33,753] [INFO] [timer.py:197:stop] 0/1260, RunningAvgSamplesPerSec=10.950069496262277, CurrSamplesPerSec=11.003399002733476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7260/20000 [9:21:18<33:21:47,  9.43s/it][2022-12-21 23:20:43,009] [INFO] [timer.py:197:stop] 0/1261, RunningAvgSamplesPerSec=10.949975763282927, CurrSamplesPerSec=10.833316928111024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7261/20000 [9:21:27<33:10:40,  9.38s/it][2022-12-21 23:20:52,126] [INFO] [timer.py:197:stop] 0/1262, RunningAvgSamplesPerSec=10.950186416305211, CurrSamplesPerSec=11.22198677092483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7262/20000 [9:21:36<32:54:03,  9.30s/it][2022-12-21 23:21:01,044] [INFO] [timer.py:197:stop] 0/1263, RunningAvgSamplesPerSec=10.95039499262605, CurrSamplesPerSec=11.219668775092282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7263/20000 [9:21:45<32:29:37,  9.18s/it][2022-12-21 23:21:09,996] [INFO] [timer.py:197:stop] 0/1264, RunningAvgSamplesPerSec=10.950550775285144, CurrSamplesPerSec=11.150583949234491, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7264/20000 [9:21:54<32:14:42,  9.11s/it][2022-12-21 23:21:19,993] [INFO] [timer.py:197:stop] 0/1265, RunningAvgSamplesPerSec=10.950258392609463, CurrSamplesPerSec=10.593308983253614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7265/20000 [9:22:04<33:10:47,  9.38s/it][2022-12-21 23:21:28,710] [INFO] [timer.py:197:stop] 0/1266, RunningAvgSamplesPerSec=10.950477488470185, CurrSamplesPerSec=11.234375326309427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7266/20000 [9:22:13<32:28:27,  9.18s/it][2022-12-21 23:21:38,097] [INFO] [timer.py:197:stop] 0/1267, RunningAvgSamplesPerSec=10.949901030015878, CurrSamplesPerSec=10.266752522709703, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7267/20000 [9:22:22<32:41:22,  9.24s/it][2022-12-21 23:21:47,784] [INFO] [timer.py:197:stop] 0/1268, RunningAvgSamplesPerSec=10.949733998775908, CurrSamplesPerSec=10.742442695297445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7268/20000 [9:22:32<33:09:35,  9.38s/it][2022-12-21 23:21:57,089] [INFO] [timer.py:197:stop] 0/1269, RunningAvgSamplesPerSec=10.949869088969834, CurrSamplesPerSec=11.123609033249439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7269/20000 [9:22:41<33:04:52,  9.35s/it][2022-12-21 23:22:06,676] [INFO] [logging.py:68:log_dist] [Rank 0] step=7270, skipped=16, lr=[6.536923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:22:06,677] [INFO] [timer.py:197:stop] 0/1270, RunningAvgSamplesPerSec=10.949896216855588, CurrSamplesPerSec=10.984375562010456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7270/20000 [9:22:51<33:19:35,  9.42s/it][2022-12-21 23:22:16,191] [INFO] [timer.py:197:stop] 0/1271, RunningAvgSamplesPerSec=10.949600571797557, CurrSamplesPerSec=10.58714180825953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7271/20000 [9:23:00<33:25:07,  9.45s/it][2022-12-21 23:22:25,687] [INFO] [timer.py:197:stop] 0/1272, RunningAvgSamplesPerSec=10.949654334663515, CurrSamplesPerSec=11.018307512688672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7272/20000 [9:23:10<33:27:49,  9.46s/it][2022-12-21 23:22:35,958] [INFO] [timer.py:197:stop] 0/1273, RunningAvgSamplesPerSec=10.949648405803703, CurrSamplesPerSec=10.942123932208718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7273/20000 [9:23:20<34:18:54,  9.71s/it][2022-12-21 23:22:45,402] [INFO] [timer.py:197:stop] 0/1274, RunningAvgSamplesPerSec=10.949698379366207, CurrSamplesPerSec=11.013585662665031, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7274/20000 [9:23:29<34:02:04,  9.63s/it][2022-12-21 23:22:54,429] [INFO] [timer.py:197:stop] 0/1275, RunningAvgSamplesPerSec=10.949480344809968, CurrSamplesPerSec=10.678996865428239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7275/20000 [9:23:38<33:23:40,  9.45s/it]

                                                         
{'loss': 0.0689, 'learning_rate': 6.534358974358975e-06, 'epoch': 0.36}


 36%|███▋      | 7275/20000 [9:23:38<33:23:40,  9.45s/it][2022-12-21 23:23:03,736] [INFO] [timer.py:197:stop] 0/1276, RunningAvgSamplesPerSec=10.949639785689868, CurrSamplesPerSec=11.156444476880491, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7276/20000 [9:23:48<33:14:34,  9.41s/it][2022-12-21 23:23:12,761] [INFO] [timer.py:197:stop] 0/1277, RunningAvgSamplesPerSec=10.949580681048275, CurrSamplesPerSec=10.874796058674496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7277/20000 [9:23:57<32:50:18,  9.29s/it][2022-12-21 23:23:22,042] [INFO] [timer.py:197:stop] 0/1278, RunningAvgSamplesPerSec=10.949773582914434, CurrSamplesPerSec=11.201379373656868, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7278/20000 [9:24:06<32:49:23,  9.29s/it][2022-12-21 23:23:31,222] [INFO] [timer.py:197:stop] 0/1279, RunningAvgSamplesPerSec=10.949936349107528, CurrSamplesPerSec=11.16164467314755, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7279/20000 [9:24:15<32:42:21,  9.26s/it][2022-12-21 23:23:40,241] [INFO] [logging.py:68:log_dist] [Rank 0] step=7280, skipped=16, lr=[6.531794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:23:40,242] [INFO] [timer.py:197:stop] 0/1280, RunningAvgSamplesPerSec=10.9499332783701, CurrSamplesPerSec=10.94601335155688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7280/20000 [9:24:24<32:27:09,  9.18s/it][2022-12-21 23:23:49,352] [INFO] [timer.py:197:stop] 0/1281, RunningAvgSamplesPerSec=10.949783286462432, CurrSamplesPerSec=10.761394195812503, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7281/20000 [9:24:33<32:22:18,  9.16s/it][2022-12-21 23:23:58,943] [INFO] [timer.py:197:stop] 0/1282, RunningAvgSamplesPerSec=10.949818552591388, CurrSamplesPerSec=10.995110648263347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7282/20000 [9:24:43<32:49:22,  9.29s/it][2022-12-21 23:24:08,212] [INFO] [timer.py:197:stop] 0/1283, RunningAvgSamplesPerSec=10.9499350708498, CurrSamplesPerSec=11.1011395278553, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7283/20000 [9:24:52<32:47:50,  9.28s/it][2022-12-21 23:24:16,893] [INFO] [timer.py:197:stop] 0/1284, RunningAvgSamplesPerSec=10.950169380529202, CurrSamplesPerSec=11.258786051300651, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7284/20000 [9:25:01<32:09:18,  9.10s/it][2022-12-21 23:24:26,517] [INFO] [timer.py:197:stop] 0/1285, RunningAvgSamplesPerSec=10.949919259914607, CurrSamplesPerSec=10.638394363124934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7285/20000 [9:25:10<32:42:13,  9.26s/it][2022-12-21 23:24:35,805] [INFO] [timer.py:197:stop] 0/1286, RunningAvgSamplesPerSec=10.949963508901138, CurrSamplesPerSec=11.007031063077662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7286/20000 [9:25:20<32:43:53,  9.27s/it][2022-12-21 23:24:44,787] [INFO] [timer.py:197:stop] 0/1287, RunningAvgSamplesPerSec=10.949774809845703, CurrSamplesPerSec=10.7127343859373, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7287/20000 [9:25:29<32:25:34,  9.18s/it][2022-12-21 23:24:53,873] [INFO] [timer.py:197:stop] 0/1288, RunningAvgSamplesPerSec=10.950096766930907, CurrSamplesPerSec=11.38006942366841, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7288/20000 [9:25:38<32:19:18,  9.15s/it][2022-12-21 23:25:02,847] [INFO] [timer.py:197:stop] 0/1289, RunningAvgSamplesPerSec=10.950288773032476, CurrSamplesPerSec=11.202909433644612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7289/20000 [9:25:47<32:07:44,  9.10s/it][2022-12-21 23:25:12,989] [INFO] [logging.py:68:log_dist] [Rank 0] step=7290, skipped=16, lr=[6.526666666666666e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:25:12,990] [INFO] [timer.py:197:stop] 0/1290, RunningAvgSamplesPerSec=10.950197814800052, CurrSamplesPerSec=10.834373750568991, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7290/20000 [9:25:57<33:13:52,  9.41s/it][2022-12-21 23:25:25,378] [INFO] [timer.py:197:stop] 0/1291, RunningAvgSamplesPerSec=10.950267757976432, CurrSamplesPerSec=11.041102437614288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7291/20000 [9:26:09<36:22:49, 10.31s/it][2022-12-21 23:25:34,679] [INFO] [timer.py:197:stop] 0/1292, RunningAvgSamplesPerSec=10.950236868025906, CurrSamplesPerSec=10.910564091483645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7292/20000 [9:26:19<35:18:52, 10.00s/it][2022-12-21 23:25:45,723] [INFO] [timer.py:197:stop] 0/1293, RunningAvgSamplesPerSec=10.949940840767999, CurrSamplesPerSec=10.580944273420265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7293/20000 [9:26:30<36:24:45, 10.32s/it][2022-12-21 23:25:55,917] [INFO] [timer.py:197:stop] 0/1294, RunningAvgSamplesPerSec=10.949804363278586, CurrSamplesPerSec=10.776404253194869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7294/20000 [9:26:40<36:16:50, 10.28s/it][2022-12-21 23:26:04,603] [INFO] [timer.py:197:stop] 0/1295, RunningAvgSamplesPerSec=10.950109239130319, CurrSamplesPerSec=11.358718804198295, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7295/20000 [9:26:49<34:35:26,  9.80s/it][2022-12-21 23:26:13,997] [INFO] [timer.py:197:stop] 0/1296, RunningAvgSamplesPerSec=10.950137176395677, CurrSamplesPerSec=10.986379711737301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7296/20000 [9:26:58<34:09:23,  9.68s/it][2022-12-21 23:26:22,878] [INFO] [timer.py:197:stop] 0/1297, RunningAvgSamplesPerSec=10.950163198719025, CurrSamplesPerSec=10.983940032662677, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7297/20000 [9:27:07<33:18:30,  9.44s/it][2022-12-21 23:26:32,405] [INFO] [timer.py:197:stop] 0/1298, RunningAvgSamplesPerSec=10.950015131956855, CurrSamplesPerSec=10.761571079668364, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7298/20000 [9:27:16<33:23:54,  9.47s/it][2022-12-21 23:26:41,580] [INFO] [timer.py:197:stop] 0/1299, RunningAvgSamplesPerSec=10.950003103018055, CurrSamplesPerSec=10.934435778613928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7299/20000 [9:27:26<33:05:19,  9.38s/it][2022-12-21 23:26:52,080] [INFO] [logging.py:68:log_dist] [Rank 0] step=7300, skipped=16, lr=[6.521538461538463e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:26:52,081] [INFO] [timer.py:197:stop] 0/1300, RunningAvgSamplesPerSec=10.949936236016883, CurrSamplesPerSec=10.863891756832006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 36%|███▋      | 7300/20000 [9:27:36<34:16:25,  9.72s/it]

                                                         
{'loss': 0.0739, 'learning_rate': 6.521538461538463e-06, 'epoch': 0.36}


 36%|███▋      | 7300/20000 [9:27:36<34:16:25,  9.72s/it][2022-12-21 23:27:02,881] [INFO] [timer.py:197:stop] 0/1301, RunningAvgSamplesPerSec=10.95000200753322, CurrSamplesPerSec=11.036044782991935, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7301/20000 [9:27:47<35:25:10, 10.04s/it][2022-12-21 23:27:12,096] [INFO] [timer.py:197:stop] 0/1302, RunningAvgSamplesPerSec=10.949951780559708, CurrSamplesPerSec=10.885093693720215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7302/20000 [9:27:56<34:32:30,  9.79s/it][2022-12-21 23:27:21,831] [INFO] [timer.py:197:stop] 0/1303, RunningAvgSamplesPerSec=10.949997736529708, CurrSamplesPerSec=11.010068493350145, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7303/20000 [9:28:06<34:28:38,  9.78s/it][2022-12-21 23:27:33,091] [INFO] [timer.py:197:stop] 0/1304, RunningAvgSamplesPerSec=10.9501670569826, CurrSamplesPerSec=11.17497901325563, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7304/20000 [9:28:17<36:02:45, 10.22s/it][2022-12-21 23:27:41,901] [INFO] [timer.py:197:stop] 0/1305, RunningAvgSamplesPerSec=10.950381412683189, CurrSamplesPerSec=11.236777485142015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7305/20000 [9:28:26<34:33:01,  9.80s/it][2022-12-21 23:27:51,239] [INFO] [timer.py:197:stop] 0/1306, RunningAvgSamplesPerSec=10.950382377220748, CurrSamplesPerSec=10.951639314031619, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7306/20000 [9:28:35<34:03:40,  9.66s/it][2022-12-21 23:28:00,591] [INFO] [timer.py:197:stop] 0/1307, RunningAvgSamplesPerSec=10.950375664184168, CurrSamplesPerSec=10.941628862095765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7307/20000 [9:28:45<33:43:59,  9.57s/it][2022-12-21 23:28:10,195] [INFO] [timer.py:197:stop] 0/1308, RunningAvgSamplesPerSec=10.950528337763423, CurrSamplesPerSec=11.15346246622254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7308/20000 [9:28:54<33:46:08,  9.58s/it][2022-12-21 23:28:19,690] [INFO] [timer.py:197:stop] 0/1309, RunningAvgSamplesPerSec=10.950604694638956, CurrSamplesPerSec=11.051243950870946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7309/20000 [9:29:04<33:40:41,  9.55s/it][2022-12-21 23:28:29,072] [INFO] [logging.py:68:log_dist] [Rank 0] step=7310, skipped=16, lr=[6.516410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:28:29,073] [INFO] [timer.py:197:stop] 0/1310, RunningAvgSamplesPerSec=10.950318991191544, CurrSamplesPerSec=10.589227507431795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7310/20000 [9:29:13<33:29:44,  9.50s/it][2022-12-21 23:28:39,698] [INFO] [timer.py:197:stop] 0/1311, RunningAvgSamplesPerSec=10.950361802801599, CurrSamplesPerSec=11.006647440380164, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7311/20000 [9:29:24<34:40:48,  9.84s/it][2022-12-21 23:28:49,966] [INFO] [timer.py:197:stop] 0/1312, RunningAvgSamplesPerSec=10.950357716867186, CurrSamplesPerSec=10.945011841803003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7312/20000 [9:29:34<35:07:49,  9.97s/it][2022-12-21 23:28:59,110] [INFO] [timer.py:197:stop] 0/1313, RunningAvgSamplesPerSec=10.950513981134984, CurrSamplesPerSec=11.159122830873446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7313/20000 [9:29:43<34:15:25,  9.72s/it][2022-12-21 23:29:08,191] [INFO] [timer.py:197:stop] 0/1314, RunningAvgSamplesPerSec=10.950654686094559, CurrSamplesPerSec=11.138281886371585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7314/20000 [9:29:52<33:34:41,  9.53s/it][2022-12-21 23:29:17,457] [INFO] [timer.py:197:stop] 0/1315, RunningAvgSamplesPerSec=10.950737965359933, CurrSamplesPerSec=11.06110237593567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7315/20000 [9:30:01<33:17:51,  9.45s/it][2022-12-21 23:29:26,606] [INFO] [timer.py:197:stop] 0/1316, RunningAvgSamplesPerSec=10.950777160433192, CurrSamplesPerSec=11.002483470275802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7316/20000 [9:30:11<32:58:39,  9.36s/it][2022-12-21 23:29:36,286] [INFO] [timer.py:197:stop] 0/1317, RunningAvgSamplesPerSec=10.950860331490313, CurrSamplesPerSec=11.061249595404997, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7317/20000 [9:30:20<33:18:46,  9.46s/it][2022-12-21 23:29:46,678] [INFO] [timer.py:197:stop] 0/1318, RunningAvgSamplesPerSec=10.950837508182191, CurrSamplesPerSec=10.920906950214727, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7318/20000 [9:30:31<34:18:00,  9.74s/it][2022-12-21 23:29:55,806] [INFO] [timer.py:197:stop] 0/1319, RunningAvgSamplesPerSec=10.95091265485597, CurrSamplesPerSec=11.050707567656266, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7319/20000 [9:30:40<33:39:14,  9.55s/it][2022-12-21 23:30:05,232] [INFO] [logging.py:68:log_dist] [Rank 0] step=7320, skipped=16, lr=[6.511282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:30:05,233] [INFO] [timer.py:197:stop] 0/1320, RunningAvgSamplesPerSec=10.950970816370015, CurrSamplesPerSec=11.02810950172922, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7320/20000 [9:30:49<33:31:01,  9.52s/it][2022-12-21 23:30:15,524] [INFO] [timer.py:197:stop] 0/1321, RunningAvgSamplesPerSec=10.950904552772437, CurrSamplesPerSec=10.86426065601106, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7321/20000 [9:30:59<34:19:59,  9.75s/it][2022-12-21 23:30:24,704] [INFO] [timer.py:197:stop] 0/1322, RunningAvgSamplesPerSec=10.950887410496412, CurrSamplesPerSec=10.928323372461795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7322/20000 [9:31:09<33:43:48,  9.58s/it][2022-12-21 23:30:34,318] [INFO] [timer.py:197:stop] 0/1323, RunningAvgSamplesPerSec=10.951029231394793, CurrSamplesPerSec=11.141491156364328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7323/20000 [9:31:18<33:45:54,  9.59s/it][2022-12-21 23:30:46,392] [INFO] [timer.py:197:stop] 0/1324, RunningAvgSamplesPerSec=10.951188925701986, CurrSamplesPerSec=11.1662918369173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7324/20000 [9:31:30<36:23:20, 10.33s/it][2022-12-21 23:30:57,319] [INFO] [timer.py:197:stop] 0/1325, RunningAvgSamplesPerSec=10.951061459694312, CurrSamplesPerSec=10.785106963161148, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7325/20000 [9:31:41<37:00:40, 10.51s/it]

                                                         
{'loss': 0.0871, 'learning_rate': 6.50871794871795e-06, 'epoch': 0.37}


 37%|███▋      | 7325/20000 [9:31:41<37:00:40, 10.51s/it][2022-12-21 23:31:07,402] [INFO] [timer.py:197:stop] 0/1326, RunningAvgSamplesPerSec=10.950921850666965, CurrSamplesPerSec=10.76928498504214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7326/20000 [9:31:51<36:33:20, 10.38s/it][2022-12-21 23:31:16,291] [INFO] [timer.py:197:stop] 0/1327, RunningAvgSamplesPerSec=10.951065551576564, CurrSamplesPerSec=11.144692096928578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7327/20000 [9:32:00<34:58:27,  9.94s/it][2022-12-21 23:31:25,576] [INFO] [timer.py:197:stop] 0/1328, RunningAvgSamplesPerSec=10.951119616101474, CurrSamplesPerSec=11.023227150778117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7328/20000 [9:32:10<34:17:05,  9.74s/it][2022-12-21 23:31:34,834] [INFO] [timer.py:197:stop] 0/1329, RunningAvgSamplesPerSec=10.951072761470758, CurrSamplesPerSec=10.889294276273585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7329/20000 [9:32:19<33:46:25,  9.60s/it][2022-12-21 23:31:43,811] [INFO] [logging.py:68:log_dist] [Rank 0] step=7330, skipped=16, lr=[6.506153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:31:43,811] [INFO] [timer.py:197:stop] 0/1330, RunningAvgSamplesPerSec=10.951133348829687, CurrSamplesPerSec=11.032127855829955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7330/20000 [9:32:28<33:07:04,  9.41s/it][2022-12-21 23:31:53,352] [INFO] [timer.py:197:stop] 0/1331, RunningAvgSamplesPerSec=10.95133058560235, CurrSamplesPerSec=11.219684250237467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7331/20000 [9:32:37<33:15:11,  9.45s/it][2022-12-21 23:32:03,803] [INFO] [timer.py:197:stop] 0/1332, RunningAvgSamplesPerSec=10.951348931834152, CurrSamplesPerSec=10.975785520590557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7332/20000 [9:32:48<34:18:29,  9.75s/it][2022-12-21 23:32:12,722] [INFO] [timer.py:197:stop] 0/1333, RunningAvgSamplesPerSec=10.951546870746995, CurrSamplesPerSec=11.221294836612104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7333/20000 [9:32:57<33:25:41,  9.50s/it][2022-12-21 23:32:22,071] [INFO] [timer.py:197:stop] 0/1334, RunningAvgSamplesPerSec=10.951594495141379, CurrSamplesPerSec=11.015351870411244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7334/20000 [9:33:06<33:15:57,  9.46s/it][2022-12-21 23:32:33,252] [INFO] [timer.py:197:stop] 0/1335, RunningAvgSamplesPerSec=10.951701937195985, CurrSamplesPerSec=11.096711103041843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7335/20000 [9:33:17<35:05:05,  9.97s/it][2022-12-21 23:32:44,766] [INFO] [timer.py:197:stop] 0/1336, RunningAvgSamplesPerSec=10.951621145762978, CurrSamplesPerSec=10.844975672122928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7336/20000 [9:33:29<36:42:33, 10.44s/it][2022-12-21 23:32:54,319] [INFO] [timer.py:197:stop] 0/1337, RunningAvgSamplesPerSec=10.951486902640676, CurrSamplesPerSec=10.775289936032374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7337/20000 [9:33:38<35:46:28, 10.17s/it][2022-12-21 23:33:05,612] [INFO] [timer.py:197:stop] 0/1338, RunningAvgSamplesPerSec=10.951285191758931, CurrSamplesPerSec=10.688468474695805, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7338/20000 [9:33:50<36:57:22, 10.51s/it][2022-12-21 23:33:14,450] [INFO] [timer.py:197:stop] 0/1339, RunningAvgSamplesPerSec=10.951471532329181, CurrSamplesPerSec=11.206217811166189, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7339/20000 [9:33:58<35:11:33, 10.01s/it][2022-12-21 23:33:23,535] [INFO] [logging.py:68:log_dist] [Rank 0] step=7340, skipped=16, lr=[6.501025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:33:23,536] [INFO] [timer.py:197:stop] 0/1340, RunningAvgSamplesPerSec=10.951393576257411, CurrSamplesPerSec=10.848149642662513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7340/20000 [9:34:07<34:13:05,  9.73s/it][2022-12-21 23:33:33,815] [INFO] [timer.py:197:stop] 0/1341, RunningAvgSamplesPerSec=10.951532055431741, CurrSamplesPerSec=11.14000833813278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7341/20000 [9:34:18<34:47:40,  9.89s/it][2022-12-21 23:33:42,787] [INFO] [timer.py:197:stop] 0/1342, RunningAvgSamplesPerSec=10.951652366099015, CurrSamplesPerSec=11.115155230755796, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7342/20000 [9:34:27<33:49:05,  9.62s/it][2022-12-21 23:33:52,347] [INFO] [timer.py:197:stop] 0/1343, RunningAvgSamplesPerSec=10.951714084972107, CurrSamplesPerSec=11.035047144957977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7343/20000 [9:34:36<33:45:14,  9.60s/it][2022-12-21 23:34:01,972] [INFO] [timer.py:197:stop] 0/1344, RunningAvgSamplesPerSec=10.951729042740885, CurrSamplesPerSec=10.971824242983834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7344/20000 [9:34:46<33:46:37,  9.61s/it][2022-12-21 23:34:11,272] [INFO] [timer.py:197:stop] 0/1345, RunningAvgSamplesPerSec=10.95146331280524, CurrSamplesPerSec=10.606107837068082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7345/20000 [9:34:55<33:27:00,  9.52s/it][2022-12-21 23:34:20,223] [INFO] [timer.py:197:stop] 0/1346, RunningAvgSamplesPerSec=10.95134628769418, CurrSamplesPerSec=10.796406783672085, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7346/20000 [9:35:04<32:51:07,  9.35s/it][2022-12-21 23:34:29,758] [INFO] [timer.py:197:stop] 0/1347, RunningAvgSamplesPerSec=10.951237379349262, CurrSamplesPerSec=10.8067965772101, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7347/20000 [9:35:14<33:02:54,  9.40s/it][2022-12-21 23:34:38,807] [INFO] [timer.py:197:stop] 0/1348, RunningAvgSamplesPerSec=10.951414155641533, CurrSamplesPerSec=11.194458890923281, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7348/20000 [9:35:23<32:40:22,  9.30s/it][2022-12-21 23:34:49,060] [INFO] [timer.py:197:stop] 0/1349, RunningAvgSamplesPerSec=10.951261357262975, CurrSamplesPerSec=10.74938875932238, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7349/20000 [9:35:33<33:40:42,  9.58s/it][2022-12-21 23:34:59,433] [INFO] [logging.py:68:log_dist] [Rank 0] step=7350, skipped=16, lr=[6.4958974358974365e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:34:59,434] [INFO] [timer.py:197:stop] 0/1350, RunningAvgSamplesPerSec=10.95125248937185, CurrSamplesPerSec=10.939320464512504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7350/20000 [9:35:43<34:30:31,  9.82s/it]

                                                         
{'loss': 0.0785, 'learning_rate': 6.4958974358974365e-06, 'epoch': 0.37}


 37%|███▋      | 7350/20000 [9:35:43<34:30:31,  9.82s/it][2022-12-21 23:35:08,601] [INFO] [timer.py:197:stop] 0/1351, RunningAvgSamplesPerSec=10.951310876557493, CurrSamplesPerSec=11.030586974490618, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7351/20000 [9:35:53<33:49:02,  9.62s/it][2022-12-21 23:35:17,624] [INFO] [timer.py:197:stop] 0/1352, RunningAvgSamplesPerSec=10.951114395835548, CurrSamplesPerSec=10.6923299676062, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7352/20000 [9:36:02<33:10:47,  9.44s/it][2022-12-21 23:35:26,890] [INFO] [timer.py:197:stop] 0/1353, RunningAvgSamplesPerSec=10.95113447534576, CurrSamplesPerSec=10.978309129372713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7353/20000 [9:36:11<32:59:21,  9.39s/it][2022-12-21 23:35:35,772] [INFO] [timer.py:197:stop] 0/1354, RunningAvgSamplesPerSec=10.951099658561208, CurrSamplesPerSec=10.904263503526376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7354/20000 [9:36:20<32:27:06,  9.24s/it][2022-12-21 23:35:45,689] [INFO] [timer.py:197:stop] 0/1355, RunningAvgSamplesPerSec=10.951169594449425, CurrSamplesPerSec=11.046547021149244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7355/20000 [9:36:30<33:09:51,  9.44s/it][2022-12-21 23:35:54,495] [INFO] [timer.py:197:stop] 0/1356, RunningAvgSamplesPerSec=10.95132028218101, CurrSamplesPerSec=11.15907133870134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7356/20000 [9:36:38<32:29:30,  9.25s/it][2022-12-21 23:36:03,301] [INFO] [timer.py:197:stop] 0/1357, RunningAvgSamplesPerSec=10.95137674187822, CurrSamplesPerSec=11.02836095954938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7357/20000 [9:36:47<32:01:12,  9.12s/it][2022-12-21 23:36:13,094] [INFO] [timer.py:197:stop] 0/1358, RunningAvgSamplesPerSec=10.951275264108416, CurrSamplesPerSec=10.815479177271541, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7358/20000 [9:36:57<32:43:43,  9.32s/it][2022-12-21 23:36:22,821] [INFO] [timer.py:197:stop] 0/1359, RunningAvgSamplesPerSec=10.9514399035193, CurrSamplesPerSec=11.17934024284117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7359/20000 [9:37:07<33:09:19,  9.44s/it][2022-12-21 23:36:32,980] [INFO] [logging.py:68:log_dist] [Rank 0] step=7360, skipped=16, lr=[6.4907692307692314e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:36:32,981] [INFO] [timer.py:197:stop] 0/1360, RunningAvgSamplesPerSec=10.951105098067462, CurrSamplesPerSec=10.514884999234795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7360/20000 [9:37:17<33:54:31,  9.66s/it][2022-12-21 23:36:43,426] [INFO] [timer.py:197:stop] 0/1361, RunningAvgSamplesPerSec=10.95112503725404, CurrSamplesPerSec=10.978269618907646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7361/20000 [9:37:27<34:44:09,  9.89s/it][2022-12-21 23:36:53,110] [INFO] [timer.py:197:stop] 0/1362, RunningAvgSamplesPerSec=10.95116296302037, CurrSamplesPerSec=11.002947982482047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7362/20000 [9:37:37<34:30:42,  9.83s/it][2022-12-21 23:37:02,347] [INFO] [timer.py:197:stop] 0/1363, RunningAvgSamplesPerSec=10.950867358364619, CurrSamplesPerSec=10.563091318730464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7363/20000 [9:37:46<33:52:59,  9.65s/it][2022-12-21 23:37:11,480] [INFO] [timer.py:197:stop] 0/1364, RunningAvgSamplesPerSec=10.951083672822046, CurrSamplesPerSec=11.253627065070702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7364/20000 [9:37:55<33:20:00,  9.50s/it][2022-12-21 23:37:20,691] [INFO] [timer.py:197:stop] 0/1365, RunningAvgSamplesPerSec=10.951157190629203, CurrSamplesPerSec=11.05221312127086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7365/20000 [9:38:05<33:01:49,  9.41s/it][2022-12-21 23:37:30,025] [INFO] [timer.py:197:stop] 0/1366, RunningAvgSamplesPerSec=10.95113175780901, CurrSamplesPerSec=10.916576286724151, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7366/20000 [9:38:14<32:56:48,  9.39s/it][2022-12-21 23:37:39,720] [INFO] [timer.py:197:stop] 0/1367, RunningAvgSamplesPerSec=10.951110541969031, CurrSamplesPerSec=10.922248460457304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7367/20000 [9:38:24<33:16:01,  9.48s/it][2022-12-21 23:37:48,910] [INFO] [timer.py:197:stop] 0/1368, RunningAvgSamplesPerSec=10.950945742991014, CurrSamplesPerSec=10.730526237608109, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7368/20000 [9:38:33<32:57:30,  9.39s/it][2022-12-21 23:37:58,174] [INFO] [timer.py:197:stop] 0/1369, RunningAvgSamplesPerSec=10.950975717853183, CurrSamplesPerSec=10.992075162759706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7369/20000 [9:38:42<32:49:15,  9.35s/it][2022-12-21 23:38:09,009] [INFO] [logging.py:68:log_dist] [Rank 0] step=7370, skipped=16, lr=[6.485641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:38:09,010] [INFO] [timer.py:197:stop] 0/1370, RunningAvgSamplesPerSec=10.951028040996736, CurrSamplesPerSec=11.023024360253185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7370/20000 [9:38:53<34:22:37,  9.80s/it][2022-12-21 23:38:19,082] [INFO] [timer.py:197:stop] 0/1371, RunningAvgSamplesPerSec=10.951166103295428, CurrSamplesPerSec=11.143352288782596, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7371/20000 [9:39:03<34:39:44,  9.88s/it][2022-12-21 23:38:29,245] [INFO] [timer.py:197:stop] 0/1372, RunningAvgSamplesPerSec=10.950912887341515, CurrSamplesPerSec=10.614904410068402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7372/20000 [9:39:13<34:57:23,  9.97s/it][2022-12-21 23:38:38,637] [INFO] [timer.py:197:stop] 0/1373, RunningAvgSamplesPerSec=10.95081858462408, CurrSamplesPerSec=10.823131379572644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7373/20000 [9:39:23<34:21:00,  9.79s/it][2022-12-21 23:38:48,141] [INFO] [timer.py:197:stop] 0/1374, RunningAvgSamplesPerSec=10.950675873106826, CurrSamplesPerSec=10.75845532353965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7374/20000 [9:39:32<34:02:35,  9.71s/it][2022-12-21 23:38:57,380] [INFO] [timer.py:197:stop] 0/1375, RunningAvgSamplesPerSec=10.950794765691112, CurrSamplesPerSec=11.116383766392637, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7375/20000 [9:39:41<33:32:57,  9.57s/it]

                                                         
{'loss': 0.073, 'learning_rate': 6.483076923076924e-06, 'epoch': 0.37}


 37%|███▋      | 7375/20000 [9:39:41<33:32:57,  9.57s/it][2022-12-21 23:39:06,641] [INFO] [timer.py:197:stop] 0/1376, RunningAvgSamplesPerSec=10.950812569286121, CurrSamplesPerSec=10.975311631717192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7376/20000 [9:39:51<33:13:26,  9.47s/it][2022-12-21 23:39:16,432] [INFO] [timer.py:197:stop] 0/1377, RunningAvgSamplesPerSec=10.950864594027163, CurrSamplesPerSec=11.022816598234858, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7377/20000 [9:40:00<33:33:15,  9.57s/it][2022-12-21 23:39:25,793] [INFO] [timer.py:197:stop] 0/1378, RunningAvgSamplesPerSec=10.950966384665332, CurrSamplesPerSec=11.09274183384094, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7378/20000 [9:40:10<33:19:59,  9.51s/it][2022-12-21 23:39:34,781] [INFO] [timer.py:197:stop] 0/1379, RunningAvgSamplesPerSec=10.951030169188236, CurrSamplesPerSec=11.039507291754187, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7379/20000 [9:40:19<32:47:04,  9.35s/it][2022-12-21 23:39:45,765] [INFO] [logging.py:68:log_dist] [Rank 0] step=7380, skipped=16, lr=[6.480512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:39:45,766] [INFO] [timer.py:197:stop] 0/1380, RunningAvgSamplesPerSec=10.951022033705328, CurrSamplesPerSec=10.939830930209878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7380/20000 [9:40:30<34:29:59,  9.84s/it][2022-12-21 23:39:55,203] [INFO] [timer.py:197:stop] 0/1381, RunningAvgSamplesPerSec=10.950873258411281, CurrSamplesPerSec=10.749631110897713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7381/20000 [9:40:39<34:04:16,  9.72s/it][2022-12-21 23:40:04,507] [INFO] [timer.py:197:stop] 0/1382, RunningAvgSamplesPerSec=10.950703136397275, CurrSamplesPerSec=10.721028788869878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7382/20000 [9:40:48<33:37:54,  9.60s/it][2022-12-21 23:40:13,717] [INFO] [timer.py:197:stop] 0/1383, RunningAvgSamplesPerSec=10.950743491425182, CurrSamplesPerSec=11.006718295735567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7383/20000 [9:40:58<33:13:24,  9.48s/it][2022-12-21 23:40:23,206] [INFO] [timer.py:197:stop] 0/1384, RunningAvgSamplesPerSec=10.950781150605591, CurrSamplesPerSec=11.003036830547085, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7384/20000 [9:41:07<33:13:51,  9.48s/it][2022-12-21 23:40:32,598] [INFO] [timer.py:197:stop] 0/1385, RunningAvgSamplesPerSec=10.950735508466924, CurrSamplesPerSec=10.888019584814014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7385/20000 [9:41:17<33:07:58,  9.46s/it][2022-12-21 23:40:41,473] [INFO] [timer.py:197:stop] 0/1386, RunningAvgSamplesPerSec=10.950723847616704, CurrSamplesPerSec=10.934620623872949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7386/20000 [9:41:25<32:31:14,  9.28s/it][2022-12-21 23:40:50,826] [INFO] [timer.py:197:stop] 0/1387, RunningAvgSamplesPerSec=10.950669044225265, CurrSamplesPerSec=10.875343258325659, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7387/20000 [9:41:35<32:35:36,  9.30s/it][2022-12-21 23:41:00,480] [INFO] [timer.py:197:stop] 0/1388, RunningAvgSamplesPerSec=10.95038547027797, CurrSamplesPerSec=10.571243784750491, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7388/20000 [9:41:44<32:57:34,  9.41s/it][2022-12-21 23:41:11,106] [INFO] [timer.py:197:stop] 0/1389, RunningAvgSamplesPerSec=10.950564632883353, CurrSamplesPerSec=11.204649899895669, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7389/20000 [9:41:55<34:14:11,  9.77s/it][2022-12-21 23:41:20,368] [INFO] [logging.py:68:log_dist] [Rank 0] step=7390, skipped=16, lr=[6.475384615384615e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:41:20,369] [INFO] [timer.py:197:stop] 0/1390, RunningAvgSamplesPerSec=10.950624543746784, CurrSamplesPerSec=11.034356752580369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7390/20000 [9:42:04<33:41:51,  9.62s/it][2022-12-21 23:41:30,502] [INFO] [timer.py:197:stop] 0/1391, RunningAvgSamplesPerSec=10.950501601986375, CurrSamplesPerSec=10.782478649575722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7391/20000 [9:42:14<34:14:03,  9.77s/it][2022-12-21 23:41:39,426] [INFO] [timer.py:197:stop] 0/1392, RunningAvgSamplesPerSec=10.950717996900726, CurrSamplesPerSec=11.259779687297153, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7392/20000 [9:42:23<33:20:16,  9.52s/it][2022-12-21 23:41:48,680] [INFO] [timer.py:197:stop] 0/1393, RunningAvgSamplesPerSec=10.950766347126184, CurrSamplesPerSec=11.018388468144297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7393/20000 [9:42:33<33:03:25,  9.44s/it][2022-12-21 23:41:59,861] [INFO] [timer.py:197:stop] 0/1394, RunningAvgSamplesPerSec=10.950800463649106, CurrSamplesPerSec=10.998463245626711, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7394/20000 [9:42:44<34:53:00,  9.96s/it][2022-12-21 23:42:09,082] [INFO] [timer.py:197:stop] 0/1395, RunningAvgSamplesPerSec=10.95047098426001, CurrSamplesPerSec=10.510285093372566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7395/20000 [9:42:53<34:06:09,  9.74s/it][2022-12-21 23:42:18,522] [INFO] [timer.py:197:stop] 0/1396, RunningAvgSamplesPerSec=10.9504679467385, CurrSamplesPerSec=10.946238314782509, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7396/20000 [9:43:02<33:47:06,  9.65s/it][2022-12-21 23:42:28,335] [INFO] [timer.py:197:stop] 0/1397, RunningAvgSamplesPerSec=10.950530885446353, CurrSamplesPerSec=11.038976586807781, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7397/20000 [9:43:12<33:57:14,  9.70s/it][2022-12-21 23:42:37,406] [INFO] [timer.py:197:stop] 0/1398, RunningAvgSamplesPerSec=10.950532534399825, CurrSamplesPerSec=10.9528333081446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7398/20000 [9:43:21<33:17:30,  9.51s/it][2022-12-21 23:42:47,068] [INFO] [timer.py:197:stop] 0/1399, RunningAvgSamplesPerSec=10.950273443663324, CurrSamplesPerSec=10.600155553716261, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7399/20000 [9:43:31<33:26:52,  9.56s/it][2022-12-21 23:42:57,869] [INFO] [logging.py:68:log_dist] [Rank 0] step=7400, skipped=16, lr=[6.47025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:42:57,870] [INFO] [timer.py:197:stop] 0/1400, RunningAvgSamplesPerSec=10.950097758165429, CurrSamplesPerSec=10.71004935148524, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7400/20000 [9:43:42<34:45:14,  9.93s/it]

                                                         
{'loss': 0.0762, 'learning_rate': 6.47025641025641e-06, 'epoch': 0.37}


 37%|███▋      | 7400/20000 [9:43:42<34:45:14,  9.93s/it][2022-12-21 23:43:06,983] [INFO] [timer.py:197:stop] 0/1401, RunningAvgSamplesPerSec=10.95015341672428, CurrSamplesPerSec=11.028521354851557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7401/20000 [9:43:51<33:53:36,  9.68s/it][2022-12-21 23:43:17,336] [INFO] [timer.py:197:stop] 0/1402, RunningAvgSamplesPerSec=10.949853311934023, CurrSamplesPerSec=10.545520973032882, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7402/20000 [9:44:01<34:35:34,  9.89s/it][2022-12-21 23:43:26,495] [INFO] [timer.py:197:stop] 0/1403, RunningAvgSamplesPerSec=10.949887598644692, CurrSamplesPerSec=10.998100497069787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7403/20000 [9:44:10<33:49:38,  9.67s/it][2022-12-21 23:43:35,811] [INFO] [timer.py:197:stop] 0/1404, RunningAvgSamplesPerSec=10.949779515096, CurrSamplesPerSec=10.80042141830152, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7404/20000 [9:44:20<33:27:22,  9.56s/it][2022-12-21 23:43:44,824] [INFO] [timer.py:197:stop] 0/1405, RunningAvgSamplesPerSec=10.949862388641467, CurrSamplesPerSec=11.067298095488766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7405/20000 [9:44:29<32:52:36,  9.40s/it][2022-12-21 23:43:53,979] [INFO] [timer.py:197:stop] 0/1406, RunningAvgSamplesPerSec=10.94988629348756, CurrSamplesPerSec=10.983527907180662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7406/20000 [9:44:38<32:37:11,  9.32s/it][2022-12-21 23:44:03,433] [INFO] [timer.py:197:stop] 0/1407, RunningAvgSamplesPerSec=10.949662369888035, CurrSamplesPerSec=10.644054554121794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7407/20000 [9:44:47<32:45:13,  9.36s/it][2022-12-21 23:44:12,478] [INFO] [timer.py:197:stop] 0/1408, RunningAvgSamplesPerSec=10.949617512971733, CurrSamplesPerSec=10.88695447907369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7408/20000 [9:44:56<32:25:01,  9.27s/it][2022-12-21 23:44:22,371] [INFO] [timer.py:197:stop] 0/1409, RunningAvgSamplesPerSec=10.949606131382868, CurrSamplesPerSec=10.933626987079007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7409/20000 [9:45:06<33:04:12,  9.46s/it][2022-12-21 23:44:31,650] [INFO] [logging.py:68:log_dist] [Rank 0] step=7410, skipped=16, lr=[6.465128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:44:31,651] [INFO] [timer.py:197:stop] 0/1410, RunningAvgSamplesPerSec=10.949658068167265, CurrSamplesPerSec=11.023224434784291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7410/20000 [9:45:16<32:53:00,  9.40s/it][2022-12-21 23:44:41,140] [INFO] [timer.py:197:stop] 0/1411, RunningAvgSamplesPerSec=10.949625865550727, CurrSamplesPerSec=10.904471693086004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7411/20000 [9:45:25<32:58:16,  9.43s/it][2022-12-21 23:44:50,942] [INFO] [timer.py:197:stop] 0/1412, RunningAvgSamplesPerSec=10.949762990250193, CurrSamplesPerSec=11.146444604338534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7412/20000 [9:45:35<33:21:39,  9.54s/it][2022-12-21 23:45:00,218] [INFO] [timer.py:197:stop] 0/1413, RunningAvgSamplesPerSec=10.949634328408793, CurrSamplesPerSec=10.771179856990946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7413/20000 [9:45:44<33:04:49,  9.46s/it][2022-12-21 23:45:09,794] [INFO] [timer.py:197:stop] 0/1414, RunningAvgSamplesPerSec=10.949608814278179, CurrSamplesPerSec=10.913726434709327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7414/20000 [9:45:54<33:11:54,  9.50s/it][2022-12-21 23:45:19,764] [INFO] [timer.py:197:stop] 0/1415, RunningAvgSamplesPerSec=10.94957724877221, CurrSamplesPerSec=10.905187571466973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7415/20000 [9:46:04<33:41:32,  9.64s/it][2022-12-21 23:45:28,993] [INFO] [timer.py:197:stop] 0/1416, RunningAvgSamplesPerSec=10.949677116355735, CurrSamplesPerSec=11.09263365415902, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7416/20000 [9:46:13<33:15:41,  9.52s/it][2022-12-21 23:45:37,888] [INFO] [timer.py:197:stop] 0/1417, RunningAvgSamplesPerSec=10.949763673234333, CurrSamplesPerSec=11.073539588306023, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7417/20000 [9:46:22<32:36:28,  9.33s/it][2022-12-21 23:45:47,554] [INFO] [timer.py:197:stop] 0/1418, RunningAvgSamplesPerSec=10.949574841474305, CurrSamplesPerSec=10.68874724320302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7418/20000 [9:46:32<32:57:32,  9.43s/it][2022-12-21 23:45:56,840] [INFO] [timer.py:197:stop] 0/1419, RunningAvgSamplesPerSec=10.94958499511088, CurrSamplesPerSec=10.963981461392278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7419/20000 [9:46:41<32:48:18,  9.39s/it][2022-12-21 23:46:05,931] [INFO] [logging.py:68:log_dist] [Rank 0] step=7420, skipped=16, lr=[6.460000000000001e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:46:05,932] [INFO] [timer.py:197:stop] 0/1420, RunningAvgSamplesPerSec=10.949318506468384, CurrSamplesPerSec=10.584301500769271, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7420/20000 [9:46:50<32:29:34,  9.30s/it][2022-12-21 23:46:15,876] [INFO] [timer.py:197:stop] 0/1421, RunningAvgSamplesPerSec=10.94933193811579, CurrSamplesPerSec=10.968411225462443, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7421/20000 [9:47:00<33:10:01,  9.49s/it][2022-12-21 23:46:25,226] [INFO] [timer.py:197:stop] 0/1422, RunningAvgSamplesPerSec=10.949381153106447, CurrSamplesPerSec=11.019665822279306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7422/20000 [9:47:09<33:00:56,  9.45s/it][2022-12-21 23:46:34,431] [INFO] [timer.py:197:stop] 0/1423, RunningAvgSamplesPerSec=10.949349956994237, CurrSamplesPerSec=10.90523010185334, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7423/20000 [9:47:18<32:45:24,  9.38s/it][2022-12-21 23:46:44,171] [INFO] [timer.py:197:stop] 0/1424, RunningAvgSamplesPerSec=10.949433890181028, CurrSamplesPerSec=11.07001735420787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7424/20000 [9:47:28<33:08:07,  9.49s/it][2022-12-21 23:46:53,419] [INFO] [timer.py:197:stop] 0/1425, RunningAvgSamplesPerSec=10.949248260347956, CurrSamplesPerSec=10.691500809981324, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7425/20000 [9:47:37<32:52:59,  9.41s/it]

                                                         
{'loss': 0.0977, 'learning_rate': 6.457435897435898e-06, 'epoch': 0.37}


 37%|███▋      | 7425/20000 [9:47:37<32:52:59,  9.41s/it][2022-12-21 23:47:02,684] [INFO] [timer.py:197:stop] 0/1426, RunningAvgSamplesPerSec=10.94935525705447, CurrSamplesPerSec=11.10376015736798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7426/20000 [9:47:47<32:43:31,  9.37s/it][2022-12-21 23:47:11,740] [INFO] [timer.py:197:stop] 0/1427, RunningAvgSamplesPerSec=10.949307773365247, CurrSamplesPerSec=10.882106289946883, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7427/20000 [9:47:56<32:23:38,  9.28s/it][2022-12-21 23:47:21,287] [INFO] [timer.py:197:stop] 0/1428, RunningAvgSamplesPerSec=10.949192340025261, CurrSamplesPerSec=10.787136150517735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7428/20000 [9:48:05<32:40:33,  9.36s/it][2022-12-21 23:47:31,178] [INFO] [timer.py:197:stop] 0/1429, RunningAvgSamplesPerSec=10.949050645416522, CurrSamplesPerSec=10.750657890204945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7429/20000 [9:48:15<33:13:59,  9.52s/it][2022-12-21 23:47:40,271] [INFO] [logging.py:68:log_dist] [Rank 0] step=7430, skipped=16, lr=[6.454871794871796e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:47:40,272] [INFO] [timer.py:197:stop] 0/1430, RunningAvgSamplesPerSec=10.949213906510394, CurrSamplesPerSec=11.187256014377143, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7430/20000 [9:48:24<32:47:13,  9.39s/it][2022-12-21 23:47:49,100] [INFO] [timer.py:197:stop] 0/1431, RunningAvgSamplesPerSec=10.949348616592076, CurrSamplesPerSec=11.145157126374121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7431/20000 [9:48:33<32:11:45,  9.22s/it][2022-12-21 23:47:59,015] [INFO] [timer.py:197:stop] 0/1432, RunningAvgSamplesPerSec=10.949136416307956, CurrSamplesPerSec=10.654079473380147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7432/20000 [9:48:43<32:55:12,  9.43s/it][2022-12-21 23:48:09,347] [INFO] [timer.py:197:stop] 0/1433, RunningAvgSamplesPerSec=10.949211700813148, CurrSamplesPerSec=11.05793833270128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7433/20000 [9:48:53<33:51:44,  9.70s/it][2022-12-21 23:48:18,879] [INFO] [timer.py:197:stop] 0/1434, RunningAvgSamplesPerSec=10.949179235013203, CurrSamplesPerSec=10.902917107711426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7434/20000 [9:49:03<33:41:00,  9.65s/it][2022-12-21 23:48:28,905] [INFO] [timer.py:197:stop] 0/1435, RunningAvgSamplesPerSec=10.949086373560606, CurrSamplesPerSec=10.817705519533092, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7435/20000 [9:49:13<34:04:26,  9.76s/it][2022-12-21 23:48:37,791] [INFO] [timer.py:197:stop] 0/1436, RunningAvgSamplesPerSec=10.949138268168799, CurrSamplesPerSec=11.024012129082672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7436/20000 [9:49:22<33:09:13,  9.50s/it][2022-12-21 23:48:46,568] [INFO] [timer.py:197:stop] 0/1437, RunningAvgSamplesPerSec=10.94927081852314, CurrSamplesPerSec=11.142708407229467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7437/20000 [9:49:31<32:23:40,  9.28s/it][2022-12-21 23:48:55,901] [INFO] [timer.py:197:stop] 0/1438, RunningAvgSamplesPerSec=10.949375262721977, CurrSamplesPerSec=11.101334184268064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7438/20000 [9:49:40<32:26:38,  9.30s/it][2022-12-21 23:49:05,191] [INFO] [timer.py:197:stop] 0/1439, RunningAvgSamplesPerSec=10.949470558551235, CurrSamplesPerSec=11.088048501409016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7439/20000 [9:49:49<32:25:59,  9.30s/it][2022-12-21 23:49:14,127] [INFO] [logging.py:68:log_dist] [Rank 0] step=7440, skipped=16, lr=[6.44974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:49:14,128] [INFO] [timer.py:197:stop] 0/1440, RunningAvgSamplesPerSec=10.94959738381987, CurrSamplesPerSec=11.134932201824103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7440/20000 [9:49:58<32:03:21,  9.19s/it][2022-12-21 23:49:23,595] [INFO] [timer.py:197:stop] 0/1441, RunningAvgSamplesPerSec=10.949404265436941, CurrSamplesPerSec=10.678573745802282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7441/20000 [9:50:08<32:20:44,  9.27s/it][2022-12-21 23:49:32,775] [INFO] [timer.py:197:stop] 0/1442, RunningAvgSamplesPerSec=10.949331344885252, CurrSamplesPerSec=10.845395430724107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7442/20000 [9:50:17<32:14:47,  9.24s/it][2022-12-21 23:49:42,039] [INFO] [timer.py:197:stop] 0/1443, RunningAvgSamplesPerSec=10.949299356404483, CurrSamplesPerSec=10.903429053256094, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7443/20000 [9:50:26<32:15:52,  9.25s/it][2022-12-21 23:49:51,261] [INFO] [timer.py:197:stop] 0/1444, RunningAvgSamplesPerSec=10.949109443001872, CurrSamplesPerSec=10.682122021712166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7444/20000 [9:50:35<32:14:00,  9.24s/it][2022-12-21 23:50:01,428] [INFO] [timer.py:197:stop] 0/1445, RunningAvgSamplesPerSec=10.94923631585437, CurrSamplesPerSec=11.135298027956111, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7445/20000 [9:50:45<33:11:52,  9.52s/it][2022-12-21 23:50:10,624] [INFO] [timer.py:197:stop] 0/1446, RunningAvgSamplesPerSec=10.949112425343804, CurrSamplesPerSec=10.77321245384214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7446/20000 [9:50:55<32:51:26,  9.42s/it][2022-12-21 23:50:19,905] [INFO] [timer.py:197:stop] 0/1447, RunningAvgSamplesPerSec=10.949242140852618, CurrSamplesPerSec=11.139813709979727, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7447/20000 [9:51:04<32:42:25,  9.38s/it][2022-12-21 23:50:29,814] [INFO] [timer.py:197:stop] 0/1448, RunningAvgSamplesPerSec=10.949112179660172, CurrSamplesPerSec=10.764487049714695, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7448/20000 [9:51:14<33:15:29,  9.54s/it][2022-12-21 23:50:38,930] [INFO] [timer.py:197:stop] 0/1449, RunningAvgSamplesPerSec=10.949278826136155, CurrSamplesPerSec=11.195676070292885, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7449/20000 [9:51:23<32:48:48,  9.41s/it][2022-12-21 23:50:48,372] [INFO] [logging.py:68:log_dist] [Rank 0] step=7450, skipped=16, lr=[6.444615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:50:48,373] [INFO] [timer.py:197:stop] 0/1450, RunningAvgSamplesPerSec=10.949418362077614, CurrSamplesPerSec=11.15512270198567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7450/20000 [9:51:32<32:50:34,  9.42s/it]

                                                         
{'loss': 0.0786, 'learning_rate': 6.444615384615385e-06, 'epoch': 0.37}


 37%|███▋      | 7450/20000 [9:51:32<32:50:34,  9.42s/it][2022-12-21 23:50:58,743] [INFO] [timer.py:197:stop] 0/1451, RunningAvgSamplesPerSec=10.949395490204305, CurrSamplesPerSec=10.91637695728698, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7451/20000 [9:51:43<33:50:00,  9.71s/it][2022-12-21 23:51:08,831] [INFO] [timer.py:197:stop] 0/1452, RunningAvgSamplesPerSec=10.949534667169788, CurrSamplesPerSec=11.154988733869063, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7452/20000 [9:51:53<34:13:47,  9.82s/it][2022-12-21 23:51:17,862] [INFO] [timer.py:197:stop] 0/1453, RunningAvgSamplesPerSec=10.949403268367066, CurrSamplesPerSec=10.762135852655511, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7453/20000 [9:52:02<33:24:07,  9.58s/it][2022-12-21 23:51:27,786] [INFO] [timer.py:197:stop] 0/1454, RunningAvgSamplesPerSec=10.949423396746433, CurrSamplesPerSec=10.97870784179874, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7454/20000 [9:52:12<33:45:15,  9.69s/it][2022-12-21 23:51:37,672] [INFO] [timer.py:197:stop] 0/1455, RunningAvgSamplesPerSec=10.949171197212488, CurrSamplesPerSec=10.594836323111194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7455/20000 [9:52:22<33:57:43,  9.75s/it][2022-12-21 23:51:47,193] [INFO] [timer.py:197:stop] 0/1456, RunningAvgSamplesPerSec=10.94893535519075, CurrSamplesPerSec=10.616663460467565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7456/20000 [9:52:31<33:43:25,  9.68s/it][2022-12-21 23:51:56,423] [INFO] [timer.py:197:stop] 0/1457, RunningAvgSamplesPerSec=10.94910007171364, CurrSamplesPerSec=11.193957529212724, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7457/20000 [9:52:40<33:15:07,  9.54s/it][2022-12-21 23:52:05,982] [INFO] [timer.py:197:stop] 0/1458, RunningAvgSamplesPerSec=10.949140767029334, CurrSamplesPerSec=11.008674624837916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7458/20000 [9:52:50<33:15:56,  9.55s/it][2022-12-21 23:52:14,982] [INFO] [timer.py:197:stop] 0/1459, RunningAvgSamplesPerSec=10.949277553957396, CurrSamplesPerSec=11.152131668173848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7459/20000 [9:52:59<32:41:22,  9.38s/it][2022-12-21 23:52:23,923] [INFO] [logging.py:68:log_dist] [Rank 0] step=7460, skipped=16, lr=[6.4394871794871804e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:52:23,924] [INFO] [timer.py:197:stop] 0/1460, RunningAvgSamplesPerSec=10.949373233143348, CurrSamplesPerSec=11.090576808171832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7460/20000 [9:53:08<32:13:31,  9.25s/it][2022-12-21 23:52:33,262] [INFO] [timer.py:197:stop] 0/1461, RunningAvgSamplesPerSec=10.94960778885746, CurrSamplesPerSec=11.302623087476348, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7461/20000 [9:53:17<32:18:47,  9.28s/it][2022-12-21 23:52:43,459] [INFO] [timer.py:197:stop] 0/1462, RunningAvgSamplesPerSec=10.949362053136664, CurrSamplesPerSec=10.602208696580853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7462/20000 [9:53:27<33:16:17,  9.55s/it][2022-12-21 23:52:52,630] [INFO] [timer.py:197:stop] 0/1463, RunningAvgSamplesPerSec=10.949152530760722, CurrSamplesPerSec=10.651569571691645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7463/20000 [9:53:37<32:52:11,  9.44s/it][2022-12-21 23:53:03,074] [INFO] [timer.py:197:stop] 0/1464, RunningAvgSamplesPerSec=10.949269693062469, CurrSamplesPerSec=11.123164236606687, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7464/20000 [9:53:47<33:55:04,  9.74s/it][2022-12-21 23:53:15,027] [INFO] [timer.py:197:stop] 0/1465, RunningAvgSamplesPerSec=10.949507543599957, CurrSamplesPerSec=11.308658857729448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7465/20000 [9:53:59<36:13:33, 10.40s/it][2022-12-21 23:53:24,916] [INFO] [timer.py:197:stop] 0/1466, RunningAvgSamplesPerSec=10.949500928353942, CurrSamplesPerSec=10.93983137605227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7466/20000 [9:54:09<35:41:06, 10.25s/it][2022-12-21 23:53:34,320] [INFO] [timer.py:197:stop] 0/1467, RunningAvgSamplesPerSec=10.949385250610524, CurrSamplesPerSec=10.782614214436665, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7467/20000 [9:54:18<34:47:58, 10.00s/it][2022-12-21 23:53:43,811] [INFO] [timer.py:197:stop] 0/1468, RunningAvgSamplesPerSec=10.949415904857089, CurrSamplesPerSec=10.994509451203154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7468/20000 [9:54:28<34:16:10,  9.84s/it][2022-12-21 23:53:52,829] [INFO] [timer.py:197:stop] 0/1469, RunningAvgSamplesPerSec=10.94929639063704, CurrSamplesPerSec=10.776849871531946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7469/20000 [9:54:37<33:24:14,  9.60s/it][2022-12-21 23:54:02,213] [INFO] [logging.py:68:log_dist] [Rank 0] step=7470, skipped=16, lr=[6.434358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:54:02,214] [INFO] [timer.py:197:stop] 0/1470, RunningAvgSamplesPerSec=10.94944164557704, CurrSamplesPerSec=11.166762851489732, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7470/20000 [9:54:46<33:10:49,  9.53s/it][2022-12-21 23:54:12,007] [INFO] [timer.py:197:stop] 0/1471, RunningAvgSamplesPerSec=10.94944417654373, CurrSamplesPerSec=10.953160897696177, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7471/20000 [9:54:56<33:26:55,  9.61s/it][2022-12-21 23:54:20,909] [INFO] [timer.py:197:stop] 0/1472, RunningAvgSamplesPerSec=10.949492757832385, CurrSamplesPerSec=11.021327187496832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7472/20000 [9:55:05<32:42:22,  9.40s/it][2022-12-21 23:54:30,207] [INFO] [timer.py:197:stop] 0/1473, RunningAvgSamplesPerSec=10.949429832569901, CurrSamplesPerSec=10.85770510889479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7473/20000 [9:55:14<32:35:57,  9.37s/it][2022-12-21 23:54:40,028] [INFO] [timer.py:197:stop] 0/1474, RunningAvgSamplesPerSec=10.949246067950687, CurrSamplesPerSec=10.685445515267203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7474/20000 [9:55:24<33:04:05,  9.50s/it][2022-12-21 23:54:50,174] [INFO] [timer.py:197:stop] 0/1475, RunningAvgSamplesPerSec=10.949395592669699, CurrSamplesPerSec=11.174014240990237, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7475/20000 [9:55:34<33:44:12,  9.70s/it]

                                                         
{'loss': 0.0808, 'learning_rate': 6.431794871794872e-06, 'epoch': 0.37}


 37%|███▋      | 7475/20000 [9:55:34<33:44:12,  9.70s/it][2022-12-21 23:54:59,682] [INFO] [timer.py:197:stop] 0/1476, RunningAvgSamplesPerSec=10.949220881210737, CurrSamplesPerSec=10.697784659482164, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7476/20000 [9:55:44<33:32:11,  9.64s/it][2022-12-21 23:55:10,259] [INFO] [timer.py:197:stop] 0/1477, RunningAvgSamplesPerSec=10.949383701462832, CurrSamplesPerSec=11.194762810805473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7477/20000 [9:55:54<34:30:43,  9.92s/it][2022-12-21 23:55:19,747] [INFO] [timer.py:197:stop] 0/1478, RunningAvgSamplesPerSec=10.949438323994748, CurrSamplesPerSec=11.030604198793064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7478/20000 [9:56:04<34:03:23,  9.79s/it][2022-12-21 23:55:28,920] [INFO] [timer.py:197:stop] 0/1479, RunningAvgSamplesPerSec=10.949568513197974, CurrSamplesPerSec=11.145162679198974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7479/20000 [9:56:13<33:24:31,  9.61s/it][2022-12-21 23:55:40,628] [INFO] [logging.py:68:log_dist] [Rank 0] step=7480, skipped=16, lr=[6.42923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:55:40,629] [INFO] [timer.py:197:stop] 0/1480, RunningAvgSamplesPerSec=10.94949377298926, CurrSamplesPerSec=10.840205064420838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7480/20000 [9:56:25<35:36:03, 10.24s/it][2022-12-21 23:55:49,750] [INFO] [timer.py:197:stop] 0/1481, RunningAvgSamplesPerSec=10.949368595295818, CurrSamplesPerSec=10.767432242026002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7481/20000 [9:56:34<34:26:03,  9.90s/it][2022-12-21 23:55:59,191] [INFO] [timer.py:197:stop] 0/1482, RunningAvgSamplesPerSec=10.949067047868105, CurrSamplesPerSec=10.520545196390755, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7482/20000 [9:56:43<33:57:02,  9.76s/it][2022-12-21 23:56:08,080] [INFO] [timer.py:197:stop] 0/1483, RunningAvgSamplesPerSec=10.949141450814539, CurrSamplesPerSec=11.060377274684983, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7483/20000 [9:56:52<33:02:08,  9.50s/it][2022-12-21 23:56:17,326] [INFO] [timer.py:197:stop] 0/1484, RunningAvgSamplesPerSec=10.94924286761063, CurrSamplesPerSec=11.101531602224943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7484/20000 [9:57:01<32:46:00,  9.42s/it][2022-12-21 23:56:27,876] [INFO] [timer.py:197:stop] 0/1485, RunningAvgSamplesPerSec=10.949292123112844, CurrSamplesPerSec=11.02277902990429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7485/20000 [9:57:12<33:56:14,  9.76s/it][2022-12-21 23:56:36,617] [INFO] [timer.py:197:stop] 0/1486, RunningAvgSamplesPerSec=10.949465432923873, CurrSamplesPerSec=11.212666199868114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7486/20000 [9:57:21<32:52:11,  9.46s/it][2022-12-21 23:56:46,868] [INFO] [timer.py:197:stop] 0/1487, RunningAvgSamplesPerSec=10.949526994054567, CurrSamplesPerSec=11.041652876706943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7487/20000 [9:57:31<33:41:45,  9.69s/it][2022-12-21 23:56:57,351] [INFO] [timer.py:197:stop] 0/1488, RunningAvgSamplesPerSec=10.94917213412769, CurrSamplesPerSec=10.446418217703632, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7488/20000 [9:57:41<34:30:55,  9.93s/it][2022-12-21 23:57:06,448] [INFO] [timer.py:197:stop] 0/1489, RunningAvgSamplesPerSec=10.948876081789448, CurrSamplesPerSec=10.525947326788005, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7489/20000 [9:57:50<33:38:36,  9.68s/it][2022-12-21 23:57:16,642] [INFO] [logging.py:68:log_dist] [Rank 0] step=7490, skipped=16, lr=[6.424102564102564e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:57:16,643] [INFO] [timer.py:197:stop] 0/1490, RunningAvgSamplesPerSec=10.948851741130817, CurrSamplesPerSec=10.912776518904396, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7490/20000 [9:58:01<34:10:34,  9.83s/it][2022-12-21 23:57:25,754] [INFO] [timer.py:197:stop] 0/1491, RunningAvgSamplesPerSec=10.948837056109854, CurrSamplesPerSec=10.927029297341534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7491/20000 [9:58:10<33:25:11,  9.62s/it][2022-12-21 23:57:34,813] [INFO] [timer.py:197:stop] 0/1492, RunningAvgSamplesPerSec=10.948852489215396, CurrSamplesPerSec=10.971880748466274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7492/20000 [9:58:19<32:50:04,  9.45s/it][2022-12-21 23:57:44,108] [INFO] [timer.py:197:stop] 0/1493, RunningAvgSamplesPerSec=10.948680217888802, CurrSamplesPerSec=10.69787973233965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7493/20000 [9:58:28<32:40:12,  9.40s/it][2022-12-21 23:57:55,434] [INFO] [timer.py:197:stop] 0/1494, RunningAvgSamplesPerSec=10.948697114187476, CurrSamplesPerSec=10.973947634611068, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7494/20000 [9:58:39<34:40:13,  9.98s/it][2022-12-21 23:58:05,309] [INFO] [timer.py:197:stop] 0/1495, RunningAvgSamplesPerSec=10.948812538257066, CurrSamplesPerSec=11.123779125512947, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7495/20000 [9:58:49<34:33:27,  9.95s/it][2022-12-21 23:58:14,644] [INFO] [timer.py:197:stop] 0/1496, RunningAvgSamplesPerSec=10.948852677305133, CurrSamplesPerSec=11.009110311930483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7496/20000 [9:58:59<33:54:55,  9.76s/it][2022-12-21 23:58:23,492] [INFO] [timer.py:197:stop] 0/1497, RunningAvgSamplesPerSec=10.94889958802994, CurrSamplesPerSec=11.01943602143186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7497/20000 [9:59:07<32:57:31,  9.49s/it][2022-12-21 23:58:34,011] [INFO] [timer.py:197:stop] 0/1498, RunningAvgSamplesPerSec=10.948616331221583, CurrSamplesPerSec=10.540926515375135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7498/20000 [9:59:18<34:01:40,  9.80s/it][2022-12-21 23:58:44,912] [INFO] [timer.py:197:stop] 0/1499, RunningAvgSamplesPerSec=10.948693000148891, CurrSamplesPerSec=11.064604800118182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 37%|███▋      | 7499/20000 [9:59:29<35:10:23, 10.13s/it][2022-12-21 23:58:53,927] [INFO] [logging.py:68:log_dist] [Rank 0] step=7500, skipped=16, lr=[6.418974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-21 23:58:53,928] [INFO] [timer.py:197:stop] 0/1500, RunningAvgSamplesPerSec=10.948566249285003, CurrSamplesPerSec=10.762054735700966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7500/20000 [9:59:38<34:00:41,  9.80s/it]

                                                         
{'loss': 0.0926, 'learning_rate': 6.418974358974359e-06, 'epoch': 0.38}


 38%|███▊      | 7500/20000 [9:59:38<34:00:41,  9.80s/it][2022-12-21 23:59:03,403] [INFO] [timer.py:197:stop] 0/1501, RunningAvgSamplesPerSec=10.948485896785215, CurrSamplesPerSec=10.829427656431681, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7501/20000 [9:59:47<33:40:28,  9.70s/it][2022-12-21 23:59:12,180] [INFO] [timer.py:197:stop] 0/1502, RunningAvgSamplesPerSec=10.948710828200456, CurrSamplesPerSec=11.296603740045446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7502/20000 [9:59:56<32:42:43,  9.42s/it][2022-12-21 23:59:23,388] [INFO] [timer.py:197:stop] 0/1503, RunningAvgSamplesPerSec=10.948656644882982, CurrSamplesPerSec=10.867980946459916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7503/20000 [10:00:07<34:34:08,  9.96s/it][2022-12-21 23:59:32,359] [INFO] [timer.py:197:stop] 0/1504, RunningAvgSamplesPerSec=10.948817973699228, CurrSamplesPerSec=11.196453111827449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7504/20000 [10:00:16<33:32:15,  9.66s/it][2022-12-21 23:59:41,130] [INFO] [timer.py:197:stop] 0/1505, RunningAvgSamplesPerSec=10.948955511701755, CurrSamplesPerSec=11.159512980698837, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7505/20000 [10:00:25<32:36:27,  9.39s/it][2022-12-21 23:59:51,389] [INFO] [timer.py:197:stop] 0/1506, RunningAvgSamplesPerSec=10.948990507417394, CurrSamplesPerSec=11.001843139111283, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7506/20000 [10:00:35<33:30:17,  9.65s/it][2022-12-22 00:00:00,288] [INFO] [timer.py:197:stop] 0/1507, RunningAvgSamplesPerSec=10.949059384009617, CurrSamplesPerSec=11.053639885554759, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7507/20000 [10:00:44<32:42:58,  9.43s/it][2022-12-22 00:00:10,500] [INFO] [timer.py:197:stop] 0/1508, RunningAvgSamplesPerSec=10.949178217653385, CurrSamplesPerSec=11.130994626604249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7508/20000 [10:00:54<33:31:49,  9.66s/it][2022-12-22 00:00:20,037] [INFO] [timer.py:197:stop] 0/1509, RunningAvgSamplesPerSec=10.949382729457795, CurrSamplesPerSec=11.266297921818863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7509/20000 [10:01:04<33:23:47,  9.63s/it][2022-12-22 00:00:29,644] [INFO] [logging.py:68:log_dist] [Rank 0] step=7510, skipped=16, lr=[6.413846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:00:29,645] [INFO] [timer.py:197:stop] 0/1510, RunningAvgSamplesPerSec=10.949399009101711, CurrSamplesPerSec=10.973987562603563, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7510/20000 [10:01:14<33:22:32,  9.62s/it][2022-12-22 00:00:38,465] [INFO] [timer.py:197:stop] 0/1511, RunningAvgSamplesPerSec=10.949477625919831, CurrSamplesPerSec=11.069330339125834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7511/20000 [10:01:22<32:32:24,  9.38s/it][2022-12-22 00:00:48,078] [INFO] [timer.py:197:stop] 0/1512, RunningAvgSamplesPerSec=10.949229545412727, CurrSamplesPerSec=10.587259978702855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7512/20000 [10:01:32<32:46:51,  9.45s/it][2022-12-22 00:00:57,632] [INFO] [timer.py:197:stop] 0/1513, RunningAvgSamplesPerSec=10.94924514615498, CurrSamplesPerSec=10.972853092699328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7513/20000 [10:01:42<32:53:11,  9.48s/it][2022-12-22 00:01:06,452] [INFO] [timer.py:197:stop] 0/1514, RunningAvgSamplesPerSec=10.949387709239188, CurrSamplesPerSec=11.169126420890132, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7514/20000 [10:01:50<32:11:44,  9.28s/it][2022-12-22 00:01:16,192] [INFO] [timer.py:197:stop] 0/1515, RunningAvgSamplesPerSec=10.94931138392217, CurrSamplesPerSec=10.835111943325803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7515/20000 [10:02:00<32:40:07,  9.42s/it][2022-12-22 00:01:25,380] [INFO] [timer.py:197:stop] 0/1516, RunningAvgSamplesPerSec=10.949312730044177, CurrSamplesPerSec=10.951349791804969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7516/20000 [10:02:09<32:25:30,  9.35s/it][2022-12-22 00:01:35,499] [INFO] [timer.py:197:stop] 0/1517, RunningAvgSamplesPerSec=10.949437594935015, CurrSamplesPerSec=11.141806543103861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7517/20000 [10:02:19<33:13:18,  9.58s/it][2022-12-22 00:01:44,620] [INFO] [timer.py:197:stop] 0/1518, RunningAvgSamplesPerSec=10.949452634306267, CurrSamplesPerSec=10.97228482447317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7518/20000 [10:02:29<32:44:27,  9.44s/it][2022-12-22 00:01:55,013] [INFO] [timer.py:197:stop] 0/1519, RunningAvgSamplesPerSec=10.949411411708004, CurrSamplesPerSec=10.887272840835832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7519/20000 [10:02:39<33:43:34,  9.73s/it][2022-12-22 00:02:04,266] [INFO] [logging.py:68:log_dist] [Rank 0] step=7520, skipped=16, lr=[6.40871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:02:04,267] [INFO] [timer.py:197:stop] 0/1520, RunningAvgSamplesPerSec=10.9493824401846, CurrSamplesPerSec=10.905608459684297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7520/20000 [10:02:48<33:13:49,  9.59s/it][2022-12-22 00:02:14,030] [INFO] [timer.py:197:stop] 0/1521, RunningAvgSamplesPerSec=10.949565426279534, CurrSamplesPerSec=11.234573272763935, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7521/20000 [10:02:58<33:24:44,  9.64s/it][2022-12-22 00:02:23,374] [INFO] [timer.py:197:stop] 0/1522, RunningAvgSamplesPerSec=10.949422019005778, CurrSamplesPerSec=10.735838354027821, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7522/20000 [10:03:07<33:06:10,  9.55s/it][2022-12-22 00:02:32,340] [INFO] [timer.py:197:stop] 0/1523, RunningAvgSamplesPerSec=10.949408618102675, CurrSamplesPerSec=10.929077093355335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7523/20000 [10:03:16<32:29:33,  9.38s/it][2022-12-22 00:02:41,780] [INFO] [timer.py:197:stop] 0/1524, RunningAvgSamplesPerSec=10.949404723666243, CurrSamplesPerSec=10.943484490699246, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7524/20000 [10:03:26<32:33:25,  9.39s/it][2022-12-22 00:02:50,884] [INFO] [timer.py:197:stop] 0/1525, RunningAvgSamplesPerSec=10.949433490396189, CurrSamplesPerSec=10.9933923449818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7525/20000 [10:03:35<32:15:09,  9.31s/it]

                                                          
{'loss': 0.0825, 'learning_rate': 6.406153846153846e-06, 'epoch': 0.38}


 38%|███▊      | 7525/20000 [10:03:35<32:15:09,  9.31s/it][2022-12-22 00:03:00,012] [INFO] [timer.py:197:stop] 0/1526, RunningAvgSamplesPerSec=10.949368279335514, CurrSamplesPerSec=10.850945168733356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7526/20000 [10:03:44<32:03:50,  9.25s/it][2022-12-22 00:03:09,212] [INFO] [timer.py:197:stop] 0/1527, RunningAvgSamplesPerSec=10.949518780037263, CurrSamplesPerSec=11.183792475560038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7527/20000 [10:03:53<32:00:20,  9.24s/it][2022-12-22 00:03:18,998] [INFO] [timer.py:197:stop] 0/1528, RunningAvgSamplesPerSec=10.949394089343787, CurrSamplesPerSec=10.76248881193808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7528/20000 [10:04:03<32:34:21,  9.40s/it][2022-12-22 00:03:28,905] [INFO] [timer.py:197:stop] 0/1529, RunningAvgSamplesPerSec=10.94941979550684, CurrSamplesPerSec=10.988788535966398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7529/20000 [10:04:13<33:05:44,  9.55s/it][2022-12-22 00:03:38,369] [INFO] [logging.py:68:log_dist] [Rank 0] step=7530, skipped=16, lr=[6.403589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:03:38,370] [INFO] [timer.py:197:stop] 0/1530, RunningAvgSamplesPerSec=10.949402822797689, CurrSamplesPerSec=10.923546737570817, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7530/20000 [10:04:22<33:00:00,  9.53s/it][2022-12-22 00:03:47,931] [INFO] [timer.py:197:stop] 0/1531, RunningAvgSamplesPerSec=10.949387669928296, CurrSamplesPerSec=10.9262829746792, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7531/20000 [10:04:32<33:01:57,  9.54s/it][2022-12-22 00:03:57,186] [INFO] [timer.py:197:stop] 0/1532, RunningAvgSamplesPerSec=10.949385692669056, CurrSamplesPerSec=10.94636329834793, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7532/20000 [10:04:41<32:44:15,  9.45s/it][2022-12-22 00:04:06,277] [INFO] [timer.py:197:stop] 0/1533, RunningAvgSamplesPerSec=10.949299530371828, CurrSamplesPerSec=10.819040543956582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7533/20000 [10:04:50<32:21:32,  9.34s/it][2022-12-22 00:04:15,665] [INFO] [timer.py:197:stop] 0/1534, RunningAvgSamplesPerSec=10.949358605312582, CurrSamplesPerSec=11.040556140208224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7534/20000 [10:05:00<32:24:05,  9.36s/it][2022-12-22 00:04:24,873] [INFO] [timer.py:197:stop] 0/1535, RunningAvgSamplesPerSec=10.949241038646692, CurrSamplesPerSec=10.7720456269907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7535/20000 [10:05:09<32:14:38,  9.31s/it][2022-12-22 00:04:34,148] [INFO] [timer.py:197:stop] 0/1536, RunningAvgSamplesPerSec=10.949244204156079, CurrSamplesPerSec=10.954099083143852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7536/20000 [10:05:18<32:12:09,  9.30s/it][2022-12-22 00:04:43,401] [INFO] [timer.py:197:stop] 0/1537, RunningAvgSamplesPerSec=10.949092997987995, CurrSamplesPerSec=10.721957606010438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7537/20000 [10:05:27<32:09:01,  9.29s/it][2022-12-22 00:04:52,749] [INFO] [timer.py:197:stop] 0/1538, RunningAvgSamplesPerSec=10.949259310813684, CurrSamplesPerSec=11.210647940396965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7538/20000 [10:05:37<32:12:39,  9.31s/it][2022-12-22 00:05:02,003] [INFO] [timer.py:197:stop] 0/1539, RunningAvgSamplesPerSec=10.949437951484514, CurrSamplesPerSec=11.230887723319862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7539/20000 [10:05:46<32:09:20,  9.29s/it][2022-12-22 00:05:11,386] [INFO] [logging.py:68:log_dist] [Rank 0] step=7540, skipped=16, lr=[6.398461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:05:11,387] [INFO] [timer.py:197:stop] 0/1540, RunningAvgSamplesPerSec=10.949425596948155, CurrSamplesPerSec=10.930469570236825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7540/20000 [10:05:55<32:15:03,  9.32s/it][2022-12-22 00:05:20,730] [INFO] [timer.py:197:stop] 0/1541, RunningAvgSamplesPerSec=10.949514420725226, CurrSamplesPerSec=11.087852478673057, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7541/20000 [10:06:05<32:16:34,  9.33s/it][2022-12-22 00:05:30,082] [INFO] [timer.py:197:stop] 0/1542, RunningAvgSamplesPerSec=10.949498884818247, CurrSamplesPerSec=10.925641254298197, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7542/20000 [10:06:14<32:17:54,  9.33s/it][2022-12-22 00:05:39,573] [INFO] [timer.py:197:stop] 0/1543, RunningAvgSamplesPerSec=10.949276275209865, CurrSamplesPerSec=10.616871730324679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7543/20000 [10:06:24<32:27:34,  9.38s/it][2022-12-22 00:05:48,997] [INFO] [timer.py:197:stop] 0/1544, RunningAvgSamplesPerSec=10.949133451669397, CurrSamplesPerSec=10.73338205901053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7544/20000 [10:06:33<32:30:06,  9.39s/it][2022-12-22 00:05:58,311] [INFO] [timer.py:197:stop] 0/1545, RunningAvgSamplesPerSec=10.949176834267895, CurrSamplesPerSec=11.016484294883002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7545/20000 [10:06:42<32:25:00,  9.37s/it][2022-12-22 00:06:07,621] [INFO] [timer.py:197:stop] 0/1546, RunningAvgSamplesPerSec=10.949241750967056, CurrSamplesPerSec=11.050333631537669, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7546/20000 [10:06:52<32:21:07,  9.35s/it][2022-12-22 00:06:17,778] [INFO] [timer.py:197:stop] 0/1547, RunningAvgSamplesPerSec=10.949378847770133, CurrSamplesPerSec=11.165231967194194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7547/20000 [10:07:02<33:11:05,  9.59s/it][2022-12-22 00:06:26,874] [INFO] [timer.py:197:stop] 0/1548, RunningAvgSamplesPerSec=10.94911058688393, CurrSamplesPerSec=10.549773636241625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7548/20000 [10:07:11<32:40:01,  9.44s/it][2022-12-22 00:06:36,037] [INFO] [timer.py:197:stop] 0/1549, RunningAvgSamplesPerSec=10.949190838719197, CurrSamplesPerSec=11.074683095078944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7549/20000 [10:07:20<32:22:17,  9.36s/it][2022-12-22 00:06:46,064] [INFO] [logging.py:68:log_dist] [Rank 0] step=7550, skipped=16, lr=[6.393333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:06:46,065] [INFO] [timer.py:197:stop] 0/1550, RunningAvgSamplesPerSec=10.949034519520856, CurrSamplesPerSec=10.71243769229658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7550/20000 [10:07:30<33:03:44,  9.56s/it]

                                                          
{'loss': 0.0887, 'learning_rate': 6.393333333333334e-06, 'epoch': 0.38}


 38%|███▊      | 7550/20000 [10:07:30<33:03:44,  9.56s/it][2022-12-22 00:06:54,854] [INFO] [timer.py:197:stop] 0/1551, RunningAvgSamplesPerSec=10.949169617171794, CurrSamplesPerSec=11.162375686833093, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7551/20000 [10:07:39<32:15:37,  9.33s/it][2022-12-22 00:07:04,072] [INFO] [timer.py:197:stop] 0/1552, RunningAvgSamplesPerSec=10.94928058717256, CurrSamplesPerSec=11.123916493793558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7552/20000 [10:07:48<32:08:35,  9.30s/it][2022-12-22 00:07:13,368] [INFO] [timer.py:197:stop] 0/1553, RunningAvgSamplesPerSec=10.949400834843244, CurrSamplesPerSec=11.139014465195427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7553/20000 [10:07:57<32:08:24,  9.30s/it][2022-12-22 00:07:23,590] [INFO] [timer.py:197:stop] 0/1554, RunningAvgSamplesPerSec=10.949609220256482, CurrSamplesPerSec=11.282651943882021, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7554/20000 [10:08:08<33:05:51,  9.57s/it][2022-12-22 00:07:32,678] [INFO] [timer.py:197:stop] 0/1555, RunningAvgSamplesPerSec=10.949645519394547, CurrSamplesPerSec=11.006273321176643, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7555/20000 [10:08:17<32:35:29,  9.43s/it][2022-12-22 00:07:41,697] [INFO] [timer.py:197:stop] 0/1556, RunningAvgSamplesPerSec=10.949624106783556, CurrSamplesPerSec=10.916471071837972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7556/20000 [10:08:26<32:09:54,  9.31s/it][2022-12-22 00:07:50,699] [INFO] [timer.py:197:stop] 0/1557, RunningAvgSamplesPerSec=10.949780507194259, CurrSamplesPerSec=11.198347602526855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7557/20000 [10:08:35<31:50:52,  9.21s/it][2022-12-22 00:08:00,174] [INFO] [timer.py:197:stop] 0/1558, RunningAvgSamplesPerSec=10.949707024517675, CurrSamplesPerSec=10.836622315721721, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7558/20000 [10:08:44<32:06:57,  9.29s/it][2022-12-22 00:08:09,623] [INFO] [timer.py:197:stop] 0/1559, RunningAvgSamplesPerSec=10.949512542420955, CurrSamplesPerSec=10.655041979448487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7559/20000 [10:08:54<32:16:31,  9.34s/it][2022-12-22 00:08:18,830] [INFO] [logging.py:68:log_dist] [Rank 0] step=7560, skipped=16, lr=[6.3882051282051286e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:08:18,830] [INFO] [timer.py:197:stop] 0/1560, RunningAvgSamplesPerSec=10.949495915264103, CurrSamplesPerSec=10.923668536331416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7560/20000 [10:09:03<32:08:08,  9.30s/it][2022-12-22 00:08:28,200] [INFO] [timer.py:197:stop] 0/1561, RunningAvgSamplesPerSec=10.949414703059023, CurrSamplesPerSec=10.824332433763553, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7561/20000 [10:09:12<32:12:21,  9.32s/it][2022-12-22 00:08:37,157] [INFO] [timer.py:197:stop] 0/1562, RunningAvgSamplesPerSec=10.949524964705873, CurrSamplesPerSec=11.124166346813153, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7562/20000 [10:09:21<31:49:35,  9.21s/it][2022-12-22 00:08:46,540] [INFO] [timer.py:197:stop] 0/1563, RunningAvgSamplesPerSec=10.949575827888351, CurrSamplesPerSec=11.029501951869486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7563/20000 [10:09:31<32:00:04,  9.26s/it][2022-12-22 00:08:55,578] [INFO] [timer.py:197:stop] 0/1564, RunningAvgSamplesPerSec=10.949461778564906, CurrSamplesPerSec=10.774280933815719, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7564/20000 [10:09:40<31:45:53,  9.20s/it][2022-12-22 00:09:07,060] [INFO] [timer.py:197:stop] 0/1565, RunningAvgSamplesPerSec=10.949397194102891, CurrSamplesPerSec=10.849437817510774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7565/20000 [10:09:51<34:07:55,  9.88s/it][2022-12-22 00:09:17,104] [INFO] [timer.py:197:stop] 0/1566, RunningAvgSamplesPerSec=10.949526250417179, CurrSamplesPerSec=11.155029526588057, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7566/20000 [10:10:01<34:17:51,  9.93s/it][2022-12-22 00:09:26,050] [INFO] [timer.py:197:stop] 0/1567, RunningAvgSamplesPerSec=10.949673471523102, CurrSamplesPerSec=11.184876377815387, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7567/20000 [10:10:10<33:16:33,  9.64s/it][2022-12-22 00:09:36,128] [INFO] [timer.py:197:stop] 0/1568, RunningAvgSamplesPerSec=10.949586806415864, CurrSamplesPerSec=10.815616444769658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7568/20000 [10:10:20<33:43:53,  9.77s/it][2022-12-22 00:09:45,980] [INFO] [timer.py:197:stop] 0/1569, RunningAvgSamplesPerSec=10.949610785708439, CurrSamplesPerSec=10.987291666572867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7569/20000 [10:10:30<33:48:59,  9.79s/it][2022-12-22 00:09:55,425] [INFO] [logging.py:68:log_dist] [Rank 0] step=7570, skipped=16, lr=[6.383076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:09:55,426] [INFO] [timer.py:197:stop] 0/1570, RunningAvgSamplesPerSec=10.949640602678857, CurrSamplesPerSec=10.996564150495715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7570/20000 [10:10:39<33:27:11,  9.69s/it][2022-12-22 00:10:04,507] [INFO] [timer.py:197:stop] 0/1571, RunningAvgSamplesPerSec=10.94969424162285, CurrSamplesPerSec=11.034451551673053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7571/20000 [10:10:48<32:49:19,  9.51s/it][2022-12-22 00:10:13,517] [INFO] [timer.py:197:stop] 0/1572, RunningAvgSamplesPerSec=10.949613688793727, CurrSamplesPerSec=10.824669405274273, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7572/20000 [10:10:57<32:18:15,  9.36s/it][2022-12-22 00:10:22,318] [INFO] [timer.py:197:stop] 0/1573, RunningAvgSamplesPerSec=10.949759945170952, CurrSamplesPerSec=11.184304110892977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7573/20000 [10:11:06<31:43:32,  9.19s/it][2022-12-22 00:10:34,849] [INFO] [timer.py:197:stop] 0/1574, RunningAvgSamplesPerSec=10.949652222385344, CurrSamplesPerSec=10.782997106127834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7574/20000 [10:11:19<35:10:55, 10.19s/it][2022-12-22 00:10:43,749] [INFO] [timer.py:197:stop] 0/1575, RunningAvgSamplesPerSec=10.949714771860888, CurrSamplesPerSec=11.048934097738458, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7575/20000 [10:11:28<33:50:25,  9.80s/it]

                                                          
{'loss': 0.0924, 'learning_rate': 6.3805128205128205e-06, 'epoch': 0.38}


 38%|███▊      | 7575/20000 [10:11:28<33:50:25,  9.80s/it][2022-12-22 00:10:53,751] [INFO] [timer.py:197:stop] 0/1576, RunningAvgSamplesPerSec=10.949695849524423, CurrSamplesPerSec=10.920011756581804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7576/20000 [10:11:38<34:02:30,  9.86s/it][2022-12-22 00:11:06,167] [INFO] [timer.py:197:stop] 0/1577, RunningAvgSamplesPerSec=10.949681162793581, CurrSamplesPerSec=10.926612980827548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7577/20000 [10:11:50<36:40:51, 10.63s/it][2022-12-22 00:11:15,768] [INFO] [timer.py:197:stop] 0/1578, RunningAvgSamplesPerSec=10.949572518841693, CurrSamplesPerSec=10.781092878494496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7578/20000 [10:12:00<35:36:49, 10.32s/it][2022-12-22 00:11:25,947] [INFO] [timer.py:197:stop] 0/1579, RunningAvgSamplesPerSec=10.949316778572706, CurrSamplesPerSec=10.560588368961826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7579/20000 [10:12:10<35:27:47, 10.28s/it][2022-12-22 00:11:34,989] [INFO] [logging.py:68:log_dist] [Rank 0] step=7580, skipped=16, lr=[6.377948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:11:34,990] [INFO] [timer.py:197:stop] 0/1580, RunningAvgSamplesPerSec=10.94918818589699, CurrSamplesPerSec=10.750087433041589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7580/20000 [10:12:19<34:10:55,  9.91s/it][2022-12-22 00:11:45,308] [INFO] [timer.py:197:stop] 0/1581, RunningAvgSamplesPerSec=10.94908153370047, CurrSamplesPerSec=10.783333674787244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7581/20000 [10:12:29<34:36:14, 10.03s/it][2022-12-22 00:11:54,279] [INFO] [timer.py:197:stop] 0/1582, RunningAvgSamplesPerSec=10.949213519575686, CurrSamplesPerSec=11.161665557924117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7582/20000 [10:12:38<33:30:14,  9.71s/it][2022-12-22 00:12:03,387] [INFO] [timer.py:197:stop] 0/1583, RunningAvgSamplesPerSec=10.948966122825857, CurrSamplesPerSec=10.571561435500884, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7583/20000 [10:12:47<32:52:33,  9.53s/it][2022-12-22 00:12:13,248] [INFO] [timer.py:197:stop] 0/1584, RunningAvgSamplesPerSec=10.948997576650694, CurrSamplesPerSec=10.998953106806134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7584/20000 [10:12:57<33:12:48,  9.63s/it][2022-12-22 00:12:22,259] [INFO] [timer.py:197:stop] 0/1585, RunningAvgSamplesPerSec=10.949122844962648, CurrSamplesPerSec=11.150952657414537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7585/20000 [10:13:06<32:34:15,  9.44s/it][2022-12-22 00:12:31,681] [INFO] [timer.py:197:stop] 0/1586, RunningAvgSamplesPerSec=10.949024456647992, CurrSamplesPerSec=10.795461550390291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7586/20000 [10:13:16<32:32:37,  9.44s/it][2022-12-22 00:12:41,421] [INFO] [timer.py:197:stop] 0/1587, RunningAvgSamplesPerSec=10.949127172297178, CurrSamplesPerSec=11.114284511205623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7587/20000 [10:13:25<32:51:16,  9.53s/it][2022-12-22 00:12:50,676] [INFO] [timer.py:197:stop] 0/1588, RunningAvgSamplesPerSec=10.949251036251328, CurrSamplesPerSec=11.14916214978956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7588/20000 [10:13:35<32:34:09,  9.45s/it][2022-12-22 00:12:59,574] [INFO] [timer.py:197:stop] 0/1589, RunningAvgSamplesPerSec=10.949299560937487, CurrSamplesPerSec=11.026804823647417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7589/20000 [10:13:44<31:59:56,  9.28s/it][2022-12-22 00:13:09,429] [INFO] [logging.py:68:log_dist] [Rank 0] step=7590, skipped=16, lr=[6.372820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:13:09,429] [INFO] [timer.py:197:stop] 0/1590, RunningAvgSamplesPerSec=10.94914022896999, CurrSamplesPerSec=10.701991651077272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7590/20000 [10:13:53<32:35:22,  9.45s/it][2022-12-22 00:13:18,670] [INFO] [timer.py:197:stop] 0/1591, RunningAvgSamplesPerSec=10.949043547912702, CurrSamplesPerSec=10.797638396962, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7591/20000 [10:14:03<32:21:58,  9.39s/it][2022-12-22 00:13:27,847] [INFO] [timer.py:197:stop] 0/1592, RunningAvgSamplesPerSec=10.948853126241776, CurrSamplesPerSec=10.654415231229413, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7592/20000 [10:14:12<32:08:39,  9.33s/it][2022-12-22 00:13:37,667] [INFO] [timer.py:197:stop] 0/1593, RunningAvgSamplesPerSec=10.948848364162307, CurrSamplesPerSec=10.941281893710194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7593/20000 [10:14:22<32:39:06,  9.47s/it][2022-12-22 00:13:46,528] [INFO] [timer.py:197:stop] 0/1594, RunningAvgSamplesPerSec=10.948980057362997, CurrSamplesPerSec=11.162594313334553, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7594/20000 [10:14:30<32:00:54,  9.29s/it][2022-12-22 00:13:56,384] [INFO] [timer.py:197:stop] 0/1595, RunningAvgSamplesPerSec=10.94882765429394, CurrSamplesPerSec=10.71146521669716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7595/20000 [10:14:40<32:35:51,  9.46s/it][2022-12-22 00:14:05,647] [INFO] [timer.py:197:stop] 0/1596, RunningAvgSamplesPerSec=10.948685587660945, CurrSamplesPerSec=10.726959454531832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7596/20000 [10:14:50<32:23:30,  9.40s/it][2022-12-22 00:14:15,786] [INFO] [timer.py:197:stop] 0/1597, RunningAvgSamplesPerSec=10.948706935874528, CurrSamplesPerSec=10.982842148593528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7597/20000 [10:15:00<33:09:06,  9.62s/it][2022-12-22 00:14:25,903] [INFO] [timer.py:197:stop] 0/1598, RunningAvgSamplesPerSec=10.948595043030947, CurrSamplesPerSec=10.772990222796064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7598/20000 [10:15:10<33:39:35,  9.77s/it][2022-12-22 00:14:35,227] [INFO] [timer.py:197:stop] 0/1599, RunningAvgSamplesPerSec=10.948392037649219, CurrSamplesPerSec=10.633713586272691, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7599/20000 [10:15:19<33:11:46,  9.64s/it][2022-12-22 00:14:44,248] [INFO] [logging.py:68:log_dist] [Rank 0] step=7600, skipped=16, lr=[6.367692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:14:44,249] [INFO] [timer.py:197:stop] 0/1600, RunningAvgSamplesPerSec=10.948288165424653, CurrSamplesPerSec=10.784881641312886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7600/20000 [10:15:28<32:33:27,  9.45s/it]

                                                          
{'loss': 0.0935, 'learning_rate': 6.367692307692308e-06, 'epoch': 0.38}


 38%|███▊      | 7600/20000 [10:15:28<32:33:27,  9.45s/it][2022-12-22 00:14:53,927] [INFO] [timer.py:197:stop] 0/1601, RunningAvgSamplesPerSec=10.948403734519472, CurrSamplesPerSec=11.136253815965603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7601/20000 [10:15:38<32:47:17,  9.52s/it][2022-12-22 00:15:03,117] [INFO] [timer.py:197:stop] 0/1602, RunningAvgSamplesPerSec=10.94829911497905, CurrSamplesPerSec=10.783531640684426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7602/20000 [10:15:47<32:26:41,  9.42s/it][2022-12-22 00:15:11,935] [INFO] [timer.py:197:stop] 0/1603, RunningAvgSamplesPerSec=10.948369310065658, CurrSamplesPerSec=11.061846261799976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7603/20000 [10:15:56<31:49:08,  9.24s/it][2022-12-22 00:15:21,205] [INFO] [timer.py:197:stop] 0/1604, RunningAvgSamplesPerSec=10.948411404382993, CurrSamplesPerSec=11.016222076088237, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7604/20000 [10:16:05<31:50:52,  9.25s/it][2022-12-22 00:15:30,240] [INFO] [timer.py:197:stop] 0/1605, RunningAvgSamplesPerSec=10.948506005407081, CurrSamplesPerSec=11.102185427171301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7605/20000 [10:16:14<31:37:26,  9.18s/it][2022-12-22 00:15:41,394] [INFO] [timer.py:197:stop] 0/1606, RunningAvgSamplesPerSec=10.948368757307936, CurrSamplesPerSec=10.73269671206243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7606/20000 [10:16:25<33:39:17,  9.78s/it][2022-12-22 00:15:50,610] [INFO] [timer.py:197:stop] 0/1607, RunningAvgSamplesPerSec=10.948547236821263, CurrSamplesPerSec=11.242519926765747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7607/20000 [10:16:35<33:04:29,  9.61s/it][2022-12-22 00:15:59,716] [INFO] [timer.py:197:stop] 0/1608, RunningAvgSamplesPerSec=10.948402951009689, CurrSamplesPerSec=10.721624001251277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7608/20000 [10:16:44<32:33:12,  9.46s/it][2022-12-22 00:16:09,360] [INFO] [timer.py:197:stop] 0/1609, RunningAvgSamplesPerSec=10.948289094845759, CurrSamplesPerSec=10.768441689770562, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7609/20000 [10:16:53<32:44:40,  9.51s/it][2022-12-22 00:16:18,472] [INFO] [logging.py:68:log_dist] [Rank 0] step=7610, skipped=16, lr=[6.362564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:16:18,473] [INFO] [timer.py:197:stop] 0/1610, RunningAvgSamplesPerSec=10.948395211232315, CurrSamplesPerSec=11.121624086222798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7610/20000 [10:17:02<32:19:39,  9.39s/it][2022-12-22 00:16:27,745] [INFO] [timer.py:197:stop] 0/1611, RunningAvgSamplesPerSec=10.948306756594254, CurrSamplesPerSec=10.807896968447123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7611/20000 [10:17:12<32:12:04,  9.36s/it][2022-12-22 00:16:36,605] [INFO] [timer.py:197:stop] 0/1612, RunningAvgSamplesPerSec=10.948357433915552, CurrSamplesPerSec=11.030509465795268, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7612/20000 [10:17:21<31:41:05,  9.21s/it][2022-12-22 00:16:46,076] [INFO] [timer.py:197:stop] 0/1613, RunningAvgSamplesPerSec=10.948510634057753, CurrSamplesPerSec=11.200851219016567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7613/20000 [10:17:30<31:57:15,  9.29s/it][2022-12-22 00:16:54,930] [INFO] [timer.py:197:stop] 0/1614, RunningAvgSamplesPerSec=10.948631231989687, CurrSamplesPerSec=11.146426553526279, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7614/20000 [10:17:39<31:30:17,  9.16s/it][2022-12-22 00:17:04,512] [INFO] [timer.py:197:stop] 0/1615, RunningAvgSamplesPerSec=10.948713599048991, CurrSamplesPerSec=11.083120267432903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7615/20000 [10:17:48<31:56:30,  9.28s/it][2022-12-22 00:17:13,846] [INFO] [timer.py:197:stop] 0/1616, RunningAvgSamplesPerSec=10.948639650382397, CurrSamplesPerSec=10.83064671401073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7616/20000 [10:17:58<31:59:21,  9.30s/it][2022-12-22 00:17:22,921] [INFO] [timer.py:197:stop] 0/1617, RunningAvgSamplesPerSec=10.948610045405015, CurrSamplesPerSec=10.901035368172215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7617/20000 [10:18:07<31:45:21,  9.23s/it][2022-12-22 00:17:32,893] [INFO] [timer.py:197:stop] 0/1618, RunningAvgSamplesPerSec=10.948678157762442, CurrSamplesPerSec=11.05979671531991, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7618/20000 [10:18:17<32:30:57,  9.45s/it][2022-12-22 00:17:42,069] [INFO] [timer.py:197:stop] 0/1619, RunningAvgSamplesPerSec=10.948725687375987, CurrSamplesPerSec=11.026076512671125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7619/20000 [10:18:26<32:13:36,  9.37s/it][2022-12-22 00:17:51,244] [INFO] [logging.py:68:log_dist] [Rank 0] step=7620, skipped=16, lr=[6.357435897435899e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:17:51,244] [INFO] [timer.py:197:stop] 0/1620, RunningAvgSamplesPerSec=10.94889347926108, CurrSamplesPerSec=11.227111616459583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7620/20000 [10:18:35<32:01:23,  9.31s/it][2022-12-22 00:18:01,523] [INFO] [timer.py:197:stop] 0/1621, RunningAvgSamplesPerSec=10.949053224768017, CurrSamplesPerSec=11.213774444334577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7621/20000 [10:18:45<33:01:02,  9.60s/it][2022-12-22 00:18:11,284] [INFO] [timer.py:197:stop] 0/1622, RunningAvgSamplesPerSec=10.948800548413812, CurrSamplesPerSec=10.55446046740333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7622/20000 [10:18:55<33:10:44,  9.65s/it][2022-12-22 00:18:21,405] [INFO] [timer.py:197:stop] 0/1623, RunningAvgSamplesPerSec=10.948820733838792, CurrSamplesPerSec=10.98161914041398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7623/20000 [10:19:05<33:39:45,  9.79s/it][2022-12-22 00:18:31,017] [INFO] [timer.py:197:stop] 0/1624, RunningAvgSamplesPerSec=10.948869765649022, CurrSamplesPerSec=11.02893187933362, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7624/20000 [10:19:15<33:28:28,  9.74s/it][2022-12-22 00:18:40,991] [INFO] [timer.py:197:stop] 0/1625, RunningAvgSamplesPerSec=10.948858626798803, CurrSamplesPerSec=10.930821194489736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7625/20000 [10:19:25<33:42:59,  9.81s/it]

                                                          
{'loss': 0.0917, 'learning_rate': 6.354871794871795e-06, 'epoch': 0.38}


 38%|███▊      | 7625/20000 [10:19:25<33:42:59,  9.81s/it][2022-12-22 00:18:50,195] [INFO] [timer.py:197:stop] 0/1626, RunningAvgSamplesPerSec=10.94900831543467, CurrSamplesPerSec=11.197469405829958, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7626/20000 [10:19:34<33:05:23,  9.63s/it][2022-12-22 00:18:59,266] [INFO] [timer.py:197:stop] 0/1627, RunningAvgSamplesPerSec=10.948935422938193, CurrSamplesPerSec=10.831824960168845, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7627/20000 [10:19:43<32:30:51,  9.46s/it][2022-12-22 00:19:08,529] [INFO] [timer.py:197:stop] 0/1628, RunningAvgSamplesPerSec=10.94890487291799, CurrSamplesPerSec=10.899485302844466, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7628/20000 [10:19:52<32:18:29,  9.40s/it][2022-12-22 00:19:17,990] [INFO] [timer.py:197:stop] 0/1629, RunningAvgSamplesPerSec=10.948923474188785, CurrSamplesPerSec=10.979252975244277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7629/20000 [10:20:02<32:22:01,  9.42s/it][2022-12-22 00:19:26,898] [INFO] [logging.py:68:log_dist] [Rank 0] step=7630, skipped=16, lr=[6.352307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:19:26,899] [INFO] [timer.py:197:stop] 0/1630, RunningAvgSamplesPerSec=10.948893441746339, CurrSamplesPerSec=10.900247886975299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7630/20000 [10:20:11<31:50:24,  9.27s/it][2022-12-22 00:19:37,620] [INFO] [timer.py:197:stop] 0/1631, RunningAvgSamplesPerSec=10.948890104342173, CurrSamplesPerSec=10.94345950690409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7631/20000 [10:20:22<33:20:08,  9.70s/it][2022-12-22 00:19:47,119] [INFO] [timer.py:197:stop] 0/1632, RunningAvgSamplesPerSec=10.948758462750545, CurrSamplesPerSec=10.738436243755908, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7632/20000 [10:20:31<33:07:24,  9.64s/it][2022-12-22 00:19:56,856] [INFO] [timer.py:197:stop] 0/1633, RunningAvgSamplesPerSec=10.948807517903484, CurrSamplesPerSec=11.029356029440217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7633/20000 [10:20:41<33:13:10,  9.67s/it][2022-12-22 00:20:05,934] [INFO] [timer.py:197:stop] 0/1634, RunningAvgSamplesPerSec=10.948819141029032, CurrSamplesPerSec=10.967809359543699, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7634/20000 [10:20:50<32:36:26,  9.49s/it][2022-12-22 00:20:15,568] [INFO] [timer.py:197:stop] 0/1635, RunningAvgSamplesPerSec=10.948683913108123, CurrSamplesPerSec=10.732355144137202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7635/20000 [10:21:00<32:45:00,  9.54s/it][2022-12-22 00:20:27,565] [INFO] [timer.py:197:stop] 0/1636, RunningAvgSamplesPerSec=10.94882482761668, CurrSamplesPerSec=11.183881472514326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7636/20000 [10:21:12<35:17:05, 10.27s/it][2022-12-22 00:20:37,236] [INFO] [timer.py:197:stop] 0/1637, RunningAvgSamplesPerSec=10.948716303889029, CurrSamplesPerSec=10.77421649903079, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7637/20000 [10:21:21<34:39:34, 10.09s/it][2022-12-22 00:20:47,902] [INFO] [timer.py:197:stop] 0/1638, RunningAvgSamplesPerSec=10.948626305503746, CurrSamplesPerSec=10.803431528008744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7638/20000 [10:21:32<35:14:53, 10.26s/it][2022-12-22 00:20:57,919] [INFO] [timer.py:197:stop] 0/1639, RunningAvgSamplesPerSec=10.94865150175122, CurrSamplesPerSec=10.99002843969783, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7639/20000 [10:21:42<34:59:24, 10.19s/it][2022-12-22 00:21:08,579] [INFO] [logging.py:68:log_dist] [Rank 0] step=7640, skipped=16, lr=[6.347179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:21:08,580] [INFO] [timer.py:197:stop] 0/1640, RunningAvgSamplesPerSec=10.948795657139726, CurrSamplesPerSec=11.189979504699545, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7640/20000 [10:21:53<35:28:16, 10.33s/it][2022-12-22 00:21:19,729] [INFO] [timer.py:197:stop] 0/1641, RunningAvgSamplesPerSec=10.94886903872926, CurrSamplesPerSec=11.070403124311671, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7641/20000 [10:22:04<36:18:39, 10.58s/it][2022-12-22 00:21:31,446] [INFO] [timer.py:197:stop] 0/1642, RunningAvgSamplesPerSec=10.948788028676695, CurrSamplesPerSec=10.817604381534387, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7642/20000 [10:22:15<37:28:53, 10.92s/it][2022-12-22 00:21:41,088] [INFO] [timer.py:197:stop] 0/1643, RunningAvgSamplesPerSec=10.948802755570364, CurrSamplesPerSec=10.973008289045476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7643/20000 [10:22:25<36:09:52, 10.54s/it][2022-12-22 00:21:50,083] [INFO] [timer.py:197:stop] 0/1644, RunningAvgSamplesPerSec=10.94874201754689, CurrSamplesPerSec=10.849970627301728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7644/20000 [10:22:34<34:34:27, 10.07s/it][2022-12-22 00:21:59,845] [INFO] [timer.py:197:stop] 0/1645, RunningAvgSamplesPerSec=10.948833451120603, CurrSamplesPerSec=11.101055974602286, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7645/20000 [10:22:44<34:15:05,  9.98s/it][2022-12-22 00:22:10,983] [INFO] [timer.py:197:stop] 0/1646, RunningAvgSamplesPerSec=10.948734887760784, CurrSamplesPerSec=10.7891569950202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7646/20000 [10:22:55<35:26:23, 10.33s/it][2022-12-22 00:22:20,794] [INFO] [timer.py:197:stop] 0/1647, RunningAvgSamplesPerSec=10.948672853421565, CurrSamplesPerSec=10.847630162450496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7647/20000 [10:23:05<34:54:21, 10.17s/it][2022-12-22 00:22:30,409] [INFO] [timer.py:197:stop] 0/1648, RunningAvgSamplesPerSec=10.94852016779945, CurrSamplesPerSec=10.702988438670946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7648/20000 [10:23:14<34:19:45, 10.01s/it][2022-12-22 00:22:39,278] [INFO] [timer.py:197:stop] 0/1649, RunningAvgSamplesPerSec=10.948652052104594, CurrSamplesPerSec=11.170127534023193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7649/20000 [10:23:23<33:09:23,  9.66s/it][2022-12-22 00:22:48,644] [INFO] [logging.py:68:log_dist] [Rank 0] step=7650, skipped=16, lr=[6.342051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:22:48,645] [INFO] [timer.py:197:stop] 0/1650, RunningAvgSamplesPerSec=10.948388684246456, CurrSamplesPerSec=10.531162061062236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7650/20000 [10:23:33<32:50:52,  9.58s/it]

                                                          
{'loss': 0.0755, 'learning_rate': 6.342051282051283e-06, 'epoch': 0.38}


 38%|███▊      | 7650/20000 [10:23:33<32:50:52,  9.58s/it][2022-12-22 00:22:58,109] [INFO] [timer.py:197:stop] 0/1651, RunningAvgSamplesPerSec=10.948280728586411, CurrSamplesPerSec=10.773216345128901, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7651/20000 [10:23:42<32:43:53,  9.54s/it][2022-12-22 00:23:08,029] [INFO] [timer.py:197:stop] 0/1652, RunningAvgSamplesPerSec=10.947948238220446, CurrSamplesPerSec=10.425835069383623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7652/20000 [10:23:52<33:07:02,  9.66s/it][2022-12-22 00:23:17,433] [INFO] [timer.py:197:stop] 0/1653, RunningAvgSamplesPerSec=10.947776766190024, CurrSamplesPerSec=10.671979794297327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7653/20000 [10:24:01<32:51:24,  9.58s/it][2022-12-22 00:23:28,534] [INFO] [timer.py:197:stop] 0/1654, RunningAvgSamplesPerSec=10.947747405442534, CurrSamplesPerSec=10.899486630524455, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7654/20000 [10:24:12<34:25:05, 10.04s/it][2022-12-22 00:23:38,014] [INFO] [timer.py:197:stop] 0/1655, RunningAvgSamplesPerSec=10.947791675074152, CurrSamplesPerSec=11.02141723766682, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7655/20000 [10:24:22<33:50:39,  9.87s/it][2022-12-22 00:23:49,253] [INFO] [timer.py:197:stop] 0/1656, RunningAvgSamplesPerSec=10.947812101009188, CurrSamplesPerSec=10.981680688687891, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7656/20000 [10:24:33<35:15:00, 10.28s/it][2022-12-22 00:23:58,122] [INFO] [timer.py:197:stop] 0/1657, RunningAvgSamplesPerSec=10.947896523590924, CurrSamplesPerSec=11.089336561484872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7657/20000 [10:24:42<33:47:44,  9.86s/it][2022-12-22 00:24:08,366] [INFO] [timer.py:197:stop] 0/1658, RunningAvgSamplesPerSec=10.9478968489331, CurrSamplesPerSec=10.94843531673282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7658/20000 [10:24:52<34:11:27,  9.97s/it][2022-12-22 00:24:18,236] [INFO] [timer.py:197:stop] 0/1659, RunningAvgSamplesPerSec=10.947819275667074, CurrSamplesPerSec=10.82084871492789, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7659/20000 [10:25:02<34:04:53,  9.94s/it][2022-12-22 00:24:28,213] [INFO] [logging.py:68:log_dist] [Rank 0] step=7660, skipped=16, lr=[6.3369230769230776e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:24:28,213] [INFO] [timer.py:197:stop] 0/1660, RunningAvgSamplesPerSec=10.94784184563563, CurrSamplesPerSec=10.985368554222617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7660/20000 [10:25:12<34:06:55,  9.95s/it][2022-12-22 00:24:37,239] [INFO] [timer.py:197:stop] 0/1661, RunningAvgSamplesPerSec=10.947877653433276, CurrSamplesPerSec=11.007570888066109, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7661/20000 [10:25:21<33:09:35,  9.67s/it][2022-12-22 00:24:48,520] [INFO] [timer.py:197:stop] 0/1662, RunningAvgSamplesPerSec=10.947977754711745, CurrSamplesPerSec=11.116605198662159, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7662/20000 [10:25:32<34:48:29, 10.16s/it][2022-12-22 00:24:57,959] [INFO] [timer.py:197:stop] 0/1663, RunningAvgSamplesPerSec=10.947983485300176, CurrSamplesPerSec=10.95750453998765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7663/20000 [10:25:42<34:04:03,  9.94s/it][2022-12-22 00:25:07,188] [INFO] [timer.py:197:stop] 0/1664, RunningAvgSamplesPerSec=10.947853128502908, CurrSamplesPerSec=10.735532221699291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7664/20000 [10:25:51<33:19:58,  9.73s/it][2022-12-22 00:25:16,706] [INFO] [timer.py:197:stop] 0/1665, RunningAvgSamplesPerSec=10.947893095812331, CurrSamplesPerSec=11.014724503511424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7665/20000 [10:26:01<33:06:55,  9.66s/it][2022-12-22 00:25:26,024] [INFO] [timer.py:197:stop] 0/1666, RunningAvgSamplesPerSec=10.947684366881234, CurrSamplesPerSec=10.6112420826437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7666/20000 [10:26:10<32:45:21,  9.56s/it][2022-12-22 00:25:35,561] [INFO] [timer.py:197:stop] 0/1667, RunningAvgSamplesPerSec=10.947531907304755, CurrSamplesPerSec=10.699588347455203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7667/20000 [10:26:20<32:43:43,  9.55s/it][2022-12-22 00:25:44,927] [INFO] [timer.py:197:stop] 0/1668, RunningAvgSamplesPerSec=10.947601118483686, CurrSamplesPerSec=11.06406438303051, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7668/20000 [10:26:29<32:32:01,  9.50s/it][2022-12-22 00:25:55,285] [INFO] [timer.py:197:stop] 0/1669, RunningAvgSamplesPerSec=10.947784114607977, CurrSamplesPerSec=11.261394247471356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7669/20000 [10:26:39<33:24:53,  9.76s/it][2022-12-22 00:26:05,557] [INFO] [logging.py:68:log_dist] [Rank 0] step=7670, skipped=16, lr=[6.331794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:26:05,558] [INFO] [timer.py:197:stop] 0/1670, RunningAvgSamplesPerSec=10.947850162033413, CurrSamplesPerSec=11.059070418393336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7670/20000 [10:26:50<33:56:39,  9.91s/it][2022-12-22 00:26:14,709] [INFO] [timer.py:197:stop] 0/1671, RunningAvgSamplesPerSec=10.947841668840812, CurrSamplesPerSec=10.933693342671635, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7671/20000 [10:26:59<33:09:45,  9.68s/it][2022-12-22 00:26:25,301] [INFO] [timer.py:197:stop] 0/1672, RunningAvgSamplesPerSec=10.947793142876476, CurrSamplesPerSec=10.867398410735507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7672/20000 [10:27:09<34:05:30,  9.96s/it][2022-12-22 00:26:35,484] [INFO] [timer.py:197:stop] 0/1673, RunningAvgSamplesPerSec=10.947675057993747, CurrSamplesPerSec=10.753964720277207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7673/20000 [10:27:19<34:19:24, 10.02s/it][2022-12-22 00:26:44,539] [INFO] [timer.py:197:stop] 0/1674, RunningAvgSamplesPerSec=10.947692173249012, CurrSamplesPerSec=10.976366718588983, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7674/20000 [10:27:29<33:19:28,  9.73s/it][2022-12-22 00:26:54,157] [INFO] [timer.py:197:stop] 0/1675, RunningAvgSamplesPerSec=10.947853935605625, CurrSamplesPerSec=11.22517593160104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7675/20000 [10:27:38<33:12:15,  9.70s/it]

                                                          
{'loss': 0.0776, 'learning_rate': 6.3292307692307695e-06, 'epoch': 0.38}


 38%|███▊      | 7675/20000 [10:27:38<33:12:15,  9.70s/it][2022-12-22 00:27:03,284] [INFO] [timer.py:197:stop] 0/1676, RunningAvgSamplesPerSec=10.94761681320417, CurrSamplesPerSec=10.564791657278402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7676/20000 [10:27:47<32:36:51,  9.53s/it][2022-12-22 00:27:12,972] [INFO] [timer.py:197:stop] 0/1677, RunningAvgSamplesPerSec=10.947405349717856, CurrSamplesPerSec=10.604509797802185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7677/20000 [10:27:57<32:46:37,  9.58s/it][2022-12-22 00:27:21,984] [INFO] [timer.py:197:stop] 0/1678, RunningAvgSamplesPerSec=10.94761761351256, CurrSamplesPerSec=11.315101228537975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7678/20000 [10:28:06<32:11:46,  9.41s/it][2022-12-22 00:27:32,174] [INFO] [timer.py:197:stop] 0/1679, RunningAvgSamplesPerSec=10.94738695769977, CurrSamplesPerSec=10.57400086329804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7679/20000 [10:28:16<32:59:52,  9.64s/it][2022-12-22 00:27:44,333] [INFO] [logging.py:68:log_dist] [Rank 0] step=7680, skipped=16, lr=[6.326666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:27:44,334] [INFO] [timer.py:197:stop] 0/1680, RunningAvgSamplesPerSec=10.947528209333123, CurrSamplesPerSec=11.189649257499763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7680/20000 [10:28:28<35:34:49, 10.40s/it][2022-12-22 00:27:53,865] [INFO] [timer.py:197:stop] 0/1681, RunningAvgSamplesPerSec=10.947583314101696, CurrSamplesPerSec=11.040837229129055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7681/20000 [10:28:38<34:41:20, 10.14s/it][2022-12-22 00:28:04,750] [INFO] [timer.py:197:stop] 0/1682, RunningAvgSamplesPerSec=10.947628335960415, CurrSamplesPerSec=11.023745930140612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7682/20000 [10:28:49<35:27:12, 10.36s/it][2022-12-22 00:28:13,799] [INFO] [timer.py:197:stop] 0/1683, RunningAvgSamplesPerSec=10.947609691824974, CurrSamplesPerSec=10.91637695728698, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7683/20000 [10:28:58<34:06:13,  9.97s/it][2022-12-22 00:28:24,108] [INFO] [timer.py:197:stop] 0/1684, RunningAvgSamplesPerSec=10.947419037695266, CurrSamplesPerSec=10.636050299020159, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7684/20000 [10:29:08<34:27:02, 10.07s/it][2022-12-22 00:28:33,172] [INFO] [timer.py:197:stop] 0/1685, RunningAvgSamplesPerSec=10.947625935884592, CurrSamplesPerSec=11.30706119896725, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7685/20000 [10:29:17<33:24:58,  9.77s/it][2022-12-22 00:28:42,133] [INFO] [timer.py:197:stop] 0/1686, RunningAvgSamplesPerSec=10.947603169447909, CurrSamplesPerSec=10.9094209711768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7686/20000 [10:29:26<32:35:02,  9.53s/it][2022-12-22 00:28:51,506] [INFO] [timer.py:197:stop] 0/1687, RunningAvgSamplesPerSec=10.947688983269197, CurrSamplesPerSec=11.094133689466949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7687/20000 [10:29:35<32:25:28,  9.48s/it][2022-12-22 00:29:02,181] [INFO] [timer.py:197:stop] 0/1688, RunningAvgSamplesPerSec=10.94759397070796, CurrSamplesPerSec=10.789806635545965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7688/20000 [10:29:46<33:38:55,  9.84s/it][2022-12-22 00:29:12,816] [INFO] [timer.py:197:stop] 0/1689, RunningAvgSamplesPerSec=10.947555080454169, CurrSamplesPerSec=10.882376721470818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7689/20000 [10:29:57<34:27:44, 10.08s/it][2022-12-22 00:29:22,101] [INFO] [logging.py:68:log_dist] [Rank 0] step=7690, skipped=16, lr=[6.321538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:29:22,102] [INFO] [timer.py:197:stop] 0/1690, RunningAvgSamplesPerSec=10.947301711342243, CurrSamplesPerSec=10.535939055994652, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7690/20000 [10:30:06<33:38:48,  9.84s/it][2022-12-22 00:29:30,939] [INFO] [timer.py:197:stop] 0/1691, RunningAvgSamplesPerSec=10.947501695371923, CurrSamplesPerSec=11.295821767060172, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7691/20000 [10:30:15<32:36:58,  9.54s/it][2022-12-22 00:29:40,053] [INFO] [timer.py:197:stop] 0/1692, RunningAvgSamplesPerSec=10.947626986494836, CurrSamplesPerSec=11.16341737269906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7692/20000 [10:30:24<32:10:42,  9.41s/it][2022-12-22 00:29:50,236] [INFO] [timer.py:197:stop] 0/1693, RunningAvgSamplesPerSec=10.947382127499262, CurrSamplesPerSec=10.548651389227933, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7693/20000 [10:30:34<32:57:56,  9.64s/it][2022-12-22 00:29:59,155] [INFO] [timer.py:197:stop] 0/1694, RunningAvgSamplesPerSec=10.94742696683921, CurrSamplesPerSec=11.02377943066086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7694/20000 [10:30:43<32:13:14,  9.43s/it][2022-12-22 00:30:09,475] [INFO] [timer.py:197:stop] 0/1695, RunningAvgSamplesPerSec=10.947487841648186, CurrSamplesPerSec=11.05146689051028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7695/20000 [10:30:53<33:08:02,  9.69s/it][2022-12-22 00:30:18,655] [INFO] [timer.py:197:stop] 0/1696, RunningAvgSamplesPerSec=10.94757537116236, CurrSamplesPerSec=11.097797460858352, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7696/20000 [10:31:03<32:36:19,  9.54s/it][2022-12-22 00:30:28,125] [INFO] [timer.py:197:stop] 0/1697, RunningAvgSamplesPerSec=10.947538547054842, CurrSamplesPerSec=10.885512149429095, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7697/20000 [10:31:12<32:31:49,  9.52s/it][2022-12-22 00:30:38,504] [INFO] [timer.py:197:stop] 0/1698, RunningAvgSamplesPerSec=10.947542473527477, CurrSamplesPerSec=10.954201895512186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7698/20000 [10:31:22<33:24:34,  9.78s/it][2022-12-22 00:30:48,819] [INFO] [timer.py:197:stop] 0/1699, RunningAvgSamplesPerSec=10.947612712181117, CurrSamplesPerSec=11.068048747572846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7699/20000 [10:31:33<33:57:32,  9.94s/it][2022-12-22 00:30:57,818] [INFO] [logging.py:68:log_dist] [Rank 0] step=7700, skipped=16, lr=[6.316410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:30:57,818] [INFO] [timer.py:197:stop] 0/1700, RunningAvgSamplesPerSec=10.947700709930245, CurrSamplesPerSec=11.09909926001858, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 38%|███▊      | 7700/20000 [10:31:42<32:59:36,  9.66s/it]

                                                          
{'loss': 0.1006, 'learning_rate': 6.316410256410257e-06, 'epoch': 0.39}


 38%|███▊      | 7700/20000 [10:31:42<32:59:36,  9.66s/it][2022-12-22 00:31:06,943] [INFO] [timer.py:197:stop] 0/1701, RunningAvgSamplesPerSec=10.947801631552613, CurrSamplesPerSec=11.12189319006603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7701/20000 [10:31:51<32:26:44,  9.50s/it][2022-12-22 00:31:16,724] [INFO] [timer.py:197:stop] 0/1702, RunningAvgSamplesPerSec=10.947935502652781, CurrSamplesPerSec=11.180210941548465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7702/20000 [10:32:01<32:44:02,  9.58s/it][2022-12-22 00:31:26,197] [INFO] [timer.py:197:stop] 0/1703, RunningAvgSamplesPerSec=10.94781116443115, CurrSamplesPerSec=10.740442318939321, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7703/20000 [10:32:10<32:37:09,  9.55s/it][2022-12-22 00:31:35,212] [INFO] [timer.py:197:stop] 0/1704, RunningAvgSamplesPerSec=10.947927286341633, CurrSamplesPerSec=11.1490820396354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7704/20000 [10:32:19<32:04:08,  9.39s/it][2022-12-22 00:31:44,990] [INFO] [timer.py:197:stop] 0/1705, RunningAvgSamplesPerSec=10.947705608940526, CurrSamplesPerSec=10.582987476862137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7705/20000 [10:32:29<32:27:53,  9.51s/it][2022-12-22 00:31:53,861] [INFO] [timer.py:197:stop] 0/1706, RunningAvgSamplesPerSec=10.947711621347494, CurrSamplesPerSec=10.95796034142356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7706/20000 [10:32:38<31:48:42,  9.32s/it][2022-12-22 00:32:06,575] [INFO] [timer.py:197:stop] 0/1707, RunningAvgSamplesPerSec=10.947880761561779, CurrSamplesPerSec=11.243893108491875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7707/20000 [10:32:51<35:17:29, 10.34s/it][2022-12-22 00:32:16,789] [INFO] [timer.py:197:stop] 0/1708, RunningAvgSamplesPerSec=10.94785706157126, CurrSamplesPerSec=10.907597263594937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7708/20000 [10:33:01<35:09:51, 10.30s/it][2022-12-22 00:32:25,834] [INFO] [timer.py:197:stop] 0/1709, RunningAvgSamplesPerSec=10.948000781553656, CurrSamplesPerSec=11.198807309335452, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7709/20000 [10:33:10<33:52:38,  9.92s/it][2022-12-22 00:32:35,163] [INFO] [logging.py:68:log_dist] [Rank 0] step=7710, skipped=16, lr=[6.311282051282051e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:32:35,164] [INFO] [timer.py:197:stop] 0/1710, RunningAvgSamplesPerSec=10.947881401988544, CurrSamplesPerSec=10.74782643511977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7710/20000 [10:33:19<33:16:02,  9.74s/it][2022-12-22 00:32:44,109] [INFO] [timer.py:197:stop] 0/1711, RunningAvgSamplesPerSec=10.94775022605829, CurrSamplesPerSec=10.728197568753608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7711/20000 [10:33:28<32:26:43,  9.50s/it][2022-12-22 00:32:53,620] [INFO] [timer.py:197:stop] 0/1712, RunningAvgSamplesPerSec=10.947809951425993, CurrSamplesPerSec=11.05084177231266, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7712/20000 [10:33:38<32:26:58,  9.51s/it][2022-12-22 00:33:02,656] [INFO] [timer.py:197:stop] 0/1713, RunningAvgSamplesPerSec=10.94765843153894, CurrSamplesPerSec=10.694553187478204, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7713/20000 [10:33:47<31:57:55,  9.37s/it][2022-12-22 00:33:12,296] [INFO] [timer.py:197:stop] 0/1714, RunningAvgSamplesPerSec=10.947425309444258, CurrSamplesPerSec=10.562583402006634, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7714/20000 [10:33:56<32:14:34,  9.45s/it][2022-12-22 00:33:21,438] [INFO] [timer.py:197:stop] 0/1715, RunningAvgSamplesPerSec=10.947426350677311, CurrSamplesPerSec=10.949209232145765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7715/20000 [10:34:05<31:55:38,  9.36s/it][2022-12-22 00:33:30,594] [INFO] [timer.py:197:stop] 0/1716, RunningAvgSamplesPerSec=10.94730060666145, CurrSamplesPerSec=10.73605991369972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7716/20000 [10:34:15<31:43:14,  9.30s/it][2022-12-22 00:33:39,784] [INFO] [timer.py:197:stop] 0/1717, RunningAvgSamplesPerSec=10.947260500465147, CurrSamplesPerSec=10.878947692425658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7717/20000 [10:34:24<31:36:33,  9.26s/it][2022-12-22 00:33:49,110] [INFO] [timer.py:197:stop] 0/1718, RunningAvgSamplesPerSec=10.947279420999196, CurrSamplesPerSec=10.97982466014487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7718/20000 [10:34:33<31:40:10,  9.28s/it][2022-12-22 00:33:58,351] [INFO] [timer.py:197:stop] 0/1719, RunningAvgSamplesPerSec=10.947242242243545, CurrSamplesPerSec=10.883813366119936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7719/20000 [10:34:42<31:37:28,  9.27s/it][2022-12-22 00:34:07,157] [INFO] [logging.py:68:log_dist] [Rank 0] step=7720, skipped=16, lr=[6.306153846153846e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:34:07,158] [INFO] [timer.py:197:stop] 0/1720, RunningAvgSamplesPerSec=10.947276700364869, CurrSamplesPerSec=11.006762975696185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7720/20000 [10:34:51<31:08:51,  9.13s/it][2022-12-22 00:34:16,577] [INFO] [timer.py:197:stop] 0/1721, RunningAvgSamplesPerSec=10.947342393215658, CurrSamplesPerSec=11.06137904238664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7721/20000 [10:35:01<31:26:21,  9.22s/it][2022-12-22 00:34:25,681] [INFO] [timer.py:197:stop] 0/1722, RunningAvgSamplesPerSec=10.947310931156796, CurrSamplesPerSec=10.893493681370467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7722/20000 [10:35:10<31:19:16,  9.18s/it][2022-12-22 00:34:35,383] [INFO] [timer.py:197:stop] 0/1723, RunningAvgSamplesPerSec=10.94720800094231, CurrSamplesPerSec=10.772987196366499, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7723/20000 [10:35:19<31:50:54,  9.34s/it][2022-12-22 00:34:44,396] [INFO] [timer.py:197:stop] 0/1724, RunningAvgSamplesPerSec=10.94726543481731, CurrSamplesPerSec=11.047010260675007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7724/20000 [10:35:28<31:30:45,  9.24s/it][2022-12-22 00:34:53,390] [INFO] [timer.py:197:stop] 0/1725, RunningAvgSamplesPerSec=10.947291078109561, CurrSamplesPerSec=10.991627770766058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7725/20000 [10:35:37<31:15:26,  9.17s/it]

                                                          
{'loss': 0.0914, 'learning_rate': 6.303589743589744e-06, 'epoch': 0.39}


 39%|███▊      | 7725/20000 [10:35:37<31:15:26,  9.17s/it][2022-12-22 00:35:02,387] [INFO] [timer.py:197:stop] 0/1726, RunningAvgSamplesPerSec=10.94718560948591, CurrSamplesPerSec=10.768432186170747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7726/20000 [10:35:46<31:04:54,  9.12s/it][2022-12-22 00:35:12,075] [INFO] [timer.py:197:stop] 0/1727, RunningAvgSamplesPerSec=10.947320093699581, CurrSamplesPerSec=11.18419041010684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7727/20000 [10:35:56<31:39:45,  9.29s/it][2022-12-22 00:35:21,192] [INFO] [timer.py:197:stop] 0/1728, RunningAvgSamplesPerSec=10.947300015691386, CurrSamplesPerSec=10.9127747443449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7728/20000 [10:36:05<31:29:09,  9.24s/it][2022-12-22 00:35:30,514] [INFO] [timer.py:197:stop] 0/1729, RunningAvgSamplesPerSec=10.947217625657554, CurrSamplesPerSec=10.806837038399866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7729/20000 [10:36:14<31:34:19,  9.26s/it][2022-12-22 00:35:39,757] [INFO] [logging.py:68:log_dist] [Rank 0] step=7730, skipped=16, lr=[6.301025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:35:39,758] [INFO] [timer.py:197:stop] 0/1730, RunningAvgSamplesPerSec=10.947028860907672, CurrSamplesPerSec=10.630464709340734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7730/20000 [10:36:24<31:32:56,  9.26s/it][2022-12-22 00:35:49,134] [INFO] [timer.py:197:stop] 0/1731, RunningAvgSamplesPerSec=10.947167052272496, CurrSamplesPerSec=11.191289957248165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7731/20000 [10:36:33<31:40:07,  9.29s/it][2022-12-22 00:35:58,098] [INFO] [timer.py:197:stop] 0/1732, RunningAvgSamplesPerSec=10.947130867873126, CurrSamplesPerSec=10.884923760450418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7732/20000 [10:36:42<31:19:48,  9.19s/it][2022-12-22 00:36:07,156] [INFO] [timer.py:197:stop] 0/1733, RunningAvgSamplesPerSec=10.947051463828632, CurrSamplesPerSec=10.811385849886014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7733/20000 [10:36:51<31:11:20,  9.15s/it][2022-12-22 00:36:17,082] [INFO] [timer.py:197:stop] 0/1734, RunningAvgSamplesPerSec=10.947059988664233, CurrSamplesPerSec=10.961836409014095, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7734/20000 [10:37:01<31:58:34,  9.38s/it][2022-12-22 00:36:26,169] [INFO] [timer.py:197:stop] 0/1735, RunningAvgSamplesPerSec=10.947067116205094, CurrSamplesPerSec=10.959425961973936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7735/20000 [10:37:10<31:40:13,  9.30s/it][2022-12-22 00:36:35,518] [INFO] [timer.py:197:stop] 0/1736, RunningAvgSamplesPerSec=10.946973575611564, CurrSamplesPerSec=10.78723455214055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7736/20000 [10:37:19<31:43:18,  9.31s/it][2022-12-22 00:36:46,173] [INFO] [timer.py:197:stop] 0/1737, RunningAvgSamplesPerSec=10.946984594952653, CurrSamplesPerSec=10.966125561485223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7737/20000 [10:37:30<33:05:30,  9.71s/it][2022-12-22 00:36:55,313] [INFO] [timer.py:197:stop] 0/1738, RunningAvgSamplesPerSec=10.947089180213165, CurrSamplesPerSec=11.131604842238843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7738/20000 [10:37:39<32:30:07,  9.54s/it][2022-12-22 00:37:04,881] [INFO] [timer.py:197:stop] 0/1739, RunningAvgSamplesPerSec=10.94707506086701, CurrSamplesPerSec=10.922618666877604, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7739/20000 [10:37:49<32:31:33,  9.55s/it][2022-12-22 00:37:14,960] [INFO] [logging.py:68:log_dist] [Rank 0] step=7740, skipped=16, lr=[6.295897435897437e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:37:14,961] [INFO] [timer.py:197:stop] 0/1740, RunningAvgSamplesPerSec=10.947182891831945, CurrSamplesPerSec=11.137747649899199, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7740/20000 [10:37:59<33:04:47,  9.71s/it][2022-12-22 00:37:23,969] [INFO] [timer.py:197:stop] 0/1741, RunningAvgSamplesPerSec=10.947279252237607, CurrSamplesPerSec=11.11735702933758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7741/20000 [10:38:08<32:20:27,  9.50s/it][2022-12-22 00:37:32,975] [INFO] [timer.py:197:stop] 0/1742, RunningAvgSamplesPerSec=10.947294815697868, CurrSamplesPerSec=10.974426789698107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7742/20000 [10:38:17<31:50:08,  9.35s/it][2022-12-22 00:37:41,772] [INFO] [timer.py:197:stop] 0/1743, RunningAvgSamplesPerSec=10.947452705526665, CurrSamplesPerSec=11.229257001650616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7743/20000 [10:38:26<31:16:09,  9.18s/it][2022-12-22 00:37:51,442] [INFO] [timer.py:197:stop] 0/1744, RunningAvgSamplesPerSec=10.947377585986013, CurrSamplesPerSec=10.818139300933417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7744/20000 [10:38:35<31:45:47,  9.33s/it][2022-12-22 00:38:00,864] [INFO] [timer.py:197:stop] 0/1745, RunningAvgSamplesPerSec=10.947183358031483, CurrSamplesPerSec=10.61898764412165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7745/20000 [10:38:45<31:51:14,  9.36s/it][2022-12-22 00:38:09,778] [INFO] [timer.py:197:stop] 0/1746, RunningAvgSamplesPerSec=10.947295635210006, CurrSamplesPerSec=11.146558927507149, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7746/20000 [10:38:54<31:23:55,  9.22s/it][2022-12-22 00:38:19,102] [INFO] [timer.py:197:stop] 0/1747, RunningAvgSamplesPerSec=10.947173458791362, CurrSamplesPerSec=10.738168193666645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7747/20000 [10:39:03<31:29:51,  9.25s/it][2022-12-22 00:38:29,395] [INFO] [timer.py:197:stop] 0/1748, RunningAvgSamplesPerSec=10.946906393878736, CurrSamplesPerSec=10.499918073123679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7748/20000 [10:39:13<32:33:23,  9.57s/it][2022-12-22 00:38:39,197] [INFO] [timer.py:197:stop] 0/1749, RunningAvgSamplesPerSec=10.946885121002035, CurrSamplesPerSec=10.909868346987157, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▊      | 7749/20000 [10:39:23<32:47:39,  9.64s/it][2022-12-22 00:38:49,608] [INFO] [logging.py:68:log_dist] [Rank 0] step=7750, skipped=16, lr=[6.290769230769232e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:38:49,609] [INFO] [timer.py:197:stop] 0/1750, RunningAvgSamplesPerSec=10.946904647981425, CurrSamplesPerSec=10.98112498219996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7750/20000 [10:39:34<33:35:02,  9.87s/it]

                                                          
{'loss': 0.0831, 'learning_rate': 6.290769230769232e-06, 'epoch': 0.39}


 39%|███▉      | 7750/20000 [10:39:34<33:35:02,  9.87s/it][2022-12-22 00:39:00,570] [INFO] [timer.py:197:stop] 0/1751, RunningAvgSamplesPerSec=10.946974858059338, CurrSamplesPerSec=11.071094382017375, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7751/20000 [10:39:45<34:41:38, 10.20s/it][2022-12-22 00:39:10,466] [INFO] [timer.py:197:stop] 0/1752, RunningAvgSamplesPerSec=10.947044481906236, CurrSamplesPerSec=11.070187181047308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7752/20000 [10:39:54<34:23:03, 10.11s/it][2022-12-22 00:39:19,379] [INFO] [timer.py:197:stop] 0/1753, RunningAvgSamplesPerSec=10.94705165591967, CurrSamplesPerSec=10.959620602247144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7753/20000 [10:40:03<33:09:51,  9.75s/it][2022-12-22 00:39:28,953] [INFO] [timer.py:197:stop] 0/1754, RunningAvgSamplesPerSec=10.947099941018939, CurrSamplesPerSec=11.032305590338622, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7754/20000 [10:40:13<32:58:58,  9.70s/it][2022-12-22 00:39:38,846] [INFO] [timer.py:197:stop] 0/1755, RunningAvgSamplesPerSec=10.947169425862954, CurrSamplesPerSec=11.070276661800623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7755/20000 [10:40:23<33:10:50,  9.76s/it][2022-12-22 00:39:47,716] [INFO] [timer.py:197:stop] 0/1756, RunningAvgSamplesPerSec=10.947219000145484, CurrSamplesPerSec=11.034818516627098, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7756/20000 [10:40:32<32:16:29,  9.49s/it][2022-12-22 00:40:00,470] [INFO] [timer.py:197:stop] 0/1757, RunningAvgSamplesPerSec=10.947069929091391, CurrSamplesPerSec=10.69170223192863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7757/20000 [10:40:44<35:36:12, 10.47s/it][2022-12-22 00:40:11,182] [INFO] [timer.py:197:stop] 0/1758, RunningAvgSamplesPerSec=10.947059964973665, CurrSamplesPerSec=10.929600843764485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7758/20000 [10:40:55<35:50:54, 10.54s/it][2022-12-22 00:40:21,192] [INFO] [timer.py:197:stop] 0/1759, RunningAvgSamplesPerSec=10.947180412778117, CurrSamplesPerSec=11.16285611939385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7759/20000 [10:41:05<35:18:11, 10.38s/it][2022-12-22 00:40:30,822] [INFO] [logging.py:68:log_dist] [Rank 0] step=7760, skipped=16, lr=[6.285641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:40:30,823] [INFO] [timer.py:197:stop] 0/1760, RunningAvgSamplesPerSec=10.947120704097474, CurrSamplesPerSec=10.843208923541642, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7760/20000 [10:41:15<34:31:58, 10.16s/it][2022-12-22 00:40:40,626] [INFO] [timer.py:197:stop] 0/1761, RunningAvgSamplesPerSec=10.947099144043174, CurrSamplesPerSec=10.909327421508126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7761/20000 [10:41:25<34:10:11, 10.05s/it][2022-12-22 00:40:49,936] [INFO] [timer.py:197:stop] 0/1762, RunningAvgSamplesPerSec=10.947203660955479, CurrSamplesPerSec=11.134190923332223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7762/20000 [10:41:34<33:24:42,  9.83s/it][2022-12-22 00:40:58,930] [INFO] [timer.py:197:stop] 0/1763, RunningAvgSamplesPerSec=10.94718529329783, CurrSamplesPerSec=10.914953450660091, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7763/20000 [10:41:43<32:33:28,  9.58s/it][2022-12-22 00:41:08,654] [INFO] [timer.py:197:stop] 0/1764, RunningAvgSamplesPerSec=10.947179940467908, CurrSamplesPerSec=10.93776172136652, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7764/20000 [10:41:53<32:42:13,  9.62s/it][2022-12-22 00:41:19,281] [INFO] [timer.py:197:stop] 0/1765, RunningAvgSamplesPerSec=10.947082006454872, CurrSamplesPerSec=10.777201633196848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7765/20000 [10:42:03<33:43:33,  9.92s/it][2022-12-22 00:41:28,389] [INFO] [timer.py:197:stop] 0/1766, RunningAvgSamplesPerSec=10.947049670739363, CurrSamplesPerSec=10.890337307172876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7766/20000 [10:42:12<32:53:31,  9.68s/it][2022-12-22 00:41:37,512] [INFO] [timer.py:197:stop] 0/1767, RunningAvgSamplesPerSec=10.947038545245553, CurrSamplesPerSec=10.927448314582318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7767/20000 [10:42:21<32:19:21,  9.51s/it][2022-12-22 00:41:47,254] [INFO] [timer.py:197:stop] 0/1768, RunningAvgSamplesPerSec=10.947052116472523, CurrSamplesPerSec=10.971057888799882, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7768/20000 [10:42:31<32:33:14,  9.58s/it][2022-12-22 00:41:56,398] [INFO] [timer.py:197:stop] 0/1769, RunningAvgSamplesPerSec=10.947073178856721, CurrSamplesPerSec=10.984396238152977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7769/20000 [10:42:40<32:06:19,  9.45s/it][2022-12-22 00:42:05,713] [INFO] [logging.py:68:log_dist] [Rank 0] step=7770, skipped=16, lr=[6.280512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:42:05,714] [INFO] [timer.py:197:stop] 0/1770, RunningAvgSamplesPerSec=10.94696039506155, CurrSamplesPerSec=10.751236589363577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7770/20000 [10:42:50<31:58:00,  9.41s/it][2022-12-22 00:42:15,468] [INFO] [timer.py:197:stop] 0/1771, RunningAvgSamplesPerSec=10.94711128314771, CurrSamplesPerSec=11.220548581421351, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7771/20000 [10:42:59<32:18:53,  9.51s/it][2022-12-22 00:42:24,270] [INFO] [timer.py:197:stop] 0/1772, RunningAvgSamplesPerSec=10.947222321585214, CurrSamplesPerSec=11.14724028668543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7772/20000 [10:43:08<31:35:16,  9.30s/it][2022-12-22 00:42:34,143] [INFO] [timer.py:197:stop] 0/1773, RunningAvgSamplesPerSec=10.947079218716004, CurrSamplesPerSec=10.699518405902612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7773/20000 [10:43:18<32:10:12,  9.47s/it][2022-12-22 00:42:45,439] [INFO] [timer.py:197:stop] 0/1774, RunningAvgSamplesPerSec=10.947055886135296, CurrSamplesPerSec=10.905889365265601, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7774/20000 [10:43:29<34:01:30, 10.02s/it][2022-12-22 00:42:54,821] [INFO] [timer.py:197:stop] 0/1775, RunningAvgSamplesPerSec=10.94708733648234, CurrSamplesPerSec=11.003102678262175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7775/20000 [10:43:39<33:22:28,  9.83s/it]

                                                          
{'loss': 0.0716, 'learning_rate': 6.2779487179487185e-06, 'epoch': 0.39}


 39%|███▉      | 7775/20000 [10:43:39<33:22:28,  9.83s/it][2022-12-22 00:43:04,002] [INFO] [timer.py:197:stop] 0/1776, RunningAvgSamplesPerSec=10.947024289758168, CurrSamplesPerSec=10.836372963720263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7776/20000 [10:43:48<32:42:43,  9.63s/it][2022-12-22 00:43:14,568] [INFO] [timer.py:197:stop] 0/1777, RunningAvgSamplesPerSec=10.94715207989316, CurrSamplesPerSec=11.178648436715926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7777/20000 [10:43:59<33:39:33,  9.91s/it][2022-12-22 00:43:24,188] [INFO] [timer.py:197:stop] 0/1778, RunningAvgSamplesPerSec=10.947100002102115, CurrSamplesPerSec=10.855436373161739, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7778/20000 [10:44:08<33:21:25,  9.83s/it][2022-12-22 00:43:33,701] [INFO] [timer.py:197:stop] 0/1779, RunningAvgSamplesPerSec=10.946988004498731, CurrSamplesPerSec=10.751631897368322, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7779/20000 [10:44:18<33:02:09,  9.73s/it][2022-12-22 00:43:42,867] [INFO] [logging.py:68:log_dist] [Rank 0] step=7780, skipped=16, lr=[6.2753846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:43:42,868] [INFO] [timer.py:197:stop] 0/1780, RunningAvgSamplesPerSec=10.946903658160267, CurrSamplesPerSec=10.799045802624585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7780/20000 [10:44:27<32:27:30,  9.56s/it][2022-12-22 00:43:52,252] [INFO] [timer.py:197:stop] 0/1781, RunningAvgSamplesPerSec=10.946744139454452, CurrSamplesPerSec=10.670286770997476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7781/20000 [10:44:36<32:16:29,  9.51s/it][2022-12-22 00:44:01,721] [INFO] [timer.py:197:stop] 0/1782, RunningAvgSamplesPerSec=10.94681000952967, CurrSamplesPerSec=11.0652615805504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7782/20000 [10:44:46<32:13:54,  9.50s/it][2022-12-22 00:44:10,951] [INFO] [timer.py:197:stop] 0/1783, RunningAvgSamplesPerSec=10.946815149726982, CurrSamplesPerSec=10.955972359006404, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7783/20000 [10:44:55<31:57:25,  9.42s/it][2022-12-22 00:44:20,322] [INFO] [timer.py:197:stop] 0/1784, RunningAvgSamplesPerSec=10.946826316490487, CurrSamplesPerSec=10.966750540604913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7784/20000 [10:45:04<31:54:27,  9.40s/it][2022-12-22 00:44:29,392] [INFO] [timer.py:197:stop] 0/1785, RunningAvgSamplesPerSec=10.946996141179431, CurrSamplesPerSec=11.258232638095084, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7785/20000 [10:45:13<31:33:57,  9.30s/it][2022-12-22 00:44:38,687] [INFO] [timer.py:197:stop] 0/1786, RunningAvgSamplesPerSec=10.947071743029076, CurrSamplesPerSec=11.08355134160972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7786/20000 [10:45:23<31:33:18,  9.30s/it][2022-12-22 00:44:47,926] [INFO] [timer.py:197:stop] 0/1787, RunningAvgSamplesPerSec=10.947056193934934, CurrSamplesPerSec=10.919386762976714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7787/20000 [10:45:32<31:29:23,  9.28s/it][2022-12-22 00:44:57,080] [INFO] [timer.py:197:stop] 0/1788, RunningAvgSamplesPerSec=10.946985461203976, CurrSamplesPerSec=10.82216793576513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7788/20000 [10:45:41<31:21:24,  9.24s/it][2022-12-22 00:45:06,728] [INFO] [timer.py:197:stop] 0/1789, RunningAvgSamplesPerSec=10.946857084280406, CurrSamplesPerSec=10.722282237502252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7789/20000 [10:45:51<31:45:54,  9.36s/it][2022-12-22 00:45:15,666] [INFO] [logging.py:68:log_dist] [Rank 0] step=7790, skipped=16, lr=[6.270256410256411e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:45:15,667] [INFO] [timer.py:197:stop] 0/1790, RunningAvgSamplesPerSec=10.9468345957433, CurrSamplesPerSec=10.906794653158546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7790/20000 [10:46:00<31:19:44,  9.24s/it][2022-12-22 00:45:26,746] [INFO] [timer.py:197:stop] 0/1791, RunningAvgSamplesPerSec=10.946802060115798, CurrSamplesPerSec=10.888936042805877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7791/20000 [10:46:11<33:12:09,  9.79s/it][2022-12-22 00:45:37,689] [INFO] [timer.py:197:stop] 0/1792, RunningAvgSamplesPerSec=10.946839841334102, CurrSamplesPerSec=11.0148506039436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7792/20000 [10:46:22<34:22:15, 10.14s/it][2022-12-22 00:45:47,202] [INFO] [timer.py:197:stop] 0/1793, RunningAvgSamplesPerSec=10.94675327174759, CurrSamplesPerSec=10.79395785475986, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7793/20000 [10:46:31<33:44:04,  9.95s/it][2022-12-22 00:45:55,901] [INFO] [timer.py:197:stop] 0/1794, RunningAvgSamplesPerSec=10.94693501274029, CurrSamplesPerSec=11.282413889019416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7794/20000 [10:46:40<32:27:40,  9.57s/it][2022-12-22 00:46:05,379] [INFO] [timer.py:197:stop] 0/1795, RunningAvgSamplesPerSec=10.94698214123915, CurrSamplesPerSec=11.032093397761455, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7795/20000 [10:46:49<32:21:37,  9.55s/it][2022-12-22 00:46:14,357] [INFO] [timer.py:197:stop] 0/1796, RunningAvgSamplesPerSec=10.946896614034339, CurrSamplesPerSec=10.795666040206614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7796/20000 [10:46:58<31:46:53,  9.38s/it][2022-12-22 00:46:24,913] [INFO] [timer.py:197:stop] 0/1797, RunningAvgSamplesPerSec=10.946824336324086, CurrSamplesPerSec=10.818676889368975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7797/20000 [10:47:09<32:58:45,  9.73s/it][2022-12-22 00:46:34,925] [INFO] [timer.py:197:stop] 0/1798, RunningAvgSamplesPerSec=10.946800370084759, CurrSamplesPerSec=10.903949462401494, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7798/20000 [10:47:19<33:15:51,  9.81s/it][2022-12-22 00:46:44,314] [INFO] [timer.py:197:stop] 0/1799, RunningAvgSamplesPerSec=10.946723996115322, CurrSamplesPerSec=10.81125478568431, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7799/20000 [10:47:28<32:49:48,  9.69s/it][2022-12-22 00:46:53,864] [INFO] [logging.py:68:log_dist] [Rank 0] step=7800, skipped=16, lr=[6.265128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:46:53,865] [INFO] [timer.py:197:stop] 0/1800, RunningAvgSamplesPerSec=10.94667828304828, CurrSamplesPerSec=10.865144093297403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7800/20000 [10:47:38<32:41:20,  9.65s/it]

                                                          
{'loss': 0.074, 'learning_rate': 6.265128205128206e-06, 'epoch': 0.39}


 39%|███▉      | 7800/20000 [10:47:38<32:41:20,  9.65s/it][2022-12-22 00:47:02,826] [INFO] [timer.py:197:stop] 0/1801, RunningAvgSamplesPerSec=10.94679599447893, CurrSamplesPerSec=11.162616130037115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7801/20000 [10:47:47<31:59:21,  9.44s/it][2022-12-22 00:47:11,963] [INFO] [timer.py:197:stop] 0/1802, RunningAvgSamplesPerSec=10.946662638646865, CurrSamplesPerSec=10.711903343188792, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7802/20000 [10:47:56<31:40:44,  9.35s/it][2022-12-22 00:47:22,149] [INFO] [timer.py:197:stop] 0/1803, RunningAvgSamplesPerSec=10.946643902648653, CurrSamplesPerSec=10.913022744630213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7803/20000 [10:48:06<32:31:35,  9.60s/it][2022-12-22 00:47:34,623] [INFO] [timer.py:197:stop] 0/1804, RunningAvgSamplesPerSec=10.946771794747953, CurrSamplesPerSec=11.182058948327132, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7804/20000 [10:48:19<35:26:39, 10.46s/it][2022-12-22 00:47:43,580] [INFO] [timer.py:197:stop] 0/1805, RunningAvgSamplesPerSec=10.946805258361453, CurrSamplesPerSec=11.00744089192453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7805/20000 [10:48:28<33:54:41, 10.01s/it][2022-12-22 00:47:52,766] [INFO] [timer.py:197:stop] 0/1806, RunningAvgSamplesPerSec=10.946927610479884, CurrSamplesPerSec=11.172067992115993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7806/20000 [10:48:37<33:04:13,  9.76s/it][2022-12-22 00:48:02,253] [INFO] [timer.py:197:stop] 0/1807, RunningAvgSamplesPerSec=10.946950669559053, CurrSamplesPerSec=10.988708014884375, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7807/20000 [10:48:46<32:47:14,  9.68s/it][2022-12-22 00:48:13,073] [INFO] [timer.py:197:stop] 0/1808, RunningAvgSamplesPerSec=10.946995915718551, CurrSamplesPerSec=11.029279444368662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7808/20000 [10:48:57<33:56:32, 10.02s/it][2022-12-22 00:48:22,760] [INFO] [timer.py:197:stop] 0/1809, RunningAvgSamplesPerSec=10.94671784865009, CurrSamplesPerSec=10.466568157192704, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7809/20000 [10:49:07<33:35:55,  9.92s/it][2022-12-22 00:48:32,287] [INFO] [logging.py:68:log_dist] [Rank 0] step=7810, skipped=16, lr=[6.26e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:48:32,288] [INFO] [timer.py:197:stop] 0/1810, RunningAvgSamplesPerSec=10.946635120545459, CurrSamplesPerSec=10.799160496288641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7810/20000 [10:49:16<33:11:47,  9.80s/it][2022-12-22 00:48:42,027] [INFO] [timer.py:197:stop] 0/1811, RunningAvgSamplesPerSec=10.946519572286896, CurrSamplesPerSec=10.741522790688778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7811/20000 [10:49:26<33:07:40,  9.78s/it][2022-12-22 00:48:51,130] [INFO] [timer.py:197:stop] 0/1812, RunningAvgSamplesPerSec=10.946509685402061, CurrSamplesPerSec=10.92865350187564, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7812/20000 [10:49:35<32:25:57,  9.58s/it][2022-12-22 00:49:01,830] [INFO] [timer.py:197:stop] 0/1813, RunningAvgSamplesPerSec=10.946455261238263, CurrSamplesPerSec=10.848826575920379, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7813/20000 [10:49:46<33:34:05,  9.92s/it][2022-12-22 00:49:11,843] [INFO] [timer.py:197:stop] 0/1814, RunningAvgSamplesPerSec=10.946332457175918, CurrSamplesPerSec=10.728365216295881, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7814/20000 [10:49:56<33:39:48,  9.94s/it][2022-12-22 00:49:21,374] [INFO] [timer.py:197:stop] 0/1815, RunningAvgSamplesPerSec=10.946405212453634, CurrSamplesPerSec=11.079845747973241, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7815/20000 [10:50:05<33:14:26,  9.82s/it][2022-12-22 00:49:32,579] [INFO] [timer.py:197:stop] 0/1816, RunningAvgSamplesPerSec=10.946359505392332, CurrSamplesPerSec=10.864115555609517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7816/20000 [10:50:17<34:38:36, 10.24s/it][2022-12-22 00:49:41,659] [INFO] [timer.py:197:stop] 0/1817, RunningAvgSamplesPerSec=10.946234682382721, CurrSamplesPerSec=10.724397106009768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7817/20000 [10:50:26<33:28:01,  9.89s/it][2022-12-22 00:49:51,540] [INFO] [timer.py:197:stop] 0/1818, RunningAvgSamplesPerSec=10.94627216954193, CurrSamplesPerSec=11.014737158621589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7818/20000 [10:50:36<33:27:21,  9.89s/it][2022-12-22 00:50:01,181] [INFO] [timer.py:197:stop] 0/1819, RunningAvgSamplesPerSec=10.946270566636752, CurrSamplesPerSec=10.943360465124337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7819/20000 [10:50:45<33:12:14,  9.81s/it][2022-12-22 00:50:10,112] [INFO] [logging.py:68:log_dist] [Rank 0] step=7820, skipped=16, lr=[6.254871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:50:10,113] [INFO] [timer.py:197:stop] 0/1820, RunningAvgSamplesPerSec=10.946292267488387, CurrSamplesPerSec=10.985865342458146, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7820/20000 [10:50:54<32:18:22,  9.55s/it][2022-12-22 00:50:18,923] [INFO] [timer.py:197:stop] 0/1821, RunningAvgSamplesPerSec=10.946434867276018, CurrSamplesPerSec=11.21197354123256, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7821/20000 [10:51:03<31:33:13,  9.33s/it][2022-12-22 00:50:28,393] [INFO] [timer.py:197:stop] 0/1822, RunningAvgSamplesPerSec=10.946531053784161, CurrSamplesPerSec=11.124337839144921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7822/20000 [10:51:12<31:41:48,  9.37s/it][2022-12-22 00:50:37,197] [INFO] [timer.py:197:stop] 0/1823, RunningAvgSamplesPerSec=10.946659332626915, CurrSamplesPerSec=11.185217528954283, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7823/20000 [10:51:21<31:07:12,  9.20s/it][2022-12-22 00:50:46,543] [INFO] [timer.py:197:stop] 0/1824, RunningAvgSamplesPerSec=10.94676390784298, CurrSamplesPerSec=11.140568683283178, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7824/20000 [10:51:31<31:15:52,  9.24s/it][2022-12-22 00:50:57,732] [INFO] [timer.py:197:stop] 0/1825, RunningAvgSamplesPerSec=10.946804617178485, CurrSamplesPerSec=11.02148330556155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7825/20000 [10:51:42<33:14:08,  9.83s/it]

                                                          
{'loss': 0.0734, 'learning_rate': 6.252307692307693e-06, 'epoch': 0.39}


 39%|███▉      | 7825/20000 [10:51:42<33:14:08,  9.83s/it][2022-12-22 00:51:07,059] [INFO] [timer.py:197:stop] 0/1826, RunningAvgSamplesPerSec=10.946717683828348, CurrSamplesPerSec=10.790501030770773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7826/20000 [10:51:51<32:43:33,  9.68s/it][2022-12-22 00:51:16,830] [INFO] [timer.py:197:stop] 0/1827, RunningAvgSamplesPerSec=10.946759499949485, CurrSamplesPerSec=11.023567565933806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7827/20000 [10:52:01<32:49:02,  9.71s/it][2022-12-22 00:51:27,768] [INFO] [timer.py:197:stop] 0/1828, RunningAvgSamplesPerSec=10.946874379017988, CurrSamplesPerSec=11.160624662969955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7828/20000 [10:52:12<34:03:56, 10.08s/it][2022-12-22 00:51:37,502] [INFO] [timer.py:197:stop] 0/1829, RunningAvgSamplesPerSec=10.946772348985384, CurrSamplesPerSec=10.76358494554602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7829/20000 [10:52:21<33:42:59,  9.97s/it][2022-12-22 00:51:46,602] [INFO] [logging.py:68:log_dist] [Rank 0] step=7830, skipped=16, lr=[6.24974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:51:46,603] [INFO] [timer.py:197:stop] 0/1830, RunningAvgSamplesPerSec=10.946873290862985, CurrSamplesPerSec=11.134456017200213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7830/20000 [10:52:31<32:49:46,  9.71s/it][2022-12-22 00:51:55,465] [INFO] [timer.py:197:stop] 0/1831, RunningAvgSamplesPerSec=10.94693239696333, CurrSamplesPerSec=11.056055984689962, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7831/20000 [10:52:39<31:57:56,  9.46s/it][2022-12-22 00:52:04,976] [INFO] [timer.py:197:stop] 0/1832, RunningAvgSamplesPerSec=10.946914537485808, CurrSamplesPerSec=10.91434678659261, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7832/20000 [10:52:49<32:01:04,  9.47s/it][2022-12-22 00:52:14,342] [INFO] [timer.py:197:stop] 0/1833, RunningAvgSamplesPerSec=10.946823516885091, CurrSamplesPerSec=10.782753680886065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7833/20000 [10:52:58<31:54:24,  9.44s/it][2022-12-22 00:52:23,477] [INFO] [timer.py:197:stop] 0/1834, RunningAvgSamplesPerSec=10.946826546747575, CurrSamplesPerSec=10.952377039391484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7834/20000 [10:53:07<31:35:42,  9.35s/it][2022-12-22 00:52:32,833] [INFO] [timer.py:197:stop] 0/1835, RunningAvgSamplesPerSec=10.946792280777489, CurrSamplesPerSec=10.884375154967312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7835/20000 [10:53:17<31:35:55,  9.35s/it][2022-12-22 00:52:42,315] [INFO] [timer.py:197:stop] 0/1836, RunningAvgSamplesPerSec=10.946641409921527, CurrSamplesPerSec=10.676913028023234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7836/20000 [10:53:26<31:43:43,  9.39s/it][2022-12-22 00:52:52,807] [INFO] [timer.py:197:stop] 0/1837, RunningAvgSamplesPerSec=10.946613945702154, CurrSamplesPerSec=10.896475398975898, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7837/20000 [10:53:37<32:50:37,  9.72s/it][2022-12-22 00:53:01,605] [INFO] [timer.py:197:stop] 0/1838, RunningAvgSamplesPerSec=10.94673458794452, CurrSamplesPerSec=11.17268504469337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7838/20000 [10:53:46<31:54:17,  9.44s/it][2022-12-22 00:53:11,918] [INFO] [timer.py:197:stop] 0/1839, RunningAvgSamplesPerSec=10.946850252899306, CurrSamplesPerSec=11.163414587183507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7839/20000 [10:53:56<32:46:57,  9.70s/it][2022-12-22 00:53:20,965] [INFO] [logging.py:68:log_dist] [Rank 0] step=7840, skipped=16, lr=[6.244615384615386e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:53:20,966] [INFO] [timer.py:197:stop] 0/1840, RunningAvgSamplesPerSec=10.94695713289093, CurrSamplesPerSec=11.146883395912075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7840/20000 [10:54:05<32:06:52,  9.51s/it][2022-12-22 00:53:30,685] [INFO] [timer.py:197:stop] 0/1841, RunningAvgSamplesPerSec=10.94685109967417, CurrSamplesPerSec=10.75537282918613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7841/20000 [10:54:15<32:19:37,  9.57s/it][2022-12-22 00:53:39,626] [INFO] [timer.py:197:stop] 0/1842, RunningAvgSamplesPerSec=10.946960701476124, CurrSamplesPerSec=11.152301243861592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7842/20000 [10:54:24<31:41:07,  9.38s/it][2022-12-22 00:53:48,699] [INFO] [timer.py:197:stop] 0/1843, RunningAvgSamplesPerSec=10.947002008974005, CurrSamplesPerSec=11.023539498995385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7843/20000 [10:54:33<31:22:12,  9.29s/it][2022-12-22 00:53:57,943] [INFO] [timer.py:197:stop] 0/1844, RunningAvgSamplesPerSec=10.946980334813194, CurrSamplesPerSec=10.90722319963876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7844/20000 [10:54:42<31:19:16,  9.28s/it][2022-12-22 00:54:06,998] [INFO] [timer.py:197:stop] 0/1845, RunningAvgSamplesPerSec=10.94697812491159, CurrSamplesPerSec=10.942909000083528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7845/20000 [10:54:51<31:05:39,  9.21s/it][2022-12-22 00:54:16,699] [INFO] [timer.py:197:stop] 0/1846, RunningAvgSamplesPerSec=10.946908181073823, CurrSamplesPerSec=10.819502778116794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7846/20000 [10:55:01<31:35:25,  9.36s/it][2022-12-22 00:54:26,570] [INFO] [timer.py:197:stop] 0/1847, RunningAvgSamplesPerSec=10.947043193610542, CurrSamplesPerSec=11.201803335584943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7847/20000 [10:55:11<32:06:28,  9.51s/it][2022-12-22 00:54:36,836] [INFO] [timer.py:197:stop] 0/1848, RunningAvgSamplesPerSec=10.94702689770213, CurrSamplesPerSec=10.917043340997164, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7848/20000 [10:55:21<32:52:09,  9.74s/it][2022-12-22 00:54:45,858] [INFO] [timer.py:197:stop] 0/1849, RunningAvgSamplesPerSec=10.94705781462353, CurrSamplesPerSec=11.004429722793871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7849/20000 [10:55:30<32:08:32,  9.52s/it][2022-12-22 00:54:55,202] [INFO] [logging.py:68:log_dist] [Rank 0] step=7850, skipped=16, lr=[6.239487179487181e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:54:55,203] [INFO] [timer.py:197:stop] 0/1850, RunningAvgSamplesPerSec=10.946989014386348, CurrSamplesPerSec=10.821373921724392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7850/20000 [10:55:39<31:57:35,  9.47s/it]

                                                          
{'loss': 0.0797, 'learning_rate': 6.239487179487181e-06, 'epoch': 0.39}


 39%|███▉      | 7850/20000 [10:55:39<31:57:35,  9.47s/it][2022-12-22 00:55:04,551] [INFO] [timer.py:197:stop] 0/1851, RunningAvgSamplesPerSec=10.946898967285358, CurrSamplesPerSec=10.782984977919693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7851/20000 [10:55:49<31:50:04,  9.43s/it][2022-12-22 00:55:13,716] [INFO] [timer.py:197:stop] 0/1852, RunningAvgSamplesPerSec=10.946998736254123, CurrSamplesPerSec=11.134635216721316, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7852/20000 [10:55:58<31:33:37,  9.35s/it][2022-12-22 00:55:23,099] [INFO] [timer.py:197:stop] 0/1853, RunningAvgSamplesPerSec=10.946896524411708, CurrSamplesPerSec=10.761017150611291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7853/20000 [10:56:07<31:35:16,  9.36s/it][2022-12-22 00:55:32,214] [INFO] [timer.py:197:stop] 0/1854, RunningAvgSamplesPerSec=10.947078316281207, CurrSamplesPerSec=11.294252443437427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7854/20000 [10:56:16<31:20:09,  9.29s/it][2022-12-22 00:55:41,353] [INFO] [timer.py:197:stop] 0/1855, RunningAvgSamplesPerSec=10.947180118779904, CurrSamplesPerSec=11.13902417193394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7855/20000 [10:56:25<31:10:55,  9.24s/it][2022-12-22 00:55:50,243] [INFO] [timer.py:197:stop] 0/1856, RunningAvgSamplesPerSec=10.94729495570391, CurrSamplesPerSec=11.16430834475056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7856/20000 [10:56:34<30:49:22,  9.14s/it][2022-12-22 00:56:01,262] [INFO] [timer.py:197:stop] 0/1857, RunningAvgSamplesPerSec=10.947326141177953, CurrSamplesPerSec=11.00545116061835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7857/20000 [10:56:45<32:43:27,  9.70s/it][2022-12-22 00:56:12,198] [INFO] [timer.py:197:stop] 0/1858, RunningAvgSamplesPerSec=10.947412425290818, CurrSamplesPerSec=11.109845594785154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7858/20000 [10:56:56<33:58:15, 10.07s/it][2022-12-22 00:56:21,248] [INFO] [timer.py:197:stop] 0/1859, RunningAvgSamplesPerSec=10.947454194129461, CurrSamplesPerSec=11.02553034257269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7859/20000 [10:57:05<32:56:00,  9.77s/it][2022-12-22 00:56:29,969] [INFO] [logging.py:68:log_dist] [Rank 0] step=7860, skipped=16, lr=[6.234358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:56:29,970] [INFO] [timer.py:197:stop] 0/1860, RunningAvgSamplesPerSec=10.947610488380993, CurrSamplesPerSec=11.24575751810929, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7860/20000 [10:57:14<31:52:30,  9.45s/it][2022-12-22 00:56:39,584] [INFO] [timer.py:197:stop] 0/1861, RunningAvgSamplesPerSec=10.947589872022679, CurrSamplesPerSec=10.909418310974486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7861/20000 [10:57:24<32:02:11,  9.50s/it][2022-12-22 00:56:49,094] [INFO] [timer.py:197:stop] 0/1862, RunningAvgSamplesPerSec=10.94745003050205, CurrSamplesPerSec=10.693517926983994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7862/20000 [10:57:33<32:02:35,  9.50s/it][2022-12-22 00:56:58,328] [INFO] [timer.py:197:stop] 0/1863, RunningAvgSamplesPerSec=10.947415332321528, CurrSamplesPerSec=10.883255165204359, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7863/20000 [10:57:42<31:46:05,  9.42s/it][2022-12-22 00:57:07,405] [INFO] [timer.py:197:stop] 0/1864, RunningAvgSamplesPerSec=10.947437281208769, CurrSamplesPerSec=10.988437220796907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7864/20000 [10:57:51<31:24:56,  9.32s/it][2022-12-22 00:57:17,066] [INFO] [timer.py:197:stop] 0/1865, RunningAvgSamplesPerSec=10.94713102873078, CurrSamplesPerSec=10.405136853859581, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7865/20000 [10:58:01<31:45:31,  9.42s/it][2022-12-22 00:57:26,149] [INFO] [timer.py:197:stop] 0/1866, RunningAvgSamplesPerSec=10.947137388601513, CurrSamplesPerSec=10.958998672519622, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7866/20000 [10:58:10<31:24:47,  9.32s/it][2022-12-22 00:57:35,074] [INFO] [timer.py:197:stop] 0/1867, RunningAvgSamplesPerSec=10.947269886082152, CurrSamplesPerSec=11.199948797460033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7867/20000 [10:58:19<31:00:43,  9.20s/it][2022-12-22 00:57:44,660] [INFO] [timer.py:197:stop] 0/1868, RunningAvgSamplesPerSec=10.947099331895902, CurrSamplesPerSec=10.638001857441466, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7868/20000 [10:58:29<31:23:51,  9.32s/it][2022-12-22 00:57:54,223] [INFO] [timer.py:197:stop] 0/1869, RunningAvgSamplesPerSec=10.947092264071031, CurrSamplesPerSec=10.933919581216134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7869/20000 [10:58:38<31:38:38,  9.39s/it][2022-12-22 00:58:03,596] [INFO] [logging.py:68:log_dist] [Rank 0] step=7870, skipped=16, lr=[6.22923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:58:03,597] [INFO] [timer.py:197:stop] 0/1870, RunningAvgSamplesPerSec=10.947029789664779, CurrSamplesPerSec=10.831620409436049, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7870/20000 [10:58:48<31:37:28,  9.39s/it][2022-12-22 00:58:12,511] [INFO] [timer.py:197:stop] 0/1871, RunningAvgSamplesPerSec=10.946943463469923, CurrSamplesPerSec=10.788028333079543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7871/20000 [10:58:56<31:08:42,  9.24s/it][2022-12-22 00:58:21,956] [INFO] [timer.py:197:stop] 0/1872, RunningAvgSamplesPerSec=10.946914521617622, CurrSamplesPerSec=10.893088315045588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7872/20000 [10:59:06<31:20:42,  9.30s/it][2022-12-22 00:58:32,024] [INFO] [timer.py:197:stop] 0/1873, RunningAvgSamplesPerSec=10.947040660722108, CurrSamplesPerSec=11.18811815409597, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7873/20000 [10:59:16<32:06:53,  9.53s/it][2022-12-22 00:58:41,302] [INFO] [timer.py:197:stop] 0/1874, RunningAvgSamplesPerSec=10.947123603797277, CurrSamplesPerSec=11.10454286662314, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7874/20000 [10:59:25<31:51:14,  9.46s/it][2022-12-22 00:58:50,371] [INFO] [timer.py:197:stop] 0/1875, RunningAvgSamplesPerSec=10.947114903128655, CurrSamplesPerSec=10.930851461938582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7875/20000 [10:59:34<31:27:33,  9.34s/it]

                                                          
{'loss': 0.0735, 'learning_rate': 6.2266666666666675e-06, 'epoch': 0.39}


 39%|███▉      | 7875/20000 [10:59:34<31:27:33,  9.34s/it][2022-12-22 00:59:00,046] [INFO] [timer.py:197:stop] 0/1876, RunningAvgSamplesPerSec=10.94708159306133, CurrSamplesPerSec=10.885045582204084, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7876/20000 [10:59:44<31:47:45,  9.44s/it][2022-12-22 00:59:09,450] [INFO] [timer.py:197:stop] 0/1877, RunningAvgSamplesPerSec=10.94690650889025, CurrSamplesPerSec=10.62835179442193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7877/20000 [10:59:53<31:45:16,  9.43s/it][2022-12-22 00:59:18,985] [INFO] [timer.py:197:stop] 0/1878, RunningAvgSamplesPerSec=10.94692673417727, CurrSamplesPerSec=10.98498104563534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7878/20000 [11:00:03<31:51:30,  9.46s/it][2022-12-22 00:59:28,209] [INFO] [timer.py:197:stop] 0/1879, RunningAvgSamplesPerSec=10.947088733338255, CurrSamplesPerSec=11.259681921604376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7879/20000 [11:00:12<31:36:57,  9.39s/it][2022-12-22 00:59:37,849] [INFO] [logging.py:68:log_dist] [Rank 0] step=7880, skipped=16, lr=[6.2241025641025645e-06], mom=[[0.9, 0.999]]
[2022-12-22 00:59:37,850] [INFO] [timer.py:197:stop] 0/1880, RunningAvgSamplesPerSec=10.947093007730057, CurrSamplesPerSec=10.95512192860424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7880/20000 [11:00:22<31:51:58,  9.47s/it][2022-12-22 00:59:47,132] [INFO] [timer.py:197:stop] 0/1881, RunningAvgSamplesPerSec=10.946892228835432, CurrSamplesPerSec=10.582391287190477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7881/20000 [11:00:31<31:40:44,  9.41s/it][2022-12-22 00:59:57,164] [INFO] [timer.py:197:stop] 0/1882, RunningAvgSamplesPerSec=10.946889022250856, CurrSamplesPerSec=10.940867166029818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7882/20000 [11:00:41<32:18:16,  9.60s/it][2022-12-22 01:00:06,561] [INFO] [timer.py:197:stop] 0/1883, RunningAvgSamplesPerSec=10.946900352706857, CurrSamplesPerSec=10.96824316243453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7883/20000 [11:00:51<32:05:58,  9.54s/it][2022-12-22 01:00:15,961] [INFO] [timer.py:197:stop] 0/1884, RunningAvgSamplesPerSec=10.946937833964038, CurrSamplesPerSec=11.01789732651392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7884/20000 [11:01:00<31:57:31,  9.50s/it][2022-12-22 01:00:24,992] [INFO] [timer.py:197:stop] 0/1885, RunningAvgSamplesPerSec=10.946962056954709, CurrSamplesPerSec=10.992740466889787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7885/20000 [11:01:09<31:29:13,  9.36s/it][2022-12-22 01:00:33,824] [INFO] [timer.py:197:stop] 0/1886, RunningAvgSamplesPerSec=10.947023532202406, CurrSamplesPerSec=11.064019236650534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7886/20000 [11:01:18<30:57:17,  9.20s/it][2022-12-22 01:00:42,825] [INFO] [timer.py:197:stop] 0/1887, RunningAvgSamplesPerSec=10.947056008393993, CurrSamplesPerSec=11.008585234237001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7887/20000 [11:01:27<30:45:06,  9.14s/it][2022-12-22 01:00:53,103] [INFO] [timer.py:197:stop] 0/1888, RunningAvgSamplesPerSec=10.94697802173697, CurrSamplesPerSec=10.801922134061995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7888/20000 [11:01:37<31:53:54,  9.48s/it][2022-12-22 01:01:03,011] [INFO] [timer.py:197:stop] 0/1889, RunningAvgSamplesPerSec=10.947010520950128, CurrSamplesPerSec=11.008649342500528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7889/20000 [11:01:47<32:19:37,  9.61s/it][2022-12-22 01:01:12,090] [INFO] [logging.py:68:log_dist] [Rank 0] step=7890, skipped=16, lr=[6.2189743589743586e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:01:12,090] [INFO] [timer.py:197:stop] 0/1890, RunningAvgSamplesPerSec=10.94694912119353, CurrSamplesPerSec=10.832301838136829, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7890/20000 [11:01:56<31:47:22,  9.45s/it][2022-12-22 01:01:21,859] [INFO] [timer.py:197:stop] 0/1891, RunningAvgSamplesPerSec=10.946982059131239, CurrSamplesPerSec=11.009524359497652, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7891/20000 [11:02:06<32:06:31,  9.55s/it][2022-12-22 01:01:31,260] [INFO] [timer.py:197:stop] 0/1892, RunningAvgSamplesPerSec=10.946884333196959, CurrSamplesPerSec=10.76534310941209, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7892/20000 [11:02:15<31:57:35,  9.50s/it][2022-12-22 01:01:40,255] [INFO] [timer.py:197:stop] 0/1893, RunningAvgSamplesPerSec=10.946844714037313, CurrSamplesPerSec=10.872473496378372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7893/20000 [11:02:24<31:26:42,  9.35s/it][2022-12-22 01:01:49,361] [INFO] [timer.py:197:stop] 0/1894, RunningAvgSamplesPerSec=10.94698725948591, CurrSamplesPerSec=11.223349309999431, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7894/20000 [11:02:33<31:11:45,  9.28s/it][2022-12-22 01:01:59,008] [INFO] [timer.py:197:stop] 0/1895, RunningAvgSamplesPerSec=10.947048082279252, CurrSamplesPerSec=11.06334801272628, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7895/20000 [11:02:43<31:33:59,  9.39s/it][2022-12-22 01:02:08,149] [INFO] [timer.py:197:stop] 0/1896, RunningAvgSamplesPerSec=10.946874419200139, CurrSamplesPerSec=10.627719766784828, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7896/20000 [11:02:52<31:18:52,  9.31s/it][2022-12-22 01:02:17,410] [INFO] [timer.py:197:stop] 0/1897, RunningAvgSamplesPerSec=10.946905330874321, CurrSamplesPerSec=11.005767014578993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7897/20000 [11:03:01<31:15:34,  9.30s/it][2022-12-22 01:02:26,882] [INFO] [timer.py:197:stop] 0/1898, RunningAvgSamplesPerSec=10.946808676268084, CurrSamplesPerSec=10.766663944606012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7898/20000 [11:03:11<31:25:55,  9.35s/it][2022-12-22 01:02:36,088] [INFO] [timer.py:197:stop] 0/1899, RunningAvgSamplesPerSec=10.946767257192528, CurrSamplesPerSec=10.868796337359319, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 39%|███▉      | 7899/20000 [11:03:20<31:17:02,  9.31s/it][2022-12-22 01:02:45,299] [INFO] [logging.py:68:log_dist] [Rank 0] step=7900, skipped=16, lr=[6.213846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:02:45,300] [INFO] [timer.py:197:stop] 0/1900, RunningAvgSamplesPerSec=10.946781812757672, CurrSamplesPerSec=10.974463580488754, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7900/20000 [11:03:29<31:11:09,  9.28s/it]

                                                          
{'loss': 0.0783, 'learning_rate': 6.213846153846155e-06, 'epoch': 0.4}


 40%|███▉      | 7900/20000 [11:03:29<31:11:09,  9.28s/it][2022-12-22 01:02:54,479] [INFO] [timer.py:197:stop] 0/1901, RunningAvgSamplesPerSec=10.946933392363666, CurrSamplesPerSec=11.2424008016398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7901/20000 [11:03:38<31:04:59,  9.25s/it][2022-12-22 01:03:03,791] [INFO] [timer.py:197:stop] 0/1902, RunningAvgSamplesPerSec=10.946941344287717, CurrSamplesPerSec=10.962062918422193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7902/20000 [11:03:48<31:08:40,  9.27s/it][2022-12-22 01:03:12,747] [INFO] [timer.py:197:stop] 0/1903, RunningAvgSamplesPerSec=10.946991256689696, CurrSamplesPerSec=11.042653980865165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7903/20000 [11:03:57<30:49:38,  9.17s/it][2022-12-22 01:03:21,668] [INFO] [timer.py:197:stop] 0/1904, RunningAvgSamplesPerSec=10.947116377693186, CurrSamplesPerSec=11.190257058028951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7904/20000 [11:04:06<30:34:10,  9.10s/it][2022-12-22 01:03:30,714] [INFO] [timer.py:197:stop] 0/1905, RunningAvgSamplesPerSec=10.947097698013643, CurrSamplesPerSec=10.911683943114548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7905/20000 [11:04:15<30:30:52,  9.08s/it][2022-12-22 01:03:42,847] [INFO] [timer.py:197:stop] 0/1906, RunningAvgSamplesPerSec=10.94702258700103, CurrSamplesPerSec=10.805929562374182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7906/20000 [11:04:27<33:35:12, 10.00s/it][2022-12-22 01:03:53,125] [INFO] [timer.py:197:stop] 0/1907, RunningAvgSamplesPerSec=10.946935552157134, CurrSamplesPerSec=10.783693657571115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7907/20000 [11:04:37<33:51:58, 10.08s/it][2022-12-22 01:04:02,280] [INFO] [timer.py:197:stop] 0/1908, RunningAvgSamplesPerSec=10.947062742596449, CurrSamplesPerSec=11.194847780605961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7908/20000 [11:04:46<32:55:49,  9.80s/it][2022-12-22 01:04:11,130] [INFO] [timer.py:197:stop] 0/1909, RunningAvgSamplesPerSec=10.947104759374847, CurrSamplesPerSec=11.027779225906961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7909/20000 [11:04:55<31:57:57,  9.52s/it][2022-12-22 01:04:20,451] [INFO] [logging.py:68:log_dist] [Rank 0] step=7910, skipped=16, lr=[6.208717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:04:20,452] [INFO] [timer.py:197:stop] 0/1910, RunningAvgSamplesPerSec=10.947232259603803, CurrSamplesPerSec=11.195901139737337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7910/20000 [11:05:04<31:45:59,  9.46s/it][2022-12-22 01:04:30,610] [INFO] [timer.py:197:stop] 0/1911, RunningAvgSamplesPerSec=10.947272124731457, CurrSamplesPerSec=11.023867257315684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7911/20000 [11:05:15<32:28:03,  9.67s/it][2022-12-22 01:04:39,584] [INFO] [timer.py:197:stop] 0/1912, RunningAvgSamplesPerSec=10.947409924535041, CurrSamplesPerSec=11.216950032747999, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7912/20000 [11:05:24<31:45:55,  9.46s/it][2022-12-22 01:04:48,955] [INFO] [timer.py:197:stop] 0/1913, RunningAvgSamplesPerSec=10.947406628649482, CurrSamplesPerSec=10.941115106970939, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7913/20000 [11:05:33<31:40:21,  9.43s/it][2022-12-22 01:04:58,440] [INFO] [timer.py:197:stop] 0/1914, RunningAvgSamplesPerSec=10.947317736388941, CurrSamplesPerSec=10.780041662329518, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7914/20000 [11:05:42<31:43:19,  9.45s/it][2022-12-22 01:05:07,980] [INFO] [timer.py:197:stop] 0/1915, RunningAvgSamplesPerSec=10.947398768055715, CurrSamplesPerSec=11.104556647704127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7915/20000 [11:05:52<31:48:40,  9.48s/it][2022-12-22 01:05:16,991] [INFO] [timer.py:197:stop] 0/1916, RunningAvgSamplesPerSec=10.947448682981081, CurrSamplesPerSec=11.043776578034239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7916/20000 [11:06:01<31:20:25,  9.34s/it][2022-12-22 01:05:26,218] [INFO] [timer.py:197:stop] 0/1917, RunningAvgSamplesPerSec=10.947441758881586, CurrSamplesPerSec=10.934205064866221, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7917/20000 [11:06:10<31:13:43,  9.30s/it][2022-12-22 01:05:35,764] [INFO] [timer.py:197:stop] 0/1918, RunningAvgSamplesPerSec=10.947462907236925, CurrSamplesPerSec=10.988112465423127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7918/20000 [11:06:20<31:28:02,  9.38s/it][2022-12-22 01:05:45,465] [INFO] [timer.py:197:stop] 0/1919, RunningAvgSamplesPerSec=10.947257183315754, CurrSamplesPerSec=10.566796182048463, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7919/20000 [11:06:29<31:47:31,  9.47s/it][2022-12-22 01:05:54,767] [INFO] [logging.py:68:log_dist] [Rank 0] step=7920, skipped=16, lr=[6.203589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:05:54,768] [INFO] [timer.py:197:stop] 0/1920, RunningAvgSamplesPerSec=10.947254814586904, CurrSamplesPerSec=10.942715845095742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7920/20000 [11:06:39<31:37:03,  9.42s/it][2022-12-22 01:06:04,197] [INFO] [timer.py:197:stop] 0/1921, RunningAvgSamplesPerSec=10.94716005378631, CurrSamplesPerSec=10.768378620740062, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7921/20000 [11:06:48<31:37:17,  9.42s/it][2022-12-22 01:06:13,174] [INFO] [timer.py:197:stop] 0/1922, RunningAvgSamplesPerSec=10.94727507215392, CurrSamplesPerSec=11.172539494122288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7922/20000 [11:06:57<31:10:06,  9.29s/it][2022-12-22 01:06:23,194] [INFO] [timer.py:197:stop] 0/1923, RunningAvgSamplesPerSec=10.947442712043559, CurrSamplesPerSec=11.279066535980112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7923/20000 [11:07:07<31:54:02,  9.51s/it][2022-12-22 01:06:33,364] [INFO] [timer.py:197:stop] 0/1924, RunningAvgSamplesPerSec=10.947301496142432, CurrSamplesPerSec=10.68258878480312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7924/20000 [11:07:17<32:33:46,  9.71s/it][2022-12-22 01:06:42,368] [INFO] [timer.py:197:stop] 0/1925, RunningAvgSamplesPerSec=10.947343922748862, CurrSamplesPerSec=11.029500139144817, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7925/20000 [11:07:26<31:51:09,  9.50s/it]

                                                          
{'loss': 0.0749, 'learning_rate': 6.201025641025642e-06, 'epoch': 0.4}


 40%|███▉      | 7925/20000 [11:07:26<31:51:09,  9.50s/it][2022-12-22 01:06:51,261] [INFO] [timer.py:197:stop] 0/1926, RunningAvgSamplesPerSec=10.947434965819333, CurrSamplesPerSec=11.12535768232546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7926/20000 [11:07:35<31:14:34,  9.32s/it][2022-12-22 01:07:00,867] [INFO] [timer.py:197:stop] 0/1927, RunningAvgSamplesPerSec=10.94739953987746, CurrSamplesPerSec=10.87966198712503, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7927/20000 [11:07:45<31:31:58,  9.40s/it][2022-12-22 01:07:09,726] [INFO] [timer.py:197:stop] 0/1928, RunningAvgSamplesPerSec=10.947521860193804, CurrSamplesPerSec=11.188167116801708, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7928/20000 [11:07:54<30:58:59,  9.24s/it][2022-12-22 01:07:19,560] [INFO] [timer.py:197:stop] 0/1929, RunningAvgSamplesPerSec=10.947630750194845, CurrSamplesPerSec=11.161451144602406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7929/20000 [11:08:04<31:34:42,  9.42s/it][2022-12-22 01:07:29,368] [INFO] [logging.py:68:log_dist] [Rank 0] step=7930, skipped=16, lr=[6.198461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:07:29,369] [INFO] [timer.py:197:stop] 0/1930, RunningAvgSamplesPerSec=10.947665833338277, CurrSamplesPerSec=11.015691347283221, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7930/20000 [11:08:13<31:58:07,  9.54s/it][2022-12-22 01:07:38,310] [INFO] [timer.py:197:stop] 0/1931, RunningAvgSamplesPerSec=10.947682304635498, CurrSamplesPerSec=10.979531400359372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7931/20000 [11:08:22<31:22:12,  9.36s/it][2022-12-22 01:07:48,366] [INFO] [timer.py:197:stop] 0/1932, RunningAvgSamplesPerSec=10.947613353919364, CurrSamplesPerSec=10.816204773514855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7932/20000 [11:08:32<32:04:09,  9.57s/it][2022-12-22 01:07:57,662] [INFO] [timer.py:197:stop] 0/1933, RunningAvgSamplesPerSec=10.947615602919395, CurrSamplesPerSec=10.951957895528777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7933/20000 [11:08:42<31:47:39,  9.49s/it][2022-12-22 01:08:06,792] [INFO] [timer.py:197:stop] 0/1934, RunningAvgSamplesPerSec=10.947667626952931, CurrSamplesPerSec=11.04905688957033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7934/20000 [11:08:51<31:26:06,  9.38s/it][2022-12-22 01:08:16,135] [INFO] [timer.py:197:stop] 0/1935, RunningAvgSamplesPerSec=10.94765351610484, CurrSamplesPerSec=10.920459112920208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7935/20000 [11:09:00<31:23:45,  9.37s/it][2022-12-22 01:08:26,118] [INFO] [timer.py:197:stop] 0/1936, RunningAvgSamplesPerSec=10.947684144618533, CurrSamplesPerSec=11.007211149307777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7936/20000 [11:09:10<32:00:41,  9.55s/it][2022-12-22 01:08:35,553] [INFO] [timer.py:197:stop] 0/1937, RunningAvgSamplesPerSec=10.947602767072189, CurrSamplesPerSec=10.792450238861987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7937/20000 [11:09:20<31:53:28,  9.52s/it][2022-12-22 01:08:45,644] [INFO] [timer.py:197:stop] 0/1938, RunningAvgSamplesPerSec=10.947694363365391, CurrSamplesPerSec=11.127851368455804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7938/20000 [11:09:30<32:27:51,  9.69s/it][2022-12-22 01:08:55,796] [INFO] [timer.py:197:stop] 0/1939, RunningAvgSamplesPerSec=10.947682366506251, CurrSamplesPerSec=10.924505642897325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7939/20000 [11:09:40<32:55:38,  9.83s/it][2022-12-22 01:09:06,923] [INFO] [logging.py:68:log_dist] [Rank 0] step=7940, skipped=16, lr=[6.193333333333333e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:09:06,924] [INFO] [timer.py:197:stop] 0/1940, RunningAvgSamplesPerSec=10.947705014666237, CurrSamplesPerSec=10.991751092488569, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7940/20000 [11:09:51<34:13:51, 10.22s/it][2022-12-22 01:09:15,795] [INFO] [timer.py:197:stop] 0/1941, RunningAvgSamplesPerSec=10.94777635213972, CurrSamplesPerSec=11.087797520271488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7941/20000 [11:10:00<32:52:25,  9.81s/it][2022-12-22 01:09:28,535] [INFO] [timer.py:197:stop] 0/1942, RunningAvgSamplesPerSec=10.94788683813265, CurrSamplesPerSec=11.166397277555976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7942/20000 [11:10:12<35:48:39, 10.69s/it][2022-12-22 01:09:38,921] [INFO] [timer.py:197:stop] 0/1943, RunningAvgSamplesPerSec=10.947792076985838, CurrSamplesPerSec=10.766993016417496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7943/20000 [11:10:23<35:30:04, 10.60s/it][2022-12-22 01:09:47,769] [INFO] [timer.py:197:stop] 0/1944, RunningAvgSamplesPerSec=10.947891909343694, CurrSamplesPerSec=11.145159902785856, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7944/20000 [11:10:32<33:44:18, 10.07s/it][2022-12-22 01:09:57,846] [INFO] [timer.py:197:stop] 0/1945, RunningAvgSamplesPerSec=10.947899944270135, CurrSamplesPerSec=10.963526054478178, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7945/20000 [11:10:42<33:44:16, 10.08s/it][2022-12-22 01:10:07,330] [INFO] [timer.py:197:stop] 0/1946, RunningAvgSamplesPerSec=10.94782115131022, CurrSamplesPerSec=10.796838858595056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7946/20000 [11:10:51<33:08:28,  9.90s/it][2022-12-22 01:10:16,452] [INFO] [timer.py:197:stop] 0/1947, RunningAvgSamplesPerSec=10.947953937319841, CurrSamplesPerSec=11.212326650627862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7947/20000 [11:11:00<32:21:32,  9.67s/it][2022-12-22 01:10:26,251] [INFO] [timer.py:197:stop] 0/1948, RunningAvgSamplesPerSec=10.947932621019671, CurrSamplesPerSec=10.906628916187614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7948/20000 [11:11:10<32:29:28,  9.71s/it][2022-12-22 01:10:35,195] [INFO] [timer.py:197:stop] 0/1949, RunningAvgSamplesPerSec=10.947891776309243, CurrSamplesPerSec=10.868981170438705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7949/20000 [11:11:19<31:43:26,  9.48s/it][2022-12-22 01:10:44,096] [INFO] [logging.py:68:log_dist] [Rank 0] step=7950, skipped=16, lr=[6.188205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:10:44,097] [INFO] [timer.py:197:stop] 0/1950, RunningAvgSamplesPerSec=10.947917283067728, CurrSamplesPerSec=10.997805359066765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7950/20000 [11:11:28<31:08:37,  9.30s/it]

                                                          
{'loss': 0.0763, 'learning_rate': 6.188205128205129e-06, 'epoch': 0.4}


 40%|███▉      | 7950/20000 [11:11:28<31:08:37,  9.30s/it][2022-12-22 01:10:54,837] [INFO] [timer.py:197:stop] 0/1951, RunningAvgSamplesPerSec=10.947933917092, CurrSamplesPerSec=10.980433235410132, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7951/20000 [11:11:39<32:34:58,  9.74s/it][2022-12-22 01:11:04,013] [INFO] [timer.py:197:stop] 0/1952, RunningAvgSamplesPerSec=10.947926990321585, CurrSamplesPerSec=10.934443350465637, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7952/20000 [11:11:48<32:01:07,  9.57s/it][2022-12-22 01:11:13,945] [INFO] [timer.py:197:stop] 0/1953, RunningAvgSamplesPerSec=10.947808994415666, CurrSamplesPerSec=10.722455696422983, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7953/20000 [11:11:58<32:22:56,  9.68s/it][2022-12-22 01:11:22,885] [INFO] [timer.py:197:stop] 0/1954, RunningAvgSamplesPerSec=10.947831831860752, CurrSamplesPerSec=10.992569856867307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7954/20000 [11:12:07<31:38:23,  9.46s/it][2022-12-22 01:11:32,588] [INFO] [timer.py:197:stop] 0/1955, RunningAvgSamplesPerSec=10.94781216018588, CurrSamplesPerSec=10.909547332281159, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7955/20000 [11:12:17<31:53:06,  9.53s/it][2022-12-22 01:11:43,096] [INFO] [timer.py:197:stop] 0/1956, RunningAvgSamplesPerSec=10.947854845597282, CurrSamplesPerSec=11.031859451304062, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7956/20000 [11:12:27<32:51:52,  9.82s/it][2022-12-22 01:11:52,239] [INFO] [timer.py:197:stop] 0/1957, RunningAvgSamplesPerSec=10.947849674458094, CurrSamplesPerSec=10.937754590591457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7957/20000 [11:12:36<32:10:45,  9.62s/it][2022-12-22 01:12:01,753] [INFO] [timer.py:197:stop] 0/1958, RunningAvgSamplesPerSec=10.947692801900859, CurrSamplesPerSec=10.649368410036347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7958/20000 [11:12:46<32:04:13,  9.59s/it][2022-12-22 01:12:10,747] [INFO] [timer.py:197:stop] 0/1959, RunningAvgSamplesPerSec=10.94771398056779, CurrSamplesPerSec=10.989296880651407, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7959/20000 [11:12:55<31:28:25,  9.41s/it][2022-12-22 01:12:20,101] [INFO] [logging.py:68:log_dist] [Rank 0] step=7960, skipped=16, lr=[6.183076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:12:20,101] [INFO] [timer.py:197:stop] 0/1960, RunningAvgSamplesPerSec=10.947579567498558, CurrSamplesPerSec=10.690708396872385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7960/20000 [11:13:04<31:24:50,  9.39s/it][2022-12-22 01:12:29,811] [INFO] [timer.py:197:stop] 0/1961, RunningAvgSamplesPerSec=10.947558143510923, CurrSamplesPerSec=10.905770178007089, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7961/20000 [11:13:14<31:43:46,  9.49s/it][2022-12-22 01:12:38,591] [INFO] [timer.py:197:stop] 0/1962, RunningAvgSamplesPerSec=10.94765044893654, CurrSamplesPerSec=11.131515290521335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7962/20000 [11:13:23<31:00:57,  9.28s/it][2022-12-22 01:12:48,774] [INFO] [timer.py:197:stop] 0/1963, RunningAvgSamplesPerSec=10.94768371572757, CurrSamplesPerSec=11.013277493052685, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7963/20000 [11:13:33<31:55:27,  9.55s/it][2022-12-22 01:12:58,045] [INFO] [timer.py:197:stop] 0/1964, RunningAvgSamplesPerSec=10.947659890459912, CurrSamplesPerSec=10.901137186863656, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7964/20000 [11:13:42<31:38:35,  9.46s/it][2022-12-22 01:13:07,209] [INFO] [timer.py:197:stop] 0/1965, RunningAvgSamplesPerSec=10.947543507984781, CurrSamplesPerSec=10.723868846190216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7965/20000 [11:13:51<31:20:24,  9.37s/it][2022-12-22 01:13:16,079] [INFO] [timer.py:197:stop] 0/1966, RunningAvgSamplesPerSec=10.947696301097317, CurrSamplesPerSec=11.256082303800614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7966/20000 [11:14:00<30:49:52,  9.22s/it][2022-12-22 01:13:25,994] [INFO] [timer.py:197:stop] 0/1967, RunningAvgSamplesPerSec=10.947800319853098, CurrSamplesPerSec=11.155979895955552, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7967/20000 [11:14:10<31:31:21,  9.43s/it][2022-12-22 01:13:36,811] [INFO] [timer.py:197:stop] 0/1968, RunningAvgSamplesPerSec=10.947744031265836, CurrSamplesPerSec=10.838243821089074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7968/20000 [11:14:21<32:54:32,  9.85s/it][2022-12-22 01:13:45,693] [INFO] [timer.py:197:stop] 0/1969, RunningAvgSamplesPerSec=10.947803750197924, CurrSamplesPerSec=11.066484585751144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7969/20000 [11:14:30<31:56:23,  9.56s/it][2022-12-22 01:13:55,048] [INFO] [logging.py:68:log_dist] [Rank 0] step=7970, skipped=16, lr=[6.177948717948719e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:13:55,049] [INFO] [timer.py:197:stop] 0/1970, RunningAvgSamplesPerSec=10.947734523528265, CurrSamplesPerSec=10.813239376922253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7970/20000 [11:14:39<31:44:07,  9.50s/it][2022-12-22 01:14:04,456] [INFO] [timer.py:197:stop] 0/1971, RunningAvgSamplesPerSec=10.947824074112088, CurrSamplesPerSec=11.126944528025978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7971/20000 [11:14:48<31:38:32,  9.47s/it][2022-12-22 01:14:13,819] [INFO] [timer.py:197:stop] 0/1972, RunningAvgSamplesPerSec=10.947864602307863, CurrSamplesPerSec=11.028250860389857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7972/20000 [11:14:58<31:31:59,  9.44s/it][2022-12-22 01:14:24,123] [INFO] [timer.py:197:stop] 0/1973, RunningAvgSamplesPerSec=10.947650063738433, CurrSamplesPerSec=10.540726595216995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7973/20000 [11:15:08<32:23:53,  9.70s/it][2022-12-22 01:14:33,454] [INFO] [timer.py:197:stop] 0/1974, RunningAvgSamplesPerSec=10.94770087996417, CurrSamplesPerSec=11.04878493207356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7974/20000 [11:15:17<32:01:39,  9.59s/it][2022-12-22 01:14:45,108] [INFO] [timer.py:197:stop] 0/1975, RunningAvgSamplesPerSec=10.947629967715429, CurrSamplesPerSec=10.80955559305917, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7975/20000 [11:15:29<34:05:45, 10.21s/it]

                                                          
{'loss': 0.0712, 'learning_rate': 6.1753846153846165e-06, 'epoch': 0.4}


 40%|███▉      | 7975/20000 [11:15:29<34:05:45, 10.21s/it][2022-12-22 01:14:54,087] [INFO] [timer.py:197:stop] 0/1976, RunningAvgSamplesPerSec=10.947635575985018, CurrSamplesPerSec=10.95871189273475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7976/20000 [11:15:38<32:51:43,  9.84s/it][2022-12-22 01:15:03,431] [INFO] [timer.py:197:stop] 0/1977, RunningAvgSamplesPerSec=10.947680595037014, CurrSamplesPerSec=11.037275860130793, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7977/20000 [11:15:47<32:21:49,  9.69s/it][2022-12-22 01:15:14,130] [INFO] [timer.py:197:stop] 0/1978, RunningAvgSamplesPerSec=10.947680137992734, CurrSamplesPerSec=10.946777549999245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7978/20000 [11:15:58<33:22:15,  9.99s/it][2022-12-22 01:15:24,312] [INFO] [timer.py:197:stop] 0/1979, RunningAvgSamplesPerSec=10.947848193711572, CurrSamplesPerSec=11.290319644605475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7979/20000 [11:16:08<33:33:29, 10.05s/it][2022-12-22 01:15:33,275] [INFO] [logging.py:68:log_dist] [Rank 0] step=7980, skipped=16, lr=[6.1728205128205135e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:15:33,276] [INFO] [timer.py:197:stop] 0/1980, RunningAvgSamplesPerSec=10.947808524751803, CurrSamplesPerSec=10.869941083306527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7980/20000 [11:16:17<32:28:03,  9.72s/it][2022-12-22 01:15:42,621] [INFO] [timer.py:197:stop] 0/1981, RunningAvgSamplesPerSec=10.947790773527062, CurrSamplesPerSec=10.912791159042273, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7981/20000 [11:16:27<32:05:06,  9.61s/it][2022-12-22 01:15:53,872] [INFO] [timer.py:197:stop] 0/1982, RunningAvgSamplesPerSec=10.947729104276632, CurrSamplesPerSec=10.827031850299836, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7982/20000 [11:16:38<33:43:31, 10.10s/it][2022-12-22 01:16:02,987] [INFO] [timer.py:197:stop] 0/1983, RunningAvgSamplesPerSec=10.947775616500913, CurrSamplesPerSec=11.040651499950377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7983/20000 [11:16:47<32:44:02,  9.81s/it][2022-12-22 01:16:12,339] [INFO] [timer.py:197:stop] 0/1984, RunningAvgSamplesPerSec=10.947880190910942, CurrSamplesPerSec=11.159039794181986, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7984/20000 [11:16:56<32:16:34,  9.67s/it][2022-12-22 01:16:21,672] [INFO] [timer.py:197:stop] 0/1985, RunningAvgSamplesPerSec=10.947777405585105, CurrSamplesPerSec=10.747780390029636, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7985/20000 [11:17:06<31:56:11,  9.57s/it][2022-12-22 01:16:31,625] [INFO] [timer.py:197:stop] 0/1986, RunningAvgSamplesPerSec=10.947824239879932, CurrSamplesPerSec=11.041491645051742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7986/20000 [11:17:16<32:19:05,  9.68s/it][2022-12-22 01:16:42,475] [INFO] [timer.py:197:stop] 0/1987, RunningAvgSamplesPerSec=10.947918168775423, CurrSamplesPerSec=11.137501807426744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7987/20000 [11:17:26<33:28:56, 10.03s/it][2022-12-22 01:16:52,594] [INFO] [timer.py:197:stop] 0/1988, RunningAvgSamplesPerSec=10.947912428367653, CurrSamplesPerSec=10.93652957231595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7988/20000 [11:17:37<33:33:53, 10.06s/it][2022-12-22 01:17:03,879] [INFO] [timer.py:197:stop] 0/1989, RunningAvgSamplesPerSec=10.94796360323665, CurrSamplesPerSec=11.050549710757956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7989/20000 [11:17:48<34:47:18, 10.43s/it][2022-12-22 01:17:13,784] [INFO] [logging.py:68:log_dist] [Rank 0] step=7990, skipped=16, lr=[6.1676923076923075e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:17:13,785] [INFO] [timer.py:197:stop] 0/1990, RunningAvgSamplesPerSec=10.947966187131938, CurrSamplesPerSec=10.953102797164762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7990/20000 [11:17:58<34:15:49, 10.27s/it][2022-12-22 01:17:23,012] [INFO] [timer.py:197:stop] 0/1991, RunningAvgSamplesPerSec=10.947827868105884, CurrSamplesPerSec=10.679590393934921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7991/20000 [11:18:07<33:13:03,  9.96s/it][2022-12-22 01:17:32,938] [INFO] [timer.py:197:stop] 0/1992, RunningAvgSamplesPerSec=10.94782244946314, CurrSamplesPerSec=10.937055374119305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7992/20000 [11:18:17<33:10:57,  9.95s/it][2022-12-22 01:17:42,353] [INFO] [timer.py:197:stop] 0/1993, RunningAvgSamplesPerSec=10.947849374068541, CurrSamplesPerSec=11.001692987732355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7993/20000 [11:18:26<32:38:47,  9.79s/it][2022-12-22 01:17:51,433] [INFO] [timer.py:197:stop] 0/1994, RunningAvgSamplesPerSec=10.947994156907157, CurrSamplesPerSec=11.244056066583832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7994/20000 [11:18:35<31:56:07,  9.58s/it][2022-12-22 01:18:00,300] [INFO] [timer.py:197:stop] 0/1995, RunningAvgSamplesPerSec=10.947996556352106, CurrSamplesPerSec=10.952778339375811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7995/20000 [11:18:44<31:13:22,  9.36s/it][2022-12-22 01:18:09,530] [INFO] [timer.py:197:stop] 0/1996, RunningAvgSamplesPerSec=10.948109922597546, CurrSamplesPerSec=11.178812302298791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7996/20000 [11:18:53<31:05:15,  9.32s/it][2022-12-22 01:18:19,147] [INFO] [timer.py:197:stop] 0/1997, RunningAvgSamplesPerSec=10.948091188977505, CurrSamplesPerSec=10.910863435250262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7997/20000 [11:19:03<31:22:43,  9.41s/it][2022-12-22 01:18:28,009] [INFO] [timer.py:197:stop] 0/1998, RunningAvgSamplesPerSec=10.948130988022422, CurrSamplesPerSec=11.028110407862941, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7998/20000 [11:19:12<30:49:35,  9.25s/it][2022-12-22 01:18:38,058] [INFO] [timer.py:197:stop] 0/1999, RunningAvgSamplesPerSec=10.948236535152951, CurrSamplesPerSec=11.163044126001479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|███▉      | 7999/20000 [11:19:22<31:37:38,  9.49s/it][2022-12-22 01:18:48,682] [INFO] [logging.py:68:log_dist] [Rank 0] step=8000, skipped=16, lr=[6.1625641025641024e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:18:48,683] [INFO] [timer.py:197:stop] 0/2000, RunningAvgSamplesPerSec=10.948069715362086, CurrSamplesPerSec=10.624773120404695, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8000/20000 [11:19:33<32:45:42,  9.83s/it]

                                                          
{'loss': 0.0718, 'learning_rate': 6.1625641025641024e-06, 'epoch': 0.4}


 40%|████      | 8000/20000 [11:19:33<32:45:42,  9.83s/it][INFO|trainer.py:2955] 2022-12-22 01:18:48,688 >> ***** Running Evaluation *****
[INFO|trainer.py:2959] 2022-12-22 01:18:48,688 >>   Num examples: Unknown
[INFO|trainer.py:2960] 2022-12-22 01:18:48,688 >>   Batch size = 32
[INFO|trainer_utils.py:689] 2022-12-22 01:18:50,940 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: duration, age, input_length, gender, speaker_id. If duration, age, input_length, gender, speaker_id are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
[INFO|configuration_utils.py:523] 2022-12-22 01:18:50,952 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:18:57,458 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:03,260 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:08,846 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:14,310 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:20,377 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:27,383 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:51,916 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:19:57,636 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:02,921 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:07,698 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:13,593 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:18,668 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:24,248 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:28,921 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:34,299 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:40,912 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:46,419 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:51,761 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:20:56,943 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:02,527 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:07,783 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:13,438 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:19,417 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:24,253 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:29,493 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:35,720 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:41,106 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:46,877 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:51,958 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:21:58,197 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 01:22:02,215 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}



                                                          
{'eval_loss': 0.1585693359375, 'eval_wer': 11.862276954008545, 'eval_runtime': 230.5512, 'eval_samples_per_second': 4.337, 'eval_steps_per_second': 0.139, 'epoch': 0.4}


 40%|████      | 8000/20000 [11:23:23<32:45:42,  9.83s/it][2022-12-22 01:22:49,720] [INFO] [timer.py:197:stop] 0/2001, RunningAvgSamplesPerSec=10.948087724891836, CurrSamplesPerSec=10.984189480230436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8001/20000 [11:23:34<263:56:54, 79.19s/it][2022-12-22 01:22:58,832] [INFO] [timer.py:197:stop] 0/2002, RunningAvgSamplesPerSec=10.94799638316507, CurrSamplesPerSec=10.768401083597727, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8002/20000 [11:23:43<193:51:30, 58.17s/it][2022-12-22 01:23:08,565] [INFO] [timer.py:197:stop] 0/2003, RunningAvgSamplesPerSec=10.947976436937513, CurrSamplesPerSec=10.908228887156518, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8003/20000 [11:23:53<145:25:13, 43.64s/it][2022-12-22 01:23:17,478] [INFO] [timer.py:197:stop] 0/2004, RunningAvgSamplesPerSec=10.948095535862477, CurrSamplesPerSec=11.191718288458622, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8004/20000 [11:24:01<110:41:43, 33.22s/it][2022-12-22 01:23:26,516] [INFO] [timer.py:197:stop] 0/2005, RunningAvgSamplesPerSec=10.948000082962349, CurrSamplesPerSec=10.760183344698712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8005/20000 [11:24:10<86:30:53, 25.97s/it] [2022-12-22 01:23:35,709] [INFO] [timer.py:197:stop] 0/2006, RunningAvgSamplesPerSec=10.948047396512706, CurrSamplesPerSec=11.043644362301846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8006/20000 [11:24:20<69:44:38, 20.93s/it][2022-12-22 01:23:46,748] [INFO] [timer.py:197:stop] 0/2007, RunningAvgSamplesPerSec=10.948156822245455, CurrSamplesPerSec=11.171930361953532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8007/20000 [11:24:31<59:50:58, 17.97s/it][2022-12-22 01:23:55,986] [INFO] [timer.py:197:stop] 0/2008, RunningAvgSamplesPerSec=10.948164255000263, CurrSamplesPerSec=10.96308725174838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8008/20000 [11:24:40<51:07:22, 15.35s/it][2022-12-22 01:24:07,897] [INFO] [timer.py:197:stop] 0/2009, RunningAvgSamplesPerSec=10.948016938592364, CurrSamplesPerSec=10.660271137013966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8009/20000 [11:24:52<47:41:06, 14.32s/it][2022-12-22 01:24:19,931] [INFO] [logging.py:68:log_dist] [Rank 0] step=8010, skipped=16, lr=[6.157435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:24:19,932] [INFO] [timer.py:197:stop] 0/2010, RunningAvgSamplesPerSec=10.948098079452812, CurrSamplesPerSec=11.11340794672628, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8010/20000 [11:25:04<45:24:05, 13.63s/it][2022-12-22 01:24:33,628] [INFO] [timer.py:197:stop] 0/2011, RunningAvgSamplesPerSec=10.94804343540911, CurrSamplesPerSec=10.839407526142377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8011/20000 [11:25:18<45:27:42, 13.65s/it][2022-12-22 01:24:43,245] [INFO] [timer.py:197:stop] 0/2012, RunningAvgSamplesPerSec=10.948037074864486, CurrSamplesPerSec=10.935273645352938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8012/20000 [11:25:27<41:25:41, 12.44s/it][2022-12-22 01:24:52,156] [INFO] [timer.py:197:stop] 0/2013, RunningAvgSamplesPerSec=10.948060761753894, CurrSamplesPerSec=10.995879465687228, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8013/20000 [11:25:36<37:53:56, 11.38s/it][2022-12-22 01:25:01,396] [INFO] [timer.py:197:stop] 0/2014, RunningAvgSamplesPerSec=10.948078117619481, CurrSamplesPerSec=10.983092445047808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8014/20000 [11:25:45<35:45:20, 10.74s/it][2022-12-22 01:25:11,104] [INFO] [timer.py:197:stop] 0/2015, RunningAvgSamplesPerSec=10.948021787599158, CurrSamplesPerSec=10.835847612238338, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8015/20000 [11:25:55<34:43:24, 10.43s/it][2022-12-22 01:25:19,806] [INFO] [timer.py:197:stop] 0/2016, RunningAvgSamplesPerSec=10.948228671876485, CurrSamplesPerSec=11.381163236982436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8016/20000 [11:26:04<32:59:40,  9.91s/it][2022-12-22 01:25:29,204] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 65536.0
[2022-12-22 01:25:29,206] [INFO] [timer.py:197:stop] 0/2017, RunningAvgSamplesPerSec=10.948583346178678, CurrSamplesPerSec=11.712780345827833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8017/20000 [11:26:13<32:28:46,  9.76s/it][2022-12-22 01:25:38,902] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0
[2022-12-22 01:25:38,903] [INFO] [timer.py:197:stop] 0/2018, RunningAvgSamplesPerSec=10.948981855143696, CurrSamplesPerSec=11.815563866439788, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8018/20000 [11:26:23<32:25:02,  9.74s/it][2022-12-22 01:25:47,958] [INFO] [timer.py:197:stop] 0/2019, RunningAvgSamplesPerSec=10.9491053948743, CurrSamplesPerSec=11.203961504700304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8019/20000 [11:26:32<31:43:52,  9.53s/it][2022-12-22 01:25:57,129] [INFO] [logging.py:68:log_dist] [Rank 0] step=8020, skipped=18, lr=[6.1533333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:25:57,130] [INFO] [timer.py:197:stop] 0/2020, RunningAvgSamplesPerSec=10.949212468167106, CurrSamplesPerSec=11.169527030513247, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8020/20000 [11:26:41<31:21:58,  9.43s/it][2022-12-22 01:26:06,088] [INFO] [timer.py:197:stop] 0/2021, RunningAvgSamplesPerSec=10.949239403978776, CurrSamplesPerSec=11.003867200865828, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8021/20000 [11:26:50<30:53:49,  9.29s/it][2022-12-22 01:26:15,236] [INFO] [timer.py:197:stop] 0/2022, RunningAvgSamplesPerSec=10.949348260714096, CurrSamplesPerSec=11.173634239019087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8022/20000 [11:26:59<30:45:25,  9.24s/it][2022-12-22 01:26:24,085] [INFO] [timer.py:197:stop] 0/2023, RunningAvgSamplesPerSec=10.949478724955203, CurrSamplesPerSec=11.219519184222992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8023/20000 [11:27:08<30:21:37,  9.13s/it][2022-12-22 01:26:33,324] [INFO] [timer.py:197:stop] 0/2024, RunningAvgSamplesPerSec=10.949481885948625, CurrSamplesPerSec=10.955873984909502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8024/20000 [11:27:17<30:28:15,  9.16s/it][2022-12-22 01:26:42,270] [INFO] [timer.py:197:stop] 0/2025, RunningAvgSamplesPerSec=10.949474880852083, CurrSamplesPerSec=10.935328884035359, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8025/20000 [11:27:26<30:15:19,  9.10s/it]

                                                          
{'loss': 0.0669, 'learning_rate': 6.150769230769231e-06, 'epoch': 0.4}


 40%|████      | 8025/20000 [11:27:26<30:15:19,  9.10s/it][2022-12-22 01:26:51,969] [INFO] [timer.py:197:stop] 0/2026, RunningAvgSamplesPerSec=10.94927987662271, CurrSamplesPerSec=10.56851186070179, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8026/20000 [11:27:36<30:51:17,  9.28s/it][2022-12-22 01:27:03,680] [INFO] [timer.py:197:stop] 0/2027, RunningAvgSamplesPerSec=10.949292870717366, CurrSamplesPerSec=10.97565627411213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8027/20000 [11:27:48<33:16:52, 10.01s/it][2022-12-22 01:27:12,633] [INFO] [timer.py:197:stop] 0/2028, RunningAvgSamplesPerSec=10.94928212525975, CurrSamplesPerSec=10.92756575193094, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8028/20000 [11:27:57<32:13:37,  9.69s/it][2022-12-22 01:27:21,943] [INFO] [timer.py:197:stop] 0/2029, RunningAvgSamplesPerSec=10.949185048214945, CurrSamplesPerSec=10.755979187925853, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8029/20000 [11:28:06<31:50:39,  9.58s/it][2022-12-22 01:27:31,196] [INFO] [logging.py:68:log_dist] [Rank 0] step=8030, skipped=18, lr=[6.148205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:27:31,197] [INFO] [timer.py:197:stop] 0/2030, RunningAvgSamplesPerSec=10.949166859689557, CurrSamplesPerSec=10.9124225057117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8030/20000 [11:28:15<31:31:11,  9.48s/it][2022-12-22 01:27:40,790] [INFO] [timer.py:197:stop] 0/2031, RunningAvgSamplesPerSec=10.949049917227958, CurrSamplesPerSec=10.71692105678679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8031/20000 [11:28:25<31:37:52,  9.51s/it][2022-12-22 01:27:51,194] [INFO] [timer.py:197:stop] 0/2032, RunningAvgSamplesPerSec=10.948953350512976, CurrSamplesPerSec=10.75646578962026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8032/20000 [11:28:35<32:30:55,  9.78s/it][2022-12-22 01:28:02,234] [INFO] [timer.py:197:stop] 0/2033, RunningAvgSamplesPerSec=10.948975350692214, CurrSamplesPerSec=10.993818718673394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8033/20000 [11:28:46<33:46:05, 10.16s/it][2022-12-22 01:28:11,493] [INFO] [timer.py:197:stop] 0/2034, RunningAvgSamplesPerSec=10.949167142444821, CurrSamplesPerSec=11.353072664447668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8034/20000 [11:28:55<32:52:10,  9.89s/it][2022-12-22 01:28:20,461] [INFO] [timer.py:197:stop] 0/2035, RunningAvgSamplesPerSec=10.94917107691776, CurrSamplesPerSec=10.957171770738974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8035/20000 [11:29:04<31:56:53,  9.61s/it][2022-12-22 01:28:29,769] [INFO] [timer.py:197:stop] 0/2036, RunningAvgSamplesPerSec=10.949263536897236, CurrSamplesPerSec=11.140519673949601, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8036/20000 [11:29:14<31:38:31,  9.52s/it][2022-12-22 01:28:39,694] [INFO] [timer.py:197:stop] 0/2037, RunningAvgSamplesPerSec=10.949302845087999, CurrSamplesPerSec=11.02984411432148, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8037/20000 [11:29:24<32:02:32,  9.64s/it][2022-12-22 01:28:48,894] [INFO] [timer.py:197:stop] 0/2038, RunningAvgSamplesPerSec=10.949212401390053, CurrSamplesPerSec=10.768203672844368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8038/20000 [11:29:33<31:35:54,  9.51s/it][2022-12-22 01:28:58,112] [INFO] [timer.py:197:stop] 0/2039, RunningAvgSamplesPerSec=10.949190931589538, CurrSamplesPerSec=10.905652322536186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8039/20000 [11:29:42<31:18:16,  9.42s/it][2022-12-22 01:29:07,551] [INFO] [logging.py:68:log_dist] [Rank 0] step=8040, skipped=18, lr=[6.143076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:29:07,552] [INFO] [timer.py:197:stop] 0/2040, RunningAvgSamplesPerSec=10.949224330248013, CurrSamplesPerSec=11.01768297455551, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8040/20000 [11:29:52<31:19:11,  9.43s/it][2022-12-22 01:29:18,255] [INFO] [timer.py:197:stop] 0/2041, RunningAvgSamplesPerSec=10.949227232697861, CurrSamplesPerSec=10.95514562440347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8041/20000 [11:30:02<32:35:20,  9.81s/it][2022-12-22 01:29:27,553] [INFO] [timer.py:197:stop] 0/2042, RunningAvgSamplesPerSec=10.949153694425359, CurrSamplesPerSec=10.801235829726926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8042/20000 [11:30:12<32:04:32,  9.66s/it][2022-12-22 01:29:36,762] [INFO] [timer.py:197:stop] 0/2043, RunningAvgSamplesPerSec=10.949168174423786, CurrSamplesPerSec=10.978787318345315, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8043/20000 [11:30:21<31:37:36,  9.52s/it][2022-12-22 01:29:45,609] [INFO] [timer.py:197:stop] 0/2044, RunningAvgSamplesPerSec=10.94920747939905, CurrSamplesPerSec=11.030021322028206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8044/20000 [11:30:30<30:57:07,  9.32s/it][2022-12-22 01:29:55,537] [INFO] [timer.py:197:stop] 0/2045, RunningAvgSamplesPerSec=10.949248160116197, CurrSamplesPerSec=11.032953553660482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8045/20000 [11:30:39<31:33:17,  9.50s/it][2022-12-22 01:30:04,612] [INFO] [timer.py:197:stop] 0/2046, RunningAvgSamplesPerSec=10.949132980412438, CurrSamplesPerSec=10.718774004496579, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8046/20000 [11:30:49<31:07:40,  9.37s/it][2022-12-22 01:30:14,788] [INFO] [timer.py:197:stop] 0/2047, RunningAvgSamplesPerSec=10.949065515864671, CurrSamplesPerSec=10.812883952194515, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8047/20000 [11:30:59<31:55:22,  9.61s/it][2022-12-22 01:30:24,694] [INFO] [timer.py:197:stop] 0/2048, RunningAvgSamplesPerSec=10.9489318348219, CurrSamplesPerSec=10.682216816379677, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8048/20000 [11:31:09<32:12:37,  9.70s/it][2022-12-22 01:30:34,134] [INFO] [timer.py:197:stop] 0/2049, RunningAvgSamplesPerSec=10.948815164754528, CurrSamplesPerSec=10.715203907866368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8049/20000 [11:31:18<31:56:50,  9.62s/it][2022-12-22 01:30:43,368] [INFO] [logging.py:68:log_dist] [Rank 0] step=8050, skipped=18, lr=[6.137948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:30:43,369] [INFO] [timer.py:197:stop] 0/2050, RunningAvgSamplesPerSec=10.94894753819274, CurrSamplesPerSec=11.226795607757628, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8050/20000 [11:31:27<31:33:25,  9.51s/it]

                                                          
{'loss': 0.0877, 'learning_rate': 6.137948717948718e-06, 'epoch': 0.4}


 40%|████      | 8050/20000 [11:31:27<31:33:25,  9.51s/it][2022-12-22 01:30:55,221] [INFO] [timer.py:197:stop] 0/2051, RunningAvgSamplesPerSec=10.948887865805858, CurrSamplesPerSec=10.828028481698269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8051/20000 [11:31:39<33:53:22, 10.21s/it][2022-12-22 01:31:04,239] [INFO] [timer.py:197:stop] 0/2052, RunningAvgSamplesPerSec=10.948917521818805, CurrSamplesPerSec=11.010021980221492, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8052/20000 [11:31:48<32:42:00,  9.85s/it][2022-12-22 01:31:13,150] [INFO] [timer.py:197:stop] 0/2053, RunningAvgSamplesPerSec=10.949057106726091, CurrSamplesPerSec=11.242889089434122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8053/20000 [11:31:57<31:45:36,  9.57s/it][2022-12-22 01:31:23,109] [INFO] [timer.py:197:stop] 0/2054, RunningAvgSamplesPerSec=10.948978811015007, CurrSamplesPerSec=10.790716610741102, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8054/20000 [11:32:07<32:08:37,  9.69s/it][2022-12-22 01:31:32,528] [INFO] [timer.py:197:stop] 0/2055, RunningAvgSamplesPerSec=10.949014506860683, CurrSamplesPerSec=11.022755945876384, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8055/20000 [11:32:16<31:52:29,  9.61s/it][2022-12-22 01:31:41,953] [INFO] [timer.py:197:stop] 0/2056, RunningAvgSamplesPerSec=10.948877562270273, CurrSamplesPerSec=10.674772271447782, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8056/20000 [11:32:26<31:41:30,  9.55s/it][2022-12-22 01:31:52,201] [INFO] [timer.py:197:stop] 0/2057, RunningAvgSamplesPerSec=10.948965618061042, CurrSamplesPerSec=11.132871645613015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8057/20000 [11:32:36<32:22:54,  9.76s/it][2022-12-22 01:32:01,815] [INFO] [timer.py:197:stop] 0/2058, RunningAvgSamplesPerSec=10.94887306439691, CurrSamplesPerSec=10.761924433365706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8058/20000 [11:32:46<32:13:57,  9.72s/it][2022-12-22 01:32:10,709] [INFO] [timer.py:197:stop] 0/2059, RunningAvgSamplesPerSec=10.948912067363509, CurrSamplesPerSec=11.02969410406358, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8059/20000 [11:32:55<31:24:41,  9.47s/it][2022-12-22 01:32:20,088] [INFO] [logging.py:68:log_dist] [Rank 0] step=8060, skipped=18, lr=[6.132820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:32:20,089] [INFO] [timer.py:197:stop] 0/2060, RunningAvgSamplesPerSec=10.948793278130807, CurrSamplesPerSec=10.709780580234646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8060/20000 [11:33:04<31:19:06,  9.44s/it][2022-12-22 01:32:29,180] [INFO] [timer.py:197:stop] 0/2061, RunningAvgSamplesPerSec=10.948732820698295, CurrSamplesPerSec=10.825710133679861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8061/20000 [11:33:13<30:57:59,  9.34s/it][2022-12-22 01:32:39,253] [INFO] [timer.py:197:stop] 0/2062, RunningAvgSamplesPerSec=10.948769784703426, CurrSamplesPerSec=11.025411695858105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8062/20000 [11:33:23<31:41:44,  9.56s/it][2022-12-22 01:32:48,777] [INFO] [timer.py:197:stop] 0/2063, RunningAvgSamplesPerSec=10.94881350184434, CurrSamplesPerSec=11.039618069796786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8063/20000 [11:33:33<31:39:34,  9.55s/it][2022-12-22 01:32:57,995] [INFO] [timer.py:197:stop] 0/2064, RunningAvgSamplesPerSec=10.948840355332388, CurrSamplesPerSec=11.004466715024172, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8064/20000 [11:33:42<31:19:40,  9.45s/it][2022-12-22 01:33:06,860] [INFO] [timer.py:197:stop] 0/2065, RunningAvgSamplesPerSec=10.948851978249007, CurrSamplesPerSec=10.972871034249026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8065/20000 [11:33:51<30:44:40,  9.27s/it][2022-12-22 01:33:16,541] [INFO] [timer.py:197:stop] 0/2066, RunningAvgSamplesPerSec=10.948727830756358, CurrSamplesPerSec=10.698468539557403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8066/20000 [11:34:01<31:08:50,  9.40s/it][2022-12-22 01:33:25,957] [INFO] [timer.py:197:stop] 0/2067, RunningAvgSamplesPerSec=10.948748257208603, CurrSamplesPerSec=10.991071507171075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8067/20000 [11:34:10<31:09:55,  9.40s/it][2022-12-22 01:33:34,869] [INFO] [timer.py:197:stop] 0/2068, RunningAvgSamplesPerSec=10.948834741331783, CurrSamplesPerSec=11.130387246924425, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8068/20000 [11:34:19<30:40:29,  9.25s/it][2022-12-22 01:33:44,712] [INFO] [timer.py:197:stop] 0/2069, RunningAvgSamplesPerSec=10.948854949563902, CurrSamplesPerSec=10.990765046187871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8069/20000 [11:34:29<31:15:24,  9.43s/it][2022-12-22 01:33:53,618] [INFO] [logging.py:68:log_dist] [Rank 0] step=8070, skipped=18, lr=[6.127692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:33:53,619] [INFO] [timer.py:197:stop] 0/2070, RunningAvgSamplesPerSec=10.948854764346546, CurrSamplesPerSec=10.948471933461335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8070/20000 [11:34:38<30:43:58,  9.27s/it][2022-12-22 01:34:05,805] [INFO] [timer.py:197:stop] 0/2071, RunningAvgSamplesPerSec=10.948920649318612, CurrSamplesPerSec=11.086888495750078, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8071/20000 [11:34:50<33:37:33, 10.15s/it][2022-12-22 01:34:15,087] [INFO] [timer.py:197:stop] 0/2072, RunningAvgSamplesPerSec=10.948966884112929, CurrSamplesPerSec=11.045470218942997, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8072/20000 [11:34:59<32:45:43,  9.89s/it][2022-12-22 01:34:24,160] [INFO] [timer.py:197:stop] 0/2073, RunningAvgSamplesPerSec=10.948962583561482, CurrSamplesPerSec=10.94006767763341, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8073/20000 [11:35:08<31:56:57,  9.64s/it][2022-12-22 01:34:33,787] [INFO] [timer.py:197:stop] 0/2074, RunningAvgSamplesPerSec=10.948903677564191, CurrSamplesPerSec=10.828254299669064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8074/20000 [11:35:18<31:55:47,  9.64s/it][2022-12-22 01:34:42,737] [INFO] [timer.py:197:stop] 0/2075, RunningAvgSamplesPerSec=10.94894369586608, CurrSamplesPerSec=11.032494666242687, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8075/20000 [11:35:27<31:14:36,  9.43s/it]

                                                          
{'loss': 0.0829, 'learning_rate': 6.125128205128206e-06, 'epoch': 0.4}


 40%|████      | 8075/20000 [11:35:27<31:14:36,  9.43s/it][2022-12-22 01:34:52,384] [INFO] [timer.py:197:stop] 0/2076, RunningAvgSamplesPerSec=10.94895139690332, CurrSamplesPerSec=10.964938969221103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8076/20000 [11:35:36<31:27:15,  9.50s/it][2022-12-22 01:35:01,524] [INFO] [timer.py:197:stop] 0/2077, RunningAvgSamplesPerSec=10.949047625605642, CurrSamplesPerSec=11.152333213626385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8077/20000 [11:35:45<31:05:51,  9.39s/it][2022-12-22 01:35:11,648] [INFO] [timer.py:197:stop] 0/2078, RunningAvgSamplesPerSec=10.949076320385863, CurrSamplesPerSec=11.008943708337943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8078/20000 [11:35:56<31:49:29,  9.61s/it][2022-12-22 01:35:22,752] [INFO] [timer.py:197:stop] 0/2079, RunningAvgSamplesPerSec=10.949109439051714, CurrSamplesPerSec=11.018298467460252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8079/20000 [11:36:07<33:18:21, 10.06s/it][2022-12-22 01:35:32,796] [INFO] [logging.py:68:log_dist] [Rank 0] step=8080, skipped=18, lr=[6.122564102564104e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:35:32,797] [INFO] [timer.py:197:stop] 0/2080, RunningAvgSamplesPerSec=10.949223739373755, CurrSamplesPerSec=11.191889536798692, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8080/20000 [11:36:17<33:17:27, 10.05s/it][2022-12-22 01:35:41,812] [INFO] [timer.py:197:stop] 0/2081, RunningAvgSamplesPerSec=10.949197885458405, CurrSamplesPerSec=10.895735897568283, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8081/20000 [11:36:26<32:15:21,  9.74s/it][2022-12-22 01:35:50,904] [INFO] [timer.py:197:stop] 0/2082, RunningAvgSamplesPerSec=10.949203142188855, CurrSamplesPerSec=10.960142809272934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8082/20000 [11:36:35<31:36:24,  9.55s/it][2022-12-22 01:36:00,331] [INFO] [timer.py:197:stop] 0/2083, RunningAvgSamplesPerSec=10.949080624758913, CurrSamplesPerSec=10.700043416348432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8083/20000 [11:36:44<31:29:04,  9.51s/it][2022-12-22 01:36:09,301] [INFO] [timer.py:197:stop] 0/2084, RunningAvgSamplesPerSec=10.949211323176948, CurrSamplesPerSec=11.228126439276387, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8084/20000 [11:36:53<30:56:38,  9.35s/it][2022-12-22 01:36:18,763] [INFO] [timer.py:197:stop] 0/2085, RunningAvgSamplesPerSec=10.949138028470205, CurrSamplesPerSec=10.798637009040693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8085/20000 [11:37:03<31:03:16,  9.38s/it][2022-12-22 01:36:28,457] [INFO] [timer.py:197:stop] 0/2086, RunningAvgSamplesPerSec=10.949205351980007, CurrSamplesPerSec=11.09126050565997, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8086/20000 [11:37:12<31:21:39,  9.48s/it][2022-12-22 01:36:37,890] [INFO] [timer.py:197:stop] 0/2087, RunningAvgSamplesPerSec=10.948987581562221, CurrSamplesPerSec=10.513224978911705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8087/20000 [11:37:22<31:18:57,  9.46s/it][2022-12-22 01:36:47,205] [INFO] [timer.py:197:stop] 0/2088, RunningAvgSamplesPerSec=10.949026222634062, CurrSamplesPerSec=11.030190377142416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8088/20000 [11:37:31<31:09:55,  9.42s/it][2022-12-22 01:36:56,596] [INFO] [timer.py:197:stop] 0/2089, RunningAvgSamplesPerSec=10.949044280605609, CurrSamplesPerSec=10.986843314828159, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8089/20000 [11:37:41<31:08:07,  9.41s/it][2022-12-22 01:37:06,751] [INFO] [logging.py:68:log_dist] [Rank 0] step=8090, skipped=18, lr=[6.1174358974358986e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:37:06,752] [INFO] [timer.py:197:stop] 0/2090, RunningAvgSamplesPerSec=10.948957591079461, CurrSamplesPerSec=10.770978886854818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8090/20000 [11:37:51<31:52:22,  9.63s/it][2022-12-22 01:37:15,870] [INFO] [timer.py:197:stop] 0/2091, RunningAvgSamplesPerSec=10.94902213625362, CurrSamplesPerSec=11.08547282092892, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8091/20000 [11:38:00<31:21:27,  9.48s/it][2022-12-22 01:37:24,719] [INFO] [timer.py:197:stop] 0/2092, RunningAvgSamplesPerSec=10.949081110399396, CurrSamplesPerSec=11.073680743564625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8092/20000 [11:38:09<30:43:46,  9.29s/it][2022-12-22 01:37:33,917] [INFO] [timer.py:197:stop] 0/2093, RunningAvgSamplesPerSec=10.949178665381211, CurrSamplesPerSec=11.156939237833155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8093/20000 [11:38:18<30:38:10,  9.26s/it][2022-12-22 01:37:43,130] [INFO] [timer.py:197:stop] 0/2094, RunningAvgSamplesPerSec=10.94933140937348, CurrSamplesPerSec=11.278320158964656, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8094/20000 [11:38:27<30:35:01,  9.25s/it][2022-12-22 01:37:52,343] [INFO] [timer.py:197:stop] 0/2095, RunningAvgSamplesPerSec=10.949332844914784, CurrSamplesPerSec=10.952336821637948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8095/20000 [11:38:36<30:32:49,  9.24s/it][2022-12-22 01:38:01,618] [INFO] [timer.py:197:stop] 0/2096, RunningAvgSamplesPerSec=10.949128900187953, CurrSamplesPerSec=10.538296702278577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8096/20000 [11:38:46<30:34:56,  9.25s/it][2022-12-22 01:38:11,342] [INFO] [timer.py:197:stop] 0/2097, RunningAvgSamplesPerSec=10.949235677532608, CurrSamplesPerSec=11.177490807374188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8097/20000 [11:38:55<31:03:04,  9.39s/it][2022-12-22 01:38:20,099] [INFO] [timer.py:197:stop] 0/2098, RunningAvgSamplesPerSec=10.949356651125415, CurrSamplesPerSec=11.208804513829081, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8098/20000 [11:39:04<30:25:10,  9.20s/it][2022-12-22 01:38:29,531] [INFO] [timer.py:197:stop] 0/2099, RunningAvgSamplesPerSec=10.949375321821618, CurrSamplesPerSec=10.988649536625973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8099/20000 [11:39:13<30:38:43,  9.27s/it][2022-12-22 01:38:39,263] [INFO] [logging.py:68:log_dist] [Rank 0] step=8100, skipped=18, lr=[6.112307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:38:39,263] [INFO] [timer.py:197:stop] 0/2100, RunningAvgSamplesPerSec=10.94893928289857, CurrSamplesPerSec=10.105072701363847, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 40%|████      | 8100/20000 [11:39:23<31:06:05,  9.41s/it]

                                                          
{'loss': 0.0724, 'learning_rate': 6.112307692307693e-06, 'epoch': 0.41}


 40%|████      | 8100/20000 [11:39:23<31:06:05,  9.41s/it][2022-12-22 01:38:49,047] [INFO] [timer.py:197:stop] 0/2101, RunningAvgSamplesPerSec=10.948932001898342, CurrSamplesPerSec=10.933677755715086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8101/20000 [11:39:33<31:28:13,  9.52s/it][2022-12-22 01:38:58,065] [INFO] [timer.py:197:stop] 0/2102, RunningAvgSamplesPerSec=10.948884041010139, CurrSamplesPerSec=10.849131749625897, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8102/20000 [11:39:42<30:58:07,  9.37s/it][2022-12-22 01:39:08,141] [INFO] [timer.py:197:stop] 0/2103, RunningAvgSamplesPerSec=10.948975886498951, CurrSamplesPerSec=11.145311682065428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8103/20000 [11:39:52<31:39:57,  9.58s/it][2022-12-22 01:39:18,078] [INFO] [timer.py:197:stop] 0/2104, RunningAvgSamplesPerSec=10.948964896979557, CurrSamplesPerSec=10.92592452697484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8104/20000 [11:40:02<32:00:57,  9.69s/it][2022-12-22 01:39:27,535] [INFO] [timer.py:197:stop] 0/2105, RunningAvgSamplesPerSec=10.948985367423903, CurrSamplesPerSec=10.992184090669445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8105/20000 [11:40:11<31:46:58,  9.62s/it][2022-12-22 01:39:37,723] [INFO] [timer.py:197:stop] 0/2106, RunningAvgSamplesPerSec=10.948993737631678, CurrSamplesPerSec=10.966624643024074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8106/20000 [11:40:22<32:20:39,  9.79s/it][2022-12-22 01:39:49,718] [INFO] [timer.py:197:stop] 0/2107, RunningAvgSamplesPerSec=10.949098690894916, CurrSamplesPerSec=11.174467765544009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8107/20000 [11:40:34<34:31:37, 10.45s/it][2022-12-22 01:39:58,989] [INFO] [timer.py:197:stop] 0/2108, RunningAvgSamplesPerSec=10.949103280405996, CurrSamplesPerSec=10.958772737113314, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8108/20000 [11:40:43<33:21:16, 10.10s/it][2022-12-22 01:40:08,287] [INFO] [timer.py:197:stop] 0/2109, RunningAvgSamplesPerSec=10.949003000413496, CurrSamplesPerSec=10.741811640961153, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8109/20000 [11:40:52<32:33:33,  9.86s/it][2022-12-22 01:40:17,196] [INFO] [logging.py:68:log_dist] [Rank 0] step=8110, skipped=18, lr=[6.1071794871794875e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:40:17,197] [INFO] [timer.py:197:stop] 0/2110, RunningAvgSamplesPerSec=10.949007619867196, CurrSamplesPerSec=10.958749473006437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8110/20000 [11:41:01<31:37:06,  9.57s/it][2022-12-22 01:40:29,204] [INFO] [timer.py:197:stop] 0/2111, RunningAvgSamplesPerSec=10.949071619804194, CurrSamplesPerSec=11.085667386107438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8111/20000 [11:41:13<34:01:36, 10.30s/it][2022-12-22 01:40:38,214] [INFO] [timer.py:197:stop] 0/2112, RunningAvgSamplesPerSec=10.949220512267637, CurrSamplesPerSec=11.272510800696082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8112/20000 [11:41:22<32:44:34,  9.92s/it][2022-12-22 01:40:47,091] [INFO] [timer.py:197:stop] 0/2113, RunningAvgSamplesPerSec=10.949199127113912, CurrSamplesPerSec=10.904261731734453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8113/20000 [11:41:31<31:42:39,  9.60s/it][2022-12-22 01:40:56,350] [INFO] [timer.py:197:stop] 0/2114, RunningAvgSamplesPerSec=10.949182530519215, CurrSamplesPerSec=10.914258921309479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8114/20000 [11:41:40<31:22:00,  9.50s/it][2022-12-22 01:41:05,760] [INFO] [timer.py:197:stop] 0/2115, RunningAvgSamplesPerSec=10.949271571920375, CurrSamplesPerSec=11.140614918898818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8115/20000 [11:41:50<31:16:29,  9.47s/it][2022-12-22 01:41:14,702] [INFO] [timer.py:197:stop] 0/2116, RunningAvgSamplesPerSec=10.949474237767529, CurrSamplesPerSec=11.395145587504963, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8116/20000 [11:41:59<30:44:45,  9.31s/it][2022-12-22 01:41:24,132] [INFO] [timer.py:197:stop] 0/2117, RunningAvgSamplesPerSec=10.949474773434638, CurrSamplesPerSec=10.950607290884694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8117/20000 [11:42:08<30:51:29,  9.35s/it][2022-12-22 01:41:33,486] [INFO] [timer.py:197:stop] 0/2118, RunningAvgSamplesPerSec=10.949489968636074, CurrSamplesPerSec=10.981722470026087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8118/20000 [11:42:17<30:51:41,  9.35s/it][2022-12-22 01:41:42,933] [INFO] [timer.py:197:stop] 0/2119, RunningAvgSamplesPerSec=10.949466337680505, CurrSamplesPerSec=10.89969065452646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8119/20000 [11:42:27<30:57:15,  9.38s/it][2022-12-22 01:41:51,971] [INFO] [logging.py:68:log_dist] [Rank 0] step=8120, skipped=18, lr=[6.102051282051282e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:41:51,972] [INFO] [timer.py:197:stop] 0/2120, RunningAvgSamplesPerSec=10.949576213788815, CurrSamplesPerSec=11.187235033725434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8120/20000 [11:42:36<30:36:54,  9.28s/it][2022-12-22 01:42:01,029] [INFO] [timer.py:197:stop] 0/2121, RunningAvgSamplesPerSec=10.949613450528126, CurrSamplesPerSec=11.029053320689123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8121/20000 [11:42:45<30:23:39,  9.21s/it][2022-12-22 01:42:10,449] [INFO] [timer.py:197:stop] 0/2122, RunningAvgSamplesPerSec=10.949462056790358, CurrSamplesPerSec=10.637794444008307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8122/20000 [11:42:54<30:35:55,  9.27s/it][2022-12-22 01:42:21,351] [INFO] [timer.py:197:stop] 0/2123, RunningAvgSamplesPerSec=10.94936334093002, CurrSamplesPerSec=10.744012485102857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8123/20000 [11:43:05<32:12:26,  9.76s/it][2022-12-22 01:42:30,614] [INFO] [timer.py:197:stop] 0/2124, RunningAvgSamplesPerSec=10.94948764193134, CurrSamplesPerSec=11.219637824929977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8124/20000 [11:43:15<31:42:38,  9.61s/it][2022-12-22 01:42:40,089] [INFO] [timer.py:197:stop] 0/2125, RunningAvgSamplesPerSec=10.949635465696684, CurrSamplesPerSec=11.2725732859847, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8125/20000 [11:43:24<31:34:17,  9.57s/it]

                                                          
{'loss': 0.0613, 'learning_rate': 6.09948717948718e-06, 'epoch': 0.41}


 41%|████      | 8125/20000 [11:43:24<31:34:17,  9.57s/it][2022-12-22 01:42:49,440] [INFO] [timer.py:197:stop] 0/2126, RunningAvgSamplesPerSec=10.949565695938837, CurrSamplesPerSec=10.803422397341905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8126/20000 [11:43:33<31:21:05,  9.51s/it][2022-12-22 01:42:59,825] [INFO] [timer.py:197:stop] 0/2127, RunningAvgSamplesPerSec=10.949438221331334, CurrSamplesPerSec=10.685218809073913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8127/20000 [11:43:44<32:13:09,  9.77s/it][2022-12-22 01:43:09,185] [INFO] [timer.py:197:stop] 0/2128, RunningAvgSamplesPerSec=10.949370352337443, CurrSamplesPerSec=10.807024556041535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8128/20000 [11:43:53<31:48:41,  9.65s/it][2022-12-22 01:43:19,884] [INFO] [timer.py:197:stop] 0/2129, RunningAvgSamplesPerSec=10.949415752249232, CurrSamplesPerSec=11.04679477445334, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8129/20000 [11:44:04<32:50:58,  9.96s/it][2022-12-22 01:43:29,314] [INFO] [logging.py:68:log_dist] [Rank 0] step=8130, skipped=18, lr=[6.096923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:43:29,315] [INFO] [timer.py:197:stop] 0/2130, RunningAvgSamplesPerSec=10.949543495660329, CurrSamplesPerSec=11.228171056243113, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8130/20000 [11:44:13<32:19:16,  9.80s/it][2022-12-22 01:43:38,180] [INFO] [timer.py:197:stop] 0/2131, RunningAvgSamplesPerSec=10.94953285691362, CurrSamplesPerSec=10.926940338156346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8131/20000 [11:44:22<31:23:29,  9.52s/it][2022-12-22 01:43:47,796] [INFO] [timer.py:197:stop] 0/2132, RunningAvgSamplesPerSec=10.949477209049853, CurrSamplesPerSec=10.832271676874855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8132/20000 [11:44:32<31:28:57,  9.55s/it][2022-12-22 01:43:57,874] [INFO] [timer.py:197:stop] 0/2133, RunningAvgSamplesPerSec=10.949414025769059, CurrSamplesPerSec=10.8164684527224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8133/20000 [11:44:42<32:00:07,  9.71s/it][2022-12-22 01:44:06,792] [INFO] [timer.py:197:stop] 0/2134, RunningAvgSamplesPerSec=10.949391120939648, CurrSamplesPerSec=10.900797651066561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8134/20000 [11:44:51<31:13:06,  9.47s/it][2022-12-22 01:44:16,561] [INFO] [timer.py:197:stop] 0/2135, RunningAvgSamplesPerSec=10.949341515293744, CurrSamplesPerSec=10.844594499874702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8135/20000 [11:45:01<31:30:36,  9.56s/it][2022-12-22 01:44:25,334] [INFO] [timer.py:197:stop] 0/2136, RunningAvgSamplesPerSec=10.949450243095974, CurrSamplesPerSec=11.186387481202038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8136/20000 [11:45:09<30:43:42,  9.32s/it][2022-12-22 01:44:35,565] [INFO] [timer.py:197:stop] 0/2137, RunningAvgSamplesPerSec=10.949469946037526, CurrSamplesPerSec=10.991678179310949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8137/20000 [11:45:20<31:37:21,  9.60s/it][2022-12-22 01:44:47,584] [INFO] [timer.py:197:stop] 0/2138, RunningAvgSamplesPerSec=10.949508991710886, CurrSamplesPerSec=11.033511343717741, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8138/20000 [11:45:32<34:00:51, 10.32s/it][2022-12-22 01:44:59,742] [INFO] [timer.py:197:stop] 0/2139, RunningAvgSamplesPerSec=10.94946851868625, CurrSamplesPerSec=10.863695665678716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8139/20000 [11:45:44<35:49:31, 10.87s/it][2022-12-22 01:45:11,157] [INFO] [logging.py:68:log_dist] [Rank 0] step=8140, skipped=18, lr=[6.091794871794873e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:45:11,158] [INFO] [timer.py:197:stop] 0/2140, RunningAvgSamplesPerSec=10.949267230590053, CurrSamplesPerSec=10.535382061045889, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8140/20000 [11:45:55<36:21:29, 11.04s/it][2022-12-22 01:45:19,988] [INFO] [timer.py:197:stop] 0/2141, RunningAvgSamplesPerSec=10.949376869181139, CurrSamplesPerSec=11.188914667325687, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8141/20000 [11:46:04<34:10:30, 10.37s/it][2022-12-22 01:45:29,583] [INFO] [timer.py:197:stop] 0/2142, RunningAvgSamplesPerSec=10.949476338512426, CurrSamplesPerSec=11.166459520982226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8142/20000 [11:46:14<33:24:07, 10.14s/it][2022-12-22 01:45:38,741] [INFO] [timer.py:197:stop] 0/2143, RunningAvgSamplesPerSec=10.949493394492562, CurrSamplesPerSec=10.986115327105825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8143/20000 [11:46:23<32:25:42,  9.85s/it][2022-12-22 01:45:50,417] [INFO] [timer.py:197:stop] 0/2144, RunningAvgSamplesPerSec=10.94957435313813, CurrSamplesPerSec=11.125696134538485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8144/20000 [11:46:34<34:14:00, 10.39s/it][2022-12-22 01:45:59,849] [INFO] [timer.py:197:stop] 0/2145, RunningAvgSamplesPerSec=10.949581868331794, CurrSamplesPerSec=10.96570312491064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8145/20000 [11:46:44<33:16:46, 10.11s/it][2022-12-22 01:46:08,886] [INFO] [timer.py:197:stop] 0/2146, RunningAvgSamplesPerSec=10.949579220100537, CurrSamplesPerSec=10.943907001797353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8146/20000 [11:46:53<32:13:14,  9.79s/it][2022-12-22 01:46:19,097] [INFO] [timer.py:197:stop] 0/2147, RunningAvgSamplesPerSec=10.949586920713031, CurrSamplesPerSec=10.966121977581, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8147/20000 [11:47:03<32:38:18,  9.91s/it][2022-12-22 01:46:28,900] [INFO] [timer.py:197:stop] 0/2148, RunningAvgSamplesPerSec=10.949476172559008, CurrSamplesPerSec=10.716968121430686, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8148/20000 [11:47:13<32:31:38,  9.88s/it][2022-12-22 01:46:40,514] [INFO] [timer.py:197:stop] 0/2149, RunningAvgSamplesPerSec=10.949344235421876, CurrSamplesPerSec=10.67334741626187, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8149/20000 [11:47:24<34:14:14, 10.40s/it][2022-12-22 01:46:51,832] [INFO] [logging.py:68:log_dist] [Rank 0] step=8150, skipped=18, lr=[6.086666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:46:51,833] [INFO] [timer.py:197:stop] 0/2150, RunningAvgSamplesPerSec=10.9493741455519, CurrSamplesPerSec=11.013970221075017, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8150/20000 [11:47:36<35:08:29, 10.68s/it]

                                                          
{'loss': 0.0643, 'learning_rate': 6.086666666666667e-06, 'epoch': 0.41}


 41%|████      | 8150/20000 [11:47:36<35:08:29, 10.68s/it][2022-12-22 01:47:00,827] [INFO] [timer.py:197:stop] 0/2151, RunningAvgSamplesPerSec=10.949393210556869, CurrSamplesPerSec=10.990498650525378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8151/20000 [11:47:45<33:28:39, 10.17s/it][2022-12-22 01:47:10,655] [INFO] [timer.py:197:stop] 0/2152, RunningAvgSamplesPerSec=10.949295334726601, CurrSamplesPerSec=10.742926353199813, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8152/20000 [11:47:55<33:08:08, 10.07s/it][2022-12-22 01:47:19,990] [INFO] [timer.py:197:stop] 0/2153, RunningAvgSamplesPerSec=10.949164040925128, CurrSamplesPerSec=10.673980213833934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8153/20000 [11:48:04<32:24:31,  9.85s/it][2022-12-22 01:47:29,513] [INFO] [timer.py:197:stop] 0/2154, RunningAvgSamplesPerSec=10.949070425220205, CurrSamplesPerSec=10.75134122688882, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8154/20000 [11:48:13<32:05:08,  9.75s/it][2022-12-22 01:47:38,946] [INFO] [timer.py:197:stop] 0/2155, RunningAvgSamplesPerSec=10.949085296238493, CurrSamplesPerSec=10.981181583521861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8155/20000 [11:48:23<31:46:06,  9.66s/it][2022-12-22 01:47:48,254] [INFO] [timer.py:197:stop] 0/2156, RunningAvgSamplesPerSec=10.949093111382318, CurrSamplesPerSec=10.965945025223244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8156/20000 [11:48:32<31:25:23,  9.55s/it][2022-12-22 01:47:57,651] [INFO] [timer.py:197:stop] 0/2157, RunningAvgSamplesPerSec=10.949092741879111, CurrSamplesPerSec=10.948296889850413, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8157/20000 [11:48:42<31:16:07,  9.50s/it][2022-12-22 01:48:06,854] [INFO] [timer.py:197:stop] 0/2158, RunningAvgSamplesPerSec=10.949188904724245, CurrSamplesPerSec=11.160419569697094, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8158/20000 [11:48:51<30:58:04,  9.41s/it][2022-12-22 01:48:16,224] [INFO] [timer.py:197:stop] 0/2159, RunningAvgSamplesPerSec=10.949198294527061, CurrSamplesPerSec=10.96948022687479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8159/20000 [11:49:00<30:55:19,  9.40s/it][2022-12-22 01:48:25,504] [INFO] [logging.py:68:log_dist] [Rank 0] step=8160, skipped=18, lr=[6.081538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:48:25,505] [INFO] [timer.py:197:stop] 0/2160, RunningAvgSamplesPerSec=10.94910326228636, CurrSamplesPerSec=10.747887542297201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8160/20000 [11:49:09<30:48:02,  9.37s/it][2022-12-22 01:48:35,355] [INFO] [timer.py:197:stop] 0/2161, RunningAvgSamplesPerSec=10.949011855427177, CurrSamplesPerSec=10.755248290616183, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8161/20000 [11:49:19<31:16:34,  9.51s/it][2022-12-22 01:48:45,064] [INFO] [timer.py:197:stop] 0/2162, RunningAvgSamplesPerSec=10.949040378804952, CurrSamplesPerSec=11.010970835487347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8162/20000 [11:49:29<31:28:10,  9.57s/it][2022-12-22 01:48:53,993] [INFO] [timer.py:197:stop] 0/2163, RunningAvgSamplesPerSec=10.949027811812352, CurrSamplesPerSec=10.921950269212484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8163/20000 [11:49:38<30:50:03,  9.38s/it][2022-12-22 01:49:03,525] [INFO] [timer.py:197:stop] 0/2164, RunningAvgSamplesPerSec=10.9489563798646, CurrSamplesPerSec=10.796738978906586, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8164/20000 [11:49:47<30:59:02,  9.42s/it][2022-12-22 01:49:12,944] [INFO] [timer.py:197:stop] 0/2165, RunningAvgSamplesPerSec=10.948787480113038, CurrSamplesPerSec=10.595417187404344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8165/20000 [11:49:57<30:58:36,  9.42s/it][2022-12-22 01:49:22,866] [INFO] [timer.py:197:stop] 0/2166, RunningAvgSamplesPerSec=10.94881517850077, CurrSamplesPerSec=11.009056582849762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8166/20000 [11:50:07<31:28:00,  9.57s/it][2022-12-22 01:49:31,864] [INFO] [timer.py:197:stop] 0/2167, RunningAvgSamplesPerSec=10.948735803493099, CurrSamplesPerSec=10.779622618475857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8167/20000 [11:50:16<30:53:49,  9.40s/it][2022-12-22 01:49:41,546] [INFO] [timer.py:197:stop] 0/2168, RunningAvgSamplesPerSec=10.948809462244874, CurrSamplesPerSec=11.110638819566942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8168/20000 [11:50:26<31:10:23,  9.48s/it][2022-12-22 01:49:50,500] [INFO] [timer.py:197:stop] 0/2169, RunningAvgSamplesPerSec=10.948824115381301, CurrSamplesPerSec=10.98065512391182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8169/20000 [11:50:34<30:38:48,  9.33s/it][2022-12-22 01:50:00,494] [INFO] [logging.py:68:log_dist] [Rank 0] step=8170, skipped=18, lr=[6.076410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:50:00,495] [INFO] [timer.py:197:stop] 0/2170, RunningAvgSamplesPerSec=10.948870246627749, CurrSamplesPerSec=11.049758219672862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8170/20000 [11:50:44<31:18:15,  9.53s/it][2022-12-22 01:50:09,920] [INFO] [timer.py:197:stop] 0/2171, RunningAvgSamplesPerSec=10.948756516241072, CurrSamplesPerSec=10.707621926313209, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8171/20000 [11:50:54<31:12:08,  9.50s/it][2022-12-22 01:50:21,356] [INFO] [timer.py:197:stop] 0/2172, RunningAvgSamplesPerSec=10.948854280528979, CurrSamplesPerSec=11.165094969799163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8172/20000 [11:51:05<33:06:42, 10.08s/it][2022-12-22 01:50:30,787] [INFO] [timer.py:197:stop] 0/2173, RunningAvgSamplesPerSec=10.948772028033531, CurrSamplesPerSec=10.773148464196353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8173/20000 [11:51:15<32:28:15,  9.88s/it][2022-12-22 01:50:39,958] [INFO] [timer.py:197:stop] 0/2174, RunningAvgSamplesPerSec=10.948883569431171, CurrSamplesPerSec=11.196519426857302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8174/20000 [11:51:24<31:45:56,  9.67s/it][2022-12-22 01:50:48,998] [INFO] [timer.py:197:stop] 0/2175, RunningAvgSamplesPerSec=10.948903553425827, CurrSamplesPerSec=10.992481627904176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8175/20000 [11:51:33<31:08:32,  9.48s/it]

                                                          
{'loss': 0.0621, 'learning_rate': 6.073846153846155e-06, 'epoch': 0.41}


 41%|████      | 8175/20000 [11:51:33<31:08:32,  9.48s/it][2022-12-22 01:50:58,831] [INFO] [timer.py:197:stop] 0/2176, RunningAvgSamplesPerSec=10.948851903065353, CurrSamplesPerSec=10.837755043210446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8176/20000 [11:51:43<31:29:11,  9.59s/it][2022-12-22 01:51:07,851] [INFO] [timer.py:197:stop] 0/2177, RunningAvgSamplesPerSec=10.948758878715038, CurrSamplesPerSec=10.750193339757233, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8177/20000 [11:51:52<30:55:34,  9.42s/it][2022-12-22 01:51:17,817] [INFO] [timer.py:197:stop] 0/2178, RunningAvgSamplesPerSec=10.948840808866487, CurrSamplesPerSec=11.129988516977729, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8178/20000 [11:52:02<31:27:52,  9.58s/it][2022-12-22 01:51:26,836] [INFO] [timer.py:197:stop] 0/2179, RunningAvgSamplesPerSec=10.948777504825534, CurrSamplesPerSec=10.812740220888317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8179/20000 [11:52:11<30:54:26,  9.41s/it][2022-12-22 01:51:35,603] [INFO] [logging.py:68:log_dist] [Rank 0] step=8180, skipped=18, lr=[6.071282051282051e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:51:35,604] [INFO] [timer.py:197:stop] 0/2180, RunningAvgSamplesPerSec=10.948913579251643, CurrSamplesPerSec=11.25338928989048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8180/20000 [11:52:20<30:16:10,  9.22s/it][2022-12-22 01:51:45,243] [INFO] [timer.py:197:stop] 0/2181, RunningAvgSamplesPerSec=10.948993713512557, CurrSamplesPerSec=11.126354653708525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8181/20000 [11:52:29<30:40:49,  9.35s/it][2022-12-22 01:51:54,071] [INFO] [timer.py:197:stop] 0/2182, RunningAvgSamplesPerSec=10.949074561887004, CurrSamplesPerSec=11.12812538696116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8182/20000 [11:52:38<30:10:07,  9.19s/it][2022-12-22 01:52:03,829] [INFO] [timer.py:197:stop] 0/2183, RunningAvgSamplesPerSec=10.948991366339351, CurrSamplesPerSec=10.770581722770949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8183/20000 [11:52:48<30:43:31,  9.36s/it][2022-12-22 01:52:13,384] [INFO] [timer.py:197:stop] 0/2184, RunningAvgSamplesPerSec=10.949037327949993, CurrSamplesPerSec=11.050206262482325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8184/20000 [11:52:57<30:54:53,  9.42s/it][2022-12-22 01:52:22,368] [INFO] [timer.py:197:stop] 0/2185, RunningAvgSamplesPerSec=10.948962848455944, CurrSamplesPerSec=10.788826567038878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8185/20000 [11:53:06<30:29:01,  9.29s/it][2022-12-22 01:52:31,833] [INFO] [timer.py:197:stop] 0/2186, RunningAvgSamplesPerSec=10.948955977418787, CurrSamplesPerSec=10.93397703304582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8186/20000 [11:53:16<30:39:21,  9.34s/it][2022-12-22 01:52:42,309] [INFO] [timer.py:197:stop] 0/2187, RunningAvgSamplesPerSec=10.94881261606858, CurrSamplesPerSec=10.644420070726081, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8187/20000 [11:53:26<31:46:12,  9.68s/it][2022-12-22 01:52:51,339] [INFO] [timer.py:197:stop] 0/2188, RunningAvgSamplesPerSec=10.948839613498727, CurrSamplesPerSec=11.008148685846173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8188/20000 [11:53:35<31:07:29,  9.49s/it][2022-12-22 01:53:01,954] [INFO] [timer.py:197:stop] 0/2189, RunningAvgSamplesPerSec=10.948850407244327, CurrSamplesPerSec=10.972496516569878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8189/20000 [11:53:46<32:14:00,  9.82s/it][2022-12-22 01:53:11,237] [INFO] [logging.py:68:log_dist] [Rank 0] step=8190, skipped=18, lr=[6.0661538461538476e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:53:11,238] [INFO] [timer.py:197:stop] 0/2190, RunningAvgSamplesPerSec=10.94896060928715, CurrSamplesPerSec=11.195399648834522, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8190/20000 [11:53:55<31:41:54,  9.66s/it][2022-12-22 01:53:20,203] [INFO] [timer.py:197:stop] 0/2191, RunningAvgSamplesPerSec=10.948962367012626, CurrSamplesPerSec=10.952809622347308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8191/20000 [11:54:04<31:00:34,  9.45s/it][2022-12-22 01:53:29,645] [INFO] [timer.py:197:stop] 0/2192, RunningAvgSamplesPerSec=10.949050912011154, CurrSamplesPerSec=11.146370550096234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8192/20000 [11:54:14<30:59:43,  9.45s/it][2022-12-22 01:53:39,843] [INFO] [timer.py:197:stop] 0/2193, RunningAvgSamplesPerSec=10.949072189687433, CurrSamplesPerSec=10.995869556401484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8193/20000 [11:54:24<31:43:49,  9.67s/it][2022-12-22 01:53:50,829] [INFO] [timer.py:197:stop] 0/2194, RunningAvgSamplesPerSec=10.949065656974145, CurrSamplesPerSec=10.934771177159613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8194/20000 [11:54:35<33:00:59, 10.07s/it][2022-12-22 01:54:00,800] [INFO] [timer.py:197:stop] 0/2195, RunningAvgSamplesPerSec=10.949092873800144, CurrSamplesPerSec=11.009079158029879, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8195/20000 [11:54:45<32:55:08, 10.04s/it][2022-12-22 01:54:11,146] [INFO] [timer.py:197:stop] 0/2196, RunningAvgSamplesPerSec=10.949021012265908, CurrSamplesPerSec=10.793665759258015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8196/20000 [11:54:55<33:13:04, 10.13s/it][2022-12-22 01:54:20,715] [INFO] [timer.py:197:stop] 0/2197, RunningAvgSamplesPerSec=10.948927230316869, CurrSamplesPerSec=10.746966704978039, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8197/20000 [11:55:05<32:39:46,  9.96s/it][2022-12-22 01:54:30,443] [INFO] [timer.py:197:stop] 0/2198, RunningAvgSamplesPerSec=10.948783769584757, CurrSamplesPerSec=10.642694850171125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8198/20000 [11:55:14<32:25:45,  9.89s/it][2022-12-22 01:54:39,690] [INFO] [timer.py:197:stop] 0/2199, RunningAvgSamplesPerSec=10.948798383049283, CurrSamplesPerSec=10.98098393065091, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8199/20000 [11:55:24<31:47:33,  9.70s/it][2022-12-22 01:54:48,835] [INFO] [logging.py:68:log_dist] [Rank 0] step=8200, skipped=18, lr=[6.061025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:54:48,836] [INFO] [timer.py:197:stop] 0/2200, RunningAvgSamplesPerSec=10.948792818348672, CurrSamplesPerSec=10.93658081348858, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8200/20000 [11:55:33<31:14:45,  9.53s/it]

                                                          
{'loss': 0.0529, 'learning_rate': 6.061025641025642e-06, 'epoch': 0.41}


 41%|████      | 8200/20000 [11:55:33<31:14:45,  9.53s/it][2022-12-22 01:54:58,083] [INFO] [timer.py:197:stop] 0/2201, RunningAvgSamplesPerSec=10.9486381531923, CurrSamplesPerSec=10.61892631359418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8201/20000 [11:55:42<30:57:47,  9.45s/it][2022-12-22 01:55:06,782] [INFO] [timer.py:197:stop] 0/2202, RunningAvgSamplesPerSec=10.948792677446518, CurrSamplesPerSec=11.299480145238915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8202/20000 [11:55:51<30:13:29,  9.22s/it][2022-12-22 01:55:16,089] [INFO] [timer.py:197:stop] 0/2203, RunningAvgSamplesPerSec=10.948807604035682, CurrSamplesPerSec=10.98174493324255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8203/20000 [11:56:00<30:18:16,  9.25s/it][2022-12-22 01:55:25,715] [INFO] [timer.py:197:stop] 0/2204, RunningAvgSamplesPerSec=10.948828245933377, CurrSamplesPerSec=10.994450460876537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8204/20000 [11:56:10<30:40:25,  9.36s/it][2022-12-22 01:55:36,045] [INFO] [timer.py:197:stop] 0/2205, RunningAvgSamplesPerSec=10.948769953192373, CurrSamplesPerSec=10.821897434379949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8205/20000 [11:56:20<31:37:24,  9.65s/it][2022-12-22 01:55:46,128] [INFO] [timer.py:197:stop] 0/2206, RunningAvgSamplesPerSec=10.948704746400486, CurrSamplesPerSec=10.80691535124076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8206/20000 [11:56:30<32:02:39,  9.78s/it][2022-12-22 01:55:54,970] [INFO] [timer.py:197:stop] 0/2207, RunningAvgSamplesPerSec=10.948736830516294, CurrSamplesPerSec=11.019910109280161, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8207/20000 [11:56:39<31:07:05,  9.50s/it][2022-12-22 01:56:04,403] [INFO] [timer.py:197:stop] 0/2208, RunningAvgSamplesPerSec=10.94872087164488, CurrSamplesPerSec=10.913644347647658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8208/20000 [11:56:48<31:03:03,  9.48s/it][2022-12-22 01:56:13,461] [INFO] [timer.py:197:stop] 0/2209, RunningAvgSamplesPerSec=10.948762352081864, CurrSamplesPerSec=11.041039767336297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8209/20000 [11:56:57<30:38:03,  9.35s/it][2022-12-22 01:56:22,338] [INFO] [logging.py:68:log_dist] [Rank 0] step=8210, skipped=18, lr=[6.0558974358974365e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:56:22,339] [INFO] [timer.py:197:stop] 0/2210, RunningAvgSamplesPerSec=10.948737437551632, CurrSamplesPerSec=10.894025963885392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8210/20000 [11:57:06<30:09:51,  9.21s/it][2022-12-22 01:56:31,850] [INFO] [timer.py:197:stop] 0/2211, RunningAvgSamplesPerSec=10.948741306354043, CurrSamplesPerSec=10.957290295102815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8211/20000 [11:57:16<30:27:27,  9.30s/it][2022-12-22 01:56:40,785] [INFO] [timer.py:197:stop] 0/2212, RunningAvgSamplesPerSec=10.948717452305813, CurrSamplesPerSec=10.896276360614563, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8212/20000 [11:57:25<30:05:41,  9.19s/it][2022-12-22 01:56:50,031] [INFO] [timer.py:197:stop] 0/2213, RunningAvgSamplesPerSec=10.948726821979232, CurrSamplesPerSec=10.969473054682588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8213/20000 [11:57:34<30:08:48,  9.21s/it][2022-12-22 01:56:59,473] [INFO] [timer.py:197:stop] 0/2214, RunningAvgSamplesPerSec=10.94867388482047, CurrSamplesPerSec=10.832868376524498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8214/20000 [11:57:43<30:22:27,  9.28s/it][2022-12-22 01:57:09,802] [INFO] [timer.py:197:stop] 0/2215, RunningAvgSamplesPerSec=10.9485982988319, CurrSamplesPerSec=10.783918063332367, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8215/20000 [11:57:54<31:24:40,  9.60s/it][2022-12-22 01:57:19,760] [INFO] [timer.py:197:stop] 0/2216, RunningAvgSamplesPerSec=10.948745746610083, CurrSamplesPerSec=11.285075743377641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8216/20000 [11:58:04<31:45:26,  9.70s/it][2022-12-22 01:57:28,858] [INFO] [timer.py:197:stop] 0/2217, RunningAvgSamplesPerSec=10.94874371655209, CurrSamplesPerSec=10.94425101327973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8217/20000 [11:58:13<31:09:45,  9.52s/it][2022-12-22 01:57:38,136] [INFO] [timer.py:197:stop] 0/2218, RunningAvgSamplesPerSec=10.948692682640148, CurrSamplesPerSec=10.836808243541808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8218/20000 [11:58:22<30:55:16,  9.45s/it][2022-12-22 01:57:47,389] [INFO] [timer.py:197:stop] 0/2219, RunningAvgSamplesPerSec=10.948618674748262, CurrSamplesPerSec=10.78703861764115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8219/20000 [11:58:31<30:43:38,  9.39s/it][2022-12-22 01:57:57,910] [INFO] [logging.py:68:log_dist] [Rank 0] step=8220, skipped=18, lr=[6.050769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:57:57,911] [INFO] [timer.py:197:stop] 0/2220, RunningAvgSamplesPerSec=10.948692512374835, CurrSamplesPerSec=11.11487632793117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8220/20000 [11:58:42<31:50:10,  9.73s/it][2022-12-22 01:58:07,724] [INFO] [timer.py:197:stop] 0/2221, RunningAvgSamplesPerSec=10.948649217086233, CurrSamplesPerSec=10.853455572493084, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8221/20000 [11:58:52<31:54:57,  9.75s/it][2022-12-22 01:58:16,950] [INFO] [timer.py:197:stop] 0/2222, RunningAvgSamplesPerSec=10.948464362886366, CurrSamplesPerSec=10.553092439837725, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8222/20000 [11:59:01<31:23:40,  9.60s/it][2022-12-22 01:58:25,940] [INFO] [timer.py:197:stop] 0/2223, RunningAvgSamplesPerSec=10.94845338962984, CurrSamplesPerSec=10.924146867230952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8223/20000 [11:59:10<30:47:48,  9.41s/it][2022-12-22 01:58:35,535] [INFO] [timer.py:197:stop] 0/2224, RunningAvgSamplesPerSec=10.948549583946916, CurrSamplesPerSec=11.166451159884623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8224/20000 [11:59:19<30:58:21,  9.47s/it][2022-12-22 01:58:44,999] [INFO] [timer.py:197:stop] 0/2225, RunningAvgSamplesPerSec=10.94867884549959, CurrSamplesPerSec=11.243639261221253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8225/20000 [11:59:29<30:57:53,  9.47s/it]

                                                          
{'loss': 0.0768, 'learning_rate': 6.048205128205129e-06, 'epoch': 0.41}


 41%|████      | 8225/20000 [11:59:29<30:57:53,  9.47s/it][2022-12-22 01:58:55,300] [INFO] [timer.py:197:stop] 0/2226, RunningAvgSamplesPerSec=10.948804919644038, CurrSamplesPerSec=11.23643365197224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8226/20000 [11:59:39<31:46:53,  9.72s/it][2022-12-22 01:59:05,701] [INFO] [timer.py:197:stop] 0/2227, RunningAvgSamplesPerSec=10.948849028968045, CurrSamplesPerSec=11.047835459699021, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8227/20000 [11:59:50<32:26:57,  9.92s/it][2022-12-22 01:59:17,124] [INFO] [timer.py:197:stop] 0/2228, RunningAvgSamplesPerSec=10.948661188591576, CurrSamplesPerSec=10.546090641734036, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8228/20000 [12:00:01<33:55:01, 10.37s/it][2022-12-22 01:59:26,665] [INFO] [timer.py:197:stop] 0/2229, RunningAvgSamplesPerSec=10.948710594053926, CurrSamplesPerSec=11.059803550436673, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8229/20000 [12:00:11<33:05:59, 10.12s/it][2022-12-22 01:59:35,744] [INFO] [logging.py:68:log_dist] [Rank 0] step=8230, skipped=18, lr=[6.0456410256410255e-06], mom=[[0.9, 0.999]]
[2022-12-22 01:59:35,745] [INFO] [timer.py:197:stop] 0/2230, RunningAvgSamplesPerSec=10.948688334436929, CurrSamplesPerSec=10.899339702568534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8230/20000 [12:00:20<32:04:24,  9.81s/it][2022-12-22 01:59:44,697] [INFO] [timer.py:197:stop] 0/2231, RunningAvgSamplesPerSec=10.94881409208331, CurrSamplesPerSec=11.2363640412516, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8231/20000 [12:00:29<31:13:46,  9.55s/it][2022-12-22 01:59:55,655] [INFO] [timer.py:197:stop] 0/2232, RunningAvgSamplesPerSec=10.948674894019929, CurrSamplesPerSec=10.646956586303602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8232/20000 [12:00:40<32:36:17,  9.97s/it][2022-12-22 02:00:06,935] [INFO] [timer.py:197:stop] 0/2233, RunningAvgSamplesPerSec=10.948632963747041, CurrSamplesPerSec=10.855920600804737, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8233/20000 [12:00:51<33:52:56, 10.37s/it][2022-12-22 02:00:16,514] [INFO] [timer.py:197:stop] 0/2234, RunningAvgSamplesPerSec=10.948491039982818, CurrSamplesPerSec=10.640762659566574, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8234/20000 [12:01:00<33:06:29, 10.13s/it][2022-12-22 02:00:25,442] [INFO] [timer.py:197:stop] 0/2235, RunningAvgSamplesPerSec=10.94844128418739, CurrSamplesPerSec=10.838502011621102, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8235/20000 [12:01:09<31:55:36,  9.77s/it][2022-12-22 02:00:34,701] [INFO] [timer.py:197:stop] 0/2236, RunningAvgSamplesPerSec=10.948560135192578, CurrSamplesPerSec=11.220550457488446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8236/20000 [12:01:19<31:25:23,  9.62s/it][2022-12-22 02:00:44,162] [INFO] [timer.py:197:stop] 0/2237, RunningAvgSamplesPerSec=10.948572007648364, CurrSamplesPerSec=10.975159511295399, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8237/20000 [12:01:28<31:16:07,  9.57s/it][2022-12-22 02:00:53,764] [INFO] [timer.py:197:stop] 0/2238, RunningAvgSamplesPerSec=10.948509788033324, CurrSamplesPerSec=10.811193826673218, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8238/20000 [12:01:38<31:17:53,  9.58s/it][2022-12-22 02:01:02,625] [INFO] [timer.py:197:stop] 0/2239, RunningAvgSamplesPerSec=10.948550905172704, CurrSamplesPerSec=11.041267745239042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8239/20000 [12:01:47<30:35:28,  9.36s/it][2022-12-22 02:01:12,706] [INFO] [logging.py:68:log_dist] [Rank 0] step=8240, skipped=18, lr=[6.04051282051282e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:01:12,707] [INFO] [timer.py:197:stop] 0/2240, RunningAvgSamplesPerSec=10.948558780151965, CurrSamplesPerSec=10.96620351198163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8240/20000 [12:01:57<31:17:32,  9.58s/it][2022-12-22 02:01:21,571] [INFO] [timer.py:197:stop] 0/2241, RunningAvgSamplesPerSec=10.948574474887177, CurrSamplesPerSec=10.98381239180287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8241/20000 [12:02:06<30:35:19,  9.36s/it][2022-12-22 02:01:31,489] [INFO] [timer.py:197:stop] 0/2242, RunningAvgSamplesPerSec=10.948527779826424, CurrSamplesPerSec=10.844966909241597, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8242/20000 [12:02:15<31:07:41,  9.53s/it][2022-12-22 02:01:40,925] [INFO] [timer.py:197:stop] 0/2243, RunningAvgSamplesPerSec=10.948488853851329, CurrSamplesPerSec=10.861983905912359, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8243/20000 [12:02:25<31:01:56,  9.50s/it][2022-12-22 02:01:50,102] [INFO] [timer.py:197:stop] 0/2244, RunningAvgSamplesPerSec=10.948381678141148, CurrSamplesPerSec=10.71335903534714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8244/20000 [12:02:34<30:42:43,  9.40s/it][2022-12-22 02:01:59,979] [INFO] [timer.py:197:stop] 0/2245, RunningAvgSamplesPerSec=10.948477422627201, CurrSamplesPerSec=11.1674313516257, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8245/20000 [12:02:44<31:10:16,  9.55s/it][2022-12-22 02:02:09,297] [INFO] [timer.py:197:stop] 0/2246, RunningAvgSamplesPerSec=10.948513955005224, CurrSamplesPerSec=11.031074261706024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8246/20000 [12:02:53<30:56:44,  9.48s/it][2022-12-22 02:02:18,334] [INFO] [timer.py:197:stop] 0/2247, RunningAvgSamplesPerSec=10.94854633943205, CurrSamplesPerSec=11.021702783363747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8247/20000 [12:03:02<30:30:38,  9.35s/it][2022-12-22 02:02:27,798] [INFO] [timer.py:197:stop] 0/2248, RunningAvgSamplesPerSec=10.948581177315305, CurrSamplesPerSec=11.02735519706596, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8248/20000 [12:03:12<30:37:28,  9.38s/it][2022-12-22 02:02:36,779] [INFO] [timer.py:197:stop] 0/2249, RunningAvgSamplesPerSec=10.948589181216365, CurrSamplesPerSec=10.96659552121952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████      | 8249/20000 [12:03:21<30:13:46,  9.26s/it][2022-12-22 02:02:45,758] [INFO] [logging.py:68:log_dist] [Rank 0] step=8250, skipped=18, lr=[6.035384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:02:45,759] [INFO] [timer.py:197:stop] 0/2250, RunningAvgSamplesPerSec=10.948693409343834, CurrSamplesPerSec=11.188015566959285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8250/20000 [12:03:30<29:57:06,  9.18s/it]

                                                          
{'loss': 0.0704, 'learning_rate': 6.035384615384616e-06, 'epoch': 0.41}


 41%|████▏     | 8250/20000 [12:03:30<29:57:06,  9.18s/it][2022-12-22 02:02:55,191] [INFO] [timer.py:197:stop] 0/2251, RunningAvgSamplesPerSec=10.948567161968294, CurrSamplesPerSec=10.671936942431154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8251/20000 [12:03:39<30:11:57,  9.25s/it][2022-12-22 02:03:04,410] [INFO] [timer.py:197:stop] 0/2252, RunningAvgSamplesPerSec=10.948660856054927, CurrSamplesPerSec=11.163515795140944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8252/20000 [12:03:48<30:09:48,  9.24s/it][2022-12-22 02:03:14,841] [INFO] [timer.py:197:stop] 0/2253, RunningAvgSamplesPerSec=10.9486543065963, CurrSamplesPerSec=10.933937841034536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8253/20000 [12:03:59<31:19:24,  9.60s/it][2022-12-22 02:03:23,695] [INFO] [timer.py:197:stop] 0/2254, RunningAvgSamplesPerSec=10.948682763406948, CurrSamplesPerSec=11.013116185337259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8254/20000 [12:04:08<30:35:27,  9.38s/it][2022-12-22 02:03:33,463] [INFO] [timer.py:197:stop] 0/2255, RunningAvgSamplesPerSec=10.948577579802029, CurrSamplesPerSec=10.716722534111026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8255/20000 [12:04:17<30:58:19,  9.49s/it][2022-12-22 02:03:42,508] [INFO] [timer.py:197:stop] 0/2256, RunningAvgSamplesPerSec=10.948589392421818, CurrSamplesPerSec=10.975268104204174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8256/20000 [12:04:26<30:31:52,  9.36s/it][2022-12-22 02:03:52,594] [INFO] [timer.py:197:stop] 0/2257, RunningAvgSamplesPerSec=10.948491650476011, CurrSamplesPerSec=10.732528929121049, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8257/20000 [12:04:37<31:14:22,  9.58s/it][2022-12-22 02:04:01,909] [INFO] [timer.py:197:stop] 0/2258, RunningAvgSamplesPerSec=10.948573707131608, CurrSamplesPerSec=11.136793915666193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8258/20000 [12:04:46<30:58:52,  9.50s/it][2022-12-22 02:04:11,763] [INFO] [timer.py:197:stop] 0/2259, RunningAvgSamplesPerSec=10.948541172024761, CurrSamplesPerSec=10.875630978781222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8259/20000 [12:04:56<31:19:34,  9.61s/it][2022-12-22 02:04:21,495] [INFO] [logging.py:68:log_dist] [Rank 0] step=8260, skipped=18, lr=[6.030256410256411e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:04:21,496] [INFO] [timer.py:197:stop] 0/2260, RunningAvgSamplesPerSec=10.948413319838805, CurrSamplesPerSec=10.667264336058054, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8260/20000 [12:05:05<31:26:52,  9.64s/it][2022-12-22 02:04:30,558] [INFO] [timer.py:197:stop] 0/2261, RunningAvgSamplesPerSec=10.948338325235797, CurrSamplesPerSec=10.781580889111508, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8261/20000 [12:05:15<30:52:37,  9.47s/it][2022-12-22 02:04:39,505] [INFO] [timer.py:197:stop] 0/2262, RunningAvgSamplesPerSec=10.948417300096128, CurrSamplesPerSec=11.129778087689823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8262/20000 [12:05:23<30:21:48,  9.31s/it][2022-12-22 02:04:48,744] [INFO] [timer.py:197:stop] 0/2263, RunningAvgSamplesPerSec=10.948552119544706, CurrSamplesPerSec=11.261970178348593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8263/20000 [12:05:33<30:17:19,  9.29s/it][2022-12-22 02:04:57,863] [INFO] [timer.py:197:stop] 0/2264, RunningAvgSamplesPerSec=10.9486550116966, CurrSamplesPerSec=11.186346924977697, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8264/20000 [12:05:42<30:07:08,  9.24s/it][2022-12-22 02:05:06,770] [INFO] [timer.py:197:stop] 0/2265, RunningAvgSamplesPerSec=10.948646542422994, CurrSamplesPerSec=10.929522522754345, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8265/20000 [12:05:51<29:47:29,  9.14s/it][2022-12-22 02:05:16,432] [INFO] [timer.py:197:stop] 0/2266, RunningAvgSamplesPerSec=10.948686255347027, CurrSamplesPerSec=11.039300723883432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8266/20000 [12:06:00<30:18:01,  9.30s/it][2022-12-22 02:05:26,261] [INFO] [timer.py:197:stop] 0/2267, RunningAvgSamplesPerSec=10.948766675403458, CurrSamplesPerSec=11.13391799144104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8267/20000 [12:06:10<30:49:09,  9.46s/it][2022-12-22 02:05:35,456] [INFO] [timer.py:197:stop] 0/2268, RunningAvgSamplesPerSec=10.948728976145068, CurrSamplesPerSec=10.864001236810825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8268/20000 [12:06:19<30:33:37,  9.38s/it][2022-12-22 02:05:44,316] [INFO] [timer.py:197:stop] 0/2269, RunningAvgSamplesPerSec=10.948730033053575, CurrSamplesPerSec=10.95112551196073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8269/20000 [12:06:28<30:03:07,  9.22s/it][2022-12-22 02:05:54,326] [INFO] [logging.py:68:log_dist] [Rank 0] step=8270, skipped=18, lr=[6.025128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:05:54,327] [INFO] [timer.py:197:stop] 0/2270, RunningAvgSamplesPerSec=10.948478610602603, CurrSamplesPerSec=10.406720147455067, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8270/20000 [12:06:38<30:49:12,  9.46s/it][2022-12-22 02:06:03,348] [INFO] [timer.py:197:stop] 0/2271, RunningAvgSamplesPerSec=10.948570341173427, CurrSamplesPerSec=11.160646935996324, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8271/20000 [12:06:47<30:23:25,  9.33s/it][2022-12-22 02:06:13,204] [INFO] [timer.py:197:stop] 0/2272, RunningAvgSamplesPerSec=10.948591410470648, CurrSamplesPerSec=10.996607396609495, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8272/20000 [12:06:57<30:54:11,  9.49s/it][2022-12-22 02:06:22,061] [INFO] [timer.py:197:stop] 0/2273, RunningAvgSamplesPerSec=10.948583401448571, CurrSamplesPerSec=10.930433073825485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8273/20000 [12:07:06<30:17:09,  9.30s/it][2022-12-22 02:06:31,825] [INFO] [timer.py:197:stop] 0/2274, RunningAvgSamplesPerSec=10.948490912329797, CurrSamplesPerSec=10.742403574650924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8274/20000 [12:07:16<30:44:24,  9.44s/it][2022-12-22 02:06:40,948] [INFO] [timer.py:197:stop] 0/2275, RunningAvgSamplesPerSec=10.948384450247012, CurrSamplesPerSec=10.71173321762146, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8275/20000 [12:07:25<30:25:47,  9.34s/it]

                                                          
{'loss': 0.0572, 'learning_rate': 6.022564102564104e-06, 'epoch': 0.41}


 41%|████▏     | 8275/20000 [12:07:25<30:25:47,  9.34s/it][2022-12-22 02:06:50,103] [INFO] [timer.py:197:stop] 0/2276, RunningAvgSamplesPerSec=10.948488474575548, CurrSamplesPerSec=11.190157230540109, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8276/20000 [12:07:34<30:14:37,  9.29s/it][2022-12-22 02:06:59,084] [INFO] [timer.py:197:stop] 0/2277, RunningAvgSamplesPerSec=10.94856460304548, CurrSamplesPerSec=11.124463234734042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8277/20000 [12:07:43<29:56:32,  9.19s/it][2022-12-22 02:07:08,435] [INFO] [timer.py:197:stop] 0/2278, RunningAvgSamplesPerSec=10.948584371060422, CurrSamplesPerSec=10.993742176081907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8278/20000 [12:07:52<30:05:32,  9.24s/it][2022-12-22 02:07:17,340] [INFO] [timer.py:197:stop] 0/2279, RunningAvgSamplesPerSec=10.948677752728038, CurrSamplesPerSec=11.16542376919542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8279/20000 [12:08:01<29:45:36,  9.14s/it][2022-12-22 02:07:26,822] [INFO] [logging.py:68:log_dist] [Rank 0] step=8280, skipped=18, lr=[6.02e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:07:26,823] [INFO] [timer.py:197:stop] 0/2280, RunningAvgSamplesPerSec=10.948487267215514, CurrSamplesPerSec=10.531286835264527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8280/20000 [12:08:11<30:05:32,  9.24s/it][2022-12-22 02:07:35,848] [INFO] [timer.py:197:stop] 0/2281, RunningAvgSamplesPerSec=10.948492370419777, CurrSamplesPerSec=10.96012983180301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8281/20000 [12:08:20<29:52:37,  9.18s/it][2022-12-22 02:07:46,095] [INFO] [timer.py:197:stop] 0/2282, RunningAvgSamplesPerSec=10.94858762050869, CurrSamplesPerSec=11.17005548878496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8282/20000 [12:08:30<30:55:02,  9.50s/it][2022-12-22 02:07:55,481] [INFO] [timer.py:197:stop] 0/2283, RunningAvgSamplesPerSec=10.948470514143025, CurrSamplesPerSec=10.687827149539224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8283/20000 [12:08:39<30:48:20,  9.46s/it][2022-12-22 02:08:04,967] [INFO] [timer.py:197:stop] 0/2284, RunningAvgSamplesPerSec=10.948424239048569, CurrSamplesPerSec=10.843879107526048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8284/20000 [12:08:49<30:49:25,  9.47s/it][2022-12-22 02:08:14,201] [INFO] [timer.py:197:stop] 0/2285, RunningAvgSamplesPerSec=10.948461667193932, CurrSamplesPerSec=11.034544538011472, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8285/20000 [12:08:58<30:35:20,  9.40s/it][2022-12-22 02:08:24,552] [INFO] [timer.py:197:stop] 0/2286, RunningAvgSamplesPerSec=10.948485649547782, CurrSamplesPerSec=11.00351266566984, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8286/20000 [12:09:09<31:30:54,  9.69s/it][2022-12-22 02:08:33,423] [INFO] [timer.py:197:stop] 0/2287, RunningAvgSamplesPerSec=10.948524443922965, CurrSamplesPerSec=11.037854057477173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8287/20000 [12:09:17<30:43:00,  9.44s/it][2022-12-22 02:08:43,081] [INFO] [timer.py:197:stop] 0/2288, RunningAvgSamplesPerSec=10.948607124781995, CurrSamplesPerSec=11.140851651263693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8288/20000 [12:09:27<30:55:34,  9.51s/it][2022-12-22 02:08:53,350] [INFO] [timer.py:197:stop] 0/2289, RunningAvgSamplesPerSec=10.948754370278948, CurrSamplesPerSec=11.296038997327013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8289/20000 [12:09:37<31:40:05,  9.73s/it][2022-12-22 02:09:02,617] [INFO] [logging.py:68:log_dist] [Rank 0] step=8290, skipped=18, lr=[6.014871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:09:02,618] [INFO] [timer.py:197:stop] 0/2290, RunningAvgSamplesPerSec=10.948658156470843, CurrSamplesPerSec=10.732954189693423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8290/20000 [12:09:47<31:12:35,  9.59s/it][2022-12-22 02:09:11,523] [INFO] [timer.py:197:stop] 0/2291, RunningAvgSamplesPerSec=10.948736940430006, CurrSamplesPerSec=11.132013382528896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8291/20000 [12:09:55<30:32:04,  9.39s/it][2022-12-22 02:09:20,421] [INFO] [timer.py:197:stop] 0/2292, RunningAvgSamplesPerSec=10.94877979841943, CurrSamplesPerSec=11.04776907549342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8292/20000 [12:10:04<30:03:12,  9.24s/it][2022-12-22 02:09:30,418] [INFO] [timer.py:197:stop] 0/2293, RunningAvgSamplesPerSec=10.948843234747098, CurrSamplesPerSec=11.096066637381439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8293/20000 [12:10:14<30:47:19,  9.47s/it][2022-12-22 02:09:39,423] [INFO] [timer.py:197:stop] 0/2294, RunningAvgSamplesPerSec=10.948855780919505, CurrSamplesPerSec=10.977674751395051, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8294/20000 [12:10:23<30:20:03,  9.33s/it][2022-12-22 02:09:48,767] [INFO] [timer.py:197:stop] 0/2295, RunningAvgSamplesPerSec=10.948783105693527, CurrSamplesPerSec=10.784708756508941, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8295/20000 [12:10:33<30:20:49,  9.33s/it][2022-12-22 02:09:57,985] [INFO] [timer.py:197:stop] 0/2296, RunningAvgSamplesPerSec=10.948918049718726, CurrSamplesPerSec=11.267347744679022, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8296/20000 [12:10:42<30:13:52,  9.30s/it][2022-12-22 02:10:06,848] [INFO] [timer.py:197:stop] 0/2297, RunningAvgSamplesPerSec=10.949062240443642, CurrSamplesPerSec=11.290144421157274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8297/20000 [12:10:51<29:48:16,  9.17s/it][2022-12-22 02:10:16,578] [INFO] [timer.py:197:stop] 0/2298, RunningAvgSamplesPerSec=10.949199189330495, CurrSamplesPerSec=11.272789622978772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8298/20000 [12:11:01<30:20:57,  9.34s/it][2022-12-22 02:10:25,905] [INFO] [timer.py:197:stop] 0/2299, RunningAvgSamplesPerSec=10.949116841444372, CurrSamplesPerSec=10.763256945152811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 41%|████▏     | 8299/20000 [12:11:10<30:20:13,  9.33s/it][2022-12-22 02:10:35,886] [INFO] [logging.py:68:log_dist] [Rank 0] step=8300, skipped=18, lr=[6.009743589743591e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:10:35,887] [INFO] [timer.py:197:stop] 0/2300, RunningAvgSamplesPerSec=10.949262320733967, CurrSamplesPerSec=11.293952601115699, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8300/20000 [12:11:20<30:58:00,  9.53s/it]

                                                          
{'loss': 0.0502, 'learning_rate': 6.009743589743591e-06, 'epoch': 0.41}


 42%|████▏     | 8300/20000 [12:11:20<30:58:00,  9.53s/it][2022-12-22 02:10:44,888] [INFO] [timer.py:197:stop] 0/2301, RunningAvgSamplesPerSec=10.949184896677586, CurrSamplesPerSec=10.774110550892118, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8301/20000 [12:11:29<30:26:59,  9.37s/it][2022-12-22 02:10:54,109] [INFO] [timer.py:197:stop] 0/2302, RunningAvgSamplesPerSec=10.94921230091999, CurrSamplesPerSec=11.012579430660846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8302/20000 [12:11:38<30:18:08,  9.33s/it][2022-12-22 02:11:03,073] [INFO] [timer.py:197:stop] 0/2303, RunningAvgSamplesPerSec=10.949304530702623, CurrSamplesPerSec=11.165625795378165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8303/20000 [12:11:47<29:56:49,  9.22s/it][2022-12-22 02:11:13,027] [INFO] [timer.py:197:stop] 0/2304, RunningAvgSamplesPerSec=10.949387160437794, CurrSamplesPerSec=11.14287954664599, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8304/20000 [12:11:57<30:39:47,  9.44s/it][2022-12-22 02:11:22,159] [INFO] [timer.py:197:stop] 0/2305, RunningAvgSamplesPerSec=10.949471551360345, CurrSamplesPerSec=11.147250007765502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8305/20000 [12:12:06<30:21:44,  9.35s/it][2022-12-22 02:11:31,520] [INFO] [timer.py:197:stop] 0/2306, RunningAvgSamplesPerSec=10.949365471847115, CurrSamplesPerSec=10.71039847514285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8306/20000 [12:12:15<30:22:28,  9.35s/it][2022-12-22 02:11:40,588] [INFO] [timer.py:197:stop] 0/2307, RunningAvgSamplesPerSec=10.94932614254093, CurrSamplesPerSec=10.859455497749044, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8307/20000 [12:12:25<30:05:46,  9.27s/it][2022-12-22 02:11:50,607] [INFO] [timer.py:197:stop] 0/2308, RunningAvgSamplesPerSec=10.9494221985442, CurrSamplesPerSec=11.17540284004249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8308/20000 [12:12:35<30:49:39,  9.49s/it][2022-12-22 02:11:59,300] [INFO] [timer.py:197:stop] 0/2309, RunningAvgSamplesPerSec=10.949542470815512, CurrSamplesPerSec=11.234101221953088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8309/20000 [12:12:43<30:02:47,  9.25s/it][2022-12-22 02:12:08,572] [INFO] [logging.py:68:log_dist] [Rank 0] step=8310, skipped=18, lr=[6.0046153846153855e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:12:08,573] [INFO] [timer.py:197:stop] 0/2310, RunningAvgSamplesPerSec=10.949586745044437, CurrSamplesPerSec=11.052689578616283, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8310/20000 [12:12:53<30:03:48,  9.26s/it][2022-12-22 02:12:17,871] [INFO] [timer.py:197:stop] 0/2311, RunningAvgSamplesPerSec=10.949507444224581, CurrSamplesPerSec=10.769491508831942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8311/20000 [12:13:02<30:05:59,  9.27s/it][2022-12-22 02:12:26,972] [INFO] [timer.py:197:stop] 0/2312, RunningAvgSamplesPerSec=10.949559396850535, CurrSamplesPerSec=11.070847363902653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8312/20000 [12:13:11<29:55:58,  9.22s/it][2022-12-22 02:12:37,405] [INFO] [timer.py:197:stop] 0/2313, RunningAvgSamplesPerSec=10.949553550384886, CurrSamplesPerSec=10.936064859083746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8313/20000 [12:13:21<31:06:41,  9.58s/it][2022-12-22 02:12:46,667] [INFO] [timer.py:197:stop] 0/2314, RunningAvgSamplesPerSec=10.949503334303266, CurrSamplesPerSec=10.834671552011441, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8314/20000 [12:13:31<30:47:45,  9.49s/it][2022-12-22 02:12:55,980] [INFO] [timer.py:197:stop] 0/2315, RunningAvgSamplesPerSec=10.949600524351242, CurrSamplesPerSec=11.179013882176513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8315/20000 [12:13:40<30:37:28,  9.44s/it][2022-12-22 02:13:04,991] [INFO] [timer.py:197:stop] 0/2316, RunningAvgSamplesPerSec=10.949668869213339, CurrSamplesPerSec=11.110067226481048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8316/20000 [12:13:49<30:12:31,  9.31s/it][2022-12-22 02:13:13,936] [INFO] [timer.py:197:stop] 0/2317, RunningAvgSamplesPerSec=10.94977129395369, CurrSamplesPerSec=11.192028125804296, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8317/20000 [12:13:58<29:51:10,  9.20s/it][2022-12-22 02:13:23,309] [INFO] [timer.py:197:stop] 0/2318, RunningAvgSamplesPerSec=10.949654943163807, CurrSamplesPerSec=10.6867723434517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8318/20000 [12:14:07<30:01:12,  9.25s/it][2022-12-22 02:13:32,508] [INFO] [timer.py:197:stop] 0/2319, RunningAvgSamplesPerSec=10.949681968735687, CurrSamplesPerSec=11.012633194133274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8319/20000 [12:14:16<29:57:59,  9.24s/it][2022-12-22 02:13:41,987] [INFO] [logging.py:68:log_dist] [Rank 0] step=8320, skipped=18, lr=[5.99948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:13:41,988] [INFO] [timer.py:197:stop] 0/2320, RunningAvgSamplesPerSec=10.949639844803723, CurrSamplesPerSec=10.852901358661187, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8320/20000 [12:14:26<30:12:06,  9.31s/it][2022-12-22 02:13:50,845] [INFO] [timer.py:197:stop] 0/2321, RunningAvgSamplesPerSec=10.949652364639315, CurrSamplesPerSec=10.97875049855921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8321/20000 [12:14:35<29:45:33,  9.17s/it][2022-12-22 02:14:01,383] [INFO] [timer.py:197:stop] 0/2322, RunningAvgSamplesPerSec=10.949586250635477, CurrSamplesPerSec=10.798385926943523, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8322/20000 [12:14:45<31:05:08,  9.58s/it][2022-12-22 02:14:12,149] [INFO] [timer.py:197:stop] 0/2323, RunningAvgSamplesPerSec=10.949506714812959, CurrSamplesPerSec=10.768042984970977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8323/20000 [12:14:56<32:14:01,  9.94s/it][2022-12-22 02:14:21,039] [INFO] [timer.py:197:stop] 0/2324, RunningAvgSamplesPerSec=10.949517985423729, CurrSamplesPerSec=10.97573974544799, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8324/20000 [12:15:05<31:12:43,  9.62s/it][2022-12-22 02:14:31,280] [INFO] [timer.py:197:stop] 0/2325, RunningAvgSamplesPerSec=10.949524576222379, CurrSamplesPerSec=10.964849839590812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8325/20000 [12:15:15<31:48:35,  9.81s/it]

                                                          
{'loss': 0.0644, 'learning_rate': 5.996923076923078e-06, 'epoch': 0.42}


 42%|████▏     | 8325/20000 [12:15:15<31:48:35,  9.81s/it][2022-12-22 02:14:40,412] [INFO] [timer.py:197:stop] 0/2326, RunningAvgSamplesPerSec=10.949607472390545, CurrSamplesPerSec=11.145624045724905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8326/20000 [12:15:24<31:08:56,  9.61s/it][2022-12-22 02:14:49,796] [INFO] [timer.py:197:stop] 0/2327, RunningAvgSamplesPerSec=10.949609586932816, CurrSamplesPerSec=10.954525990607857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8327/20000 [12:15:34<30:55:52,  9.54s/it][2022-12-22 02:14:59,287] [INFO] [timer.py:197:stop] 0/2328, RunningAvgSamplesPerSec=10.949598765356658, CurrSamplesPerSec=10.924496306428924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8328/20000 [12:15:43<30:52:52,  9.52s/it][2022-12-22 02:15:08,741] [INFO] [timer.py:197:stop] 0/2329, RunningAvgSamplesPerSec=10.949538208565158, CurrSamplesPerSec=10.810472820809554, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8329/20000 [12:15:53<30:48:33,  9.50s/it][2022-12-22 02:15:17,871] [INFO] [logging.py:68:log_dist] [Rank 0] step=8330, skipped=18, lr=[5.9943589743589745e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:15:17,871] [INFO] [timer.py:197:stop] 0/2330, RunningAvgSamplesPerSec=10.949490895195263, CurrSamplesPerSec=10.840489177479911, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8330/20000 [12:16:02<30:26:39,  9.39s/it][2022-12-22 02:15:27,017] [INFO] [timer.py:197:stop] 0/2331, RunningAvgSamplesPerSec=10.94955171265584, CurrSamplesPerSec=11.092990288386265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8331/20000 [12:16:11<30:12:10,  9.32s/it][2022-12-22 02:15:36,565] [INFO] [timer.py:197:stop] 0/2332, RunningAvgSamplesPerSec=10.949585679294161, CurrSamplesPerSec=11.02926992795477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8332/20000 [12:16:21<30:25:27,  9.39s/it][2022-12-22 02:15:47,173] [INFO] [timer.py:197:stop] 0/2333, RunningAvgSamplesPerSec=10.949489428851908, CurrSamplesPerSec=10.729728887090356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8333/20000 [12:16:31<31:36:29,  9.75s/it][2022-12-22 02:15:57,793] [INFO] [timer.py:197:stop] 0/2334, RunningAvgSamplesPerSec=10.949496663347887, CurrSamplesPerSec=10.96638629680183, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8334/20000 [12:16:42<32:26:53, 10.01s/it][2022-12-22 02:16:07,113] [INFO] [timer.py:197:stop] 0/2335, RunningAvgSamplesPerSec=10.949447545392532, CurrSamplesPerSec=10.836090816083995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8335/20000 [12:16:51<31:46:18,  9.81s/it][2022-12-22 02:16:16,948] [INFO] [timer.py:197:stop] 0/2336, RunningAvgSamplesPerSec=10.949477173499895, CurrSamplesPerSec=11.019038868548366, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8336/20000 [12:17:01<31:47:52,  9.81s/it][2022-12-22 02:16:27,335] [INFO] [timer.py:197:stop] 0/2337, RunningAvgSamplesPerSec=10.949427330711812, CurrSamplesPerSec=10.834317777969897, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8337/20000 [12:17:11<32:21:08,  9.99s/it][2022-12-22 02:16:36,086] [INFO] [timer.py:197:stop] 0/2338, RunningAvgSamplesPerSec=10.949522999263747, CurrSamplesPerSec=11.177563413988121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8338/20000 [12:17:20<31:08:54,  9.62s/it][2022-12-22 02:16:45,920] [INFO] [timer.py:197:stop] 0/2339, RunningAvgSamplesPerSec=10.949615091318503, CurrSamplesPerSec=11.1690553180087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8339/20000 [12:17:30<31:21:31,  9.68s/it][2022-12-22 02:16:55,145] [INFO] [logging.py:68:log_dist] [Rank 0] step=8340, skipped=18, lr=[5.989230769230769e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:16:55,146] [INFO] [timer.py:197:stop] 0/2340, RunningAvgSamplesPerSec=10.949697133565628, CurrSamplesPerSec=11.144848490560326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8340/20000 [12:17:39<30:54:48,  9.54s/it][2022-12-22 02:17:04,003] [INFO] [timer.py:197:stop] 0/2341, RunningAvgSamplesPerSec=10.949727475007679, CurrSamplesPerSec=11.021128539310343, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8341/20000 [12:17:48<30:14:33,  9.34s/it][2022-12-22 02:17:13,454] [INFO] [timer.py:197:stop] 0/2342, RunningAvgSamplesPerSec=10.949766033899229, CurrSamplesPerSec=11.040704629664132, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8342/20000 [12:17:57<30:21:01,  9.37s/it][2022-12-22 02:17:23,039] [INFO] [timer.py:197:stop] 0/2343, RunningAvgSamplesPerSec=10.949773890930462, CurrSamplesPerSec=10.968190279667027, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8343/20000 [12:18:07<30:33:16,  9.44s/it][2022-12-22 02:17:32,477] [INFO] [timer.py:197:stop] 0/2344, RunningAvgSamplesPerSec=10.949785835337153, CurrSamplesPerSec=10.977819309494764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8344/20000 [12:18:16<30:33:11,  9.44s/it][2022-12-22 02:17:41,715] [INFO] [timer.py:197:stop] 0/2345, RunningAvgSamplesPerSec=10.949800684557093, CurrSamplesPerSec=10.984688409357538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8345/20000 [12:18:26<30:21:28,  9.38s/it][2022-12-22 02:17:52,695] [INFO] [timer.py:197:stop] 0/2346, RunningAvgSamplesPerSec=10.949882488982121, CurrSamplesPerSec=11.144966482743651, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8346/20000 [12:18:37<31:54:45,  9.86s/it][2022-12-22 02:18:01,752] [INFO] [timer.py:197:stop] 0/2347, RunningAvgSamplesPerSec=10.949819216023226, CurrSamplesPerSec=10.803490225521243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8347/20000 [12:18:46<31:07:52,  9.62s/it][2022-12-22 02:18:11,680] [INFO] [timer.py:197:stop] 0/2348, RunningAvgSamplesPerSec=10.94981606796107, CurrSamplesPerSec=10.94243883795072, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8348/20000 [12:18:56<31:25:48,  9.71s/it][2022-12-22 02:18:20,899] [INFO] [timer.py:197:stop] 0/2349, RunningAvgSamplesPerSec=10.949914870800336, CurrSamplesPerSec=11.186721265436127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8349/20000 [12:19:05<30:57:00,  9.56s/it][2022-12-22 02:18:29,821] [INFO] [logging.py:68:log_dist] [Rank 0] step=8350, skipped=18, lr=[5.984102564102564e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:18:29,822] [INFO] [timer.py:197:stop] 0/2350, RunningAvgSamplesPerSec=10.949994826853601, CurrSamplesPerSec=11.14092516980715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8350/20000 [12:19:14<30:19:38,  9.37s/it]

                                                          
{'loss': 0.0729, 'learning_rate': 5.984102564102564e-06, 'epoch': 0.42}


 42%|████▏     | 8350/20000 [12:19:14<30:19:38,  9.37s/it][2022-12-22 02:18:39,433] [INFO] [timer.py:197:stop] 0/2351, RunningAvgSamplesPerSec=10.94987963939723, CurrSamplesPerSec=10.685941495191702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8351/20000 [12:19:23<30:33:19,  9.44s/it][2022-12-22 02:18:48,823] [INFO] [timer.py:197:stop] 0/2352, RunningAvgSamplesPerSec=10.949773705544008, CurrSamplesPerSec=10.706466701283924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8352/20000 [12:19:33<30:30:05,  9.43s/it][2022-12-22 02:19:01,613] [INFO] [timer.py:197:stop] 0/2353, RunningAvgSamplesPerSec=10.949801254509513, CurrSamplesPerSec=11.014926536779374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8353/20000 [12:19:46<33:45:50, 10.44s/it][2022-12-22 02:19:10,455] [INFO] [timer.py:197:stop] 0/2354, RunningAvgSamplesPerSec=10.949840412099407, CurrSamplesPerSec=11.04268078242774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8354/20000 [12:19:54<32:12:50,  9.96s/it][2022-12-22 02:19:20,736] [INFO] [timer.py:197:stop] 0/2355, RunningAvgSamplesPerSec=10.949895067554152, CurrSamplesPerSec=11.079972429207027, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8355/20000 [12:20:05<32:31:25, 10.05s/it][2022-12-22 02:19:29,505] [INFO] [timer.py:197:stop] 0/2356, RunningAvgSamplesPerSec=10.94999560095442, CurrSamplesPerSec=11.191776148346994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8356/20000 [12:20:13<31:16:26,  9.67s/it][2022-12-22 02:19:39,113] [INFO] [timer.py:197:stop] 0/2357, RunningAvgSamplesPerSec=10.949970693135402, CurrSamplesPerSec=10.891650104808141, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8357/20000 [12:20:23<31:12:43,  9.65s/it][2022-12-22 02:19:47,950] [INFO] [timer.py:197:stop] 0/2358, RunningAvgSamplesPerSec=10.950014113903482, CurrSamplesPerSec=11.05323434665834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8358/20000 [12:20:32<30:25:11,  9.41s/it][2022-12-22 02:19:58,276] [INFO] [timer.py:197:stop] 0/2359, RunningAvgSamplesPerSec=10.949928211636987, CurrSamplesPerSec=10.751216781666262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8359/20000 [12:20:42<31:18:33,  9.68s/it][2022-12-22 02:20:07,730] [INFO] [logging.py:68:log_dist] [Rank 0] step=8360, skipped=18, lr=[5.97897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:20:07,731] [INFO] [timer.py:197:stop] 0/2360, RunningAvgSamplesPerSec=10.949871633931728, CurrSamplesPerSec=10.818123169746013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8360/20000 [12:20:52<31:05:08,  9.61s/it][2022-12-22 02:20:16,752] [INFO] [timer.py:197:stop] 0/2361, RunningAvgSamplesPerSec=10.949790939557694, CurrSamplesPerSec=10.762764982043311, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8361/20000 [12:21:01<30:30:29,  9.44s/it][2022-12-22 02:20:26,267] [INFO] [timer.py:197:stop] 0/2362, RunningAvgSamplesPerSec=10.949825480933805, CurrSamplesPerSec=11.031919750507702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8362/20000 [12:21:10<30:34:52,  9.46s/it][2022-12-22 02:20:35,681] [INFO] [timer.py:197:stop] 0/2363, RunningAvgSamplesPerSec=10.949845889720446, CurrSamplesPerSec=10.99822351346418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8363/20000 [12:21:20<30:32:05,  9.45s/it][2022-12-22 02:20:44,880] [INFO] [timer.py:197:stop] 0/2364, RunningAvgSamplesPerSec=10.949983460079142, CurrSamplesPerSec=11.284720409004471, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8364/20000 [12:21:29<30:17:33,  9.37s/it][2022-12-22 02:20:54,819] [INFO] [timer.py:197:stop] 0/2365, RunningAvgSamplesPerSec=10.95006833650871, CurrSamplesPerSec=11.154286960399533, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8365/20000 [12:21:39<30:50:19,  9.54s/it][2022-12-22 02:21:04,251] [INFO] [timer.py:197:stop] 0/2366, RunningAvgSamplesPerSec=10.950022898729104, CurrSamplesPerSec=10.843696441325719, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8366/20000 [12:21:48<30:43:46,  9.51s/it][2022-12-22 02:21:14,451] [INFO] [timer.py:197:stop] 0/2367, RunningAvgSamplesPerSec=10.950134389047681, CurrSamplesPerSec=11.220200581826822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8367/20000 [12:21:58<31:23:49,  9.72s/it][2022-12-22 02:21:23,665] [INFO] [timer.py:197:stop] 0/2368, RunningAvgSamplesPerSec=10.95007528258503, CurrSamplesPerSec=10.8120512347814, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8368/20000 [12:22:08<30:54:29,  9.57s/it][2022-12-22 02:21:32,846] [INFO] [timer.py:197:stop] 0/2369, RunningAvgSamplesPerSec=10.950179323821244, CurrSamplesPerSec=11.202004343082756, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8369/20000 [12:22:17<30:31:54,  9.45s/it][2022-12-22 02:21:42,020] [INFO] [logging.py:68:log_dist] [Rank 0] step=8370, skipped=18, lr=[5.973846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:21:42,021] [INFO] [timer.py:197:stop] 0/2370, RunningAvgSamplesPerSec=10.950125181123285, CurrSamplesPerSec=10.823452565629884, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8370/20000 [12:22:26<30:15:46,  9.37s/it][2022-12-22 02:21:51,275] [INFO] [timer.py:197:stop] 0/2371, RunningAvgSamplesPerSec=10.950131943439024, CurrSamplesPerSec=10.966168568518613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8371/20000 [12:22:35<30:09:00,  9.33s/it][2022-12-22 02:22:00,524] [INFO] [timer.py:197:stop] 0/2372, RunningAvgSamplesPerSec=10.950119881355613, CurrSamplesPerSec=10.921619211568942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8372/20000 [12:22:44<30:03:55,  9.31s/it][2022-12-22 02:22:09,723] [INFO] [timer.py:197:stop] 0/2373, RunningAvgSamplesPerSec=10.950192863503554, CurrSamplesPerSec=11.125937766972731, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8373/20000 [12:22:54<29:57:25,  9.28s/it][2022-12-22 02:22:19,121] [INFO] [timer.py:197:stop] 0/2374, RunningAvgSamplesPerSec=10.950016580149613, CurrSamplesPerSec=10.547422456527785, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8374/20000 [12:23:03<30:04:22,  9.31s/it][2022-12-22 02:22:28,072] [INFO] [timer.py:197:stop] 0/2375, RunningAvgSamplesPerSec=10.95005149179068, CurrSamplesPerSec=11.033493203316434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8375/20000 [12:23:12<29:43:16,  9.20s/it]

                                                          
{'loss': 0.0597, 'learning_rate': 5.971282051282051e-06, 'epoch': 0.42}


 42%|████▏     | 8375/20000 [12:23:12<29:43:16,  9.20s/it][2022-12-22 02:22:37,205] [INFO] [timer.py:197:stop] 0/2376, RunningAvgSamplesPerSec=10.95006140676816, CurrSamplesPerSec=10.973640333381272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8376/20000 [12:23:21<29:38:57,  9.18s/it][2022-12-22 02:22:46,513] [INFO] [timer.py:197:stop] 0/2377, RunningAvgSamplesPerSec=10.950092521699952, CurrSamplesPerSec=11.024461255759304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8377/20000 [12:23:30<29:46:08,  9.22s/it][2022-12-22 02:22:55,814] [INFO] [timer.py:197:stop] 0/2378, RunningAvgSamplesPerSec=10.950175188309366, CurrSamplesPerSec=11.150094383217255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8378/20000 [12:23:40<29:50:39,  9.24s/it][2022-12-22 02:23:06,122] [INFO] [timer.py:197:stop] 0/2379, RunningAvgSamplesPerSec=10.9502176261375, CurrSamplesPerSec=11.051987421337556, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8379/20000 [12:23:50<30:52:18,  9.56s/it][2022-12-22 02:23:15,227] [INFO] [logging.py:68:log_dist] [Rank 0] step=8380, skipped=18, lr=[5.968717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:23:15,228] [INFO] [timer.py:197:stop] 0/2380, RunningAvgSamplesPerSec=10.950144308955714, CurrSamplesPerSec=10.778600686358411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8380/20000 [12:23:59<30:25:33,  9.43s/it][2022-12-22 02:23:24,713] [INFO] [timer.py:197:stop] 0/2381, RunningAvgSamplesPerSec=10.95016500972729, CurrSamplesPerSec=10.999613835063645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8381/20000 [12:24:09<30:28:47,  9.44s/it][2022-12-22 02:23:35,867] [INFO] [timer.py:197:stop] 0/2382, RunningAvgSamplesPerSec=10.950166598856786, CurrSamplesPerSec=10.953948444159197, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8382/20000 [12:24:20<32:07:58,  9.96s/it][2022-12-22 02:23:45,266] [INFO] [timer.py:197:stop] 0/2383, RunningAvgSamplesPerSec=10.95014361601159, CurrSamplesPerSec=10.89571643836039, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8383/20000 [12:24:29<31:35:24,  9.79s/it][2022-12-22 02:23:54,923] [INFO] [timer.py:197:stop] 0/2384, RunningAvgSamplesPerSec=10.950241637627176, CurrSamplesPerSec=11.188715994745333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8384/20000 [12:24:39<31:27:32,  9.75s/it][2022-12-22 02:24:04,029] [INFO] [timer.py:197:stop] 0/2385, RunningAvgSamplesPerSec=10.95016955669531, CurrSamplesPerSec=10.78112448742705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8385/20000 [12:24:48<30:50:00,  9.56s/it][2022-12-22 02:24:13,142] [INFO] [timer.py:197:stop] 0/2386, RunningAvgSamplesPerSec=10.950228281517928, CurrSamplesPerSec=11.091981870393345, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8386/20000 [12:24:57<30:24:04,  9.42s/it][2022-12-22 02:24:22,258] [INFO] [timer.py:197:stop] 0/2387, RunningAvgSamplesPerSec=10.950293239177979, CurrSamplesPerSec=11.10737467848108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8387/20000 [12:25:06<30:06:03,  9.33s/it][2022-12-22 02:24:32,038] [INFO] [timer.py:197:stop] 0/2388, RunningAvgSamplesPerSec=10.950293885826024, CurrSamplesPerSec=10.951836358745703, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8388/20000 [12:25:16<30:31:58,  9.47s/it][2022-12-22 02:24:41,045] [INFO] [timer.py:197:stop] 0/2389, RunningAvgSamplesPerSec=10.950284994137057, CurrSamplesPerSec=10.929110465928193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8389/20000 [12:25:25<30:05:11,  9.33s/it][2022-12-22 02:24:50,167] [INFO] [logging.py:68:log_dist] [Rank 0] step=8390, skipped=18, lr=[5.963589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:24:50,167] [INFO] [timer.py:197:stop] 0/2390, RunningAvgSamplesPerSec=10.950365153911436, CurrSamplesPerSec=11.14511085304887, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8390/20000 [12:25:34<29:53:03,  9.27s/it][2022-12-22 02:24:59,945] [INFO] [timer.py:197:stop] 0/2391, RunningAvgSamplesPerSec=10.95022397565591, CurrSamplesPerSec=10.623163986690347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8391/20000 [12:25:44<30:22:34,  9.42s/it][2022-12-22 02:25:09,392] [INFO] [timer.py:197:stop] 0/2392, RunningAvgSamplesPerSec=10.95021214214205, CurrSamplesPerSec=10.922014705583777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8392/20000 [12:25:53<30:24:00,  9.43s/it][2022-12-22 02:25:19,142] [INFO] [timer.py:197:stop] 0/2393, RunningAvgSamplesPerSec=10.950115220392584, CurrSamplesPerSec=10.723272956178047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8393/20000 [12:26:03<30:42:33,  9.52s/it][2022-12-22 02:25:28,457] [INFO] [timer.py:197:stop] 0/2394, RunningAvgSamplesPerSec=10.950170850308064, CurrSamplesPerSec=11.084818216475249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8394/20000 [12:26:12<30:30:11,  9.46s/it][2022-12-22 02:25:38,678] [INFO] [timer.py:197:stop] 0/2395, RunningAvgSamplesPerSec=10.950179826963945, CurrSamplesPerSec=10.971694192894265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8395/20000 [12:26:23<31:14:07,  9.69s/it][2022-12-22 02:25:47,656] [INFO] [timer.py:197:stop] 0/2396, RunningAvgSamplesPerSec=10.950198828130414, CurrSamplesPerSec=10.995858295871178, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8396/20000 [12:26:32<30:32:37,  9.48s/it][2022-12-22 02:25:57,458] [INFO] [timer.py:197:stop] 0/2397, RunningAvgSamplesPerSec=10.95025499776238, CurrSamplesPerSec=11.086397638694446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8397/20000 [12:26:41<30:51:25,  9.57s/it][2022-12-22 02:26:06,729] [INFO] [timer.py:197:stop] 0/2398, RunningAvgSamplesPerSec=10.950156020610331, CurrSamplesPerSec=10.718130749353923, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8398/20000 [12:26:51<30:33:40,  9.48s/it][2022-12-22 02:26:16,616] [INFO] [timer.py:197:stop] 0/2399, RunningAvgSamplesPerSec=10.949980017548567, CurrSamplesPerSec=10.543921258152588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8399/20000 [12:27:01<30:56:57,  9.60s/it][2022-12-22 02:26:26,050] [INFO] [logging.py:68:log_dist] [Rank 0] step=8400, skipped=18, lr=[5.958461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:26:26,051] [INFO] [timer.py:197:stop] 0/2400, RunningAvgSamplesPerSec=10.949954989977012, CurrSamplesPerSec=10.890290916546844, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8400/20000 [12:27:10<30:47:00,  9.55s/it]

                                                          
{'loss': 0.0637, 'learning_rate': 5.958461538461539e-06, 'epoch': 0.42}


 42%|████▏     | 8400/20000 [12:27:10<30:47:00,  9.55s/it][2022-12-22 02:26:36,454] [INFO] [timer.py:197:stop] 0/2401, RunningAvgSamplesPerSec=10.94997638488921, CurrSamplesPerSec=11.001523001478084, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8401/20000 [12:27:20<31:36:08,  9.81s/it][2022-12-22 02:26:46,593] [INFO] [timer.py:197:stop] 0/2402, RunningAvgSamplesPerSec=10.949913408060235, CurrSamplesPerSec=10.800889016250656, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8402/20000 [12:27:31<31:55:05,  9.91s/it][2022-12-22 02:26:55,613] [INFO] [timer.py:197:stop] 0/2403, RunningAvgSamplesPerSec=10.949807064676378, CurrSamplesPerSec=10.700398712597949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8403/20000 [12:27:40<31:03:31,  9.64s/it][2022-12-22 02:27:05,103] [INFO] [timer.py:197:stop] 0/2404, RunningAvgSamplesPerSec=10.949888841333438, CurrSamplesPerSec=11.149821134219843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8404/20000 [12:27:49<30:54:33,  9.60s/it][2022-12-22 02:27:14,334] [INFO] [timer.py:197:stop] 0/2405, RunningAvgSamplesPerSec=10.949905736352559, CurrSamplesPerSec=10.990638596636613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8405/20000 [12:27:58<30:33:12,  9.49s/it][2022-12-22 02:27:23,668] [INFO] [timer.py:197:stop] 0/2406, RunningAvgSamplesPerSec=10.949816668044598, CurrSamplesPerSec=10.739890562807558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8406/20000 [12:28:08<30:24:16,  9.44s/it][2022-12-22 02:27:33,334] [INFO] [timer.py:197:stop] 0/2407, RunningAvgSamplesPerSec=10.949733044334407, CurrSamplesPerSec=10.752327417196685, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8407/20000 [12:28:17<30:37:12,  9.51s/it][2022-12-22 02:27:42,440] [INFO] [timer.py:197:stop] 0/2408, RunningAvgSamplesPerSec=10.94974814137712, CurrSamplesPerSec=10.986177375417386, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8408/20000 [12:28:26<30:13:38,  9.39s/it][2022-12-22 02:27:53,034] [INFO] [timer.py:197:stop] 0/2409, RunningAvgSamplesPerSec=10.949701147351405, CurrSamplesPerSec=10.837789610653772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8409/20000 [12:28:37<31:23:26,  9.75s/it][2022-12-22 02:28:03,231] [INFO] [logging.py:68:log_dist] [Rank 0] step=8410, skipped=18, lr=[5.9533333333333345e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:28:03,232] [INFO] [timer.py:197:stop] 0/2410, RunningAvgSamplesPerSec=10.949776738578052, CurrSamplesPerSec=11.134800565725804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8410/20000 [12:28:47<31:49:16,  9.88s/it][2022-12-22 02:28:13,455] [INFO] [timer.py:197:stop] 0/2411, RunningAvgSamplesPerSec=10.949595214775648, CurrSamplesPerSec=10.529272217438566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8411/20000 [12:28:57<32:08:46,  9.99s/it][2022-12-22 02:28:22,743] [INFO] [timer.py:197:stop] 0/2412, RunningAvgSamplesPerSec=10.949537339944085, CurrSamplesPerSec=10.811870510232744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8412/20000 [12:29:07<31:28:07,  9.78s/it][2022-12-22 02:28:33,679] [INFO] [timer.py:197:stop] 0/2413, RunningAvgSamplesPerSec=10.949544928159657, CurrSamplesPerSec=10.967863134898296, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8413/20000 [12:29:18<32:35:10, 10.12s/it][2022-12-22 02:28:42,681] [INFO] [timer.py:197:stop] 0/2414, RunningAvgSamplesPerSec=10.949550749292435, CurrSamplesPerSec=10.963603520240534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8414/20000 [12:29:27<31:29:58,  9.79s/it][2022-12-22 02:28:51,409] [INFO] [timer.py:197:stop] 0/2415, RunningAvgSamplesPerSec=10.949661860786154, CurrSamplesPerSec=11.224389735606037, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8415/20000 [12:29:35<30:28:26,  9.47s/it][2022-12-22 02:29:00,911] [INFO] [timer.py:197:stop] 0/2416, RunningAvgSamplesPerSec=10.949646935709328, CurrSamplesPerSec=10.913750839209033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8416/20000 [12:29:45<30:30:09,  9.48s/it][2022-12-22 02:29:10,221] [INFO] [timer.py:197:stop] 0/2417, RunningAvgSamplesPerSec=10.949596434598513, CurrSamplesPerSec=10.829029665161332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8417/20000 [12:29:54<30:20:11,  9.43s/it][2022-12-22 02:29:19,245] [INFO] [timer.py:197:stop] 0/2418, RunningAvgSamplesPerSec=10.949643008905165, CurrSamplesPerSec=11.06328782542954, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8418/20000 [12:30:03<29:56:35,  9.31s/it][2022-12-22 02:29:28,525] [INFO] [timer.py:197:stop] 0/2419, RunningAvgSamplesPerSec=10.949610912971423, CurrSamplesPerSec=10.87261265479478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8419/20000 [12:30:12<29:54:53,  9.30s/it][2022-12-22 02:29:38,098] [INFO] [logging.py:68:log_dist] [Rank 0] step=8420, skipped=18, lr=[5.9482051282051285e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:29:38,098] [INFO] [timer.py:197:stop] 0/2420, RunningAvgSamplesPerSec=10.949562774645113, CurrSamplesPerSec=10.834436283141015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8420/20000 [12:30:22<30:10:35,  9.38s/it][2022-12-22 02:29:48,143] [INFO] [timer.py:197:stop] 0/2421, RunningAvgSamplesPerSec=10.949495058371287, CurrSamplesPerSec=10.788170541019996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8421/20000 [12:30:32<30:48:50,  9.58s/it][2022-12-22 02:29:57,054] [INFO] [timer.py:197:stop] 0/2422, RunningAvgSamplesPerSec=10.949555050213561, CurrSamplesPerSec=11.096625322866458, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8422/20000 [12:30:41<30:09:56,  9.38s/it][2022-12-22 02:30:07,639] [INFO] [timer.py:197:stop] 0/2423, RunningAvgSamplesPerSec=10.949596429665997, CurrSamplesPerSec=11.050659345762229, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8423/20000 [12:30:52<31:19:31,  9.74s/it][2022-12-22 02:30:16,907] [INFO] [timer.py:197:stop] 0/2424, RunningAvgSamplesPerSec=10.949611468069616, CurrSamplesPerSec=10.986140955671292, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8424/20000 [12:31:01<30:52:00,  9.60s/it][2022-12-22 02:30:26,139] [INFO] [timer.py:197:stop] 0/2425, RunningAvgSamplesPerSec=10.949573616321372, CurrSamplesPerSec=10.85865819921857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8425/20000 [12:31:10<30:30:36,  9.49s/it]

                                                          
{'loss': 0.0682, 'learning_rate': 5.9456410256410256e-06, 'epoch': 0.42}


 42%|████▏     | 8425/20000 [12:31:10<30:30:36,  9.49s/it][2022-12-22 02:30:36,858] [INFO] [timer.py:197:stop] 0/2426, RunningAvgSamplesPerSec=10.949415033269625, CurrSamplesPerSec=10.578200664265816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8426/20000 [12:31:21<31:41:36,  9.86s/it][2022-12-22 02:30:46,078] [INFO] [timer.py:197:stop] 0/2427, RunningAvgSamplesPerSec=10.949248184159245, CurrSamplesPerSec=10.55921875248924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8427/20000 [12:31:30<31:04:30,  9.67s/it][2022-12-22 02:30:55,219] [INFO] [timer.py:197:stop] 0/2428, RunningAvgSamplesPerSec=10.949261894114903, CurrSamplesPerSec=10.982609836958424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8428/20000 [12:31:39<30:33:58,  9.51s/it][2022-12-22 02:31:04,686] [INFO] [timer.py:197:stop] 0/2429, RunningAvgSamplesPerSec=10.949182796638683, CurrSamplesPerSec=10.76059872176643, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8429/20000 [12:31:49<30:31:21,  9.50s/it][2022-12-22 02:31:16,529] [INFO] [logging.py:68:log_dist] [Rank 0] step=8430, skipped=18, lr=[5.9430769230769234e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:31:16,530] [INFO] [timer.py:197:stop] 0/2430, RunningAvgSamplesPerSec=10.94918618888614, CurrSamplesPerSec=10.957425371277646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8430/20000 [12:32:00<32:47:03, 10.20s/it][2022-12-22 02:31:25,652] [INFO] [timer.py:197:stop] 0/2431, RunningAvgSamplesPerSec=10.949279082200539, CurrSamplesPerSec=11.179569777518047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8431/20000 [12:32:10<31:44:28,  9.88s/it][2022-12-22 02:31:35,650] [INFO] [timer.py:197:stop] 0/2432, RunningAvgSamplesPerSec=10.949321895369893, CurrSamplesPerSec=11.054312663291071, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8432/20000 [12:32:20<31:51:16,  9.91s/it][2022-12-22 02:31:44,532] [INFO] [timer.py:197:stop] 0/2433, RunningAvgSamplesPerSec=10.949311262520485, CurrSamplesPerSec=10.923534291135104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8433/20000 [12:32:28<30:51:29,  9.60s/it][2022-12-22 02:31:53,807] [INFO] [timer.py:197:stop] 0/2434, RunningAvgSamplesPerSec=10.949315026164982, CurrSamplesPerSec=10.95847210088007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8434/20000 [12:32:38<30:32:19,  9.51s/it][2022-12-22 02:32:04,127] [INFO] [timer.py:197:stop] 0/2435, RunningAvgSamplesPerSec=10.949342227961358, CurrSamplesPerSec=11.015899292851339, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8435/20000 [12:32:48<31:19:14,  9.75s/it][2022-12-22 02:32:13,348] [INFO] [timer.py:197:stop] 0/2436, RunningAvgSamplesPerSec=10.949342424152535, CurrSamplesPerSec=10.949819778106166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8436/20000 [12:32:57<30:48:31,  9.59s/it][2022-12-22 02:32:22,470] [INFO] [timer.py:197:stop] 0/2437, RunningAvgSamplesPerSec=10.94929480347015, CurrSamplesPerSec=10.83460070789355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8437/20000 [12:33:06<30:21:14,  9.45s/it][2022-12-22 02:32:32,494] [INFO] [timer.py:197:stop] 0/2438, RunningAvgSamplesPerSec=10.94930316949683, CurrSamplesPerSec=10.969712431664428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8438/20000 [12:33:16<30:54:14,  9.62s/it][2022-12-22 02:32:42,754] [INFO] [timer.py:197:stop] 0/2439, RunningAvgSamplesPerSec=10.94924699944031, CurrSamplesPerSec=10.814106258248243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8439/20000 [12:33:27<31:30:56,  9.81s/it][2022-12-22 02:32:52,962] [INFO] [logging.py:68:log_dist] [Rank 0] step=8440, skipped=18, lr=[5.937948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:32:52,962] [INFO] [timer.py:197:stop] 0/2440, RunningAvgSamplesPerSec=10.949238868949134, CurrSamplesPerSec=10.929460667749886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8440/20000 [12:33:37<31:53:34,  9.93s/it][2022-12-22 02:33:02,400] [INFO] [timer.py:197:stop] 0/2441, RunningAvgSamplesPerSec=10.949270067000548, CurrSamplesPerSec=11.025863200994037, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8441/20000 [12:33:46<31:24:55,  9.78s/it][2022-12-22 02:33:13,823] [INFO] [timer.py:197:stop] 0/2442, RunningAvgSamplesPerSec=10.949255140437392, CurrSamplesPerSec=10.91296994934961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8442/20000 [12:33:58<32:59:23, 10.28s/it][2022-12-22 02:33:22,975] [INFO] [timer.py:197:stop] 0/2443, RunningAvgSamplesPerSec=10.94925473045687, CurrSamplesPerSec=10.948254469409747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8443/20000 [12:34:07<31:54:19,  9.94s/it][2022-12-22 02:33:32,461] [INFO] [timer.py:197:stop] 0/2444, RunningAvgSamplesPerSec=10.94920504607443, CurrSamplesPerSec=10.829254651143557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8444/20000 [12:34:16<31:28:00,  9.80s/it][2022-12-22 02:33:42,342] [INFO] [timer.py:197:stop] 0/2445, RunningAvgSamplesPerSec=10.949118175691524, CurrSamplesPerSec=10.741014331598219, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8445/20000 [12:34:26<31:32:19,  9.83s/it][2022-12-22 02:33:51,250] [INFO] [timer.py:197:stop] 0/2446, RunningAvgSamplesPerSec=10.949155676101938, CurrSamplesPerSec=11.041542511995088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8446/20000 [12:34:35<30:39:06,  9.55s/it][2022-12-22 02:34:01,528] [INFO] [timer.py:197:stop] 0/2447, RunningAvgSamplesPerSec=10.94907748755657, CurrSamplesPerSec=10.76126390947172, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8447/20000 [12:34:45<31:21:00,  9.77s/it][2022-12-22 02:34:11,073] [INFO] [timer.py:197:stop] 0/2448, RunningAvgSamplesPerSec=10.948989737368583, CurrSamplesPerSec=10.738565548343185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8448/20000 [12:34:55<31:07:53,  9.70s/it][2022-12-22 02:34:20,560] [INFO] [timer.py:197:stop] 0/2449, RunningAvgSamplesPerSec=10.948876993550495, CurrSamplesPerSec=10.679883571225096, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8449/20000 [12:35:05<30:55:21,  9.64s/it][2022-12-22 02:34:30,727] [INFO] [logging.py:68:log_dist] [Rank 0] step=8450, skipped=18, lr=[5.932820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:34:30,728] [INFO] [timer.py:197:stop] 0/2450, RunningAvgSamplesPerSec=10.94871837747864, CurrSamplesPerSec=10.573878407005884, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8450/20000 [12:35:15<31:25:48,  9.80s/it]

                                                          
{'loss': 0.0672, 'learning_rate': 5.932820512820513e-06, 'epoch': 0.42}


 42%|████▏     | 8450/20000 [12:35:15<31:25:48,  9.80s/it][2022-12-22 02:34:39,980] [INFO] [timer.py:197:stop] 0/2451, RunningAvgSamplesPerSec=10.948648159519987, CurrSamplesPerSec=10.779412675902782, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8451/20000 [12:35:24<30:54:14,  9.63s/it][2022-12-22 02:34:50,715] [INFO] [timer.py:197:stop] 0/2452, RunningAvgSamplesPerSec=10.948643494207204, CurrSamplesPerSec=10.937230058448595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8452/20000 [12:35:35<31:57:41,  9.96s/it][2022-12-22 02:34:59,511] [INFO] [timer.py:197:stop] 0/2453, RunningAvgSamplesPerSec=10.94875645266843, CurrSamplesPerSec=11.232684367440699, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8453/20000 [12:35:43<30:50:04,  9.61s/it][2022-12-22 02:35:08,974] [INFO] [timer.py:197:stop] 0/2454, RunningAvgSamplesPerSec=10.948749863187563, CurrSamplesPerSec=10.932622844721994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8454/20000 [12:35:53<30:41:17,  9.57s/it][2022-12-22 02:35:18,953] [INFO] [timer.py:197:stop] 0/2455, RunningAvgSamplesPerSec=10.948663001917073, CurrSamplesPerSec=10.739744898334775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8455/20000 [12:36:03<31:04:48,  9.69s/it][2022-12-22 02:35:27,912] [INFO] [timer.py:197:stop] 0/2456, RunningAvgSamplesPerSec=10.948664383663953, CurrSamplesPerSec=10.952054858793865, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8456/20000 [12:36:12<30:22:22,  9.47s/it][2022-12-22 02:35:36,754] [INFO] [timer.py:197:stop] 0/2457, RunningAvgSamplesPerSec=10.94869503650818, CurrSamplesPerSec=11.024437711919798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8457/20000 [12:36:21<29:45:49,  9.28s/it][2022-12-22 02:35:46,600] [INFO] [timer.py:197:stop] 0/2458, RunningAvgSamplesPerSec=10.948677880576454, CurrSamplesPerSec=10.906721533285749, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8458/20000 [12:36:31<30:18:12,  9.45s/it][2022-12-22 02:35:56,148] [INFO] [timer.py:197:stop] 0/2459, RunningAvgSamplesPerSec=10.948613525211284, CurrSamplesPerSec=10.792806925139818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8459/20000 [12:36:40<30:23:35,  9.48s/it][2022-12-22 02:36:05,148] [INFO] [logging.py:68:log_dist] [Rank 0] step=8460, skipped=18, lr=[5.927692307692307e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:36:05,149] [INFO] [timer.py:197:stop] 0/2460, RunningAvgSamplesPerSec=10.948574716892873, CurrSamplesPerSec=10.854046269652974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8460/20000 [12:36:49<29:55:45,  9.34s/it][2022-12-22 02:36:15,125] [INFO] [timer.py:197:stop] 0/2461, RunningAvgSamplesPerSec=10.948691965137263, CurrSamplesPerSec=11.244682510163594, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8461/20000 [12:36:59<30:32:30,  9.53s/it][2022-12-22 02:36:23,999] [INFO] [timer.py:197:stop] 0/2462, RunningAvgSamplesPerSec=10.948797187419435, CurrSamplesPerSec=11.213803956796966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8462/20000 [12:37:08<29:54:35,  9.33s/it][2022-12-22 02:36:33,374] [INFO] [timer.py:197:stop] 0/2463, RunningAvgSamplesPerSec=10.948742856270313, CurrSamplesPerSec=10.816700762577417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8463/20000 [12:37:17<29:56:51,  9.34s/it][2022-12-22 02:36:42,722] [INFO] [timer.py:197:stop] 0/2464, RunningAvgSamplesPerSec=10.948690362039997, CurrSamplesPerSec=10.821009237841215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8464/20000 [12:37:27<29:56:54,  9.35s/it][2022-12-22 02:36:52,040] [INFO] [timer.py:197:stop] 0/2465, RunningAvgSamplesPerSec=10.948691830801272, CurrSamplesPerSec=10.952309116246221, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8465/20000 [12:37:36<29:55:08,  9.34s/it][2022-12-22 02:37:02,849] [INFO] [timer.py:197:stop] 0/2466, RunningAvgSamplesPerSec=10.94870983924386, CurrSamplesPerSec=10.99324512542234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8466/20000 [12:37:47<31:19:51,  9.78s/it][2022-12-22 02:37:12,171] [INFO] [timer.py:197:stop] 0/2467, RunningAvgSamplesPerSec=10.94871511004189, CurrSamplesPerSec=10.96171778628029, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8467/20000 [12:37:56<30:53:19,  9.64s/it][2022-12-22 02:37:22,050] [INFO] [timer.py:197:stop] 0/2468, RunningAvgSamplesPerSec=10.9487589776082, CurrSamplesPerSec=11.057971585837763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8468/20000 [12:38:06<31:06:49,  9.71s/it][2022-12-22 02:37:31,770] [INFO] [timer.py:197:stop] 0/2469, RunningAvgSamplesPerSec=10.948604860720726, CurrSamplesPerSec=10.581307553882251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8469/20000 [12:38:16<31:07:06,  9.72s/it][2022-12-22 02:37:41,402] [INFO] [logging.py:68:log_dist] [Rank 0] step=8470, skipped=18, lr=[5.922564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:37:41,402] [INFO] [timer.py:197:stop] 0/2470, RunningAvgSamplesPerSec=10.948679043617041, CurrSamplesPerSec=11.134800565725804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8470/20000 [12:38:25<31:02:08,  9.69s/it][2022-12-22 02:37:50,472] [INFO] [timer.py:197:stop] 0/2471, RunningAvgSamplesPerSec=10.948691515623526, CurrSamplesPerSec=10.979559243647554, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8471/20000 [12:38:34<30:26:12,  9.50s/it][2022-12-22 02:37:59,636] [INFO] [timer.py:197:stop] 0/2472, RunningAvgSamplesPerSec=10.948692003459737, CurrSamplesPerSec=10.949896603634894, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8472/20000 [12:38:44<30:06:27,  9.40s/it][2022-12-22 02:38:08,848] [INFO] [timer.py:197:stop] 0/2473, RunningAvgSamplesPerSec=10.948775728819841, CurrSamplesPerSec=11.159560301557676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8473/20000 [12:38:53<29:55:20,  9.35s/it][2022-12-22 02:38:18,258] [INFO] [timer.py:197:stop] 0/2474, RunningAvgSamplesPerSec=10.948711486039123, CurrSamplesPerSec=10.792237192976982, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8474/20000 [12:39:02<29:58:57,  9.36s/it][2022-12-22 02:38:27,807] [INFO] [timer.py:197:stop] 0/2475, RunningAvgSamplesPerSec=10.948603222731947, CurrSamplesPerSec=10.68736460909518, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8475/20000 [12:39:12<30:09:25,  9.42s/it]

                                                          
{'loss': 0.0555, 'learning_rate': 5.92e-06, 'epoch': 0.42}


 42%|████▏     | 8475/20000 [12:39:12<30:09:25,  9.42s/it][2022-12-22 02:38:36,893] [INFO] [timer.py:197:stop] 0/2476, RunningAvgSamplesPerSec=10.948506131051507, CurrSamplesPerSec=10.713553157528416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8476/20000 [12:39:21<29:49:59,  9.32s/it][2022-12-22 02:38:46,553] [INFO] [timer.py:197:stop] 0/2477, RunningAvgSamplesPerSec=10.948422540538198, CurrSamplesPerSec=10.745454980689157, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8477/20000 [12:39:31<30:09:27,  9.42s/it][2022-12-22 02:38:55,402] [INFO] [timer.py:197:stop] 0/2478, RunningAvgSamplesPerSec=10.94843963861653, CurrSamplesPerSec=10.990921649665198, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8478/20000 [12:39:39<29:36:19,  9.25s/it][2022-12-22 02:39:04,972] [INFO] [timer.py:197:stop] 0/2479, RunningAvgSamplesPerSec=10.948450470945634, CurrSamplesPerSec=10.975337209901358, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8479/20000 [12:39:49<29:54:32,  9.35s/it][2022-12-22 02:39:15,020] [INFO] [logging.py:68:log_dist] [Rank 0] step=8480, skipped=18, lr=[5.917435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:39:15,020] [INFO] [timer.py:197:stop] 0/2480, RunningAvgSamplesPerSec=10.948374959204777, CurrSamplesPerSec=10.764475394773287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8480/20000 [12:39:59<30:34:52,  9.56s/it][2022-12-22 02:39:25,439] [INFO] [timer.py:197:stop] 0/2481, RunningAvgSamplesPerSec=10.94837075953572, CurrSamplesPerSec=10.937973866177549, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8481/20000 [12:40:09<31:24:20,  9.82s/it][2022-12-22 02:39:34,881] [INFO] [timer.py:197:stop] 0/2482, RunningAvgSamplesPerSec=10.948495227597215, CurrSamplesPerSec=11.266003344520206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8482/20000 [12:40:19<31:02:44,  9.70s/it][2022-12-22 02:39:43,941] [INFO] [timer.py:197:stop] 0/2483, RunningAvgSamplesPerSec=10.948427621099054, CurrSamplesPerSec=10.78329338940066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8483/20000 [12:40:28<30:25:28,  9.51s/it][2022-12-22 02:39:53,660] [INFO] [timer.py:197:stop] 0/2484, RunningAvgSamplesPerSec=10.948351499882728, CurrSamplesPerSec=10.762698527316845, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8484/20000 [12:40:38<30:37:20,  9.57s/it][2022-12-22 02:40:03,027] [INFO] [timer.py:197:stop] 0/2485, RunningAvgSamplesPerSec=10.948366427641918, CurrSamplesPerSec=10.985542986964207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8485/20000 [12:40:47<30:25:22,  9.51s/it][2022-12-22 02:40:12,392] [INFO] [timer.py:197:stop] 0/2486, RunningAvgSamplesPerSec=10.94831500950802, CurrSamplesPerSec=10.822116015902216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8486/20000 [12:40:56<30:16:46,  9.47s/it][2022-12-22 02:40:21,688] [INFO] [timer.py:197:stop] 0/2487, RunningAvgSamplesPerSec=10.948385579686734, CurrSamplesPerSec=11.126535437313736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8487/20000 [12:41:06<30:06:43,  9.42s/it][2022-12-22 02:40:31,202] [INFO] [timer.py:197:stop] 0/2488, RunningAvgSamplesPerSec=10.94839246771889, CurrSamplesPerSec=10.965536040741307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8488/20000 [12:41:15<30:12:13,  9.45s/it][2022-12-22 02:40:40,104] [INFO] [timer.py:197:stop] 0/2489, RunningAvgSamplesPerSec=10.948401254708475, CurrSamplesPerSec=10.970289400021594, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8489/20000 [12:41:24<29:40:50,  9.28s/it][2022-12-22 02:40:49,460] [INFO] [logging.py:68:log_dist] [Rank 0] step=8490, skipped=18, lr=[5.912307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:40:49,461] [INFO] [timer.py:197:stop] 0/2490, RunningAvgSamplesPerSec=10.948385542561477, CurrSamplesPerSec=10.90944846001002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8490/20000 [12:41:33<29:44:55,  9.30s/it][2022-12-22 02:40:58,544] [INFO] [timer.py:197:stop] 0/2491, RunningAvgSamplesPerSec=10.948381114922805, CurrSamplesPerSec=10.937376227175317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8491/20000 [12:41:43<29:32:03,  9.24s/it][2022-12-22 02:41:08,068] [INFO] [timer.py:197:stop] 0/2492, RunningAvgSamplesPerSec=10.948317271863777, CurrSamplesPerSec=10.791686176441749, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8492/20000 [12:41:52<29:48:18,  9.32s/it][2022-12-22 02:41:18,177] [INFO] [timer.py:197:stop] 0/2493, RunningAvgSamplesPerSec=10.948258706150934, CurrSamplesPerSec=10.804347716713773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8493/20000 [12:42:02<30:33:20,  9.56s/it][2022-12-22 02:41:27,140] [INFO] [timer.py:197:stop] 0/2494, RunningAvgSamplesPerSec=10.948235787784165, CurrSamplesPerSec=10.891442404538811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8494/20000 [12:42:11<29:58:53,  9.38s/it][2022-12-22 02:41:37,648] [INFO] [timer.py:197:stop] 0/2495, RunningAvgSamplesPerSec=10.948227520461232, CurrSamplesPerSec=10.92766406316756, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8495/20000 [12:42:22<31:03:35,  9.72s/it][2022-12-22 02:41:47,438] [INFO] [timer.py:197:stop] 0/2496, RunningAvgSamplesPerSec=10.948178772487132, CurrSamplesPerSec=10.827984804261016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8496/20000 [12:42:31<31:07:31,  9.74s/it][2022-12-22 02:41:56,523] [INFO] [timer.py:197:stop] 0/2497, RunningAvgSamplesPerSec=10.948251669430618, CurrSamplesPerSec=11.13312790365592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8497/20000 [12:42:40<30:29:39,  9.54s/it][2022-12-22 02:42:07,493] [INFO] [timer.py:197:stop] 0/2498, RunningAvgSamplesPerSec=10.948247545348785, CurrSamplesPerSec=10.937967626506822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8498/20000 [12:42:51<31:51:33,  9.97s/it][2022-12-22 02:42:16,597] [INFO] [timer.py:197:stop] 0/2499, RunningAvgSamplesPerSec=10.948338597628421, CurrSamplesPerSec=11.180424679235209, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▏     | 8499/20000 [12:43:01<31:01:27,  9.71s/it][2022-12-22 02:42:25,664] [INFO] [logging.py:68:log_dist] [Rank 0] step=8500, skipped=18, lr=[5.907179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:42:25,665] [INFO] [timer.py:197:stop] 0/2500, RunningAvgSamplesPerSec=10.948358889959845, CurrSamplesPerSec=10.99926453158603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 42%|████▎     | 8500/20000 [12:43:10<30:24:20,  9.52s/it]

                                                          
{'loss': 0.0579, 'learning_rate': 5.907179487179488e-06, 'epoch': 0.42}


 42%|████▎     | 8500/20000 [12:43:10<30:24:20,  9.52s/it][2022-12-22 02:42:34,982] [INFO] [timer.py:197:stop] 0/2501, RunningAvgSamplesPerSec=10.948368017483533, CurrSamplesPerSec=10.971216173196764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8501/20000 [12:43:19<30:12:35,  9.46s/it][2022-12-22 02:42:45,639] [INFO] [timer.py:197:stop] 0/2502, RunningAvgSamplesPerSec=10.948355627253472, CurrSamplesPerSec=10.917479797602669, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8502/20000 [12:43:30<31:21:22,  9.82s/it][2022-12-22 02:42:57,262] [INFO] [timer.py:197:stop] 0/2503, RunningAvgSamplesPerSec=10.948423035448155, CurrSamplesPerSec=11.119579046139869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8503/20000 [12:43:41<33:04:59, 10.36s/it][2022-12-22 02:43:06,212] [INFO] [timer.py:197:stop] 0/2504, RunningAvgSamplesPerSec=10.948384909074809, CurrSamplesPerSec=10.853854483511498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8504/20000 [12:43:50<31:43:49,  9.94s/it][2022-12-22 02:43:16,380] [INFO] [timer.py:197:stop] 0/2505, RunningAvgSamplesPerSec=10.948326893610817, CurrSamplesPerSec=10.80507225501175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8505/20000 [12:44:00<31:57:00, 10.01s/it][2022-12-22 02:43:25,390] [INFO] [timer.py:197:stop] 0/2506, RunningAvgSamplesPerSec=10.948278359310352, CurrSamplesPerSec=10.828130688278438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8506/20000 [12:44:09<30:59:34,  9.71s/it][2022-12-22 02:43:34,393] [INFO] [timer.py:197:stop] 0/2507, RunningAvgSamplesPerSec=10.948185925196523, CurrSamplesPerSec=10.721524651856088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8507/20000 [12:44:18<30:18:57,  9.50s/it][2022-12-22 02:43:50,652] [INFO] [timer.py:197:stop] 0/2508, RunningAvgSamplesPerSec=10.94819280613812, CurrSamplesPerSec=10.965456755932921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8508/20000 [12:44:35<36:47:21, 11.52s/it][2022-12-22 02:44:00,654] [INFO] [timer.py:197:stop] 0/2509, RunningAvgSamplesPerSec=10.948144282352647, CurrSamplesPerSec=10.82787997984925, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8509/20000 [12:44:45<35:19:42, 11.07s/it][2022-12-22 02:44:11,262] [INFO] [logging.py:68:log_dist] [Rank 0] step=8510, skipped=18, lr=[5.902051282051282e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:44:11,263] [INFO] [timer.py:197:stop] 0/2510, RunningAvgSamplesPerSec=10.948072696042317, CurrSamplesPerSec=10.77150142480838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8510/20000 [12:44:55<34:53:07, 10.93s/it][2022-12-22 02:44:21,023] [INFO] [timer.py:197:stop] 0/2511, RunningAvgSamplesPerSec=10.948018970086226, CurrSamplesPerSec=10.81491314906441, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8511/20000 [12:45:05<33:45:44, 10.58s/it][2022-12-22 02:44:30,657] [INFO] [timer.py:197:stop] 0/2512, RunningAvgSamplesPerSec=10.947981686166406, CurrSamplesPerSec=10.855229173804972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8512/20000 [12:45:15<32:51:17, 10.30s/it][2022-12-22 02:44:40,383] [INFO] [timer.py:197:stop] 0/2513, RunningAvgSamplesPerSec=10.947935050998808, CurrSamplesPerSec=10.832119561765474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8513/20000 [12:45:24<32:18:21, 10.12s/it][2022-12-22 02:44:49,345] [INFO] [timer.py:197:stop] 0/2514, RunningAvgSamplesPerSec=10.947967337673651, CurrSamplesPerSec=11.029644252615343, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8514/20000 [12:45:33<31:11:27,  9.78s/it][2022-12-22 02:44:59,251] [INFO] [timer.py:197:stop] 0/2515, RunningAvgSamplesPerSec=10.947966591255117, CurrSamplesPerSec=10.946091909092889, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8515/20000 [12:45:43<31:18:44,  9.81s/it][2022-12-22 02:45:08,102] [INFO] [timer.py:197:stop] 0/2516, RunningAvgSamplesPerSec=10.948063107984181, CurrSamplesPerSec=11.196107072198053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8516/20000 [12:45:52<30:23:15,  9.53s/it][2022-12-22 02:45:17,544] [INFO] [timer.py:197:stop] 0/2517, RunningAvgSamplesPerSec=10.948028510223166, CurrSamplesPerSec=10.861735582910063, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8517/20000 [12:46:02<30:18:15,  9.50s/it][2022-12-22 02:45:30,375] [INFO] [timer.py:197:stop] 0/2518, RunningAvgSamplesPerSec=10.948129238917142, CurrSamplesPerSec=11.207465156547483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8518/20000 [12:46:14<33:29:16, 10.50s/it][2022-12-22 02:45:40,020] [INFO] [timer.py:197:stop] 0/2519, RunningAvgSamplesPerSec=10.948059185811658, CurrSamplesPerSec=10.774599227012574, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8519/20000 [12:46:24<32:40:04, 10.24s/it][2022-12-22 02:45:50,376] [INFO] [logging.py:68:log_dist] [Rank 0] step=8520, skipped=18, lr=[5.8969230769230775e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:45:50,376] [INFO] [timer.py:197:stop] 0/2520, RunningAvgSamplesPerSec=10.948009473102783, CurrSamplesPerSec=10.824297079160525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8520/20000 [12:46:34<32:46:22, 10.28s/it][2022-12-22 02:46:00,808] [INFO] [timer.py:197:stop] 0/2521, RunningAvgSamplesPerSec=10.948086850684087, CurrSamplesPerSec=11.146455249716755, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8521/20000 [12:46:45<32:55:05, 10.32s/it][2022-12-22 02:46:11,886] [INFO] [timer.py:197:stop] 0/2522, RunningAvgSamplesPerSec=10.948029354735434, CurrSamplesPerSec=10.805088782228895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8522/20000 [12:46:56<33:38:10, 10.55s/it][2022-12-22 02:46:21,171] [INFO] [timer.py:197:stop] 0/2523, RunningAvgSamplesPerSec=10.948067109591285, CurrSamplesPerSec=11.044043745258096, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8523/20000 [12:47:05<32:25:25, 10.17s/it][2022-12-22 02:46:31,613] [INFO] [timer.py:197:stop] 0/2524, RunningAvgSamplesPerSec=10.948071420806995, CurrSamplesPerSec=10.958950800279457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8524/20000 [12:47:16<32:40:50, 10.25s/it][2022-12-22 02:46:40,954] [INFO] [timer.py:197:stop] 0/2525, RunningAvgSamplesPerSec=10.948185179591835, CurrSamplesPerSec=11.24280856846854, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8525/20000 [12:47:25<31:48:25,  9.98s/it]

                                                          
{'loss': 0.0735, 'learning_rate': 5.8943589743589746e-06, 'epoch': 0.43}


 43%|████▎     | 8525/20000 [12:47:25<31:48:25,  9.98s/it][2022-12-22 02:46:49,899] [INFO] [timer.py:197:stop] 0/2526, RunningAvgSamplesPerSec=10.948230647198235, CurrSamplesPerSec=11.064160605332436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8526/20000 [12:47:34<30:48:55,  9.67s/it][2022-12-22 02:46:59,848] [INFO] [timer.py:197:stop] 0/2527, RunningAvgSamplesPerSec=10.948249109293247, CurrSamplesPerSec=10.995046697586083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8527/20000 [12:47:44<31:04:51,  9.75s/it][2022-12-22 02:47:09,253] [INFO] [timer.py:197:stop] 0/2528, RunningAvgSamplesPerSec=10.948218433948222, CurrSamplesPerSec=10.871307524057084, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8528/20000 [12:47:53<30:44:47,  9.65s/it][2022-12-22 02:47:18,070] [INFO] [timer.py:197:stop] 0/2529, RunningAvgSamplesPerSec=10.948285948661997, CurrSamplesPerSec=11.121527783388215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8529/20000 [12:48:02<29:56:55,  9.40s/it][2022-12-22 02:47:31,030] [INFO] [logging.py:68:log_dist] [Rank 0] step=8530, skipped=18, lr=[5.8917948717948724e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:47:31,031] [INFO] [timer.py:197:stop] 0/2530, RunningAvgSamplesPerSec=10.94819598905432, CurrSamplesPerSec=10.725494064718609, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8530/20000 [12:48:15<33:21:01, 10.47s/it][2022-12-22 02:47:42,563] [INFO] [timer.py:197:stop] 0/2531, RunningAvgSamplesPerSec=10.948034811277816, CurrSamplesPerSec=10.555203342490454, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8531/20000 [12:48:27<34:21:53, 10.79s/it][2022-12-22 02:47:52,560] [INFO] [timer.py:197:stop] 0/2532, RunningAvgSamplesPerSec=10.948054052583911, CurrSamplesPerSec=10.996932654322833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8532/20000 [12:48:37<33:36:25, 10.55s/it][2022-12-22 02:48:01,359] [INFO] [timer.py:197:stop] 0/2533, RunningAvgSamplesPerSec=10.948125364355082, CurrSamplesPerSec=11.131568375128428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8533/20000 [12:48:45<31:55:54, 10.02s/it][2022-12-22 02:48:11,434] [INFO] [timer.py:197:stop] 0/2534, RunningAvgSamplesPerSec=10.948131277756556, CurrSamplesPerSec=10.96311859363564, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8534/20000 [12:48:55<31:58:36, 10.04s/it][2022-12-22 02:48:20,953] [INFO] [timer.py:197:stop] 0/2535, RunningAvgSamplesPerSec=10.948209242338502, CurrSamplesPerSec=11.149241798020531, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8535/20000 [12:49:05<31:28:35,  9.88s/it][2022-12-22 02:48:29,874] [INFO] [timer.py:197:stop] 0/2536, RunningAvgSamplesPerSec=10.94818025231517, CurrSamplesPerSec=10.875237955563263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8536/20000 [12:49:14<30:33:16,  9.59s/it][2022-12-22 02:48:38,737] [INFO] [timer.py:197:stop] 0/2537, RunningAvgSamplesPerSec=10.948203214788292, CurrSamplesPerSec=11.006701145948032, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8537/20000 [12:49:23<29:51:09,  9.38s/it][2022-12-22 02:48:48,732] [INFO] [timer.py:197:stop] 0/2538, RunningAvgSamplesPerSec=10.948118072630047, CurrSamplesPerSec=10.736457112359302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8538/20000 [12:49:33<30:26:30,  9.56s/it][2022-12-22 02:48:57,827] [INFO] [timer.py:197:stop] 0/2539, RunningAvgSamplesPerSec=10.948213218325966, CurrSamplesPerSec=11.19494255613591, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8539/20000 [12:49:42<29:59:38,  9.42s/it][2022-12-22 02:49:06,856] [INFO] [logging.py:68:log_dist] [Rank 0] step=8540, skipped=18, lr=[5.886666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:49:06,857] [INFO] [timer.py:197:stop] 0/2540, RunningAvgSamplesPerSec=10.948130360851364, CurrSamplesPerSec=10.741882566394594, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8540/20000 [12:49:51<29:37:01,  9.30s/it][2022-12-22 02:49:17,646] [INFO] [timer.py:197:stop] 0/2541, RunningAvgSamplesPerSec=10.948126096137251, CurrSamplesPerSec=10.937312946332348, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8541/20000 [12:50:02<31:01:59,  9.75s/it][2022-12-22 02:49:26,779] [INFO] [timer.py:197:stop] 0/2542, RunningAvgSamplesPerSec=10.948203671144825, CurrSamplesPerSec=11.14877642765543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8542/20000 [12:50:11<30:26:30,  9.56s/it][2022-12-22 02:49:35,860] [INFO] [timer.py:197:stop] 0/2543, RunningAvgSamplesPerSec=10.948107788721407, CurrSamplesPerSec=10.709868175106356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8543/20000 [12:50:20<29:58:37,  9.42s/it][2022-12-22 02:49:45,115] [INFO] [timer.py:197:stop] 0/2544, RunningAvgSamplesPerSec=10.948115350096813, CurrSamplesPerSec=10.967362596362356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8544/20000 [12:50:29<29:49:03,  9.37s/it][2022-12-22 02:49:54,459] [INFO] [timer.py:197:stop] 0/2545, RunningAvgSamplesPerSec=10.947899714929038, CurrSamplesPerSec=10.425901073675478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8545/20000 [12:50:38<29:47:26,  9.36s/it][2022-12-22 02:50:03,290] [INFO] [timer.py:197:stop] 0/2546, RunningAvgSamplesPerSec=10.948025226387026, CurrSamplesPerSec=11.276789328962124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8546/20000 [12:50:47<29:16:48,  9.20s/it][2022-12-22 02:50:13,513] [INFO] [timer.py:197:stop] 0/2547, RunningAvgSamplesPerSec=10.948098179569694, CurrSamplesPerSec=11.136892793311842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8547/20000 [12:50:57<30:15:05,  9.51s/it][2022-12-22 02:50:22,898] [INFO] [timer.py:197:stop] 0/2548, RunningAvgSamplesPerSec=10.94800294120762, CurrSamplesPerSec=10.710873268561059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8548/20000 [12:51:07<30:07:50,  9.47s/it][2022-12-22 02:50:34,481] [INFO] [timer.py:197:stop] 0/2549, RunningAvgSamplesPerSec=10.947942593321846, CurrSamplesPerSec=10.79642415285106, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8549/20000 [12:51:18<32:08:32, 10.10s/it][2022-12-22 02:50:44,659] [INFO] [logging.py:68:log_dist] [Rank 0] step=8550, skipped=18, lr=[5.881538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:50:44,660] [INFO] [timer.py:197:stop] 0/2550, RunningAvgSamplesPerSec=10.947965742255215, CurrSamplesPerSec=11.007245452114965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8550/20000 [12:51:29<32:12:36, 10.13s/it]

                                                          
{'loss': 0.0653, 'learning_rate': 5.881538461538462e-06, 'epoch': 0.43}


 43%|████▎     | 8550/20000 [12:51:29<32:12:36, 10.13s/it][2022-12-22 02:50:54,090] [INFO] [timer.py:197:stop] 0/2551, RunningAvgSamplesPerSec=10.947806726469016, CurrSamplesPerSec=10.557100015743103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8551/20000 [12:51:38<31:32:34,  9.92s/it][2022-12-22 02:51:03,308] [INFO] [timer.py:197:stop] 0/2552, RunningAvgSamplesPerSec=10.947913006379133, CurrSamplesPerSec=11.225696993804979, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8552/20000 [12:51:47<30:52:16,  9.71s/it][2022-12-22 02:51:12,428] [INFO] [timer.py:197:stop] 0/2553, RunningAvgSamplesPerSec=10.948007745605883, CurrSamplesPerSec=11.195046204119041, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8553/20000 [12:51:56<30:18:30,  9.53s/it][2022-12-22 02:51:21,955] [INFO] [timer.py:197:stop] 0/2554, RunningAvgSamplesPerSec=10.948124309263081, CurrSamplesPerSec=11.253783228443258, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8554/20000 [12:52:06<30:18:03,  9.53s/it][2022-12-22 02:51:31,057] [INFO] [timer.py:197:stop] 0/2555, RunningAvgSamplesPerSec=10.947977757888301, CurrSamplesPerSec=10.58633765120511, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8555/20000 [12:52:15<29:53:21,  9.40s/it][2022-12-22 02:51:40,580] [INFO] [timer.py:197:stop] 0/2556, RunningAvgSamplesPerSec=10.947893900369591, CurrSamplesPerSec=10.737913472569355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8556/20000 [12:52:25<30:00:08,  9.44s/it][2022-12-22 02:51:50,105] [INFO] [timer.py:197:stop] 0/2557, RunningAvgSamplesPerSec=10.947968642942193, CurrSamplesPerSec=11.142250057011397, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8557/20000 [12:52:34<30:04:59,  9.46s/it][2022-12-22 02:51:59,302] [INFO] [timer.py:197:stop] 0/2558, RunningAvgSamplesPerSec=10.94799869030857, CurrSamplesPerSec=11.02531207081817, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8558/20000 [12:52:43<29:49:31,  9.38s/it][2022-12-22 02:52:08,432] [INFO] [timer.py:197:stop] 0/2559, RunningAvgSamplesPerSec=10.948103921628578, CurrSamplesPerSec=11.223852369473365, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8559/20000 [12:52:52<29:34:52,  9.31s/it][2022-12-22 02:52:18,349] [INFO] [logging.py:68:log_dist] [Rank 0] step=8560, skipped=18, lr=[5.876410256410256e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:52:18,349] [INFO] [timer.py:197:stop] 0/2560, RunningAvgSamplesPerSec=10.948137319060532, CurrSamplesPerSec=11.034206165982937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8560/20000 [12:53:02<30:09:33,  9.49s/it][2022-12-22 02:52:27,730] [INFO] [timer.py:197:stop] 0/2561, RunningAvgSamplesPerSec=10.948042623921781, CurrSamplesPerSec=10.711057898070532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8561/20000 [12:53:12<30:03:05,  9.46s/it][2022-12-22 02:52:36,720] [INFO] [timer.py:197:stop] 0/2562, RunningAvgSamplesPerSec=10.947961690294676, CurrSamplesPerSec=10.744699278018757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8562/20000 [12:53:21<29:36:12,  9.32s/it][2022-12-22 02:52:46,197] [INFO] [timer.py:197:stop] 0/2563, RunningAvgSamplesPerSec=10.948070034501232, CurrSamplesPerSec=11.23264347482377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8563/20000 [12:53:30<29:45:09,  9.37s/it][2022-12-22 02:52:55,823] [INFO] [timer.py:197:stop] 0/2564, RunningAvgSamplesPerSec=10.948054289591761, CurrSamplesPerSec=10.907879601367222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8564/20000 [12:53:40<29:59:54,  9.44s/it][2022-12-22 02:53:04,792] [INFO] [timer.py:197:stop] 0/2565, RunningAvgSamplesPerSec=10.948042851575705, CurrSamplesPerSec=10.918816912900786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8565/20000 [12:53:49<29:32:41,  9.30s/it][2022-12-22 02:53:14,263] [INFO] [timer.py:197:stop] 0/2566, RunningAvgSamplesPerSec=10.94802538625093, CurrSamplesPerSec=10.903444111205802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8566/20000 [12:53:58<29:42:12,  9.35s/it][2022-12-22 02:53:24,594] [INFO] [timer.py:197:stop] 0/2567, RunningAvgSamplesPerSec=10.948036187297769, CurrSamplesPerSec=10.975800330277252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8567/20000 [12:54:09<30:37:59,  9.65s/it][2022-12-22 02:53:35,282] [INFO] [timer.py:197:stop] 0/2568, RunningAvgSamplesPerSec=10.947971575223583, CurrSamplesPerSec=10.784713955971073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8568/20000 [12:54:19<31:37:26,  9.96s/it][2022-12-22 02:53:44,322] [INFO] [timer.py:197:stop] 0/2569, RunningAvgSamplesPerSec=10.948004766639077, CurrSamplesPerSec=11.033841962981828, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8569/20000 [12:54:28<30:44:46,  9.68s/it][2022-12-22 02:53:54,008] [INFO] [logging.py:68:log_dist] [Rank 0] step=8570, skipped=18, lr=[5.871282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:53:54,009] [INFO] [timer.py:197:stop] 0/2570, RunningAvgSamplesPerSec=10.948115325507967, CurrSamplesPerSec=11.23947573012609, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8570/20000 [12:54:38<30:44:46,  9.68s/it][2022-12-22 02:54:03,278] [INFO] [timer.py:197:stop] 0/2571, RunningAvgSamplesPerSec=10.948079504709177, CurrSamplesPerSec=10.85685844825833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8571/20000 [12:54:47<30:20:57,  9.56s/it][2022-12-22 02:54:12,989] [INFO] [timer.py:197:stop] 0/2572, RunningAvgSamplesPerSec=10.947860029086664, CurrSamplesPerSec=10.411653429891896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8572/20000 [12:54:57<30:29:25,  9.60s/it][2022-12-22 02:54:21,919] [INFO] [timer.py:197:stop] 0/2573, RunningAvgSamplesPerSec=10.947906026530555, CurrSamplesPerSec=11.067410344583907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8573/20000 [12:55:06<29:50:40,  9.40s/it][2022-12-22 02:54:31,197] [INFO] [timer.py:197:stop] 0/2574, RunningAvgSamplesPerSec=10.947930904487002, CurrSamplesPerSec=11.012268154991723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8574/20000 [12:55:15<29:43:25,  9.37s/it][2022-12-22 02:54:40,554] [INFO] [timer.py:197:stop] 0/2575, RunningAvgSamplesPerSec=10.947934946032118, CurrSamplesPerSec=10.958339683010248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8575/20000 [12:55:25<29:42:49,  9.36s/it]

                                                          
{'loss': 0.0712, 'learning_rate': 5.868717948717949e-06, 'epoch': 0.43}


 43%|████▎     | 8575/20000 [12:55:25<29:42:49,  9.36s/it][2022-12-22 02:54:49,930] [INFO] [timer.py:197:stop] 0/2576, RunningAvgSamplesPerSec=10.94779651334446, CurrSamplesPerSec=10.602836855901517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8576/20000 [12:55:34<29:43:26,  9.37s/it][2022-12-22 02:54:59,765] [INFO] [timer.py:197:stop] 0/2577, RunningAvgSamplesPerSec=10.947828505080315, CurrSamplesPerSec=11.030799562409602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8577/20000 [12:55:44<30:10:00,  9.51s/it][2022-12-22 02:55:09,955] [INFO] [timer.py:197:stop] 0/2578, RunningAvgSamplesPerSec=10.947851500284484, CurrSamplesPerSec=11.007386276406036, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8578/20000 [12:55:54<30:48:51,  9.71s/it][2022-12-22 02:55:19,038] [INFO] [timer.py:197:stop] 0/2579, RunningAvgSamplesPerSec=10.947872394946957, CurrSamplesPerSec=11.001963082796994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8579/20000 [12:56:03<30:12:44,  9.52s/it][2022-12-22 02:55:29,049] [INFO] [logging.py:68:log_dist] [Rank 0] step=8580, skipped=18, lr=[5.866153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:55:29,050] [INFO] [timer.py:197:stop] 0/2580, RunningAvgSamplesPerSec=10.947824281040917, CurrSamplesPerSec=10.825223795248016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8580/20000 [12:56:13<30:40:29,  9.67s/it][2022-12-22 02:55:39,516] [INFO] [timer.py:197:stop] 0/2581, RunningAvgSamplesPerSec=10.947904706053084, CurrSamplesPerSec=11.159244372839975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8581/20000 [12:56:23<31:25:48,  9.91s/it][2022-12-22 02:55:48,477] [INFO] [timer.py:197:stop] 0/2582, RunningAvgSamplesPerSec=10.947850041716483, CurrSamplesPerSec=10.808663763369525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8582/20000 [12:56:32<30:31:30,  9.62s/it][2022-12-22 02:55:57,464] [INFO] [timer.py:197:stop] 0/2583, RunningAvgSamplesPerSec=10.94779054745393, CurrSamplesPerSec=10.796418507861762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8583/20000 [12:56:41<29:55:00,  9.43s/it][2022-12-22 02:56:07,435] [INFO] [timer.py:197:stop] 0/2584, RunningAvgSamplesPerSec=10.947864580444278, CurrSamplesPerSec=11.142339319031487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8584/20000 [12:56:51<30:25:32,  9.59s/it][2022-12-22 02:56:16,625] [INFO] [timer.py:197:stop] 0/2585, RunningAvgSamplesPerSec=10.947849613412327, CurrSamplesPerSec=10.909340722311045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8585/20000 [12:57:01<30:02:16,  9.47s/it][2022-12-22 02:56:25,983] [INFO] [timer.py:197:stop] 0/2586, RunningAvgSamplesPerSec=10.947858558671482, CurrSamplesPerSec=10.971013049857568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8586/20000 [12:57:10<29:55:32,  9.44s/it][2022-12-22 02:56:35,677] [INFO] [timer.py:197:stop] 0/2587, RunningAvgSamplesPerSec=10.947643685536942, CurrSamplesPerSec=10.419221872321305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8587/20000 [12:57:20<30:09:57,  9.52s/it][2022-12-22 02:56:46,097] [INFO] [timer.py:197:stop] 0/2588, RunningAvgSamplesPerSec=10.947658681105853, CurrSamplesPerSec=10.986560022160123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8588/20000 [12:57:30<31:01:26,  9.79s/it][2022-12-22 02:56:55,231] [INFO] [timer.py:197:stop] 0/2589, RunningAvgSamplesPerSec=10.947593601865218, CurrSamplesPerSec=10.781847646507824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8589/20000 [12:57:39<30:24:02,  9.59s/it][2022-12-22 02:57:04,984] [INFO] [logging.py:68:log_dist] [Rank 0] step=8590, skipped=18, lr=[5.861025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:57:04,985] [INFO] [timer.py:197:stop] 0/2590, RunningAvgSamplesPerSec=10.947597063619758, CurrSamplesPerSec=10.956559957446489, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8590/20000 [12:57:49<30:33:08,  9.64s/it][2022-12-22 02:57:15,490] [INFO] [timer.py:197:stop] 0/2591, RunningAvgSamplesPerSec=10.94750425841632, CurrSamplesPerSec=10.71248258004877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8591/20000 [12:57:59<31:22:22,  9.90s/it][2022-12-22 02:57:25,135] [INFO] [timer.py:197:stop] 0/2592, RunningAvgSamplesPerSec=10.94744515088609, CurrSamplesPerSec=10.796526197906202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8592/20000 [12:58:09<31:07:41,  9.82s/it][2022-12-22 02:57:34,003] [INFO] [timer.py:197:stop] 0/2593, RunningAvgSamplesPerSec=10.947486607090436, CurrSamplesPerSec=11.055922108713547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8593/20000 [12:58:18<30:13:02,  9.54s/it][2022-12-22 02:57:43,817] [INFO] [timer.py:197:stop] 0/2594, RunningAvgSamplesPerSec=10.947431703471667, CurrSamplesPerSec=10.807001931758126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8594/20000 [12:58:28<30:28:42,  9.62s/it][2022-12-22 02:57:54,185] [INFO] [timer.py:197:stop] 0/2595, RunningAvgSamplesPerSec=10.947499190384221, CurrSamplesPerSec=11.125266847838677, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8595/20000 [12:58:38<31:11:12,  9.84s/it][2022-12-22 02:58:03,211] [INFO] [timer.py:197:stop] 0/2596, RunningAvgSamplesPerSec=10.947547296459103, CurrSamplesPerSec=11.073724598358236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8596/20000 [12:58:47<30:24:24,  9.60s/it][2022-12-22 02:58:12,028] [INFO] [timer.py:197:stop] 0/2597, RunningAvgSamplesPerSec=10.947630232369933, CurrSamplesPerSec=11.167080135182031, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8597/20000 [12:58:56<29:39:42,  9.36s/it][2022-12-22 02:58:21,844] [INFO] [timer.py:197:stop] 0/2598, RunningAvgSamplesPerSec=10.947635672503637, CurrSamplesPerSec=10.961771054284675, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8598/20000 [12:59:06<30:05:15,  9.50s/it][2022-12-22 02:58:30,539] [INFO] [timer.py:197:stop] 0/2599, RunningAvgSamplesPerSec=10.94777310885891, CurrSamplesPerSec=11.31658188923339, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8599/20000 [12:59:15<29:19:16,  9.26s/it][2022-12-22 02:58:39,886] [INFO] [logging.py:68:log_dist] [Rank 0] step=8600, skipped=18, lr=[5.855897435897437e-06], mom=[[0.9, 0.999]]
[2022-12-22 02:58:39,886] [INFO] [timer.py:197:stop] 0/2600, RunningAvgSamplesPerSec=10.947867634427038, CurrSamplesPerSec=11.198983446842957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8600/20000 [12:59:24<29:24:08,  9.28s/it]

                                                          
{'loss': 0.0593, 'learning_rate': 5.855897435897437e-06, 'epoch': 0.43}


 43%|████▎     | 8600/20000 [12:59:24<29:24:08,  9.28s/it][2022-12-22 02:58:49,310] [INFO] [timer.py:197:stop] 0/2601, RunningAvgSamplesPerSec=10.947927624242418, CurrSamplesPerSec=11.106032799511532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8601/20000 [12:59:33<29:31:53,  9.33s/it][2022-12-22 02:58:58,366] [INFO] [timer.py:197:stop] 0/2602, RunningAvgSamplesPerSec=10.947842661988016, CurrSamplesPerSec=10.731393206598087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8602/20000 [12:59:42<29:16:18,  9.25s/it][2022-12-22 02:59:08,913] [INFO] [timer.py:197:stop] 0/2603, RunningAvgSamplesPerSec=10.94777462963859, CurrSamplesPerSec=10.773704075325696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8603/20000 [12:59:53<30:30:21,  9.64s/it][2022-12-22 02:59:18,633] [INFO] [timer.py:197:stop] 0/2604, RunningAvgSamplesPerSec=10.947778901607602, CurrSamplesPerSec=10.958901586262945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8604/20000 [13:00:03<30:34:57,  9.66s/it][2022-12-22 02:59:28,087] [INFO] [timer.py:197:stop] 0/2605, RunningAvgSamplesPerSec=10.947862405917501, CurrSamplesPerSec=11.169541902885422, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8605/20000 [13:00:12<30:22:59,  9.60s/it][2022-12-22 02:59:38,435] [INFO] [timer.py:197:stop] 0/2606, RunningAvgSamplesPerSec=10.947843766070585, CurrSamplesPerSec=10.899538410296284, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8606/20000 [13:00:22<31:05:32,  9.82s/it][2022-12-22 02:59:49,693] [INFO] [timer.py:197:stop] 0/2607, RunningAvgSamplesPerSec=10.9477543764374, CurrSamplesPerSec=10.719831712885108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8607/20000 [13:00:34<32:27:02, 10.25s/it][2022-12-22 03:00:00,614] [INFO] [timer.py:197:stop] 0/2608, RunningAvgSamplesPerSec=10.947656585208959, CurrSamplesPerSec=10.6987056156521, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8608/20000 [13:00:45<33:04:54, 10.45s/it][2022-12-22 03:00:09,912] [INFO] [timer.py:197:stop] 0/2609, RunningAvgSamplesPerSec=10.9476718671297, CurrSamplesPerSec=10.987642008999345, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8609/20000 [13:00:54<31:58:52, 10.11s/it][2022-12-22 03:00:19,255] [INFO] [logging.py:68:log_dist] [Rank 0] step=8610, skipped=18, lr=[5.850769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:00:19,256] [INFO] [timer.py:197:stop] 0/2610, RunningAvgSamplesPerSec=10.947559874778142, CurrSamplesPerSec=10.66318286698928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8610/20000 [13:01:03<31:15:13,  9.88s/it][2022-12-22 03:00:28,422] [INFO] [timer.py:197:stop] 0/2611, RunningAvgSamplesPerSec=10.947517862818819, CurrSamplesPerSec=10.839036811476426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8611/20000 [13:01:12<30:34:30,  9.66s/it][2022-12-22 03:00:37,998] [INFO] [timer.py:197:stop] 0/2612, RunningAvgSamplesPerSec=10.947556689818242, CurrSamplesPerSec=11.04980279489331, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8612/20000 [13:01:22<30:29:15,  9.64s/it][2022-12-22 03:00:47,588] [INFO] [timer.py:197:stop] 0/2613, RunningAvgSamplesPerSec=10.947568500874311, CurrSamplesPerSec=10.978482439999619, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8613/20000 [13:01:32<30:26:23,  9.62s/it][2022-12-22 03:00:56,676] [INFO] [timer.py:197:stop] 0/2614, RunningAvgSamplesPerSec=10.947486981533451, CurrSamplesPerSec=10.738700870431964, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8614/20000 [13:01:41<29:55:43,  9.46s/it][2022-12-22 03:01:06,092] [INFO] [timer.py:197:stop] 0/2615, RunningAvgSamplesPerSec=10.947447781785812, CurrSamplesPerSec=10.846007162186956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8615/20000 [13:01:50<29:52:56,  9.45s/it][2022-12-22 03:01:15,919] [INFO] [timer.py:197:stop] 0/2616, RunningAvgSamplesPerSec=10.947384708294692, CurrSamplesPerSec=10.785018999857773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8616/20000 [13:02:00<30:14:16,  9.56s/it][2022-12-22 03:01:25,774] [INFO] [timer.py:197:stop] 0/2617, RunningAvgSamplesPerSec=10.947399337801194, CurrSamplesPerSec=10.985774973110097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8617/20000 [13:02:10<30:30:47,  9.65s/it][2022-12-22 03:01:34,955] [INFO] [timer.py:197:stop] 0/2618, RunningAvgSamplesPerSec=10.947401770496022, CurrSamplesPerSec=10.953766967680005, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8618/20000 [13:02:19<30:03:56,  9.51s/it][2022-12-22 03:01:45,489] [INFO] [timer.py:197:stop] 0/2619, RunningAvgSamplesPerSec=10.947329295876305, CurrSamplesPerSec=10.760964521689198, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8619/20000 [13:02:29<31:02:04,  9.82s/it][2022-12-22 03:01:54,475] [INFO] [logging.py:68:log_dist] [Rank 0] step=8620, skipped=18, lr=[5.845641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:01:54,476] [INFO] [timer.py:197:stop] 0/2620, RunningAvgSamplesPerSec=10.947238523796527, CurrSamplesPerSec=10.71473514569656, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8620/20000 [13:02:38<30:14:43,  9.57s/it][2022-12-22 03:02:03,584] [INFO] [timer.py:197:stop] 0/2621, RunningAvgSamplesPerSec=10.94735083755867, CurrSamplesPerSec=11.249507050443226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8621/20000 [13:02:48<29:48:23,  9.43s/it][2022-12-22 03:02:13,420] [INFO] [timer.py:197:stop] 0/2622, RunningAvgSamplesPerSec=10.947362293899733, CurrSamplesPerSec=10.977448943100036, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8622/20000 [13:02:57<30:11:18,  9.55s/it][2022-12-22 03:02:22,474] [INFO] [timer.py:197:stop] 0/2623, RunningAvgSamplesPerSec=10.947394544330214, CurrSamplesPerSec=11.032548170912369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8623/20000 [13:03:06<29:42:50,  9.40s/it][2022-12-22 03:02:32,382] [INFO] [timer.py:197:stop] 0/2624, RunningAvgSamplesPerSec=10.94738648099043, CurrSamplesPerSec=10.926293203680926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8624/20000 [13:03:16<30:11:26,  9.55s/it][2022-12-22 03:02:41,659] [INFO] [timer.py:197:stop] 0/2625, RunningAvgSamplesPerSec=10.94751917147392, CurrSamplesPerSec=11.306857832347175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8625/20000 [13:03:26<29:55:31,  9.47s/it]

                                                          
{'loss': 0.0642, 'learning_rate': 5.8430769230769236e-06, 'epoch': 0.43}


 43%|████▎     | 8625/20000 [13:03:26<29:55:31,  9.47s/it][2022-12-22 03:02:50,874] [INFO] [timer.py:197:stop] 0/2626, RunningAvgSamplesPerSec=10.947487641002436, CurrSamplesPerSec=10.86540356708122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8626/20000 [13:03:35<29:40:51,  9.39s/it][2022-12-22 03:02:59,952] [INFO] [timer.py:197:stop] 0/2627, RunningAvgSamplesPerSec=10.94747342287355, CurrSamplesPerSec=10.910291813789495, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8627/20000 [13:03:44<29:22:41,  9.30s/it][2022-12-22 03:03:10,128] [INFO] [timer.py:197:stop] 0/2628, RunningAvgSamplesPerSec=10.947489425995109, CurrSamplesPerSec=10.989659498607745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8628/20000 [13:03:54<30:12:23,  9.56s/it][2022-12-22 03:03:19,226] [INFO] [timer.py:197:stop] 0/2629, RunningAvgSamplesPerSec=10.947519097242559, CurrSamplesPerSec=11.025994538417496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8629/20000 [13:04:03<29:45:47,  9.42s/it][2022-12-22 03:03:28,172] [INFO] [logging.py:68:log_dist] [Rank 0] step=8630, skipped=18, lr=[5.8405128205128214e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:03:28,173] [INFO] [timer.py:197:stop] 0/2630, RunningAvgSamplesPerSec=10.947483542568143, CurrSamplesPerSec=10.854871861293061, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8630/20000 [13:04:12<29:18:36,  9.28s/it][2022-12-22 03:03:36,974] [INFO] [timer.py:197:stop] 0/2631, RunningAvgSamplesPerSec=10.947560509322694, CurrSamplesPerSec=11.153638107097015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8631/20000 [13:04:21<28:51:13,  9.14s/it][2022-12-22 03:03:47,143] [INFO] [timer.py:197:stop] 0/2632, RunningAvgSamplesPerSec=10.94765674474753, CurrSamplesPerSec=11.206647285846776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8632/20000 [13:04:31<29:49:43,  9.45s/it][2022-12-22 03:03:55,978] [INFO] [timer.py:197:stop] 0/2633, RunningAvgSamplesPerSec=10.947688231583342, CurrSamplesPerSec=11.031130019174125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8633/20000 [13:04:40<29:14:48,  9.26s/it][2022-12-22 03:04:05,287] [INFO] [timer.py:197:stop] 0/2634, RunningAvgSamplesPerSec=10.947644529711866, CurrSamplesPerSec=10.83386039855914, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8634/20000 [13:04:49<29:17:18,  9.28s/it][2022-12-22 03:04:15,932] [INFO] [timer.py:197:stop] 0/2635, RunningAvgSamplesPerSec=10.947729241077543, CurrSamplesPerSec=11.175326539543441, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8635/20000 [13:05:00<30:34:57,  9.69s/it][2022-12-22 03:04:24,954] [INFO] [timer.py:197:stop] 0/2636, RunningAvgSamplesPerSec=10.947736788177785, CurrSamplesPerSec=10.967644451744347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8636/20000 [13:05:09<29:56:57,  9.49s/it][2022-12-22 03:04:35,878] [INFO] [timer.py:197:stop] 0/2637, RunningAvgSamplesPerSec=10.947773640406565, CurrSamplesPerSec=11.045711106229987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8637/20000 [13:05:20<31:18:23,  9.92s/it][2022-12-22 03:04:45,147] [INFO] [timer.py:197:stop] 0/2638, RunningAvgSamplesPerSec=10.9478454446108, CurrSamplesPerSec=11.1403781965944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8638/20000 [13:05:29<30:41:21,  9.72s/it][2022-12-22 03:04:54,497] [INFO] [timer.py:197:stop] 0/2639, RunningAvgSamplesPerSec=10.94784379917022, CurrSamplesPerSec=10.94350813618188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8639/20000 [13:05:38<30:19:58,  9.61s/it][2022-12-22 03:05:04,099] [INFO] [logging.py:68:log_dist] [Rank 0] step=8640, skipped=18, lr=[5.835384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:05:04,100] [INFO] [timer.py:197:stop] 0/2640, RunningAvgSamplesPerSec=10.94784818521027, CurrSamplesPerSec=10.959426409414913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8640/20000 [13:05:48<30:19:16,  9.61s/it][2022-12-22 03:05:13,094] [INFO] [timer.py:197:stop] 0/2641, RunningAvgSamplesPerSec=10.947794379381335, CurrSamplesPerSec=10.80767199875382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8641/20000 [13:05:57<29:44:13,  9.42s/it][2022-12-22 03:05:23,307] [INFO] [timer.py:197:stop] 0/2642, RunningAvgSamplesPerSec=10.947726221903446, CurrSamplesPerSec=10.77076711998759, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8642/20000 [13:06:07<30:28:51,  9.66s/it][2022-12-22 03:05:33,325] [INFO] [timer.py:197:stop] 0/2643, RunningAvgSamplesPerSec=10.94757329908333, CurrSamplesPerSec=10.558220738987272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8643/20000 [13:06:17<30:48:55,  9.77s/it][2022-12-22 03:05:42,345] [INFO] [timer.py:197:stop] 0/2644, RunningAvgSamplesPerSec=10.947553859528274, CurrSamplesPerSec=10.896453725557102, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8644/20000 [13:06:26<30:06:17,  9.54s/it][2022-12-22 03:05:51,773] [INFO] [timer.py:197:stop] 0/2645, RunningAvgSamplesPerSec=10.947550713465766, CurrSamplesPerSec=10.939245124701722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8645/20000 [13:06:36<29:59:36,  9.51s/it][2022-12-22 03:06:01,249] [INFO] [timer.py:197:stop] 0/2646, RunningAvgSamplesPerSec=10.947484412153468, CurrSamplesPerSec=10.775011825257852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8646/20000 [13:06:45<29:57:32,  9.50s/it][2022-12-22 03:06:11,225] [INFO] [timer.py:197:stop] 0/2647, RunningAvgSamplesPerSec=10.947514520219642, CurrSamplesPerSec=11.027703568798481, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8647/20000 [13:06:55<30:24:28,  9.64s/it][2022-12-22 03:06:20,895] [INFO] [timer.py:197:stop] 0/2648, RunningAvgSamplesPerSec=10.947475291375586, CurrSamplesPerSec=10.844689571364105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8648/20000 [13:07:05<30:25:51,  9.65s/it][2022-12-22 03:06:30,083] [INFO] [timer.py:197:stop] 0/2649, RunningAvgSamplesPerSec=10.947405571000326, CurrSamplesPerSec=10.765983840242994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8649/20000 [13:07:14<29:59:28,  9.51s/it][2022-12-22 03:06:38,882] [INFO] [logging.py:68:log_dist] [Rank 0] step=8650, skipped=18, lr=[5.83025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:06:38,883] [INFO] [timer.py:197:stop] 0/2650, RunningAvgSamplesPerSec=10.947501436349391, CurrSamplesPerSec=11.207280797696013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8650/20000 [13:07:23<29:18:53,  9.30s/it]

                                                          
{'loss': 0.0638, 'learning_rate': 5.83025641025641e-06, 'epoch': 0.43}


 43%|████▎     | 8650/20000 [13:07:23<29:18:53,  9.30s/it][2022-12-22 03:06:48,016] [INFO] [timer.py:197:stop] 0/2651, RunningAvgSamplesPerSec=10.9475906626351, CurrSamplesPerSec=11.1890755693045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8651/20000 [13:07:32<29:09:23,  9.25s/it][2022-12-22 03:06:57,204] [INFO] [timer.py:197:stop] 0/2652, RunningAvgSamplesPerSec=10.947702006679965, CurrSamplesPerSec=11.250822052353337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8652/20000 [13:07:41<29:05:46,  9.23s/it][2022-12-22 03:07:06,169] [INFO] [timer.py:197:stop] 0/2653, RunningAvgSamplesPerSec=10.947664190949562, CurrSamplesPerSec=10.848361832857798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8653/20000 [13:07:50<28:50:35,  9.15s/it][2022-12-22 03:07:15,349] [INFO] [timer.py:197:stop] 0/2654, RunningAvgSamplesPerSec=10.947735028862567, CurrSamplesPerSec=11.138805081097344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8654/20000 [13:07:59<28:52:02,  9.16s/it][2022-12-22 03:07:25,046] [INFO] [timer.py:197:stop] 0/2655, RunningAvgSamplesPerSec=10.947759993196039, CurrSamplesPerSec=11.014368364478528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8655/20000 [13:08:09<29:22:23,  9.32s/it][2022-12-22 03:07:35,521] [INFO] [timer.py:197:stop] 0/2656, RunningAvgSamplesPerSec=10.947802793449748, CurrSamplesPerSec=11.062542377973381, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8656/20000 [13:08:19<30:27:45,  9.67s/it][2022-12-22 03:07:47,153] [INFO] [timer.py:197:stop] 0/2657, RunningAvgSamplesPerSec=10.947772217563282, CurrSamplesPerSec=10.867221110521356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8657/20000 [13:08:31<32:18:58, 10.26s/it][2022-12-22 03:07:56,476] [INFO] [timer.py:197:stop] 0/2658, RunningAvgSamplesPerSec=10.947782715136992, CurrSamplesPerSec=10.975724935924788, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8658/20000 [13:08:40<31:25:51,  9.98s/it][2022-12-22 03:08:05,797] [INFO] [timer.py:197:stop] 0/2659, RunningAvgSamplesPerSec=10.947873699941333, CurrSamplesPerSec=11.194985976003355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8659/20000 [13:08:50<30:48:32,  9.78s/it][2022-12-22 03:08:14,492] [INFO] [logging.py:68:log_dist] [Rank 0] step=8660, skipped=18, lr=[5.825128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:08:14,493] [INFO] [timer.py:197:stop] 0/2660, RunningAvgSamplesPerSec=10.948059955798277, CurrSamplesPerSec=11.466380050723915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8660/20000 [13:08:58<29:46:57,  9.45s/it][2022-12-22 03:08:24,065] [INFO] [timer.py:197:stop] 0/2661, RunningAvgSamplesPerSec=10.948144240775393, CurrSamplesPerSec=11.176855539736259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8661/20000 [13:09:08<29:53:25,  9.49s/it][2022-12-22 03:08:33,063] [INFO] [timer.py:197:stop] 0/2662, RunningAvgSamplesPerSec=10.948234994559092, CurrSamplesPerSec=11.194990177943886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8662/20000 [13:09:17<29:25:22,  9.34s/it][2022-12-22 03:08:42,429] [INFO] [timer.py:197:stop] 0/2663, RunningAvgSamplesPerSec=10.948077201017032, CurrSamplesPerSec=10.54384960957362, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8663/20000 [13:09:26<29:26:35,  9.35s/it][2022-12-22 03:08:51,311] [INFO] [timer.py:197:stop] 0/2664, RunningAvgSamplesPerSec=10.948148970768091, CurrSamplesPerSec=11.14252015994295, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8664/20000 [13:09:35<28:59:57,  9.21s/it][2022-12-22 03:09:01,727] [INFO] [timer.py:197:stop] 0/2665, RunningAvgSamplesPerSec=10.948219247706987, CurrSamplesPerSec=11.13854994820055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8665/20000 [13:09:46<30:08:09,  9.57s/it][2022-12-22 03:09:10,881] [INFO] [timer.py:197:stop] 0/2666, RunningAvgSamplesPerSec=10.948224799433458, CurrSamplesPerSec=10.96302904586176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8666/20000 [13:09:55<29:44:21,  9.45s/it][2022-12-22 03:09:20,644] [INFO] [timer.py:197:stop] 0/2667, RunningAvgSamplesPerSec=10.948193823202038, CurrSamplesPerSec=10.866290709204653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8667/20000 [13:10:05<30:02:08,  9.54s/it][2022-12-22 03:09:30,280] [INFO] [timer.py:197:stop] 0/2668, RunningAvgSamplesPerSec=10.948093464661598, CurrSamplesPerSec=10.687018261876988, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8668/20000 [13:10:14<30:07:22,  9.57s/it][2022-12-22 03:09:39,183] [INFO] [timer.py:197:stop] 0/2669, RunningAvgSamplesPerSec=10.94815626450055, CurrSamplesPerSec=11.118181719907122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8669/20000 [13:10:23<29:29:29,  9.37s/it][2022-12-22 03:09:49,431] [INFO] [logging.py:68:log_dist] [Rank 0] step=8670, skipped=18, lr=[5.82e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:09:49,432] [INFO] [timer.py:197:stop] 0/2670, RunningAvgSamplesPerSec=10.9481633746913, CurrSamplesPerSec=10.967159167615952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8670/20000 [13:10:33<30:19:07,  9.63s/it][2022-12-22 03:09:58,520] [INFO] [timer.py:197:stop] 0/2671, RunningAvgSamplesPerSec=10.948054190579462, CurrSamplesPerSec=10.66430377333005, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8671/20000 [13:10:42<29:48:04,  9.47s/it][2022-12-22 03:10:07,779] [INFO] [timer.py:197:stop] 0/2672, RunningAvgSamplesPerSec=10.948030162307363, CurrSamplesPerSec=10.884272325178452, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8672/20000 [13:10:52<29:35:57,  9.41s/it][2022-12-22 03:10:16,855] [INFO] [timer.py:197:stop] 0/2673, RunningAvgSamplesPerSec=10.94800452992278, CurrSamplesPerSec=10.87999138794627, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8673/20000 [13:11:01<29:17:04,  9.31s/it][2022-12-22 03:10:26,365] [INFO] [timer.py:197:stop] 0/2674, RunningAvgSamplesPerSec=10.947817655253042, CurrSamplesPerSec=10.470448196518241, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8674/20000 [13:11:10<29:28:23,  9.37s/it][2022-12-22 03:10:35,790] [INFO] [timer.py:197:stop] 0/2675, RunningAvgSamplesPerSec=10.947743956457947, CurrSamplesPerSec=10.754301633220026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8675/20000 [13:11:20<29:31:25,  9.39s/it]

                                                          
{'loss': 0.0586, 'learning_rate': 5.817435897435898e-06, 'epoch': 0.43}


 43%|████▎     | 8675/20000 [13:11:20<29:31:25,  9.39s/it][2022-12-22 03:10:44,638] [INFO] [timer.py:197:stop] 0/2676, RunningAvgSamplesPerSec=10.947845052823789, CurrSamplesPerSec=11.224917296165867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8676/20000 [13:11:29<29:00:52,  9.22s/it][2022-12-22 03:10:54,368] [INFO] [timer.py:197:stop] 0/2677, RunningAvgSamplesPerSec=10.947865832849308, CurrSamplesPerSec=11.00371518997512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8677/20000 [13:11:38<29:29:24,  9.38s/it][2022-12-22 03:11:05,486] [INFO] [timer.py:197:stop] 0/2678, RunningAvgSamplesPerSec=10.94790793932625, CurrSamplesPerSec=11.061714068889058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8678/20000 [13:11:49<31:07:51,  9.90s/it][2022-12-22 03:11:16,670] [INFO] [timer.py:197:stop] 0/2679, RunningAvgSamplesPerSec=10.947853458987716, CurrSamplesPerSec=10.803980700779043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8679/20000 [13:12:01<32:20:24, 10.28s/it][2022-12-22 03:11:26,456] [INFO] [logging.py:68:log_dist] [Rank 0] step=8680, skipped=18, lr=[5.814871794871796e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:11:26,457] [INFO] [timer.py:197:stop] 0/2680, RunningAvgSamplesPerSec=10.947862036311475, CurrSamplesPerSec=10.97087180958488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8680/20000 [13:12:10<31:52:06, 10.13s/it][2022-12-22 03:11:35,735] [INFO] [timer.py:197:stop] 0/2681, RunningAvgSamplesPerSec=10.947913700546799, CurrSamplesPerSec=11.088042089340714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8681/20000 [13:12:20<31:03:29,  9.88s/it][2022-12-22 03:11:44,994] [INFO] [timer.py:197:stop] 0/2682, RunningAvgSamplesPerSec=10.947974062570275, CurrSamplesPerSec=11.112109229031178, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8682/20000 [13:12:29<30:28:18,  9.69s/it][2022-12-22 03:11:55,786] [INFO] [timer.py:197:stop] 0/2683, RunningAvgSamplesPerSec=10.948076266344364, CurrSamplesPerSec=11.229013679014106, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8683/20000 [13:12:40<31:30:20, 10.02s/it][2022-12-22 03:12:06,545] [INFO] [timer.py:197:stop] 0/2684, RunningAvgSamplesPerSec=10.948155033315963, CurrSamplesPerSec=11.163484225489398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8684/20000 [13:12:51<32:11:52, 10.24s/it][2022-12-22 03:12:15,674] [INFO] [timer.py:197:stop] 0/2685, RunningAvgSamplesPerSec=10.948205088792717, CurrSamplesPerSec=11.084121124853358, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8685/20000 [13:13:00<31:08:38,  9.91s/it][2022-12-22 03:12:24,558] [INFO] [timer.py:197:stop] 0/2686, RunningAvgSamplesPerSec=10.948262826366943, CurrSamplesPerSec=11.105396898892428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8686/20000 [13:13:09<30:10:32,  9.60s/it][2022-12-22 03:12:35,918] [INFO] [timer.py:197:stop] 0/2687, RunningAvgSamplesPerSec=10.948362860670759, CurrSamplesPerSec=11.223607403909824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8687/20000 [13:13:20<31:49:48, 10.13s/it][2022-12-22 03:12:46,278] [INFO] [timer.py:197:stop] 0/2688, RunningAvgSamplesPerSec=10.94830185025558, CurrSamplesPerSec=10.786904675364891, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8688/20000 [13:13:30<32:02:43, 10.20s/it][2022-12-22 03:12:55,369] [INFO] [timer.py:197:stop] 0/2689, RunningAvgSamplesPerSec=10.948282793428309, CurrSamplesPerSec=10.897334443491347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8689/20000 [13:13:39<30:59:54,  9.87s/it][2022-12-22 03:13:05,291] [INFO] [logging.py:68:log_dist] [Rank 0] step=8690, skipped=18, lr=[5.809743589743591e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:13:05,292] [INFO] [timer.py:197:stop] 0/2690, RunningAvgSamplesPerSec=10.94821445552069, CurrSamplesPerSec=10.767620554245013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8690/20000 [13:13:49<31:02:57,  9.88s/it][2022-12-22 03:13:14,701] [INFO] [timer.py:197:stop] 0/2691, RunningAvgSamplesPerSec=10.94812395540529, CurrSamplesPerSec=10.710149342960873, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8691/20000 [13:13:59<30:36:01,  9.74s/it][2022-12-22 03:13:24,275] [INFO] [timer.py:197:stop] 0/2692, RunningAvgSamplesPerSec=10.948168962221072, CurrSamplesPerSec=11.0705455693004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8692/20000 [13:14:08<30:26:24,  9.69s/it][2022-12-22 03:13:32,975] [INFO] [timer.py:197:stop] 0/2693, RunningAvgSamplesPerSec=10.94829193418613, CurrSamplesPerSec=11.289396577342213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8693/20000 [13:14:17<29:30:11,  9.39s/it][2022-12-22 03:13:43,571] [INFO] [timer.py:197:stop] 0/2694, RunningAvgSamplesPerSec=10.948284996369074, CurrSamplesPerSec=10.929647124889009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8694/20000 [13:14:28<30:38:01,  9.75s/it][2022-12-22 03:13:53,009] [INFO] [timer.py:197:stop] 0/2695, RunningAvgSamplesPerSec=10.94828607077045, CurrSamplesPerSec=10.951179123836988, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8695/20000 [13:14:37<30:20:00,  9.66s/it][2022-12-22 03:14:01,876] [INFO] [timer.py:197:stop] 0/2696, RunningAvgSamplesPerSec=10.948294985208177, CurrSamplesPerSec=10.97235434110416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8696/20000 [13:14:46<29:35:05,  9.42s/it][2022-12-22 03:14:12,075] [INFO] [timer.py:197:stop] 0/2697, RunningAvgSamplesPerSec=10.948362696405574, CurrSamplesPerSec=11.133868578806718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8697/20000 [13:14:56<30:18:48,  9.65s/it][2022-12-22 03:14:21,387] [INFO] [timer.py:197:stop] 0/2698, RunningAvgSamplesPerSec=10.948419913637423, CurrSamplesPerSec=11.104824007444048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8698/20000 [13:15:05<29:59:16,  9.55s/it][2022-12-22 03:14:30,353] [INFO] [timer.py:197:stop] 0/2699, RunningAvgSamplesPerSec=10.948520847543433, CurrSamplesPerSec=11.227576975180838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 43%|████▎     | 8699/20000 [13:15:14<29:26:01,  9.38s/it][2022-12-22 03:14:39,597] [INFO] [logging.py:68:log_dist] [Rank 0] step=8700, skipped=18, lr=[5.804615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:14:39,598] [INFO] [timer.py:197:stop] 0/2700, RunningAvgSamplesPerSec=10.948542715419334, CurrSamplesPerSec=11.007839917611214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8700/20000 [13:15:24<29:18:26,  9.34s/it]

                                                          
{'loss': 0.0545, 'learning_rate': 5.804615384615385e-06, 'epoch': 0.43}


 44%|████▎     | 8700/20000 [13:15:24<29:18:26,  9.34s/it][2022-12-22 03:14:49,606] [INFO] [timer.py:197:stop] 0/2701, RunningAvgSamplesPerSec=10.948608151171944, CurrSamplesPerSec=11.128048346724748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8701/20000 [13:15:34<29:56:12,  9.54s/it][2022-12-22 03:14:58,731] [INFO] [timer.py:197:stop] 0/2702, RunningAvgSamplesPerSec=10.948695664677219, CurrSamplesPerSec=11.19010451861268, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8702/20000 [13:15:43<29:32:41,  9.41s/it][2022-12-22 03:15:08,244] [INFO] [timer.py:197:stop] 0/2703, RunningAvgSamplesPerSec=10.948646178330371, CurrSamplesPerSec=10.816644536575255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8703/20000 [13:15:52<29:38:07,  9.44s/it][2022-12-22 03:15:17,528] [INFO] [timer.py:197:stop] 0/2704, RunningAvgSamplesPerSec=10.94866661916947, CurrSamplesPerSec=11.00415725110154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8704/20000 [13:16:01<29:28:54,  9.40s/it][2022-12-22 03:15:26,756] [INFO] [timer.py:197:stop] 0/2705, RunningAvgSamplesPerSec=10.948625723719354, CurrSamplesPerSec=10.839230700399625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8705/20000 [13:16:11<29:19:16,  9.35s/it][2022-12-22 03:15:36,075] [INFO] [timer.py:197:stop] 0/2706, RunningAvgSamplesPerSec=10.948557548776709, CurrSamplesPerSec=10.767332041878747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8706/20000 [13:16:20<29:17:40,  9.34s/it][2022-12-22 03:15:46,059] [INFO] [timer.py:197:stop] 0/2707, RunningAvgSamplesPerSec=10.948561225423166, CurrSamplesPerSec=10.958511916338322, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8707/20000 [13:16:30<29:54:00,  9.53s/it][2022-12-22 03:15:55,813] [INFO] [timer.py:197:stop] 0/2708, RunningAvgSamplesPerSec=10.948616751745158, CurrSamplesPerSec=11.100905398289148, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8708/20000 [13:16:40<30:06:24,  9.60s/it][2022-12-22 03:16:04,917] [INFO] [timer.py:197:stop] 0/2709, RunningAvgSamplesPerSec=10.948704967972494, CurrSamplesPerSec=11.192740723469244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8709/20000 [13:16:49<29:38:20,  9.45s/it][2022-12-22 03:16:13,984] [INFO] [logging.py:68:log_dist] [Rank 0] step=8710, skipped=18, lr=[5.79948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:16:13,985] [INFO] [timer.py:197:stop] 0/2710, RunningAvgSamplesPerSec=10.948776310674704, CurrSamplesPerSec=11.14536998861944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8710/20000 [13:16:58<29:16:33,  9.34s/it][2022-12-22 03:16:23,229] [INFO] [timer.py:197:stop] 0/2711, RunningAvgSamplesPerSec=10.948787037539914, CurrSamplesPerSec=10.977912690663898, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8711/20000 [13:17:07<29:11:17,  9.31s/it][2022-12-22 03:16:32,879] [INFO] [timer.py:197:stop] 0/2712, RunningAvgSamplesPerSec=10.948730075000036, CurrSamplesPerSec=10.796563976777582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8712/20000 [13:17:17<29:30:27,  9.41s/it][2022-12-22 03:16:43,463] [INFO] [timer.py:197:stop] 0/2713, RunningAvgSamplesPerSec=10.948682344471289, CurrSamplesPerSec=10.820843480565244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8713/20000 [13:17:27<30:36:29,  9.76s/it][2022-12-22 03:16:54,225] [INFO] [timer.py:197:stop] 0/2714, RunningAvgSamplesPerSec=10.948650432817347, CurrSamplesPerSec=10.862816420191406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8714/20000 [13:17:38<31:32:45, 10.06s/it][2022-12-22 03:17:03,579] [INFO] [timer.py:197:stop] 0/2715, RunningAvgSamplesPerSec=10.948693479225259, CurrSamplesPerSec=11.066693997185704, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8715/20000 [13:17:48<30:52:36,  9.85s/it][2022-12-22 03:17:12,487] [INFO] [timer.py:197:stop] 0/2716, RunningAvgSamplesPerSec=10.948715588003711, CurrSamplesPerSec=11.009027235254026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8716/20000 [13:17:56<29:59:17,  9.57s/it][2022-12-22 03:17:23,665] [INFO] [timer.py:197:stop] 0/2717, RunningAvgSamplesPerSec=10.948700809271724, CurrSamplesPerSec=10.908737785168514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8717/20000 [13:18:08<31:30:01, 10.05s/it][2022-12-22 03:17:32,513] [INFO] [timer.py:197:stop] 0/2718, RunningAvgSamplesPerSec=10.94877438728541, CurrSamplesPerSec=11.152252594571198, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8718/20000 [13:18:16<30:22:01,  9.69s/it][2022-12-22 03:17:41,390] [INFO] [timer.py:197:stop] 0/2719, RunningAvgSamplesPerSec=10.9488101250823, CurrSamplesPerSec=11.046742495308122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8719/20000 [13:18:25<29:35:59,  9.45s/it][2022-12-22 03:17:50,803] [INFO] [logging.py:68:log_dist] [Rank 0] step=8720, skipped=18, lr=[5.794358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:17:50,804] [INFO] [timer.py:197:stop] 0/2720, RunningAvgSamplesPerSec=10.948790425178908, CurrSamplesPerSec=10.895526272487421, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8720/20000 [13:18:35<29:33:59,  9.44s/it][2022-12-22 03:18:01,115] [INFO] [timer.py:197:stop] 0/2721, RunningAvgSamplesPerSec=10.94872220962219, CurrSamplesPerSec=10.766400960730248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8721/20000 [13:18:45<30:23:12,  9.70s/it][2022-12-22 03:18:09,987] [INFO] [timer.py:197:stop] 0/2722, RunningAvgSamplesPerSec=10.948829807074205, CurrSamplesPerSec=11.249422191750913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8722/20000 [13:18:54<29:36:23,  9.45s/it][2022-12-22 03:18:23,334] [INFO] [timer.py:197:stop] 0/2723, RunningAvgSamplesPerSec=10.948828543269052, CurrSamplesPerSec=10.945392072586907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8723/20000 [13:19:07<33:15:56, 10.62s/it][2022-12-22 03:18:32,470] [INFO] [timer.py:197:stop] 0/2724, RunningAvgSamplesPerSec=10.948927720707838, CurrSamplesPerSec=11.225611555064996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8724/20000 [13:19:16<31:52:06, 10.17s/it][2022-12-22 03:18:42,844] [INFO] [timer.py:197:stop] 0/2725, RunningAvgSamplesPerSec=10.948784112307735, CurrSamplesPerSec=10.571362016875478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8725/20000 [13:19:27<32:03:14, 10.23s/it]

                                                          
{'loss': 0.0599, 'learning_rate': 5.7917948717948726e-06, 'epoch': 0.44}


 44%|████▎     | 8725/20000 [13:19:27<32:03:14, 10.23s/it][2022-12-22 03:18:51,655] [INFO] [timer.py:197:stop] 0/2726, RunningAvgSamplesPerSec=10.948869879956376, CurrSamplesPerSec=11.187507322077426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8726/20000 [13:19:36<30:42:47,  9.81s/it][2022-12-22 03:19:02,400] [INFO] [timer.py:197:stop] 0/2727, RunningAvgSamplesPerSec=10.948834102402554, CurrSamplesPerSec=10.852236201277863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8727/20000 [13:19:46<31:35:29, 10.09s/it][2022-12-22 03:19:12,387] [INFO] [timer.py:197:stop] 0/2728, RunningAvgSamplesPerSec=10.948933850578134, CurrSamplesPerSec=11.227669957632019, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8728/20000 [13:19:56<31:29:35, 10.06s/it][2022-12-22 03:19:21,421] [INFO] [timer.py:197:stop] 0/2729, RunningAvgSamplesPerSec=10.948995943984393, CurrSamplesPerSec=11.120921436386354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8729/20000 [13:20:05<30:31:43,  9.75s/it][2022-12-22 03:19:30,392] [INFO] [logging.py:68:log_dist] [Rank 0] step=8730, skipped=18, lr=[5.7892307692307696e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:19:30,393] [INFO] [timer.py:197:stop] 0/2730, RunningAvgSamplesPerSec=10.948983351181406, CurrSamplesPerSec=10.914750186276434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8730/20000 [13:20:14<29:47:38,  9.52s/it][2022-12-22 03:19:43,296] [INFO] [timer.py:197:stop] 0/2731, RunningAvgSamplesPerSec=10.948904306010586, CurrSamplesPerSec=10.737435419896672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8731/20000 [13:20:27<32:58:15, 10.53s/it][2022-12-22 03:19:52,283] [INFO] [timer.py:197:stop] 0/2732, RunningAvgSamplesPerSec=10.948908458209528, CurrSamplesPerSec=10.960251552728588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8732/20000 [13:20:36<31:30:58, 10.07s/it][2022-12-22 03:20:02,106] [INFO] [timer.py:197:stop] 0/2733, RunningAvgSamplesPerSec=10.948851261024005, CurrSamplesPerSec=10.794899351864784, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8733/20000 [13:20:46<31:16:57, 10.00s/it][2022-12-22 03:20:11,849] [INFO] [timer.py:197:stop] 0/2734, RunningAvgSamplesPerSec=10.94885950434198, CurrSamplesPerSec=10.97141840721605, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8734/20000 [13:20:56<31:02:32,  9.92s/it][2022-12-22 03:20:21,007] [INFO] [timer.py:197:stop] 0/2735, RunningAvgSamplesPerSec=10.948810915746465, CurrSamplesPerSec=10.817657565935875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8735/20000 [13:21:05<30:19:32,  9.69s/it][2022-12-22 03:20:30,572] [INFO] [timer.py:197:stop] 0/2736, RunningAvgSamplesPerSec=10.948664328514306, CurrSamplesPerSec=10.562188158549453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8736/20000 [13:21:15<30:12:15,  9.65s/it][2022-12-22 03:20:40,024] [INFO] [timer.py:197:stop] 0/2737, RunningAvgSamplesPerSec=10.948708262481137, CurrSamplesPerSec=11.070156593570532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8737/20000 [13:21:24<30:00:45,  9.59s/it][2022-12-22 03:20:49,070] [INFO] [timer.py:197:stop] 0/2738, RunningAvgSamplesPerSec=10.948724609796438, CurrSamplesPerSec=10.993617909203236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8738/20000 [13:21:33<29:29:47,  9.43s/it][2022-12-22 03:20:58,266] [INFO] [timer.py:197:stop] 0/2739, RunningAvgSamplesPerSec=10.948741193218275, CurrSamplesPerSec=10.994302312389442, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8739/20000 [13:21:42<29:16:31,  9.36s/it][2022-12-22 03:21:07,385] [INFO] [logging.py:68:log_dist] [Rank 0] step=8740, skipped=18, lr=[5.784102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:21:07,386] [INFO] [timer.py:197:stop] 0/2740, RunningAvgSamplesPerSec=10.94863830539461, CurrSamplesPerSec=10.674098208535185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8740/20000 [13:21:51<29:02:54,  9.29s/it][2022-12-22 03:21:16,813] [INFO] [timer.py:197:stop] 0/2741, RunningAvgSamplesPerSec=10.948612913364675, CurrSamplesPerSec=10.879528380429713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8741/20000 [13:22:01<29:10:36,  9.33s/it][2022-12-22 03:21:26,399] [INFO] [timer.py:197:stop] 0/2742, RunningAvgSamplesPerSec=10.948558646397519, CurrSamplesPerSec=10.801913005946343, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8742/20000 [13:22:10<29:24:53,  9.41s/it][2022-12-22 03:21:35,209] [INFO] [timer.py:197:stop] 0/2743, RunningAvgSamplesPerSec=10.948643927285733, CurrSamplesPerSec=11.187411273645653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8743/20000 [13:22:19<28:51:13,  9.23s/it][2022-12-22 03:21:45,915] [INFO] [timer.py:197:stop] 0/2744, RunningAvgSamplesPerSec=10.94859207447816, CurrSamplesPerSec=10.808285574523614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8744/20000 [13:22:30<30:14:17,  9.67s/it][2022-12-22 03:21:56,017] [INFO] [timer.py:197:stop] 0/2745, RunningAvgSamplesPerSec=10.948528217389471, CurrSamplesPerSec=10.776189244712196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8745/20000 [13:22:40<30:38:22,  9.80s/it][2022-12-22 03:22:05,550] [INFO] [timer.py:197:stop] 0/2746, RunningAvgSamplesPerSec=10.948624692083294, CurrSamplesPerSec=11.219811804575356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8746/20000 [13:22:50<30:23:07,  9.72s/it][2022-12-22 03:22:15,348] [INFO] [timer.py:197:stop] 0/2747, RunningAvgSamplesPerSec=10.948701709877508, CurrSamplesPerSec=11.164199693332826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8747/20000 [13:22:59<30:27:22,  9.74s/it][2022-12-22 03:22:24,545] [INFO] [timer.py:197:stop] 0/2748, RunningAvgSamplesPerSec=10.948553820151655, CurrSamplesPerSec=10.557115793077815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8748/20000 [13:23:09<29:56:28,  9.58s/it][2022-12-22 03:22:33,616] [INFO] [timer.py:197:stop] 0/2749, RunningAvgSamplesPerSec=10.948643368564673, CurrSamplesPerSec=11.200195067942074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▎     | 8749/20000 [13:23:18<29:27:44,  9.43s/it][2022-12-22 03:22:43,287] [INFO] [logging.py:68:log_dist] [Rank 0] step=8750, skipped=18, lr=[5.778974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:22:43,287] [INFO] [timer.py:197:stop] 0/2750, RunningAvgSamplesPerSec=10.948675561201188, CurrSamplesPerSec=11.037829094802099, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8750/20000 [13:23:27<29:41:17,  9.50s/it]

                                                          
{'loss': 0.0577, 'learning_rate': 5.778974358974359e-06, 'epoch': 0.44}


 44%|████▍     | 8750/20000 [13:23:27<29:41:17,  9.50s/it][2022-12-22 03:22:52,455] [INFO] [timer.py:197:stop] 0/2751, RunningAvgSamplesPerSec=10.94856634411482, CurrSamplesPerSec=10.656448413663304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8751/20000 [13:23:36<29:22:24,  9.40s/it][2022-12-22 03:23:01,723] [INFO] [timer.py:197:stop] 0/2752, RunningAvgSamplesPerSec=10.948638832202267, CurrSamplesPerSec=11.151603977921411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8752/20000 [13:23:46<29:14:49,  9.36s/it][2022-12-22 03:23:10,632] [INFO] [timer.py:197:stop] 0/2753, RunningAvgSamplesPerSec=10.948650104703352, CurrSamplesPerSec=10.979737533856195, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8753/20000 [13:23:55<28:49:17,  9.23s/it][2022-12-22 03:23:21,537] [INFO] [timer.py:197:stop] 0/2754, RunningAvgSamplesPerSec=10.94873401639512, CurrSamplesPerSec=11.184548761816494, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8754/20000 [13:24:05<30:23:34,  9.73s/it][2022-12-22 03:23:31,478] [INFO] [timer.py:197:stop] 0/2755, RunningAvgSamplesPerSec=10.948731572533612, CurrSamplesPerSec=10.942010195921712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8755/20000 [13:24:15<30:35:19,  9.79s/it][2022-12-22 03:23:40,830] [INFO] [timer.py:197:stop] 0/2756, RunningAvgSamplesPerSec=10.948840680819155, CurrSamplesPerSec=11.257692026706563, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8756/20000 [13:24:25<30:10:22,  9.66s/it][2022-12-22 03:23:50,294] [INFO] [timer.py:197:stop] 0/2757, RunningAvgSamplesPerSec=10.948860966680158, CurrSamplesPerSec=11.005014860752269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8757/20000 [13:24:34<29:59:08,  9.60s/it][2022-12-22 03:24:00,805] [INFO] [timer.py:197:stop] 0/2758, RunningAvgSamplesPerSec=10.948936855417696, CurrSamplesPerSec=11.162081877443722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8758/20000 [13:24:45<30:50:08,  9.87s/it][2022-12-22 03:24:10,480] [INFO] [timer.py:197:stop] 0/2759, RunningAvgSamplesPerSec=10.948990895516635, CurrSamplesPerSec=11.0999799945566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8759/20000 [13:24:54<30:38:44,  9.81s/it][2022-12-22 03:24:19,732] [INFO] [logging.py:68:log_dist] [Rank 0] step=8760, skipped=18, lr=[5.773846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:24:19,732] [INFO] [timer.py:197:stop] 0/2760, RunningAvgSamplesPerSec=10.948991311160174, CurrSamplesPerSec=10.950137360384813, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8760/20000 [13:25:04<30:06:59,  9.65s/it][2022-12-22 03:24:29,338] [INFO] [timer.py:197:stop] 0/2761, RunningAvgSamplesPerSec=10.948996541867743, CurrSamplesPerSec=10.963441873272409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8761/20000 [13:25:13<30:04:36,  9.63s/it][2022-12-22 03:24:38,831] [INFO] [timer.py:197:stop] 0/2762, RunningAvgSamplesPerSec=10.948976323078865, CurrSamplesPerSec=10.893475556386662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8762/20000 [13:25:23<29:56:31,  9.59s/it][2022-12-22 03:24:47,970] [INFO] [timer.py:197:stop] 0/2763, RunningAvgSamplesPerSec=10.948850486076173, CurrSamplesPerSec=10.612222455778001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8763/20000 [13:25:32<29:30:54,  9.46s/it][2022-12-22 03:24:57,596] [INFO] [timer.py:197:stop] 0/2764, RunningAvgSamplesPerSec=10.948878910829082, CurrSamplesPerSec=11.02792646577074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8764/20000 [13:25:42<29:40:19,  9.51s/it][2022-12-22 03:25:07,402] [INFO] [timer.py:197:stop] 0/2765, RunningAvgSamplesPerSec=10.948918621315284, CurrSamplesPerSec=11.05970922657152, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8765/20000 [13:25:51<29:56:58,  9.60s/it][2022-12-22 03:25:16,615] [INFO] [timer.py:197:stop] 0/2766, RunningAvgSamplesPerSec=10.94893446030156, CurrSamplesPerSec=10.99287326727451, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8766/20000 [13:26:01<29:35:16,  9.48s/it][2022-12-22 03:25:26,182] [INFO] [timer.py:197:stop] 0/2767, RunningAvgSamplesPerSec=10.94893639785899, CurrSamplesPerSec=10.954294428293801, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8767/20000 [13:26:10<29:39:51,  9.51s/it][2022-12-22 03:25:35,592] [INFO] [timer.py:197:stop] 0/2768, RunningAvgSamplesPerSec=10.948980435874832, CurrSamplesPerSec=11.072115446287349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8768/20000 [13:26:20<29:34:16,  9.48s/it][2022-12-22 03:25:44,887] [INFO] [timer.py:197:stop] 0/2769, RunningAvgSamplesPerSec=10.948938894318818, CurrSamplesPerSec=10.835228716441616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8769/20000 [13:26:29<29:23:49,  9.42s/it][2022-12-22 03:25:54,748] [INFO] [logging.py:68:log_dist] [Rank 0] step=8770, skipped=18, lr=[5.768717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:25:54,749] [INFO] [timer.py:197:stop] 0/2770, RunningAvgSamplesPerSec=10.948886799698757, CurrSamplesPerSec=10.806614723130561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8770/20000 [13:26:39<29:48:20,  9.55s/it][2022-12-22 03:26:04,134] [INFO] [timer.py:197:stop] 0/2771, RunningAvgSamplesPerSec=10.948893228592267, CurrSamplesPerSec=10.966717385801465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8771/20000 [13:26:48<29:38:38,  9.50s/it][2022-12-22 03:26:14,392] [INFO] [timer.py:197:stop] 0/2772, RunningAvgSamplesPerSec=10.94888798546966, CurrSamplesPerSec=10.934389011526966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8772/20000 [13:26:58<30:20:50,  9.73s/it][2022-12-22 03:26:24,523] [INFO] [timer.py:197:stop] 0/2773, RunningAvgSamplesPerSec=10.948808707107641, CurrSamplesPerSec=10.733527121747825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8773/20000 [13:27:08<30:43:08,  9.85s/it][2022-12-22 03:26:33,962] [INFO] [timer.py:197:stop] 0/2774, RunningAvgSamplesPerSec=10.948805962069123, CurrSamplesPerSec=10.941204743062382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8774/20000 [13:27:18<30:19:56,  9.73s/it][2022-12-22 03:26:43,279] [INFO] [timer.py:197:stop] 0/2775, RunningAvgSamplesPerSec=10.948744636966929, CurrSamplesPerSec=10.781351384383251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8775/20000 [13:27:27<29:56:42,  9.60s/it]

                                                          
{'loss': 0.0671, 'learning_rate': 5.766153846153847e-06, 'epoch': 0.44}


 44%|████▍     | 8775/20000 [13:27:27<29:56:42,  9.60s/it][2022-12-22 03:26:52,626] [INFO] [timer.py:197:stop] 0/2776, RunningAvgSamplesPerSec=10.948820559623043, CurrSamplesPerSec=11.163483296972938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8776/20000 [13:27:37<29:42:09,  9.53s/it][2022-12-22 03:27:02,141] [INFO] [timer.py:197:stop] 0/2777, RunningAvgSamplesPerSec=10.948701534380023, CurrSamplesPerSec=10.628194411670147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8777/20000 [13:27:46<29:41:21,  9.52s/it][2022-12-22 03:27:11,485] [INFO] [timer.py:197:stop] 0/2778, RunningAvgSamplesPerSec=10.948711782371053, CurrSamplesPerSec=10.977224041885256, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8778/20000 [13:27:55<29:31:06,  9.47s/it][2022-12-22 03:27:21,596] [INFO] [timer.py:197:stop] 0/2779, RunningAvgSamplesPerSec=10.948628681729614, CurrSamplesPerSec=10.722703259862426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8779/20000 [13:28:06<30:06:58,  9.66s/it][2022-12-22 03:27:31,150] [INFO] [logging.py:68:log_dist] [Rank 0] step=8780, skipped=18, lr=[5.763589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:27:31,151] [INFO] [timer.py:197:stop] 0/2780, RunningAvgSamplesPerSec=10.948712983629568, CurrSamplesPerSec=11.187936296369465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8780/20000 [13:28:15<30:00:47,  9.63s/it][2022-12-22 03:27:41,830] [INFO] [timer.py:197:stop] 0/2781, RunningAvgSamplesPerSec=10.94866580496106, CurrSamplesPerSec=10.819154354551593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8781/20000 [13:28:26<30:59:28,  9.94s/it][2022-12-22 03:27:50,794] [INFO] [timer.py:197:stop] 0/2782, RunningAvgSamplesPerSec=10.948632327288164, CurrSamplesPerSec=10.856382040140579, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8782/20000 [13:28:35<30:04:17,  9.65s/it][2022-12-22 03:28:00,159] [INFO] [timer.py:197:stop] 0/2783, RunningAvgSamplesPerSec=10.948622942761887, CurrSamplesPerSec=10.92259600045719, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8783/20000 [13:28:44<29:48:09,  9.56s/it][2022-12-22 03:28:09,382] [INFO] [timer.py:197:stop] 0/2784, RunningAvgSamplesPerSec=10.948714721067878, CurrSamplesPerSec=11.210044476783906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8784/20000 [13:28:53<29:28:47,  9.46s/it][2022-12-22 03:28:19,238] [INFO] [timer.py:197:stop] 0/2785, RunningAvgSamplesPerSec=10.948646347406996, CurrSamplesPerSec=10.761680232851358, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8785/20000 [13:29:03<29:50:43,  9.58s/it][2022-12-22 03:28:28,242] [INFO] [timer.py:197:stop] 0/2786, RunningAvgSamplesPerSec=10.948677641815364, CurrSamplesPerSec=11.036468572872966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8786/20000 [13:29:12<29:18:16,  9.41s/it][2022-12-22 03:28:37,365] [INFO] [timer.py:197:stop] 0/2787, RunningAvgSamplesPerSec=10.948768324725556, CurrSamplesPerSec=11.207190492146943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8787/20000 [13:29:21<29:02:10,  9.32s/it][2022-12-22 03:28:47,559] [INFO] [timer.py:197:stop] 0/2788, RunningAvgSamplesPerSec=10.948644308111437, CurrSamplesPerSec=10.613824079570074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8788/20000 [13:29:32<29:50:51,  9.58s/it][2022-12-22 03:28:56,623] [INFO] [timer.py:197:stop] 0/2789, RunningAvgSamplesPerSec=10.94870268085271, CurrSamplesPerSec=11.113782022685433, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8789/20000 [13:29:41<29:21:33,  9.43s/it][2022-12-22 03:29:05,516] [INFO] [logging.py:68:log_dist] [Rank 0] step=8790, skipped=18, lr=[5.75846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:29:05,517] [INFO] [timer.py:197:stop] 0/2790, RunningAvgSamplesPerSec=10.948826387263784, CurrSamplesPerSec=11.304809809695357, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8790/20000 [13:29:49<28:51:29,  9.27s/it][2022-12-22 03:29:14,559] [INFO] [timer.py:197:stop] 0/2791, RunningAvgSamplesPerSec=10.948769336373445, CurrSamplesPerSec=10.79198987938328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8791/20000 [13:29:59<28:38:42,  9.20s/it][2022-12-22 03:29:25,092] [INFO] [timer.py:197:stop] 0/2792, RunningAvgSamplesPerSec=10.948714588297664, CurrSamplesPerSec=10.798123128604388, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8792/20000 [13:30:09<29:53:15,  9.60s/it][2022-12-22 03:29:34,035] [INFO] [timer.py:197:stop] 0/2793, RunningAvgSamplesPerSec=10.948709799204781, CurrSamplesPerSec=10.935364522191152, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8793/20000 [13:30:18<29:16:16,  9.40s/it][2022-12-22 03:29:44,077] [INFO] [timer.py:197:stop] 0/2794, RunningAvgSamplesPerSec=10.948688078613849, CurrSamplesPerSec=10.88839984094652, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8794/20000 [13:30:28<29:51:57,  9.59s/it][2022-12-22 03:29:53,111] [INFO] [timer.py:197:stop] 0/2795, RunningAvgSamplesPerSec=10.948650122349393, CurrSamplesPerSec=10.843692498957584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8795/20000 [13:30:37<29:20:22,  9.43s/it][2022-12-22 03:30:03,824] [INFO] [timer.py:197:stop] 0/2796, RunningAvgSamplesPerSec=10.948669754143763, CurrSamplesPerSec=11.003777437250475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8796/20000 [13:30:48<30:32:18,  9.81s/it][2022-12-22 03:30:13,572] [INFO] [timer.py:197:stop] 0/2797, RunningAvgSamplesPerSec=10.948691913146073, CurrSamplesPerSec=11.010956382395774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8797/20000 [13:30:58<30:28:32,  9.79s/it][2022-12-22 03:30:22,801] [INFO] [timer.py:197:stop] 0/2798, RunningAvgSamplesPerSec=10.948758464560742, CurrSamplesPerSec=11.137985646841873, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8798/20000 [13:31:07<29:56:47,  9.62s/it][2022-12-22 03:30:32,391] [INFO] [timer.py:197:stop] 0/2799, RunningAvgSamplesPerSec=10.948773530998839, CurrSamplesPerSec=10.991062056577004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8799/20000 [13:31:16<29:54:42,  9.61s/it][2022-12-22 03:30:42,451] [INFO] [logging.py:68:log_dist] [Rank 0] step=8800, skipped=18, lr=[5.753333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:30:42,452] [INFO] [timer.py:197:stop] 0/2800, RunningAvgSamplesPerSec=10.948685488577585, CurrSamplesPerSec=10.707849584158305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8800/20000 [13:31:26<30:19:36,  9.75s/it]

                                                          
{'loss': 0.0673, 'learning_rate': 5.753333333333334e-06, 'epoch': 0.44}


 44%|████▍     | 8800/20000 [13:31:26<30:19:36,  9.75s/it][2022-12-22 03:30:52,247] [INFO] [timer.py:197:stop] 0/2801, RunningAvgSamplesPerSec=10.948586335553525, CurrSamplesPerSec=10.678014735543812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8801/20000 [13:31:36<30:22:05,  9.76s/it][2022-12-22 03:31:01,113] [INFO] [timer.py:197:stop] 0/2802, RunningAvgSamplesPerSec=10.948655641020489, CurrSamplesPerSec=11.146141913832105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8802/20000 [13:31:45<29:31:50,  9.49s/it][2022-12-22 03:31:12,260] [INFO] [timer.py:197:stop] 0/2803, RunningAvgSamplesPerSec=10.948747151210624, CurrSamplesPerSec=11.21111802223576, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8803/20000 [13:31:56<31:04:08,  9.99s/it][2022-12-22 03:31:22,084] [INFO] [timer.py:197:stop] 0/2804, RunningAvgSamplesPerSec=10.948659104382367, CurrSamplesPerSec=10.707474573206536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8804/20000 [13:32:06<30:54:44,  9.94s/it][2022-12-22 03:31:31,429] [INFO] [timer.py:197:stop] 0/2805, RunningAvgSamplesPerSec=10.948672451536014, CurrSamplesPerSec=10.98619940723286, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8805/20000 [13:32:15<30:21:16,  9.76s/it][2022-12-22 03:31:40,660] [INFO] [timer.py:197:stop] 0/2806, RunningAvgSamplesPerSec=10.948671200389132, CurrSamplesPerSec=10.945165359033515, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8806/20000 [13:32:25<29:51:28,  9.60s/it][2022-12-22 03:31:51,498] [INFO] [timer.py:197:stop] 0/2807, RunningAvgSamplesPerSec=10.948713957235952, CurrSamplesPerSec=11.069931986232374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8807/20000 [13:32:35<31:00:27,  9.97s/it][2022-12-22 03:32:00,491] [INFO] [timer.py:197:stop] 0/2808, RunningAvgSamplesPerSec=10.948750305757484, CurrSamplesPerSec=11.051666633867368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8808/20000 [13:32:44<30:05:26,  9.68s/it][2022-12-22 03:32:09,873] [INFO] [timer.py:197:stop] 0/2809, RunningAvgSamplesPerSec=10.948688373182895, CurrSamplesPerSec=10.777621786999608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8809/20000 [13:32:54<29:48:40,  9.59s/it][2022-12-22 03:32:20,638] [INFO] [logging.py:68:log_dist] [Rank 0] step=8810, skipped=18, lr=[5.748205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:32:20,639] [INFO] [timer.py:197:stop] 0/2810, RunningAvgSamplesPerSec=10.948675761136435, CurrSamplesPerSec=10.91338788899981, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8810/20000 [13:33:05<30:54:16,  9.94s/it][2022-12-22 03:32:31,415] [INFO] [timer.py:197:stop] 0/2811, RunningAvgSamplesPerSec=10.948626483655158, CurrSamplesPerSec=10.811982863579015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8811/20000 [13:33:15<31:40:46, 10.19s/it][2022-12-22 03:32:41,011] [INFO] [timer.py:197:stop] 0/2812, RunningAvgSamplesPerSec=10.94849407095261, CurrSamplesPerSec=10.588771790946083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8812/20000 [13:33:25<31:07:14, 10.01s/it][2022-12-22 03:32:51,513] [INFO] [timer.py:197:stop] 0/2813, RunningAvgSamplesPerSec=10.94850284187409, CurrSamplesPerSec=10.973204757768455, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8813/20000 [13:33:35<31:34:19, 10.16s/it][2022-12-22 03:33:01,805] [INFO] [timer.py:197:stop] 0/2814, RunningAvgSamplesPerSec=10.94843128164098, CurrSamplesPerSec=10.750905896501514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8814/20000 [13:33:46<31:41:33, 10.20s/it][2022-12-22 03:33:15,462] [INFO] [timer.py:197:stop] 0/2815, RunningAvgSamplesPerSec=10.948530855118427, CurrSamplesPerSec=11.23588290424613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8815/20000 [13:33:59<34:54:43, 11.24s/it][2022-12-22 03:33:25,549] [INFO] [timer.py:197:stop] 0/2816, RunningAvgSamplesPerSec=10.948397038177584, CurrSamplesPerSec=10.584486383283577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8816/20000 [13:34:10<33:50:15, 10.89s/it][2022-12-22 03:33:34,501] [INFO] [timer.py:197:stop] 0/2817, RunningAvgSamplesPerSec=10.948431784674217, CurrSamplesPerSec=11.047089819949225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8817/20000 [13:34:18<32:01:36, 10.31s/it][2022-12-22 03:33:43,757] [INFO] [timer.py:197:stop] 0/2818, RunningAvgSamplesPerSec=10.948450006558755, CurrSamplesPerSec=10.99998614938811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8818/20000 [13:34:28<31:02:30,  9.99s/it][2022-12-22 03:33:53,846] [INFO] [timer.py:197:stop] 0/2819, RunningAvgSamplesPerSec=10.9484144369977, CurrSamplesPerSec=10.849158935472722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8819/20000 [13:34:38<31:07:40, 10.02s/it][2022-12-22 03:34:03,322] [INFO] [logging.py:68:log_dist] [Rank 0] step=8820, skipped=18, lr=[5.743076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:34:03,323] [INFO] [timer.py:197:stop] 0/2820, RunningAvgSamplesPerSec=10.948406555763386, CurrSamplesPerSec=10.92625006410794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8820/20000 [13:34:47<30:36:59,  9.86s/it][2022-12-22 03:34:12,614] [INFO] [timer.py:197:stop] 0/2821, RunningAvgSamplesPerSec=10.948329019230641, CurrSamplesPerSec=10.734107841141793, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8821/20000 [13:34:57<30:05:05,  9.69s/it][2022-12-22 03:34:23,920] [INFO] [timer.py:197:stop] 0/2822, RunningAvgSamplesPerSec=10.94823164959714, CurrSamplesPerSec=10.68046232495049, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8822/20000 [13:35:08<31:35:23, 10.17s/it][2022-12-22 03:34:35,336] [INFO] [timer.py:197:stop] 0/2823, RunningAvgSamplesPerSec=10.948174366990068, CurrSamplesPerSec=10.788987008543957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8823/20000 [13:35:19<32:44:35, 10.55s/it][2022-12-22 03:34:44,894] [INFO] [timer.py:197:stop] 0/2824, RunningAvgSamplesPerSec=10.948193244772568, CurrSamplesPerSec=11.001707867415782, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8824/20000 [13:35:29<31:49:12, 10.25s/it][2022-12-22 03:34:55,103] [INFO] [timer.py:197:stop] 0/2825, RunningAvgSamplesPerSec=10.948161267864908, CurrSamplesPerSec=10.85866039547244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8825/20000 [13:35:39<31:46:46, 10.24s/it]

                                                          
{'loss': 0.0588, 'learning_rate': 5.7405128205128215e-06, 'epoch': 0.44}


 44%|████▍     | 8825/20000 [13:35:39<31:46:46, 10.24s/it][2022-12-22 03:35:05,197] [INFO] [timer.py:197:stop] 0/2826, RunningAvgSamplesPerSec=10.948126110681466, CurrSamplesPerSec=10.849769337452413, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8826/20000 [13:35:49<31:38:34, 10.19s/it][2022-12-22 03:35:14,675] [INFO] [timer.py:197:stop] 0/2827, RunningAvgSamplesPerSec=10.94815746072842, CurrSamplesPerSec=11.037412007899341, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8827/20000 [13:35:59<30:58:21,  9.98s/it][2022-12-22 03:35:23,975] [INFO] [timer.py:197:stop] 0/2828, RunningAvgSamplesPerSec=10.94821718355647, CurrSamplesPerSec=11.119575821845174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8828/20000 [13:36:08<30:20:12,  9.78s/it][2022-12-22 03:35:34,195] [INFO] [timer.py:197:stop] 0/2829, RunningAvgSamplesPerSec=10.94817231149215, CurrSamplesPerSec=10.822816321554203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8829/20000 [13:36:18<30:44:52,  9.91s/it][2022-12-22 03:35:43,047] [INFO] [logging.py:68:log_dist] [Rank 0] step=8830, skipped=18, lr=[5.737948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:35:43,048] [INFO] [timer.py:197:stop] 0/2830, RunningAvgSamplesPerSec=10.948259044125667, CurrSamplesPerSec=11.19907128406301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8830/20000 [13:36:27<29:45:43,  9.59s/it][2022-12-22 03:35:52,274] [INFO] [timer.py:197:stop] 0/2831, RunningAvgSamplesPerSec=10.948340906880214, CurrSamplesPerSec=11.184851677789485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8831/20000 [13:36:36<29:25:08,  9.48s/it][2022-12-22 03:36:01,163] [INFO] [timer.py:197:stop] 0/2832, RunningAvgSamplesPerSec=10.94837797289715, CurrSamplesPerSec=11.054252119045488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8832/20000 [13:36:45<28:51:49,  9.30s/it][2022-12-22 03:36:12,056] [INFO] [timer.py:197:stop] 0/2833, RunningAvgSamplesPerSec=10.948375416127869, CurrSamplesPerSec=10.94114453955543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8833/20000 [13:36:56<30:20:23,  9.78s/it][2022-12-22 03:36:20,899] [INFO] [timer.py:197:stop] 0/2834, RunningAvgSamplesPerSec=10.948461103446759, CurrSamplesPerSec=11.196540442347581, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8834/20000 [13:37:05<29:27:54,  9.50s/it][2022-12-22 03:36:30,416] [INFO] [timer.py:197:stop] 0/2835, RunningAvgSamplesPerSec=10.948546115455141, CurrSamplesPerSec=11.194715190931843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8835/20000 [13:37:14<29:28:41,  9.50s/it][2022-12-22 03:36:40,203] [INFO] [timer.py:197:stop] 0/2836, RunningAvgSamplesPerSec=10.948660928035473, CurrSamplesPerSec=11.283887429757726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8836/20000 [13:37:24<29:44:17,  9.59s/it][2022-12-22 03:36:49,221] [INFO] [timer.py:197:stop] 0/2837, RunningAvgSamplesPerSec=10.948681356336925, CurrSamplesPerSec=11.006883026680006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8837/20000 [13:37:33<29:12:12,  9.42s/it][2022-12-22 03:36:58,287] [INFO] [timer.py:197:stop] 0/2838, RunningAvgSamplesPerSec=10.948648552405034, CurrSamplesPerSec=10.856432972099944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8838/20000 [13:37:42<28:52:23,  9.31s/it][2022-12-22 03:37:09,282] [INFO] [timer.py:197:stop] 0/2839, RunningAvgSamplesPerSec=10.948722993367028, CurrSamplesPerSec=11.163989825641845, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8839/20000 [13:37:53<30:26:10,  9.82s/it][2022-12-22 03:37:18,394] [INFO] [logging.py:68:log_dist] [Rank 0] step=8840, skipped=18, lr=[5.732820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:37:18,395] [INFO] [timer.py:197:stop] 0/2840, RunningAvgSamplesPerSec=10.948757862368456, CurrSamplesPerSec=11.048583473864497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8840/20000 [13:38:02<29:46:41,  9.61s/it][2022-12-22 03:37:27,439] [INFO] [timer.py:197:stop] 0/2841, RunningAvgSamplesPerSec=10.948757240521456, CurrSamplesPerSec=10.946992723250412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8841/20000 [13:38:11<29:15:10,  9.44s/it][2022-12-22 03:37:36,760] [INFO] [timer.py:197:stop] 0/2842, RunningAvgSamplesPerSec=10.94879245916032, CurrSamplesPerSec=11.049699999518388, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8842/20000 [13:38:21<29:08:32,  9.40s/it][2022-12-22 03:37:46,554] [INFO] [timer.py:197:stop] 0/2843, RunningAvgSamplesPerSec=10.948802267781021, CurrSamplesPerSec=10.97672983027531, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8843/20000 [13:38:31<29:30:15,  9.52s/it][2022-12-22 03:37:55,951] [INFO] [timer.py:197:stop] 0/2844, RunningAvgSamplesPerSec=10.948800658460506, CurrSamplesPerSec=10.944230487993169, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8844/20000 [13:38:40<29:23:12,  9.48s/it][2022-12-22 03:38:04,810] [INFO] [timer.py:197:stop] 0/2845, RunningAvgSamplesPerSec=10.948790782933001, CurrSamplesPerSec=10.920796320324209, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8845/20000 [13:38:49<28:48:15,  9.30s/it][2022-12-22 03:38:15,187] [INFO] [timer.py:197:stop] 0/2846, RunningAvgSamplesPerSec=10.948807236280569, CurrSamplesPerSec=10.995784877778988, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8846/20000 [13:38:59<29:48:24,  9.62s/it][2022-12-22 03:38:25,010] [INFO] [timer.py:197:stop] 0/2847, RunningAvgSamplesPerSec=10.948789163337022, CurrSamplesPerSec=10.897629964881302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8847/20000 [13:39:09<29:59:31,  9.68s/it][2022-12-22 03:38:34,303] [INFO] [timer.py:197:stop] 0/2848, RunningAvgSamplesPerSec=10.948873893361528, CurrSamplesPerSec=11.19535949415003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8848/20000 [13:39:18<29:37:47,  9.56s/it][2022-12-22 03:38:43,219] [INFO] [timer.py:197:stop] 0/2849, RunningAvgSamplesPerSec=10.948869023790557, CurrSamplesPerSec=10.935027750893049, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8849/20000 [13:39:27<29:01:25,  9.37s/it][2022-12-22 03:38:53,221] [INFO] [logging.py:68:log_dist] [Rank 0] step=8850, skipped=18, lr=[5.727692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:38:53,221] [INFO] [timer.py:197:stop] 0/2850, RunningAvgSamplesPerSec=10.948943889346323, CurrSamplesPerSec=11.166319242001912, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8850/20000 [13:39:37<29:36:29,  9.56s/it]

                                                          
{'loss': 0.1067, 'learning_rate': 5.727692307692308e-06, 'epoch': 0.44}


 44%|████▍     | 8850/20000 [13:39:37<29:36:29,  9.56s/it][2022-12-22 03:39:02,458] [INFO] [timer.py:197:stop] 0/2851, RunningAvgSamplesPerSec=10.949018502881064, CurrSamplesPerSec=11.165725185654537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8851/20000 [13:39:46<29:18:19,  9.46s/it][2022-12-22 03:39:11,872] [INFO] [timer.py:197:stop] 0/2852, RunningAvgSamplesPerSec=10.948901889051848, CurrSamplesPerSec=10.626456778320774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8852/20000 [13:39:56<29:15:28,  9.45s/it][2022-12-22 03:39:22,072] [INFO] [timer.py:197:stop] 0/2853, RunningAvgSamplesPerSec=10.948858535865327, CurrSamplesPerSec=10.82668119498189, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8853/20000 [13:40:06<29:57:13,  9.67s/it][2022-12-22 03:39:33,237] [INFO] [timer.py:197:stop] 0/2854, RunningAvgSamplesPerSec=10.94893931115492, CurrSamplesPerSec=11.184179226547835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8854/20000 [13:40:17<31:20:07, 10.12s/it][2022-12-22 03:39:42,444] [INFO] [timer.py:197:stop] 0/2855, RunningAvgSamplesPerSec=10.94885828691176, CurrSamplesPerSec=10.72255506307377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8855/20000 [13:40:26<30:29:04,  9.85s/it][2022-12-22 03:39:51,757] [INFO] [timer.py:197:stop] 0/2856, RunningAvgSamplesPerSec=10.94873621443816, CurrSamplesPerSec=10.611203911743996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8856/20000 [13:40:36<29:59:09,  9.69s/it][2022-12-22 03:40:02,364] [INFO] [timer.py:197:stop] 0/2857, RunningAvgSamplesPerSec=10.948691107634195, CurrSamplesPerSec=10.821452881639544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8857/20000 [13:40:46<30:50:16,  9.96s/it][2022-12-22 03:40:11,524] [INFO] [timer.py:197:stop] 0/2858, RunningAvgSamplesPerSec=10.948752405911467, CurrSamplesPerSec=11.126602771484542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8858/20000 [13:40:55<30:05:22,  9.72s/it][2022-12-22 03:40:20,404] [INFO] [timer.py:197:stop] 0/2859, RunningAvgSamplesPerSec=10.948745659838762, CurrSamplesPerSec=10.929512732707002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8859/20000 [13:41:04<29:18:17,  9.47s/it][2022-12-22 03:40:29,859] [INFO] [logging.py:68:log_dist] [Rank 0] step=8860, skipped=18, lr=[5.722564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:40:29,860] [INFO] [timer.py:197:stop] 0/2860, RunningAvgSamplesPerSec=10.948655279371284, CurrSamplesPerSec=10.696389883396458, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8860/20000 [13:41:14<29:17:22,  9.47s/it][2022-12-22 03:40:40,184] [INFO] [timer.py:197:stop] 0/2861, RunningAvgSamplesPerSec=10.948665093186781, CurrSamplesPerSec=10.976785039718528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8861/20000 [13:41:24<30:05:02,  9.72s/it][2022-12-22 03:40:49,914] [INFO] [timer.py:197:stop] 0/2862, RunningAvgSamplesPerSec=10.948710743398632, CurrSamplesPerSec=11.080799815795716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8862/20000 [13:41:34<30:05:17,  9.73s/it][2022-12-22 03:40:58,990] [INFO] [timer.py:197:stop] 0/2863, RunningAvgSamplesPerSec=10.948713475121522, CurrSamplesPerSec=10.956531783480019, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8863/20000 [13:41:43<29:28:59,  9.53s/it][2022-12-22 03:41:12,313] [INFO] [timer.py:197:stop] 0/2864, RunningAvgSamplesPerSec=10.948722456252694, CurrSamplesPerSec=10.974477937937385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8864/20000 [13:41:56<33:00:01, 10.67s/it][2022-12-22 03:41:21,607] [INFO] [timer.py:197:stop] 0/2865, RunningAvgSamplesPerSec=10.94876097520359, CurrSamplesPerSec=11.060123899052206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8865/20000 [13:42:06<31:43:21, 10.26s/it][2022-12-22 03:41:31,015] [INFO] [timer.py:197:stop] 0/2866, RunningAvgSamplesPerSec=10.94872682743532, CurrSamplesPerSec=10.851827319133251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8866/20000 [13:42:15<30:55:57, 10.00s/it][2022-12-22 03:41:40,051] [INFO] [timer.py:197:stop] 0/2867, RunningAvgSamplesPerSec=10.948826963369406, CurrSamplesPerSec=11.243333152670747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8867/20000 [13:42:24<30:02:01,  9.71s/it][2022-12-22 03:41:50,040] [INFO] [timer.py:197:stop] 0/2868, RunningAvgSamplesPerSec=10.948767923883912, CurrSamplesPerSec=10.782194104388942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8868/20000 [13:42:34<30:17:19,  9.80s/it][2022-12-22 03:41:59,511] [INFO] [timer.py:197:stop] 0/2869, RunningAvgSamplesPerSec=10.948795487869624, CurrSamplesPerSec=11.028368208953893, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8869/20000 [13:42:43<29:59:04,  9.70s/it][2022-12-22 03:42:09,402] [INFO] [logging.py:68:log_dist] [Rank 0] step=8870, skipped=18, lr=[5.717435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:42:09,403] [INFO] [timer.py:197:stop] 0/2870, RunningAvgSamplesPerSec=10.948822471905691, CurrSamplesPerSec=11.026736427167654, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8870/20000 [13:42:53<30:09:44,  9.76s/it][2022-12-22 03:42:19,321] [INFO] [timer.py:197:stop] 0/2871, RunningAvgSamplesPerSec=10.948780601369883, CurrSamplesPerSec=10.829999137426237, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8871/20000 [13:43:03<30:18:35,  9.80s/it][2022-12-22 03:42:30,117] [INFO] [timer.py:197:stop] 0/2872, RunningAvgSamplesPerSec=10.948739282210656, CurrSamplesPerSec=10.831464816188818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8872/20000 [13:43:14<31:13:34, 10.10s/it][2022-12-22 03:42:38,984] [INFO] [timer.py:197:stop] 0/2873, RunningAvgSamplesPerSec=10.948769821986561, CurrSamplesPerSec=11.037126555272748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8873/20000 [13:43:23<30:04:44,  9.73s/it][2022-12-22 03:42:49,255] [INFO] [timer.py:197:stop] 0/2874, RunningAvgSamplesPerSec=10.94861450460935, CurrSamplesPerSec=10.52015474185269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8874/20000 [13:43:33<30:34:34,  9.89s/it][2022-12-22 03:42:59,863] [INFO] [timer.py:197:stop] 0/2875, RunningAvgSamplesPerSec=10.94870057743101, CurrSamplesPerSec=11.20161402116625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8875/20000 [13:43:44<31:14:07, 10.11s/it]

                                                          
{'loss': 0.0759, 'learning_rate': 5.714871794871796e-06, 'epoch': 0.44}


 44%|████▍     | 8875/20000 [13:43:44<31:14:07, 10.11s/it][2022-12-22 03:43:08,843] [INFO] [timer.py:197:stop] 0/2876, RunningAvgSamplesPerSec=10.948681075411475, CurrSamplesPerSec=10.892937139254624, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8876/20000 [13:43:53<30:11:14,  9.77s/it][2022-12-22 03:43:19,943] [INFO] [timer.py:197:stop] 0/2877, RunningAvgSamplesPerSec=10.948671369316886, CurrSamplesPerSec=10.920846969875422, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8877/20000 [13:44:04<31:25:05, 10.17s/it][2022-12-22 03:43:29,851] [INFO] [timer.py:197:stop] 0/2878, RunningAvgSamplesPerSec=10.948675831440355, CurrSamplesPerSec=10.961519490613112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8878/20000 [13:44:14<31:10:26, 10.09s/it][2022-12-22 03:43:40,433] [INFO] [timer.py:197:stop] 0/2879, RunningAvgSamplesPerSec=10.94859469831212, CurrSamplesPerSec=10.720126675672141, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8879/20000 [13:44:24<31:37:35, 10.24s/it][2022-12-22 03:43:50,644] [INFO] [logging.py:68:log_dist] [Rank 0] step=8880, skipped=18, lr=[5.712307692307692e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:43:50,645] [INFO] [timer.py:197:stop] 0/2880, RunningAvgSamplesPerSec=10.94866292483608, CurrSamplesPerSec=11.148535191243559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8880/20000 [13:44:35<31:35:57, 10.23s/it][2022-12-22 03:44:00,322] [INFO] [timer.py:197:stop] 0/2881, RunningAvgSamplesPerSec=10.948531845377481, CurrSamplesPerSec=10.583854971448263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8881/20000 [13:44:44<31:05:04, 10.06s/it][2022-12-22 03:44:09,274] [INFO] [timer.py:197:stop] 0/2882, RunningAvgSamplesPerSec=10.948611598387517, CurrSamplesPerSec=11.183140650996117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8882/20000 [13:44:53<30:03:05,  9.73s/it][2022-12-22 03:44:19,184] [INFO] [timer.py:197:stop] 0/2883, RunningAvgSamplesPerSec=10.94858087045964, CurrSamplesPerSec=10.860794256159348, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8883/20000 [13:45:03<30:12:52,  9.78s/it][2022-12-22 03:44:29,008] [INFO] [timer.py:197:stop] 0/2884, RunningAvgSamplesPerSec=10.948577249988098, CurrSamplesPerSec=10.938156602548768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8884/20000 [13:45:13<30:14:54,  9.80s/it][2022-12-22 03:44:38,268] [INFO] [timer.py:197:stop] 0/2885, RunningAvgSamplesPerSec=10.948652891283675, CurrSamplesPerSec=11.171081407616706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8885/20000 [13:45:22<29:44:58,  9.64s/it][2022-12-22 03:44:48,277] [INFO] [timer.py:197:stop] 0/2886, RunningAvgSamplesPerSec=10.948579096026709, CurrSamplesPerSec=10.739884117393354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8886/20000 [13:45:32<30:05:32,  9.75s/it][2022-12-22 03:44:58,258] [INFO] [timer.py:197:stop] 0/2887, RunningAvgSamplesPerSec=10.948603161178873, CurrSamplesPerSec=11.018449976995251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8887/20000 [13:45:42<30:18:23,  9.82s/it][2022-12-22 03:45:07,306] [INFO] [timer.py:197:stop] 0/2888, RunningAvgSamplesPerSec=10.948637145488224, CurrSamplesPerSec=11.04756810899464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8888/20000 [13:45:51<29:35:26,  9.59s/it][2022-12-22 03:45:16,776] [INFO] [timer.py:197:stop] 0/2889, RunningAvgSamplesPerSec=10.948490444233128, CurrSamplesPerSec=10.540878500732168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8889/20000 [13:46:01<29:28:47,  9.55s/it][2022-12-22 03:45:27,274] [INFO] [logging.py:68:log_dist] [Rank 0] step=8890, skipped=18, lr=[5.707179487179487e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:45:27,275] [INFO] [timer.py:197:stop] 0/2890, RunningAvgSamplesPerSec=10.94836768877661, CurrSamplesPerSec=10.605088371503909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8890/20000 [13:46:11<30:21:16,  9.84s/it][2022-12-22 03:45:36,174] [INFO] [timer.py:197:stop] 0/2891, RunningAvgSamplesPerSec=10.94836685280357, CurrSamplesPerSec=10.945953095120124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8891/20000 [13:46:20<29:29:05,  9.55s/it][2022-12-22 03:45:45,418] [INFO] [timer.py:197:stop] 0/2892, RunningAvgSamplesPerSec=10.948378645805656, CurrSamplesPerSec=10.98255501823788, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8892/20000 [13:46:29<29:11:39,  9.46s/it][2022-12-22 03:45:55,354] [INFO] [timer.py:197:stop] 0/2893, RunningAvgSamplesPerSec=10.948390713025345, CurrSamplesPerSec=10.983376457713572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8893/20000 [13:46:39<29:37:50,  9.60s/it][2022-12-22 03:46:05,366] [INFO] [timer.py:197:stop] 0/2894, RunningAvgSamplesPerSec=10.94839922661794, CurrSamplesPerSec=10.973067498056974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8894/20000 [13:46:49<30:00:20,  9.73s/it][2022-12-22 03:46:14,362] [INFO] [timer.py:197:stop] 0/2895, RunningAvgSamplesPerSec=10.948324962057015, CurrSamplesPerSec=10.737685393612592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8895/20000 [13:46:58<29:19:35,  9.51s/it][2022-12-22 03:46:24,696] [INFO] [timer.py:197:stop] 0/2896, RunningAvgSamplesPerSec=10.948351196610199, CurrSamplesPerSec=11.02477774905581, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8896/20000 [13:47:09<30:05:22,  9.76s/it][2022-12-22 03:46:34,620] [INFO] [timer.py:197:stop] 0/2897, RunningAvgSamplesPerSec=10.94826807090733, CurrSamplesPerSec=10.712876325882561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8897/20000 [13:47:19<30:14:35,  9.81s/it][2022-12-22 03:46:44,393] [INFO] [timer.py:197:stop] 0/2898, RunningAvgSamplesPerSec=10.948159017990163, CurrSamplesPerSec=10.641302589792168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8898/20000 [13:47:28<30:12:34,  9.80s/it][2022-12-22 03:46:55,431] [INFO] [timer.py:197:stop] 0/2899, RunningAvgSamplesPerSec=10.948133389964514, CurrSamplesPerSec=10.874414549470815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8899/20000 [13:47:39<31:21:20, 10.17s/it][2022-12-22 03:47:08,188] [INFO] [logging.py:68:log_dist] [Rank 0] step=8900, skipped=18, lr=[5.702051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:47:08,189] [INFO] [timer.py:197:stop] 0/2900, RunningAvgSamplesPerSec=10.94818856545195, CurrSamplesPerSec=11.11040107016612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 44%|████▍     | 8900/20000 [13:47:52<33:44:53, 10.95s/it]

                                                          
{'loss': 0.0631, 'learning_rate': 5.702051282051283e-06, 'epoch': 0.45}


 44%|████▍     | 8900/20000 [13:47:52<33:44:53, 10.95s/it][2022-12-22 03:47:19,853] [INFO] [timer.py:197:stop] 0/2901, RunningAvgSamplesPerSec=10.948244417967585, CurrSamplesPerSec=11.11253474071307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8901/20000 [13:48:04<34:24:38, 11.16s/it][2022-12-22 03:47:29,801] [INFO] [timer.py:197:stop] 0/2902, RunningAvgSamplesPerSec=10.94830180556157, CurrSamplesPerSec=11.117236398093588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8902/20000 [13:48:14<33:17:09, 10.80s/it][2022-12-22 03:47:38,967] [INFO] [timer.py:197:stop] 0/2903, RunningAvgSamplesPerSec=10.948358280203848, CurrSamplesPerSec=11.114622750217604, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8903/20000 [13:48:23<31:46:24, 10.31s/it][2022-12-22 03:47:48,173] [INFO] [timer.py:197:stop] 0/2904, RunningAvgSamplesPerSec=10.948327725927285, CurrSamplesPerSec=10.860401865136884, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8904/20000 [13:48:32<30:45:06,  9.98s/it][2022-12-22 03:47:57,448] [INFO] [timer.py:197:stop] 0/2905, RunningAvgSamplesPerSec=10.948332696874365, CurrSamplesPerSec=10.962777424447792, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8905/20000 [13:48:41<30:05:59,  9.77s/it][2022-12-22 03:48:06,200] [INFO] [timer.py:197:stop] 0/2906, RunningAvgSamplesPerSec=10.94840271312267, CurrSamplesPerSec=11.155506081815245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8906/20000 [13:48:50<29:09:33,  9.46s/it][2022-12-22 03:48:17,612] [INFO] [timer.py:197:stop] 0/2907, RunningAvgSamplesPerSec=10.948354851944265, CurrSamplesPerSec=10.811108920624763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8907/20000 [13:49:02<30:57:31, 10.05s/it][2022-12-22 03:48:27,007] [INFO] [timer.py:197:stop] 0/2908, RunningAvgSamplesPerSec=10.948469007703624, CurrSamplesPerSec=11.290453558874798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8908/20000 [13:49:11<30:21:11,  9.85s/it][2022-12-22 03:48:35,994] [INFO] [timer.py:197:stop] 0/2909, RunningAvgSamplesPerSec=10.948499450931024, CurrSamplesPerSec=11.037688398199696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8909/20000 [13:49:20<29:33:07,  9.59s/it][2022-12-22 03:48:45,526] [INFO] [logging.py:68:log_dist] [Rank 0] step=8910, skipped=18, lr=[5.696923076923078e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:48:45,526] [INFO] [timer.py:197:stop] 0/2910, RunningAvgSamplesPerSec=10.948448767274279, CurrSamplesPerSec=10.803068487196695, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8910/20000 [13:49:29<29:29:37,  9.57s/it][2022-12-22 03:48:54,980] [INFO] [timer.py:197:stop] 0/2911, RunningAvgSamplesPerSec=10.948391205764597, CurrSamplesPerSec=10.783523843203046, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8911/20000 [13:49:39<29:22:48,  9.54s/it][2022-12-22 03:49:04,139] [INFO] [timer.py:197:stop] 0/2912, RunningAvgSamplesPerSec=10.948423666550983, CurrSamplesPerSec=11.043673894750986, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8912/20000 [13:49:48<29:01:35,  9.42s/it][2022-12-22 03:49:14,264] [INFO] [timer.py:197:stop] 0/2913, RunningAvgSamplesPerSec=10.948380509448207, CurrSamplesPerSec=10.824218077734074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8913/20000 [13:49:58<29:40:17,  9.63s/it][2022-12-22 03:49:23,345] [INFO] [timer.py:197:stop] 0/2914, RunningAvgSamplesPerSec=10.948411281157364, CurrSamplesPerSec=11.038726914363705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8914/20000 [13:50:07<29:09:28,  9.47s/it][2022-12-22 03:49:32,545] [INFO] [timer.py:197:stop] 0/2915, RunningAvgSamplesPerSec=10.948437593141822, CurrSamplesPerSec=11.02559827123053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8915/20000 [13:50:17<28:54:26,  9.39s/it][2022-12-22 03:49:42,889] [INFO] [timer.py:197:stop] 0/2916, RunningAvgSamplesPerSec=10.948416475643617, CurrSamplesPerSec=10.887245022075394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8916/20000 [13:50:27<29:47:15,  9.67s/it][2022-12-22 03:49:51,841] [INFO] [timer.py:197:stop] 0/2917, RunningAvgSamplesPerSec=10.948444362817442, CurrSamplesPerSec=11.030315472198277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8917/20000 [13:50:36<29:07:00,  9.46s/it][2022-12-22 03:50:01,630] [INFO] [timer.py:197:stop] 0/2918, RunningAvgSamplesPerSec=10.948429454697752, CurrSamplesPerSec=10.905144155373065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8918/20000 [13:50:46<29:25:12,  9.56s/it][2022-12-22 03:50:11,140] [INFO] [timer.py:197:stop] 0/2919, RunningAvgSamplesPerSec=10.948393866219359, CurrSamplesPerSec=10.845592614561339, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8919/20000 [13:50:55<29:22:27,  9.54s/it][2022-12-22 03:50:21,548] [INFO] [logging.py:68:log_dist] [Rank 0] step=8920, skipped=18, lr=[5.691794871794873e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:50:21,549] [INFO] [timer.py:197:stop] 0/2920, RunningAvgSamplesPerSec=10.948406086697146, CurrSamplesPerSec=10.984169703793535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8920/20000 [13:51:06<30:10:16,  9.80s/it][2022-12-22 03:50:31,059] [INFO] [timer.py:197:stop] 0/2921, RunningAvgSamplesPerSec=10.948418555526107, CurrSamplesPerSec=10.98492395561351, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8921/20000 [13:51:15<29:53:53,  9.72s/it][2022-12-22 03:50:40,001] [INFO] [timer.py:197:stop] 0/2922, RunningAvgSamplesPerSec=10.9484353812676, CurrSamplesPerSec=10.99777111507217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8922/20000 [13:51:24<29:10:52,  9.48s/it][2022-12-22 03:50:49,287] [INFO] [timer.py:197:stop] 0/2923, RunningAvgSamplesPerSec=10.948535896451528, CurrSamplesPerSec=11.250127972162376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8923/20000 [13:51:33<28:59:50,  9.42s/it][2022-12-22 03:50:58,860] [INFO] [timer.py:197:stop] 0/2924, RunningAvgSamplesPerSec=10.948505903534276, CurrSamplesPerSec=10.861592307900846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8924/20000 [13:51:43<29:07:53,  9.47s/it][2022-12-22 03:51:08,537] [INFO] [timer.py:197:stop] 0/2925, RunningAvgSamplesPerSec=10.948382209880448, CurrSamplesPerSec=10.598503652625043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8925/20000 [13:51:52<29:19:17,  9.53s/it]

                                                          
{'loss': 0.0695, 'learning_rate': 5.6892307692307705e-06, 'epoch': 0.45}


 45%|████▍     | 8925/20000 [13:51:53<29:19:17,  9.53s/it][2022-12-22 03:51:17,720] [INFO] [timer.py:197:stop] 0/2926, RunningAvgSamplesPerSec=10.948385282961214, CurrSamplesPerSec=10.957375276413694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8926/20000 [13:52:02<28:59:50,  9.43s/it][2022-12-22 03:51:28,640] [INFO] [timer.py:197:stop] 0/2927, RunningAvgSamplesPerSec=10.948309827406014, CurrSamplesPerSec=10.732037625616021, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8927/20000 [13:52:13<30:22:21,  9.87s/it][2022-12-22 03:51:37,829] [INFO] [timer.py:197:stop] 0/2928, RunningAvgSamplesPerSec=10.948334661976018, CurrSamplesPerSec=11.021461132001722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8928/20000 [13:52:22<29:44:17,  9.67s/it][2022-12-22 03:51:48,072] [INFO] [timer.py:197:stop] 0/2929, RunningAvgSamplesPerSec=10.948359382204597, CurrSamplesPerSec=11.021171978848713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8929/20000 [13:52:32<30:15:50,  9.84s/it][2022-12-22 03:51:57,874] [INFO] [logging.py:68:log_dist] [Rank 0] step=8930, skipped=18, lr=[5.686666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:51:57,875] [INFO] [timer.py:197:stop] 0/2930, RunningAvgSamplesPerSec=10.948228368862795, CurrSamplesPerSec=10.577733808659017, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8930/20000 [13:52:42<30:13:37,  9.83s/it][2022-12-22 03:52:07,288] [INFO] [timer.py:197:stop] 0/2931, RunningAvgSamplesPerSec=10.948193447697227, CurrSamplesPerSec=10.8468907013411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8931/20000 [13:52:51<29:50:19,  9.70s/it][2022-12-22 03:52:16,670] [INFO] [timer.py:197:stop] 0/2932, RunningAvgSamplesPerSec=10.94826021058987, CurrSamplesPerSec=11.147366199130197, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8932/20000 [13:53:01<29:32:19,  9.61s/it][2022-12-22 03:52:26,706] [INFO] [timer.py:197:stop] 0/2933, RunningAvgSamplesPerSec=10.948303354446999, CurrSamplesPerSec=11.07619198991754, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8933/20000 [13:53:11<29:55:53,  9.74s/it][2022-12-22 03:52:35,496] [INFO] [timer.py:197:stop] 0/2934, RunningAvgSamplesPerSec=10.94840122156157, CurrSamplesPerSec=11.242970082446073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8934/20000 [13:53:19<29:03:19,  9.45s/it][2022-12-22 03:52:45,004] [INFO] [timer.py:197:stop] 0/2935, RunningAvgSamplesPerSec=10.948483280759733, CurrSamplesPerSec=11.194488768644192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8935/20000 [13:53:29<29:06:16,  9.47s/it][2022-12-22 03:52:54,864] [INFO] [timer.py:197:stop] 0/2936, RunningAvgSamplesPerSec=10.948483105669863, CurrSamplesPerSec=10.947969591177527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8936/20000 [13:53:39<29:27:44,  9.59s/it][2022-12-22 03:53:03,636] [INFO] [timer.py:197:stop] 0/2937, RunningAvgSamplesPerSec=10.948551211564109, CurrSamplesPerSec=11.1520899700242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8937/20000 [13:53:48<28:42:29,  9.34s/it][2022-12-22 03:53:13,057] [INFO] [timer.py:197:stop] 0/2938, RunningAvgSamplesPerSec=10.948554409299085, CurrSamplesPerSec=10.957947816441715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8938/20000 [13:53:57<28:46:42,  9.37s/it][2022-12-22 03:53:22,502] [INFO] [timer.py:197:stop] 0/2939, RunningAvgSamplesPerSec=10.94856141980189, CurrSamplesPerSec=10.9691830370179, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8939/20000 [13:54:06<28:50:56,  9.39s/it][2022-12-22 03:53:31,742] [INFO] [logging.py:68:log_dist] [Rank 0] step=8940, skipped=18, lr=[5.681538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:53:31,743] [INFO] [timer.py:197:stop] 0/2940, RunningAvgSamplesPerSec=10.948635548251426, CurrSamplesPerSec=11.170769474885464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8940/20000 [13:54:16<28:42:34,  9.34s/it][2022-12-22 03:53:41,137] [INFO] [timer.py:197:stop] 0/2941, RunningAvgSamplesPerSec=10.948680607056696, CurrSamplesPerSec=11.08268419360114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8941/20000 [13:54:25<28:45:10,  9.36s/it][2022-12-22 03:53:50,463] [INFO] [timer.py:197:stop] 0/2942, RunningAvgSamplesPerSec=10.9487694531565, CurrSamplesPerSec=11.216269967201757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8942/20000 [13:54:34<28:43:06,  9.35s/it][2022-12-22 03:54:00,616] [INFO] [timer.py:197:stop] 0/2943, RunningAvgSamplesPerSec=10.94869171732604, CurrSamplesPerSec=10.72482300785957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8943/20000 [13:54:45<29:27:23,  9.59s/it][2022-12-22 03:54:10,677] [INFO] [timer.py:197:stop] 0/2944, RunningAvgSamplesPerSec=10.948664111856726, CurrSamplesPerSec=10.868074228373507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8944/20000 [13:54:55<29:53:18,  9.73s/it][2022-12-22 03:54:20,066] [INFO] [timer.py:197:stop] 0/2945, RunningAvgSamplesPerSec=10.948734218488855, CurrSamplesPerSec=11.15894933662282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8945/20000 [13:55:04<29:34:08,  9.63s/it][2022-12-22 03:54:29,392] [INFO] [timer.py:197:stop] 0/2946, RunningAvgSamplesPerSec=10.948821691622195, CurrSamplesPerSec=11.212455911086778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8946/20000 [13:55:13<29:17:13,  9.54s/it][2022-12-22 03:54:38,594] [INFO] [timer.py:197:stop] 0/2947, RunningAvgSamplesPerSec=10.948847426376396, CurrSamplesPerSec=11.025138636975887, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8947/20000 [13:55:23<28:58:30,  9.44s/it][2022-12-22 03:54:47,486] [INFO] [timer.py:197:stop] 0/2948, RunningAvgSamplesPerSec=10.948869875078836, CurrSamplesPerSec=11.01538305982352, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8948/20000 [13:55:31<28:28:10,  9.27s/it][2022-12-22 03:54:57,045] [INFO] [timer.py:197:stop] 0/2949, RunningAvgSamplesPerSec=10.94879985467315, CurrSamplesPerSec=10.746335549238758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8949/20000 [13:55:41<28:43:50,  9.36s/it][2022-12-22 03:55:06,672] [INFO] [logging.py:68:log_dist] [Rank 0] step=8950, skipped=18, lr=[5.6764102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:55:06,673] [INFO] [timer.py:197:stop] 0/2950, RunningAvgSamplesPerSec=10.948815569254016, CurrSamplesPerSec=10.9953232220578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8950/20000 [13:55:51<28:58:30,  9.44s/it]

                                                          
{'loss': 0.0923, 'learning_rate': 5.6764102564102565e-06, 'epoch': 0.45}


 45%|████▍     | 8950/20000 [13:55:51<28:58:30,  9.44s/it][2022-12-22 03:55:15,772] [INFO] [timer.py:197:stop] 0/2951, RunningAvgSamplesPerSec=10.948851043912146, CurrSamplesPerSec=11.054439216562864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8951/20000 [13:56:00<28:39:30,  9.34s/it][2022-12-22 03:55:24,894] [INFO] [timer.py:197:stop] 0/2952, RunningAvgSamplesPerSec=10.948926284333158, CurrSamplesPerSec=11.1754014442923, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8952/20000 [13:56:09<28:27:28,  9.27s/it][2022-12-22 03:55:34,614] [INFO] [timer.py:197:stop] 0/2953, RunningAvgSamplesPerSec=10.949009179728261, CurrSamplesPerSec=11.199139031796264, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8953/20000 [13:56:19<28:51:58,  9.41s/it][2022-12-22 03:55:44,909] [INFO] [timer.py:197:stop] 0/2954, RunningAvgSamplesPerSec=10.949105808629167, CurrSamplesPerSec=11.241885249667343, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8954/20000 [13:56:29<29:40:53,  9.67s/it][2022-12-22 03:55:53,934] [INFO] [timer.py:197:stop] 0/2955, RunningAvgSamplesPerSec=10.949097007871515, CurrSamplesPerSec=10.923178690667791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8955/20000 [13:56:38<29:04:54,  9.48s/it][2022-12-22 03:56:03,391] [INFO] [timer.py:197:stop] 0/2956, RunningAvgSamplesPerSec=10.949098704503216, CurrSamplesPerSec=10.954111152321893, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8956/20000 [13:56:47<29:03:30,  9.47s/it][2022-12-22 03:56:13,465] [INFO] [timer.py:197:stop] 0/2957, RunningAvgSamplesPerSec=10.948979308067631, CurrSamplesPerSec=10.607292641087895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8957/20000 [13:56:57<29:36:40,  9.65s/it][2022-12-22 03:56:22,716] [INFO] [timer.py:197:stop] 0/2958, RunningAvgSamplesPerSec=10.948962995203697, CurrSamplesPerSec=10.900969851063445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8958/20000 [13:57:07<29:14:14,  9.53s/it][2022-12-22 03:56:31,780] [INFO] [timer.py:197:stop] 0/2959, RunningAvgSamplesPerSec=10.94896319929603, CurrSamplesPerSec=10.94956652949156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8959/20000 [13:57:16<28:48:13,  9.39s/it][2022-12-22 03:56:41,828] [INFO] [logging.py:68:log_dist] [Rank 0] step=8960, skipped=18, lr=[5.671282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:56:41,829] [INFO] [timer.py:197:stop] 0/2960, RunningAvgSamplesPerSec=10.948985143235902, CurrSamplesPerSec=11.01426035224237, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8960/20000 [13:57:26<29:24:21,  9.59s/it][2022-12-22 03:56:50,831] [INFO] [timer.py:197:stop] 0/2961, RunningAvgSamplesPerSec=10.948932699978272, CurrSamplesPerSec=10.795973440747929, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8961/20000 [13:57:35<28:51:49,  9.41s/it][2022-12-22 03:57:01,132] [INFO] [timer.py:197:stop] 0/2962, RunningAvgSamplesPerSec=10.948837902244804, CurrSamplesPerSec=10.675340706776467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8962/20000 [13:57:45<29:40:39,  9.68s/it][2022-12-22 03:57:12,497] [INFO] [timer.py:197:stop] 0/2963, RunningAvgSamplesPerSec=10.948804882124975, CurrSamplesPerSec=10.851930414193873, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8963/20000 [13:57:56<31:13:31, 10.18s/it][2022-12-22 03:57:21,530] [INFO] [timer.py:197:stop] 0/2964, RunningAvgSamplesPerSec=10.948828103940485, CurrSamplesPerSec=11.01802259512728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8964/20000 [13:58:05<30:09:48,  9.84s/it][2022-12-22 03:57:30,588] [INFO] [timer.py:197:stop] 0/2965, RunningAvgSamplesPerSec=10.948835985028015, CurrSamplesPerSec=10.97222966028962, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8965/20000 [13:58:15<29:26:31,  9.60s/it][2022-12-22 03:57:40,361] [INFO] [timer.py:197:stop] 0/2966, RunningAvgSamplesPerSec=10.948905965539774, CurrSamplesPerSec=11.160262274760546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8966/20000 [13:58:24<29:35:35,  9.66s/it][2022-12-22 03:57:49,673] [INFO] [timer.py:197:stop] 0/2967, RunningAvgSamplesPerSec=10.948858143790378, CurrSamplesPerSec=10.808926639792341, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8967/20000 [13:58:34<29:16:30,  9.55s/it][2022-12-22 03:57:58,599] [INFO] [timer.py:197:stop] 0/2968, RunningAvgSamplesPerSec=10.948879788607492, CurrSamplesPerSec=11.013435190597114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8968/20000 [13:58:43<28:41:48,  9.36s/it][2022-12-22 03:58:07,741] [INFO] [timer.py:197:stop] 0/2969, RunningAvgSamplesPerSec=10.948717842930359, CurrSamplesPerSec=10.488580444835243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8969/20000 [13:58:52<28:29:22,  9.30s/it][2022-12-22 03:58:17,290] [INFO] [logging.py:68:log_dist] [Rank 0] step=8970, skipped=18, lr=[5.666153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:58:17,291] [INFO] [timer.py:197:stop] 0/2970, RunningAvgSamplesPerSec=10.94867536781878, CurrSamplesPerSec=10.824086265766542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8970/20000 [13:59:01<28:43:07,  9.37s/it][2022-12-22 03:58:27,148] [INFO] [timer.py:197:stop] 0/2971, RunningAvgSamplesPerSec=10.948756384197994, CurrSamplesPerSec=11.19461435018384, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8971/20000 [13:59:11<29:09:39,  9.52s/it][2022-12-22 03:58:39,775] [INFO] [timer.py:197:stop] 0/2972, RunningAvgSamplesPerSec=10.948759016559226, CurrSamplesPerSec=10.956580081796965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8972/20000 [13:59:24<32:00:53, 10.45s/it][2022-12-22 03:58:49,944] [INFO] [timer.py:197:stop] 0/2973, RunningAvgSamplesPerSec=10.94863313342665, CurrSamplesPerSec=10.587109656333936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8973/20000 [13:59:34<31:45:12, 10.37s/it][2022-12-22 03:59:00,476] [INFO] [timer.py:197:stop] 0/2974, RunningAvgSamplesPerSec=10.948673333001711, CurrSamplesPerSec=11.069423914236657, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8974/20000 [13:59:44<31:54:08, 10.42s/it][2022-12-22 03:59:09,908] [INFO] [timer.py:197:stop] 0/2975, RunningAvgSamplesPerSec=10.948635257933608, CurrSamplesPerSec=10.836634127416978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8975/20000 [13:59:54<30:59:43, 10.12s/it]

                                                          
{'loss': 0.0774, 'learning_rate': 5.663589743589743e-06, 'epoch': 0.45}


 45%|████▍     | 8975/20000 [13:59:54<30:59:43, 10.12s/it][2022-12-22 03:59:18,987] [INFO] [timer.py:197:stop] 0/2976, RunningAvgSamplesPerSec=10.948637877272429, CurrSamplesPerSec=10.95643071615756, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8976/20000 [14:00:03<30:02:05,  9.81s/it][2022-12-22 03:59:27,795] [INFO] [timer.py:197:stop] 0/2977, RunningAvgSamplesPerSec=10.948686807071017, CurrSamplesPerSec=11.096164793154752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8977/20000 [14:00:12<29:06:49,  9.51s/it][2022-12-22 03:59:40,360] [INFO] [timer.py:197:stop] 0/2978, RunningAvgSamplesPerSec=10.948769359674328, CurrSamplesPerSec=11.200000667572061, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8978/20000 [14:00:24<31:55:07, 10.43s/it][2022-12-22 03:59:49,992] [INFO] [timer.py:197:stop] 0/2979, RunningAvgSamplesPerSec=10.948762712406426, CurrSamplesPerSec=10.929016133315082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8979/20000 [14:00:34<31:11:15, 10.19s/it][2022-12-22 03:59:59,092] [INFO] [logging.py:68:log_dist] [Rank 0] step=8980, skipped=18, lr=[5.661025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 03:59:59,092] [INFO] [timer.py:197:stop] 0/2980, RunningAvgSamplesPerSec=10.948769685368424, CurrSamplesPerSec=10.969567638720957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8980/20000 [14:00:43<30:11:09,  9.86s/it][2022-12-22 04:00:10,273] [INFO] [timer.py:197:stop] 0/2981, RunningAvgSamplesPerSec=10.948748310886657, CurrSamplesPerSec=10.885463151369786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8981/20000 [14:00:54<31:23:42, 10.26s/it][2022-12-22 04:00:19,700] [INFO] [timer.py:197:stop] 0/2982, RunningAvgSamplesPerSec=10.94871830271093, CurrSamplesPerSec=10.860048166285996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8982/20000 [14:01:04<30:37:47, 10.01s/it][2022-12-22 04:00:29,208] [INFO] [timer.py:197:stop] 0/2983, RunningAvgSamplesPerSec=10.948694048269733, CurrSamplesPerSec=10.87688998988672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8983/20000 [14:01:13<30:10:06,  9.86s/it][2022-12-22 04:00:38,413] [INFO] [timer.py:197:stop] 0/2984, RunningAvgSamplesPerSec=10.948640509482201, CurrSamplesPerSec=10.79133520390598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8984/20000 [14:01:22<29:33:58,  9.66s/it][2022-12-22 04:00:47,814] [INFO] [timer.py:197:stop] 0/2985, RunningAvgSamplesPerSec=10.948596760703476, CurrSamplesPerSec=10.819674599751115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8985/20000 [14:01:32<29:19:27,  9.58s/it][2022-12-22 04:00:57,420] [INFO] [timer.py:197:stop] 0/2986, RunningAvgSamplesPerSec=10.948527090519747, CurrSamplesPerSec=10.744573696298787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8986/20000 [14:01:41<29:20:29,  9.59s/it][2022-12-22 04:01:06,577] [INFO] [timer.py:197:stop] 0/2987, RunningAvgSamplesPerSec=10.948537588525582, CurrSamplesPerSec=10.979953555695474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8987/20000 [14:01:51<28:56:26,  9.46s/it][2022-12-22 04:01:15,689] [INFO] [timer.py:197:stop] 0/2988, RunningAvgSamplesPerSec=10.94860089074441, CurrSamplesPerSec=11.140877544476485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8988/20000 [14:02:00<28:37:06,  9.36s/it][2022-12-22 04:01:24,757] [INFO] [timer.py:197:stop] 0/2989, RunningAvgSamplesPerSec=10.948487712423587, CurrSamplesPerSec=10.620659804031186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8989/20000 [14:02:09<28:21:05,  9.27s/it][2022-12-22 04:01:33,579] [INFO] [logging.py:68:log_dist] [Rank 0] step=8990, skipped=18, lr=[5.655897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:01:33,580] [INFO] [timer.py:197:stop] 0/2990, RunningAvgSamplesPerSec=10.948563816500743, CurrSamplesPerSec=11.180708278454164, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8990/20000 [14:02:18<27:56:21,  9.14s/it][2022-12-22 04:01:43,264] [INFO] [timer.py:197:stop] 0/2991, RunningAvgSamplesPerSec=10.948622363440627, CurrSamplesPerSec=11.126402154954144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8991/20000 [14:02:27<28:26:25,  9.30s/it][2022-12-22 04:01:52,260] [INFO] [timer.py:197:stop] 0/2992, RunningAvgSamplesPerSec=10.94862834690912, CurrSamplesPerSec=10.966542206316571, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8992/20000 [14:02:36<28:09:33,  9.21s/it][2022-12-22 04:02:05,553] [INFO] [timer.py:197:stop] 0/2993, RunningAvgSamplesPerSec=10.94857455841011, CurrSamplesPerSec=10.790075968742658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8993/20000 [14:02:50<31:54:07, 10.43s/it][2022-12-22 04:02:15,678] [INFO] [timer.py:197:stop] 0/2994, RunningAvgSamplesPerSec=10.948610528498278, CurrSamplesPerSec=11.057265113581504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8994/20000 [14:03:00<31:36:58, 10.34s/it][2022-12-22 04:02:25,679] [INFO] [timer.py:197:stop] 0/2995, RunningAvgSamplesPerSec=10.948622129123594, CurrSamplesPerSec=10.983441620918942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8995/20000 [14:03:10<31:18:01, 10.24s/it][2022-12-22 04:02:34,956] [INFO] [timer.py:197:stop] 0/2996, RunningAvgSamplesPerSec=10.948567384825472, CurrSamplesPerSec=10.787134416584532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8996/20000 [14:03:19<30:24:56,  9.95s/it][2022-12-22 04:02:44,114] [INFO] [timer.py:197:stop] 0/2997, RunningAvgSamplesPerSec=10.948442404784362, CurrSamplesPerSec=10.586622390667335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8997/20000 [14:03:28<29:41:10,  9.71s/it][2022-12-22 04:02:54,072] [INFO] [timer.py:197:stop] 0/2998, RunningAvgSamplesPerSec=10.948432772356837, CurrSamplesPerSec=10.919659494813603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8998/20000 [14:03:38<29:54:28,  9.79s/it][2022-12-22 04:03:03,440] [INFO] [timer.py:197:stop] 0/2999, RunningAvgSamplesPerSec=10.948500605218808, CurrSamplesPerSec=11.1555728398844, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▍     | 8999/20000 [14:03:47<29:31:18,  9.66s/it][2022-12-22 04:03:13,506] [INFO] [logging.py:68:log_dist] [Rank 0] step=9000, skipped=18, lr=[5.650769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:03:13,507] [INFO] [timer.py:197:stop] 0/3000, RunningAvgSamplesPerSec=10.948439042799501, CurrSamplesPerSec=10.766995175747779, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9000/20000 [14:03:57<29:53:29,  9.78s/it]

                                                          
{'loss': 0.0685, 'learning_rate': 5.650769230769231e-06, 'epoch': 0.45}


 45%|████▌     | 9000/20000 [14:03:57<29:53:29,  9.78s/it][INFO|trainer.py:2955] 2022-12-22 04:03:13,512 >> ***** Running Evaluation *****
[INFO|trainer.py:2959] 2022-12-22 04:03:13,512 >>   Num examples: Unknown
[INFO|trainer.py:2960] 2022-12-22 04:03:13,512 >>   Batch size = 32
[INFO|trainer_utils.py:689] 2022-12-22 04:03:16,617 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: duration, age, input_length, gender, speaker_id. If duration, age, input_length, gender, speaker_id are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
[INFO|configuration_utils.py:523] 2022-12-22 04:03:16,628 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:21,812 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:27,688 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:33,345 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:38,921 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:44,064 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:49,741 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:03:54,926 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:00,349 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:05,492 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:10,319 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:16,061 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:21,229 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:26,909 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:31,578 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:37,688 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:44,545 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:50,012 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:04:55,970 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:01,529 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:07,079 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:14,020 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:19,671 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:25,869 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:30,783 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:35,965 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:41,853 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:47,313 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:52,699 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:05:57,817 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:06:03,306 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 04:06:07,197 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}



                                                          
{'eval_loss': 0.1539306640625, 'eval_wer': 10.442322191505403, 'eval_runtime': 210.7067, 'eval_samples_per_second': 4.746, 'eval_steps_per_second': 0.152, 'epoch': 0.45}


 45%|████▌     | 9000/20000 [14:07:28<29:53:29,  9.78s/it][2022-12-22 04:06:54,595] [INFO] [timer.py:197:stop] 0/3001, RunningAvgSamplesPerSec=10.94852550283127, CurrSamplesPerSec=11.214020386267798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9001/20000 [14:07:39<223:34:02, 73.17s/it][2022-12-22 04:07:03,681] [INFO] [timer.py:197:stop] 0/3002, RunningAvgSamplesPerSec=10.948582292552862, CurrSamplesPerSec=11.121586762916728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9002/20000 [14:07:48<164:48:37, 53.95s/it][2022-12-22 04:07:14,300] [INFO] [timer.py:197:stop] 0/3003, RunningAvgSamplesPerSec=10.948613928606818, CurrSamplesPerSec=11.044352275872875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9003/20000 [14:07:58<125:05:17, 40.95s/it][2022-12-22 04:07:23,393] [INFO] [timer.py:197:stop] 0/3004, RunningAvgSamplesPerSec=10.948695734075704, CurrSamplesPerSec=11.199826834495015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9004/20000 [14:08:07<95:53:11, 31.39s/it] [2022-12-22 04:07:34,760] [INFO] [timer.py:197:stop] 0/3005, RunningAvgSamplesPerSec=10.94863606312053, CurrSamplesPerSec=10.77238842910965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9005/20000 [14:08:19<77:31:44, 25.38s/it][2022-12-22 04:07:44,119] [INFO] [timer.py:197:stop] 0/3006, RunningAvgSamplesPerSec=10.948569924193677, CurrSamplesPerSec=10.753494714598325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9006/20000 [14:08:28<62:50:24, 20.58s/it][2022-12-22 04:07:53,673] [INFO] [timer.py:197:stop] 0/3007, RunningAvgSamplesPerSec=10.948483780268493, CurrSamplesPerSec=10.695684534600751, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9007/20000 [14:08:38<52:44:09, 17.27s/it][2022-12-22 04:08:04,069] [INFO] [timer.py:197:stop] 0/3008, RunningAvgSamplesPerSec=10.948489493659148, CurrSamplesPerSec=10.965685206793513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9008/20000 [14:08:48<46:26:03, 15.21s/it][2022-12-22 04:08:12,992] [INFO] [timer.py:197:stop] 0/3009, RunningAvgSamplesPerSec=10.948559919512919, CurrSamplesPerSec=11.164435571748227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9009/20000 [14:08:57<40:40:27, 13.32s/it][2022-12-22 04:08:21,814] [INFO] [logging.py:68:log_dist] [Rank 0] step=9010, skipped=18, lr=[5.645641025641027e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:08:21,815] [INFO] [timer.py:197:stop] 0/3010, RunningAvgSamplesPerSec=10.948637994889694, CurrSamplesPerSec=11.188556968491616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9010/20000 [14:09:06<36:32:59, 11.97s/it][2022-12-22 04:08:31,442] [INFO] [timer.py:197:stop] 0/3011, RunningAvgSamplesPerSec=10.948626950375566, CurrSamplesPerSec=10.915505586890566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9011/20000 [14:09:15<34:23:54, 11.27s/it][2022-12-22 04:08:40,244] [INFO] [timer.py:197:stop] 0/3012, RunningAvgSamplesPerSec=10.948734486821879, CurrSamplesPerSec=11.282169205646023, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9012/20000 [14:09:24<32:08:10, 10.53s/it][2022-12-22 04:08:50,871] [INFO] [timer.py:197:stop] 0/3013, RunningAvgSamplesPerSec=10.948755321041466, CurrSamplesPerSec=11.01182770062221, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9013/20000 [14:09:35<32:13:24, 10.56s/it][2022-12-22 04:08:59,589] [INFO] [timer.py:197:stop] 0/3014, RunningAvgSamplesPerSec=10.94884538948128, CurrSamplesPerSec=11.226931775745143, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9014/20000 [14:09:44<30:32:06, 10.01s/it][2022-12-22 04:09:08,765] [INFO] [timer.py:197:stop] 0/3015, RunningAvgSamplesPerSec=10.948919069725447, CurrSamplesPerSec=11.175436803404612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9015/20000 [14:09:53<29:46:20,  9.76s/it][2022-12-22 04:09:19,919] [INFO] [timer.py:197:stop] 0/3016, RunningAvgSamplesPerSec=10.94895323653532, CurrSamplesPerSec=11.052875257931552, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9016/20000 [14:10:04<31:02:57, 10.18s/it][2022-12-22 04:09:29,391] [INFO] [timer.py:197:stop] 0/3017, RunningAvgSamplesPerSec=10.948807962292221, CurrSamplesPerSec=10.527793861961673, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9017/20000 [14:10:13<30:24:05,  9.96s/it][2022-12-22 04:09:38,741] [INFO] [timer.py:197:stop] 0/3018, RunningAvgSamplesPerSec=10.948817983797277, CurrSamplesPerSec=10.979116462282615, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9018/20000 [14:10:23<29:50:09,  9.78s/it][2022-12-22 04:09:48,314] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 65536.0
[2022-12-22 04:09:48,316] [INFO] [timer.py:197:stop] 0/3019, RunningAvgSamplesPerSec=10.949059706959991, CurrSamplesPerSec=11.73012050888365, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9019/20000 [14:10:32<29:38:38,  9.72s/it][2022-12-22 04:09:56,921] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0
[2022-12-22 04:09:56,922] [INFO] [logging.py:68:log_dist] [Rank 0] step=9020, skipped=20, lr=[5.641538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:09:56,922] [INFO] [timer.py:197:stop] 0/3020, RunningAvgSamplesPerSec=10.949295246272543, CurrSamplesPerSec=11.709256047910879, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9020/20000 [14:10:41<28:37:27,  9.39s/it][2022-12-22 04:10:06,156] [INFO] [timer.py:197:stop] 0/3021, RunningAvgSamplesPerSec=10.949232594525593, CurrSamplesPerSec=10.763360522064701, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9021/20000 [14:10:50<28:29:01,  9.34s/it][2022-12-22 04:10:16,442] [INFO] [timer.py:197:stop] 0/3022, RunningAvgSamplesPerSec=10.949162610850767, CurrSamplesPerSec=10.741882996248561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9022/20000 [14:11:00<29:20:46,  9.62s/it][2022-12-22 04:10:26,336] [INFO] [timer.py:197:stop] 0/3023, RunningAvgSamplesPerSec=10.949060703664776, CurrSamplesPerSec=10.64971781380333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9023/20000 [14:11:10<29:35:27,  9.70s/it][2022-12-22 04:10:35,490] [INFO] [timer.py:197:stop] 0/3024, RunningAvgSamplesPerSec=10.949074821608093, CurrSamplesPerSec=10.991891970689101, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9024/20000 [14:11:19<29:05:06,  9.54s/it][2022-12-22 04:10:44,933] [INFO] [timer.py:197:stop] 0/3025, RunningAvgSamplesPerSec=10.949077052367798, CurrSamplesPerSec=10.955822562789203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9025/20000 [14:11:29<28:59:39,  9.51s/it]

                                                          
{'loss': 0.0664, 'learning_rate': 5.63897435897436e-06, 'epoch': 0.45}


 45%|████▌     | 9025/20000 [14:11:29<28:59:39,  9.51s/it][2022-12-22 04:10:56,882] [INFO] [timer.py:197:stop] 0/3026, RunningAvgSamplesPerSec=10.949063021222411, CurrSamplesPerSec=10.906810606715627, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9026/20000 [14:11:41<31:13:15, 10.24s/it][2022-12-22 04:11:06,517] [INFO] [timer.py:197:stop] 0/3027, RunningAvgSamplesPerSec=10.949153117468196, CurrSamplesPerSec=11.228559003972645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9027/20000 [14:11:50<30:39:49, 10.06s/it][2022-12-22 04:11:15,731] [INFO] [timer.py:197:stop] 0/3028, RunningAvgSamplesPerSec=10.949156054869064, CurrSamplesPerSec=10.958048911755148, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9028/20000 [14:12:00<29:53:12,  9.81s/it][2022-12-22 04:11:25,074] [INFO] [timer.py:197:stop] 0/3029, RunningAvgSamplesPerSec=10.949162409861989, CurrSamplesPerSec=10.968426463431626, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9029/20000 [14:12:09<29:27:38,  9.67s/it][2022-12-22 04:11:34,445] [INFO] [logging.py:68:log_dist] [Rank 0] step=9030, skipped=20, lr=[5.636410256410258e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:11:34,446] [INFO] [timer.py:197:stop] 0/3030, RunningAvgSamplesPerSec=10.949122877183134, CurrSamplesPerSec=10.830751591998956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9030/20000 [14:12:18<29:11:16,  9.58s/it][2022-12-22 04:11:43,929] [INFO] [timer.py:197:stop] 0/3031, RunningAvgSamplesPerSec=10.94903668026891, CurrSamplesPerSec=10.694111366609777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9031/20000 [14:12:28<29:05:54,  9.55s/it][2022-12-22 04:11:53,051] [INFO] [timer.py:197:stop] 0/3032, RunningAvgSamplesPerSec=10.949064867195968, CurrSamplesPerSec=11.035114283648264, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9032/20000 [14:12:37<28:42:14,  9.42s/it][2022-12-22 04:12:02,467] [INFO] [timer.py:197:stop] 0/3033, RunningAvgSamplesPerSec=10.94901918739595, CurrSamplesPerSec=10.81233779355859, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9033/20000 [14:12:46<28:41:50,  9.42s/it][2022-12-22 04:12:11,993] [INFO] [timer.py:197:stop] 0/3034, RunningAvgSamplesPerSec=10.94909676166408, CurrSamplesPerSec=11.189386193170824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9034/20000 [14:12:56<28:47:26,  9.45s/it][2022-12-22 04:12:20,789] [INFO] [timer.py:197:stop] 0/3035, RunningAvgSamplesPerSec=10.949201528068127, CurrSamplesPerSec=11.27634735602481, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9035/20000 [14:13:05<28:11:21,  9.26s/it][2022-12-22 04:12:30,684] [INFO] [timer.py:197:stop] 0/3036, RunningAvgSamplesPerSec=10.949229568999057, CurrSamplesPerSec=11.034943716682438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9036/20000 [14:13:15<28:46:18,  9.45s/it][2022-12-22 04:12:40,124] [INFO] [timer.py:197:stop] 0/3037, RunningAvgSamplesPerSec=10.94907037176392, CurrSamplesPerSec=10.48647930693996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9037/20000 [14:13:24<28:45:45,  9.44s/it][2022-12-22 04:12:50,758] [INFO] [timer.py:197:stop] 0/3038, RunningAvgSamplesPerSec=10.949073691802509, CurrSamplesPerSec=10.959159293652181, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9038/20000 [14:13:35<29:50:44,  9.80s/it][2022-12-22 04:13:00,436] [INFO] [timer.py:197:stop] 0/3039, RunningAvgSamplesPerSec=10.949052317803204, CurrSamplesPerSec=10.884543305718196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9039/20000 [14:13:44<29:43:48,  9.76s/it][2022-12-22 04:13:09,998] [INFO] [logging.py:68:log_dist] [Rank 0] step=9040, skipped=20, lr=[5.631282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:13:09,999] [INFO] [timer.py:197:stop] 0/3040, RunningAvgSamplesPerSec=10.948997336756342, CurrSamplesPerSec=10.784528944861576, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9040/20000 [14:13:54<29:32:35,  9.70s/it][2022-12-22 04:13:20,415] [INFO] [timer.py:197:stop] 0/3041, RunningAvgSamplesPerSec=10.948968669918427, CurrSamplesPerSec=10.8625663008548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9041/20000 [14:14:04<30:11:26,  9.92s/it][2022-12-22 04:13:29,315] [INFO] [timer.py:197:stop] 0/3042, RunningAvgSamplesPerSec=10.94897943087396, CurrSamplesPerSec=10.981779976043736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9042/20000 [14:14:13<29:15:32,  9.61s/it][2022-12-22 04:13:41,037] [INFO] [timer.py:197:stop] 0/3043, RunningAvgSamplesPerSec=10.948993035396851, CurrSamplesPerSec=10.99050765016807, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9043/20000 [14:14:25<31:10:56, 10.25s/it][2022-12-22 04:13:50,383] [INFO] [timer.py:197:stop] 0/3044, RunningAvgSamplesPerSec=10.949036326573863, CurrSamplesPerSec=11.08228750146664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9044/20000 [14:14:34<30:21:33,  9.98s/it][2022-12-22 04:13:59,421] [INFO] [timer.py:197:stop] 0/3045, RunningAvgSamplesPerSec=10.94901610564314, CurrSamplesPerSec=10.887847793715354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9045/20000 [14:14:43<29:30:00,  9.69s/it][2022-12-22 04:14:08,615] [INFO] [timer.py:197:stop] 0/3046, RunningAvgSamplesPerSec=10.94910979885172, CurrSamplesPerSec=11.24184334843411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9046/20000 [14:14:53<29:02:26,  9.54s/it][2022-12-22 04:14:18,616] [INFO] [timer.py:197:stop] 0/3047, RunningAvgSamplesPerSec=10.949207376783216, CurrSamplesPerSec=11.254519755215503, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9047/20000 [14:15:03<29:27:17,  9.68s/it][2022-12-22 04:14:28,625] [INFO] [timer.py:197:stop] 0/3048, RunningAvgSamplesPerSec=10.949127368765806, CurrSamplesPerSec=10.710807453098925, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9048/20000 [14:15:13<29:45:04,  9.78s/it][2022-12-22 04:14:37,799] [INFO] [timer.py:197:stop] 0/3049, RunningAvgSamplesPerSec=10.949124888690557, CurrSamplesPerSec=10.941575789670365, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9049/20000 [14:15:22<29:11:44,  9.60s/it][2022-12-22 04:14:47,120] [INFO] [logging.py:68:log_dist] [Rank 0] step=9050, skipped=20, lr=[5.626153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:14:47,121] [INFO] [timer.py:197:stop] 0/3050, RunningAvgSamplesPerSec=10.949063246170109, CurrSamplesPerSec=10.764407192288795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9050/20000 [14:15:31<28:56:29,  9.51s/it]

                                                          
{'loss': 0.0775, 'learning_rate': 5.626153846153847e-06, 'epoch': 0.45}


 45%|████▌     | 9050/20000 [14:15:31<28:56:29,  9.51s/it][2022-12-22 04:14:56,129] [INFO] [timer.py:197:stop] 0/3051, RunningAvgSamplesPerSec=10.949102400783623, CurrSamplesPerSec=11.069761254231285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9051/20000 [14:15:40<28:28:37,  9.36s/it][2022-12-22 04:15:05,665] [INFO] [timer.py:197:stop] 0/3052, RunningAvgSamplesPerSec=10.9490152417549, CurrSamplesPerSec=10.68956660886674, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9052/20000 [14:15:50<28:37:54,  9.41s/it][2022-12-22 04:15:16,134] [INFO] [timer.py:197:stop] 0/3053, RunningAvgSamplesPerSec=10.94895479760109, CurrSamplesPerSec=10.767653811903825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9053/20000 [14:16:00<29:35:26,  9.73s/it][2022-12-22 04:15:24,939] [INFO] [timer.py:197:stop] 0/3054, RunningAvgSamplesPerSec=10.949027566304652, CurrSamplesPerSec=11.175641518452506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9054/20000 [14:16:09<28:44:36,  9.45s/it][2022-12-22 04:15:33,983] [INFO] [timer.py:197:stop] 0/3055, RunningAvgSamplesPerSec=10.94902606485596, CurrSamplesPerSec=10.94444556112332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9055/20000 [14:16:18<28:22:01,  9.33s/it][2022-12-22 04:15:43,722] [INFO] [timer.py:197:stop] 0/3056, RunningAvgSamplesPerSec=10.94910517104624, CurrSamplesPerSec=11.196065511522125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9056/20000 [14:16:28<28:44:16,  9.45s/it][2022-12-22 04:15:53,026] [INFO] [timer.py:197:stop] 0/3057, RunningAvgSamplesPerSec=10.949160015971263, CurrSamplesPerSec=11.119259389448546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9057/20000 [14:16:37<28:35:55,  9.41s/it][2022-12-22 04:16:02,247] [INFO] [timer.py:197:stop] 0/3058, RunningAvgSamplesPerSec=10.949153771306245, CurrSamplesPerSec=10.930109512642174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9058/20000 [14:16:46<28:25:30,  9.35s/it][2022-12-22 04:16:11,380] [INFO] [timer.py:197:stop] 0/3059, RunningAvgSamplesPerSec=10.949220976595866, CurrSamplesPerSec=11.158527684582939, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9059/20000 [14:16:55<28:13:23,  9.29s/it][2022-12-22 04:16:21,298] [INFO] [logging.py:68:log_dist] [Rank 0] step=9060, skipped=20, lr=[5.621025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:16:21,299] [INFO] [timer.py:197:stop] 0/3060, RunningAvgSamplesPerSec=10.94914404439918, CurrSamplesPerSec=10.718909256252672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9060/20000 [14:17:05<28:47:49,  9.48s/it][2022-12-22 04:16:30,103] [INFO] [timer.py:197:stop] 0/3061, RunningAvgSamplesPerSec=10.9492120303393, CurrSamplesPerSec=11.161138357258354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9061/20000 [14:17:14<28:10:51,  9.27s/it][2022-12-22 04:16:39,687] [INFO] [timer.py:197:stop] 0/3062, RunningAvgSamplesPerSec=10.949164689251855, CurrSamplesPerSec=10.806239287777712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9062/20000 [14:17:24<28:27:40,  9.37s/it][2022-12-22 04:16:48,679] [INFO] [timer.py:197:stop] 0/3063, RunningAvgSamplesPerSec=10.949228802501318, CurrSamplesPerSec=11.148995910927301, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9063/20000 [14:17:33<28:07:00,  9.25s/it][2022-12-22 04:16:57,860] [INFO] [timer.py:197:stop] 0/3064, RunningAvgSamplesPerSec=10.94917409483897, CurrSamplesPerSec=10.784237359441775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9064/20000 [14:17:42<28:02:46,  9.23s/it][2022-12-22 04:17:07,169] [INFO] [timer.py:197:stop] 0/3065, RunningAvgSamplesPerSec=10.949129606891212, CurrSamplesPerSec=10.814582012995848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9065/20000 [14:17:51<28:06:50,  9.26s/it][2022-12-22 04:17:16,135] [INFO] [timer.py:197:stop] 0/3066, RunningAvgSamplesPerSec=10.949150662064888, CurrSamplesPerSec=11.014024901948531, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9066/20000 [14:18:00<27:50:48,  9.17s/it][2022-12-22 04:17:25,631] [INFO] [timer.py:197:stop] 0/3067, RunningAvgSamplesPerSec=10.94897769478882, CurrSamplesPerSec=10.443481848249018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9067/20000 [14:18:10<28:08:36,  9.27s/it][2022-12-22 04:17:35,559] [INFO] [timer.py:197:stop] 0/3068, RunningAvgSamplesPerSec=10.94898108650757, CurrSamplesPerSec=10.959386587311156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9068/20000 [14:18:20<28:44:34,  9.47s/it][2022-12-22 04:17:44,885] [INFO] [timer.py:197:stop] 0/3069, RunningAvgSamplesPerSec=10.949072069856078, CurrSamplesPerSec=11.235322335193544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9069/20000 [14:18:29<28:36:46,  9.42s/it][2022-12-22 04:17:55,495] [INFO] [logging.py:68:log_dist] [Rank 0] step=9070, skipped=20, lr=[5.6158974358974365e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:17:55,496] [INFO] [timer.py:197:stop] 0/3070, RunningAvgSamplesPerSec=10.948974023733266, CurrSamplesPerSec=10.656307118985415, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9070/20000 [14:18:39<29:41:31,  9.78s/it][2022-12-22 04:18:06,598] [INFO] [timer.py:197:stop] 0/3071, RunningAvgSamplesPerSec=10.948911495039344, CurrSamplesPerSec=10.760377873476193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9071/20000 [14:18:51<30:53:38, 10.18s/it][2022-12-22 04:18:16,349] [INFO] [timer.py:197:stop] 0/3072, RunningAvgSamplesPerSec=10.948796585057329, CurrSamplesPerSec=10.60714594070053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9072/20000 [14:19:00<30:30:11, 10.05s/it][2022-12-22 04:18:26,496] [INFO] [timer.py:197:stop] 0/3073, RunningAvgSamplesPerSec=10.948722801179606, CurrSamplesPerSec=10.72679913792542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9073/20000 [14:19:10<30:35:25, 10.08s/it][2022-12-22 04:18:36,485] [INFO] [timer.py:197:stop] 0/3074, RunningAvgSamplesPerSec=10.948782177557113, CurrSamplesPerSec=11.134216323765795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9074/20000 [14:19:20<30:30:20, 10.05s/it][2022-12-22 04:18:46,013] [INFO] [timer.py:197:stop] 0/3075, RunningAvgSamplesPerSec=10.948823190608326, CurrSamplesPerSec=11.076282481838987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9075/20000 [14:19:30<30:01:38,  9.89s/it]

                                                          
{'loss': 0.0562, 'learning_rate': 5.613333333333334e-06, 'epoch': 0.45}


 45%|████▌     | 9075/20000 [14:19:30<30:01:38,  9.89s/it][2022-12-22 04:18:57,003] [INFO] [timer.py:197:stop] 0/3076, RunningAvgSamplesPerSec=10.94885860550839, CurrSamplesPerSec=11.058781566457363, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9076/20000 [14:19:41<31:01:15, 10.22s/it][2022-12-22 04:19:06,638] [INFO] [timer.py:197:stop] 0/3077, RunningAvgSamplesPerSec=10.948755349996482, CurrSamplesPerSec=10.640293217895323, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9077/20000 [14:19:51<30:29:00, 10.05s/it][2022-12-22 04:19:16,122] [INFO] [timer.py:197:stop] 0/3078, RunningAvgSamplesPerSec=10.948752807818728, CurrSamplesPerSec=10.940941190385912, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9078/20000 [14:20:00<29:58:06,  9.88s/it][2022-12-22 04:19:25,418] [INFO] [timer.py:197:stop] 0/3079, RunningAvgSamplesPerSec=10.948842336743573, CurrSamplesPerSec=11.231341177218786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9079/20000 [14:20:09<29:26:08,  9.70s/it][2022-12-22 04:19:34,998] [INFO] [logging.py:68:log_dist] [Rank 0] step=9080, skipped=20, lr=[5.6107692307692305e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:19:34,999] [INFO] [timer.py:197:stop] 0/3080, RunningAvgSamplesPerSec=10.948782026747274, CurrSamplesPerSec=10.766302075207367, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9080/20000 [14:20:19<29:19:20,  9.67s/it][2022-12-22 04:19:45,517] [INFO] [timer.py:197:stop] 0/3081, RunningAvgSamplesPerSec=10.948786540565607, CurrSamplesPerSec=10.96269773181767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9081/20000 [14:20:29<30:05:39,  9.92s/it][2022-12-22 04:19:54,491] [INFO] [timer.py:197:stop] 0/3082, RunningAvgSamplesPerSec=10.948827718412076, CurrSamplesPerSec=11.077100175382135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9082/20000 [14:20:38<29:13:42,  9.64s/it][2022-12-22 04:20:04,048] [INFO] [timer.py:197:stop] 0/3083, RunningAvgSamplesPerSec=10.948723241106038, CurrSamplesPerSec=10.636123627575477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9083/20000 [14:20:48<29:09:09,  9.61s/it][2022-12-22 04:20:14,032] [INFO] [timer.py:197:stop] 0/3084, RunningAvgSamplesPerSec=10.948747412345364, CurrSamplesPerSec=11.023729179956842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9084/20000 [14:20:58<29:29:15,  9.72s/it][2022-12-22 04:20:23,088] [INFO] [timer.py:197:stop] 0/3085, RunningAvgSamplesPerSec=10.94875608925668, CurrSamplesPerSec=10.975563828845525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9085/20000 [14:21:07<28:52:32,  9.52s/it][2022-12-22 04:20:32,961] [INFO] [timer.py:197:stop] 0/3086, RunningAvgSamplesPerSec=10.948715569925012, CurrSamplesPerSec=10.825204150538376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9086/20000 [14:21:17<29:11:29,  9.63s/it][2022-12-22 04:20:42,419] [INFO] [timer.py:197:stop] 0/3087, RunningAvgSamplesPerSec=10.948782003175797, CurrSamplesPerSec=11.157570388361016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9087/20000 [14:21:26<29:01:58,  9.58s/it][2022-12-22 04:20:51,442] [INFO] [timer.py:197:stop] 0/3088, RunningAvgSamplesPerSec=10.948727990722826, CurrSamplesPerSec=10.784598269123832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9088/20000 [14:21:35<28:31:33,  9.41s/it][2022-12-22 04:21:00,409] [INFO] [timer.py:197:stop] 0/3089, RunningAvgSamplesPerSec=10.948764523132377, CurrSamplesPerSec=11.062676870239741, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9089/20000 [14:21:44<28:07:11,  9.28s/it][2022-12-22 04:21:12,095] [INFO] [logging.py:68:log_dist] [Rank 0] step=9090, skipped=20, lr=[5.605641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:21:12,096] [INFO] [timer.py:197:stop] 0/3090, RunningAvgSamplesPerSec=10.948760911924433, CurrSamplesPerSec=10.937624455579735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9090/20000 [14:21:56<30:18:27, 10.00s/it][2022-12-22 04:21:21,981] [INFO] [timer.py:197:stop] 0/3091, RunningAvgSamplesPerSec=10.948746363614946, CurrSamplesPerSec=10.90400482800006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9091/20000 [14:22:06<30:11:57,  9.97s/it][2022-12-22 04:21:32,313] [INFO] [timer.py:197:stop] 0/3092, RunningAvgSamplesPerSec=10.948643619298542, CurrSamplesPerSec=10.64021013145583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9092/20000 [14:22:16<30:31:45, 10.08s/it][2022-12-22 04:21:42,070] [INFO] [timer.py:197:stop] 0/3093, RunningAvgSamplesPerSec=10.948552206609067, CurrSamplesPerSec=10.673193366238, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9093/20000 [14:22:26<30:14:14,  9.98s/it][2022-12-22 04:21:51,163] [INFO] [timer.py:197:stop] 0/3094, RunningAvgSamplesPerSec=10.948638102433891, CurrSamplesPerSec=11.220742757693438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9094/20000 [14:22:35<29:25:40,  9.71s/it][2022-12-22 04:22:00,366] [INFO] [timer.py:197:stop] 0/3095, RunningAvgSamplesPerSec=10.948475123104053, CurrSamplesPerSec=10.466724054482318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9095/20000 [14:22:44<28:57:39,  9.56s/it][2022-12-22 04:22:10,082] [INFO] [timer.py:197:stop] 0/3096, RunningAvgSamplesPerSec=10.948493374829566, CurrSamplesPerSec=11.00523864622778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9096/20000 [14:22:54<29:05:56,  9.61s/it][2022-12-22 04:22:19,189] [INFO] [timer.py:197:stop] 0/3097, RunningAvgSamplesPerSec=10.948387708859409, CurrSamplesPerSec=10.630939599447105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9097/20000 [14:23:03<28:38:31,  9.46s/it][2022-12-22 04:22:28,367] [INFO] [timer.py:197:stop] 0/3098, RunningAvgSamplesPerSec=10.948473197091307, CurrSamplesPerSec=11.219613909012423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9098/20000 [14:23:12<28:23:12,  9.37s/it][2022-12-22 04:22:37,485] [INFO] [timer.py:197:stop] 0/3099, RunningAvgSamplesPerSec=10.948506293173546, CurrSamplesPerSec=11.051940098327043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 45%|████▌     | 9099/20000 [14:23:21<28:09:03,  9.30s/it][2022-12-22 04:22:46,662] [INFO] [logging.py:68:log_dist] [Rank 0] step=9100, skipped=20, lr=[5.600512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:22:46,663] [INFO] [timer.py:197:stop] 0/3100, RunningAvgSamplesPerSec=10.948574143509212, CurrSamplesPerSec=11.162819911441128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9100/20000 [14:23:31<28:02:27,  9.26s/it]

                                                          
{'loss': 0.0666, 'learning_rate': 5.600512820512821e-06, 'epoch': 0.46}


 46%|████▌     | 9100/20000 [14:23:31<28:02:27,  9.26s/it][2022-12-22 04:22:56,063] [INFO] [timer.py:197:stop] 0/3101, RunningAvgSamplesPerSec=10.948545801818877, CurrSamplesPerSec=10.861442005051927, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9101/20000 [14:23:40<28:09:53,  9.30s/it][2022-12-22 04:23:05,297] [INFO] [timer.py:197:stop] 0/3102, RunningAvgSamplesPerSec=10.948622733871643, CurrSamplesPerSec=11.192344046905571, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9102/20000 [14:23:49<28:05:55,  9.28s/it][2022-12-22 04:23:14,845] [INFO] [timer.py:197:stop] 0/3103, RunningAvgSamplesPerSec=10.948622921841457, CurrSamplesPerSec=10.949205659290064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9103/20000 [14:23:59<28:20:18,  9.36s/it][2022-12-22 04:23:24,114] [INFO] [timer.py:197:stop] 0/3104, RunningAvgSamplesPerSec=10.948618071576462, CurrSamplesPerSec=10.933598040260712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9104/20000 [14:24:08<28:15:04,  9.33s/it][2022-12-22 04:23:33,133] [INFO] [timer.py:197:stop] 0/3105, RunningAvgSamplesPerSec=10.948600957121268, CurrSamplesPerSec=10.895768182316514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9105/20000 [14:24:17<27:57:44,  9.24s/it][2022-12-22 04:23:44,992] [INFO] [timer.py:197:stop] 0/3106, RunningAvgSamplesPerSec=10.948630521647065, CurrSamplesPerSec=11.041144672333349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9106/20000 [14:24:29<30:20:16, 10.03s/it][2022-12-22 04:23:54,482] [INFO] [timer.py:197:stop] 0/3107, RunningAvgSamplesPerSec=10.94865709610458, CurrSamplesPerSec=11.03177059052123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9107/20000 [14:24:38<29:50:57,  9.86s/it][2022-12-22 04:24:03,755] [INFO] [timer.py:197:stop] 0/3108, RunningAvgSamplesPerSec=10.948727229709188, CurrSamplesPerSec=11.170912654959816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9108/20000 [14:24:48<29:18:31,  9.69s/it][2022-12-22 04:24:13,985] [INFO] [timer.py:197:stop] 0/3109, RunningAvgSamplesPerSec=10.948804645779676, CurrSamplesPerSec=11.194660101779549, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9109/20000 [14:24:58<29:47:57,  9.85s/it][2022-12-22 04:24:23,555] [INFO] [logging.py:68:log_dist] [Rank 0] step=9110, skipped=20, lr=[5.595384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:24:23,556] [INFO] [timer.py:197:stop] 0/3110, RunningAvgSamplesPerSec=10.948733013196543, CurrSamplesPerSec=10.730606022072948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9110/20000 [14:25:08<29:32:34,  9.77s/it][2022-12-22 04:24:33,036] [INFO] [timer.py:197:stop] 0/3111, RunningAvgSamplesPerSec=10.948816507209989, CurrSamplesPerSec=11.214617718735852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9111/20000 [14:25:17<29:16:48,  9.68s/it][2022-12-22 04:24:43,497] [INFO] [timer.py:197:stop] 0/3112, RunningAvgSamplesPerSec=10.948884736894321, CurrSamplesPerSec=11.1652031742423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9112/20000 [14:25:27<29:59:11,  9.91s/it][2022-12-22 04:24:52,264] [INFO] [timer.py:197:stop] 0/3113, RunningAvgSamplesPerSec=10.949017491754311, CurrSamplesPerSec=11.378069066099206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9113/20000 [14:25:36<28:56:32,  9.57s/it][2022-12-22 04:25:02,526] [INFO] [timer.py:197:stop] 0/3114, RunningAvgSamplesPerSec=10.949084669501689, CurrSamplesPerSec=11.16214268032931, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9114/20000 [14:25:46<29:34:00,  9.78s/it][2022-12-22 04:25:11,837] [INFO] [timer.py:197:stop] 0/3115, RunningAvgSamplesPerSec=10.949118128783772, CurrSamplesPerSec=11.054243469921687, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9115/20000 [14:25:56<29:08:25,  9.64s/it][2022-12-22 04:25:21,452] [INFO] [timer.py:197:stop] 0/3116, RunningAvgSamplesPerSec=10.94901219231995, CurrSamplesPerSec=10.628877419259808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9116/20000 [14:26:05<29:07:03,  9.63s/it][2022-12-22 04:25:30,414] [INFO] [timer.py:197:stop] 0/3117, RunningAvgSamplesPerSec=10.948995987067926, CurrSamplesPerSec=10.898764420380466, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9117/20000 [14:26:14<28:30:33,  9.43s/it][2022-12-22 04:25:40,433] [INFO] [timer.py:197:stop] 0/3118, RunningAvgSamplesPerSec=10.948969060538767, CurrSamplesPerSec=10.865730785588552, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9118/20000 [14:26:24<29:02:21,  9.61s/it][2022-12-22 04:25:49,414] [INFO] [timer.py:197:stop] 0/3119, RunningAvgSamplesPerSec=10.948967260259986, CurrSamplesPerSec=10.943360465124337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9119/20000 [14:26:33<28:28:08,  9.42s/it][2022-12-22 04:25:59,511] [INFO] [logging.py:68:log_dist] [Rank 0] step=9120, skipped=20, lr=[5.59025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:25:59,512] [INFO] [timer.py:197:stop] 0/3120, RunningAvgSamplesPerSec=10.949012779677831, CurrSamplesPerSec=11.092760169589372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9120/20000 [14:26:43<29:04:54,  9.62s/it][2022-12-22 04:26:08,853] [INFO] [timer.py:197:stop] 0/3121, RunningAvgSamplesPerSec=10.94907490843661, CurrSamplesPerSec=11.146282611961537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9121/20000 [14:26:53<28:49:27,  9.54s/it][2022-12-22 04:26:17,978] [INFO] [timer.py:197:stop] 0/3122, RunningAvgSamplesPerSec=10.94910772916788, CurrSamplesPerSec=11.052442015900073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9122/20000 [14:27:02<28:26:49,  9.41s/it][2022-12-22 04:26:27,353] [INFO] [timer.py:197:stop] 0/3123, RunningAvgSamplesPerSec=10.949174916914947, CurrSamplesPerSec=11.162893720208752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9123/20000 [14:27:11<28:24:29,  9.40s/it][2022-12-22 04:26:36,696] [INFO] [timer.py:197:stop] 0/3124, RunningAvgSamplesPerSec=10.949141812912025, CurrSamplesPerSec=10.846790331759651, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9124/20000 [14:27:21<28:21:07,  9.38s/it][2022-12-22 04:26:47,788] [INFO] [timer.py:197:stop] 0/3125, RunningAvgSamplesPerSec=10.949131401793224, CurrSamplesPerSec=10.916724123725293, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9125/20000 [14:27:32<29:53:49,  9.90s/it]

                                                          
{'loss': 0.0623, 'learning_rate': 5.587692307692308e-06, 'epoch': 0.46}


 46%|████▌     | 9125/20000 [14:27:32<29:53:49,  9.90s/it][2022-12-22 04:26:56,635] [INFO] [timer.py:197:stop] 0/3126, RunningAvgSamplesPerSec=10.94919881465888, CurrSamplesPerSec=11.163857965907653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9126/20000 [14:27:41<28:56:32,  9.58s/it][2022-12-22 04:27:06,065] [INFO] [timer.py:197:stop] 0/3127, RunningAvgSamplesPerSec=10.949212368257507, CurrSamplesPerSec=10.991718236430767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9127/20000 [14:27:50<28:48:09,  9.54s/it][2022-12-22 04:27:15,722] [INFO] [timer.py:197:stop] 0/3128, RunningAvgSamplesPerSec=10.949167292670095, CurrSamplesPerSec=10.81009581135121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9128/20000 [14:28:00<28:54:30,  9.57s/it][2022-12-22 04:27:25,695] [INFO] [timer.py:197:stop] 0/3129, RunningAvgSamplesPerSec=10.9491151863801, CurrSamplesPerSec=10.78861930102357, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9129/20000 [14:28:10<29:16:09,  9.69s/it][2022-12-22 04:27:36,027] [INFO] [logging.py:68:log_dist] [Rank 0] step=9130, skipped=20, lr=[5.585128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:27:36,028] [INFO] [timer.py:197:stop] 0/3130, RunningAvgSamplesPerSec=10.949194292530152, CurrSamplesPerSec=11.202278753336035, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9130/20000 [14:28:20<29:50:45,  9.88s/it][2022-12-22 04:27:45,205] [INFO] [timer.py:197:stop] 0/3131, RunningAvgSamplesPerSec=10.949153948773606, CurrSamplesPerSec=10.824397032893998, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9131/20000 [14:28:29<29:12:09,  9.67s/it][2022-12-22 04:27:54,279] [INFO] [timer.py:197:stop] 0/3132, RunningAvgSamplesPerSec=10.94917212293066, CurrSamplesPerSec=11.006336048677333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9132/20000 [14:28:38<28:39:28,  9.49s/it][2022-12-22 04:28:03,515] [INFO] [timer.py:197:stop] 0/3133, RunningAvgSamplesPerSec=10.949216158625578, CurrSamplesPerSec=11.088805635607846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9133/20000 [14:28:47<28:25:21,  9.42s/it][2022-12-22 04:28:12,611] [INFO] [timer.py:197:stop] 0/3134, RunningAvgSamplesPerSec=10.94928539330441, CurrSamplesPerSec=11.170438966066907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9134/20000 [14:28:57<28:07:51,  9.32s/it][2022-12-22 04:28:21,878] [INFO] [timer.py:197:stop] 0/3135, RunningAvgSamplesPerSec=10.949302303834095, CurrSamplesPerSec=11.00252360619021, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9135/20000 [14:29:06<28:04:49,  9.30s/it][2022-12-22 04:28:31,026] [INFO] [timer.py:197:stop] 0/3136, RunningAvgSamplesPerSec=10.949305831521992, CurrSamplesPerSec=10.960369248694473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9136/20000 [14:29:15<27:56:09,  9.26s/it][2022-12-22 04:28:40,286] [INFO] [timer.py:197:stop] 0/3137, RunningAvgSamplesPerSec=10.949378042975585, CurrSamplesPerSec=11.180466589543855, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9137/20000 [14:29:24<27:56:08,  9.26s/it][2022-12-22 04:28:49,898] [INFO] [timer.py:197:stop] 0/3138, RunningAvgSamplesPerSec=10.949383093385727, CurrSamplesPerSec=10.965239064558263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9138/20000 [14:29:34<28:15:15,  9.36s/it][2022-12-22 04:28:59,323] [INFO] [timer.py:197:stop] 0/3139, RunningAvgSamplesPerSec=10.949296128028726, CurrSamplesPerSec=10.6832026956321, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9139/20000 [14:29:43<28:18:22,  9.38s/it][2022-12-22 04:29:08,529] [INFO] [logging.py:68:log_dist] [Rank 0] step=9140, skipped=20, lr=[5.580000000000001e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:29:08,529] [INFO] [timer.py:197:stop] 0/3140, RunningAvgSamplesPerSec=10.949397077777395, CurrSamplesPerSec=11.275511349777247, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9140/20000 [14:29:52<28:08:39,  9.33s/it][2022-12-22 04:29:17,594] [INFO] [timer.py:197:stop] 0/3141, RunningAvgSamplesPerSec=10.949438861592704, CurrSamplesPerSec=11.082146126704961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9141/20000 [14:30:02<27:54:08,  9.25s/it][2022-12-22 04:29:26,983] [INFO] [timer.py:197:stop] 0/3142, RunningAvgSamplesPerSec=10.949365450998483, CurrSamplesPerSec=10.72368077597874, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9142/20000 [14:30:11<28:01:29,  9.29s/it][2022-12-22 04:29:35,874] [INFO] [timer.py:197:stop] 0/3143, RunningAvgSamplesPerSec=10.949381389309414, CurrSamplesPerSec=10.99965755589979, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9143/20000 [14:30:20<27:39:36,  9.17s/it][2022-12-22 04:29:45,340] [INFO] [timer.py:197:stop] 0/3144, RunningAvgSamplesPerSec=10.949435936427252, CurrSamplesPerSec=11.123492875668415, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9144/20000 [14:30:29<27:55:24,  9.26s/it][2022-12-22 04:29:54,689] [INFO] [timer.py:197:stop] 0/3145, RunningAvgSamplesPerSec=10.949400677758028, CurrSamplesPerSec=10.839727928076355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9145/20000 [14:30:39<28:00:05,  9.29s/it][2022-12-22 04:30:04,364] [INFO] [timer.py:197:stop] 0/3146, RunningAvgSamplesPerSec=10.94927590514056, CurrSamplesPerSec=10.57067972070314, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9146/20000 [14:30:48<28:21:02,  9.40s/it][2022-12-22 04:30:14,168] [INFO] [timer.py:197:stop] 0/3147, RunningAvgSamplesPerSec=10.949298808490017, CurrSamplesPerSec=11.021783788719782, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9147/20000 [14:30:58<28:42:36,  9.52s/it][2022-12-22 04:30:23,391] [INFO] [timer.py:197:stop] 0/3148, RunningAvgSamplesPerSec=10.949250524720263, CurrSamplesPerSec=10.79947591642712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9148/20000 [14:31:07<28:26:09,  9.43s/it][2022-12-22 04:30:32,707] [INFO] [timer.py:197:stop] 0/3149, RunningAvgSamplesPerSec=10.94919995373839, CurrSamplesPerSec=10.792382983142506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9149/20000 [14:31:17<28:19:37,  9.40s/it][2022-12-22 04:30:41,797] [INFO] [logging.py:68:log_dist] [Rank 0] step=9150, skipped=20, lr=[5.574871794871796e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:30:41,798] [INFO] [timer.py:197:stop] 0/3150, RunningAvgSamplesPerSec=10.949309141252364, CurrSamplesPerSec=11.304058593779773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9150/20000 [14:31:26<28:02:50,  9.31s/it]

                                                          
{'loss': 0.069, 'learning_rate': 5.574871794871796e-06, 'epoch': 0.46}


 46%|████▌     | 9150/20000 [14:31:26<28:02:50,  9.31s/it][2022-12-22 04:30:50,887] [INFO] [timer.py:197:stop] 0/3151, RunningAvgSamplesPerSec=10.94922692967244, CurrSamplesPerSec=10.696402670033702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9151/20000 [14:31:35<27:50:54,  9.24s/it][2022-12-22 04:31:00,317] [INFO] [timer.py:197:stop] 0/3152, RunningAvgSamplesPerSec=10.949226748104579, CurrSamplesPerSec=10.948655020777876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9152/20000 [14:31:44<28:01:01,  9.30s/it][2022-12-22 04:31:09,906] [INFO] [timer.py:197:stop] 0/3153, RunningAvgSamplesPerSec=10.949192373639223, CurrSamplesPerSec=10.841973461595302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9153/20000 [14:31:54<28:16:40,  9.39s/it][2022-12-22 04:31:18,920] [INFO] [timer.py:197:stop] 0/3154, RunningAvgSamplesPerSec=10.949131904768068, CurrSamplesPerSec=10.761854537386771, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9154/20000 [14:32:03<27:56:23,  9.27s/it][2022-12-22 04:31:28,185] [INFO] [timer.py:197:stop] 0/3155, RunningAvgSamplesPerSec=10.949181476568766, CurrSamplesPerSec=11.10769457146307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9155/20000 [14:32:12<27:55:45,  9.27s/it][2022-12-22 04:31:37,682] [INFO] [timer.py:197:stop] 0/3156, RunningAvgSamplesPerSec=10.949253209245757, CurrSamplesPerSec=11.180198368997857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9156/20000 [14:32:22<28:07:50,  9.34s/it][2022-12-22 04:31:47,036] [INFO] [timer.py:197:stop] 0/3157, RunningAvgSamplesPerSec=10.949250858917635, CurrSamplesPerSec=10.941842940971297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9157/20000 [14:32:31<28:08:28,  9.34s/it][2022-12-22 04:31:56,543] [INFO] [timer.py:197:stop] 0/3158, RunningAvgSamplesPerSec=10.949301793100528, CurrSamplesPerSec=11.112393513222974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9158/20000 [14:32:41<28:17:13,  9.39s/it][2022-12-22 04:32:05,771] [INFO] [timer.py:197:stop] 0/3159, RunningAvgSamplesPerSec=10.949316913616226, CurrSamplesPerSec=10.997246217369142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9159/20000 [14:32:50<28:08:10,  9.34s/it][2022-12-22 04:32:14,737] [INFO] [logging.py:68:log_dist] [Rank 0] step=9160, skipped=20, lr=[5.569743589743591e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:32:14,738] [INFO] [timer.py:197:stop] 0/3160, RunningAvgSamplesPerSec=10.949251046779862, CurrSamplesPerSec=10.745186149971538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9160/20000 [14:32:59<27:47:35,  9.23s/it][2022-12-22 04:32:24,569] [INFO] [timer.py:197:stop] 0/3161, RunningAvgSamplesPerSec=10.949191025761532, CurrSamplesPerSec=10.762871138698486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9161/20000 [14:33:09<28:20:00,  9.41s/it][2022-12-22 04:32:33,920] [INFO] [timer.py:197:stop] 0/3162, RunningAvgSamplesPerSec=10.949268743431746, CurrSamplesPerSec=11.200411907085577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9162/20000 [14:33:18<28:16:36,  9.39s/it][2022-12-22 04:32:44,875] [INFO] [timer.py:197:stop] 0/3163, RunningAvgSamplesPerSec=10.949342691590244, CurrSamplesPerSec=11.188116288858513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9163/20000 [14:33:29<29:41:06,  9.86s/it][2022-12-22 04:32:54,288] [INFO] [timer.py:197:stop] 0/3164, RunningAvgSamplesPerSec=10.94940345007882, CurrSamplesPerSec=11.144891060001125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9164/20000 [14:33:38<29:16:39,  9.73s/it][2022-12-22 04:33:03,395] [INFO] [timer.py:197:stop] 0/3165, RunningAvgSamplesPerSec=10.949286015501912, CurrSamplesPerSec=10.590141564863112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9165/20000 [14:33:47<28:42:57,  9.54s/it][2022-12-22 04:33:12,822] [INFO] [timer.py:197:stop] 0/3166, RunningAvgSamplesPerSec=10.9492851022419, CurrSamplesPerSec=10.946397222951024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9166/20000 [14:33:57<28:36:34,  9.51s/it][2022-12-22 04:33:22,272] [INFO] [timer.py:197:stop] 0/3167, RunningAvgSamplesPerSec=10.949299387553063, CurrSamplesPerSec=10.994685525331764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9167/20000 [14:34:06<28:33:23,  9.49s/it][2022-12-22 04:33:31,351] [INFO] [timer.py:197:stop] 0/3168, RunningAvgSamplesPerSec=10.949199533049821, CurrSamplesPerSec=10.64202905112201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9168/20000 [14:34:15<28:10:58,  9.37s/it][2022-12-22 04:33:41,058] [INFO] [timer.py:197:stop] 0/3169, RunningAvgSamplesPerSec=10.949153496087982, CurrSamplesPerSec=10.805315819118913, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9169/20000 [14:34:25<28:29:15,  9.47s/it][2022-12-22 04:33:51,018] [INFO] [logging.py:68:log_dist] [Rank 0] step=9170, skipped=20, lr=[5.564615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:33:51,019] [INFO] [timer.py:197:stop] 0/3170, RunningAvgSamplesPerSec=10.94920400030388, CurrSamplesPerSec=11.111522766340805, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9170/20000 [14:34:35<28:55:43,  9.62s/it][2022-12-22 04:34:00,093] [INFO] [timer.py:197:stop] 0/3171, RunningAvgSamplesPerSec=10.949196957581007, CurrSamplesPerSec=10.92693099752593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9171/20000 [14:34:44<28:26:14,  9.45s/it][2022-12-22 04:34:09,581] [INFO] [timer.py:197:stop] 0/3172, RunningAvgSamplesPerSec=10.949233336302989, CurrSamplesPerSec=11.06574463758434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9172/20000 [14:34:54<28:27:55,  9.46s/it][2022-12-22 04:34:19,638] [INFO] [timer.py:197:stop] 0/3173, RunningAvgSamplesPerSec=10.949186660294398, CurrSamplesPerSec=10.803197179112065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9173/20000 [14:35:04<28:59:52,  9.64s/it][2022-12-22 04:34:28,553] [INFO] [timer.py:197:stop] 0/3174, RunningAvgSamplesPerSec=10.949191887147105, CurrSamplesPerSec=10.96579137249186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9174/20000 [14:35:13<28:20:21,  9.42s/it][2022-12-22 04:34:37,873] [INFO] [timer.py:197:stop] 0/3175, RunningAvgSamplesPerSec=10.949285462302722, CurrSamplesPerSec=11.254379142402966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9175/20000 [14:35:22<28:14:34,  9.39s/it]

                                                          
{'loss': 0.0661, 'learning_rate': 5.5620512820512825e-06, 'epoch': 0.46}


 46%|████▌     | 9175/20000 [14:35:22<28:14:34,  9.39s/it][2022-12-22 04:34:47,303] [INFO] [timer.py:197:stop] 0/3176, RunningAvgSamplesPerSec=10.94927900334265, CurrSamplesPerSec=10.92882302351634, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9176/20000 [14:35:31<28:16:29,  9.40s/it][2022-12-22 04:34:58,131] [INFO] [timer.py:197:stop] 0/3177, RunningAvgSamplesPerSec=10.949227430114542, CurrSamplesPerSec=10.787945958243544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9177/20000 [14:35:42<29:33:23,  9.83s/it][2022-12-22 04:35:07,146] [INFO] [timer.py:197:stop] 0/3178, RunningAvgSamplesPerSec=10.949302083338466, CurrSamplesPerSec=11.19157224156261, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9178/20000 [14:35:51<28:49:02,  9.59s/it][2022-12-22 04:35:16,960] [INFO] [timer.py:197:stop] 0/3179, RunningAvgSamplesPerSec=10.94924608586105, CurrSamplesPerSec=10.774241580935996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9179/20000 [14:36:01<29:01:12,  9.65s/it][2022-12-22 04:35:26,770] [INFO] [logging.py:68:log_dist] [Rank 0] step=9180, skipped=20, lr=[5.5594871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:35:26,770] [INFO] [timer.py:197:stop] 0/3180, RunningAvgSamplesPerSec=10.949243581792762, CurrSamplesPerSec=10.941293934660898, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9180/20000 [14:36:11<29:09:27,  9.70s/it][2022-12-22 04:35:35,859] [INFO] [timer.py:197:stop] 0/3181, RunningAvgSamplesPerSec=10.94913883332564, CurrSamplesPerSec=10.626073565706163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9181/20000 [14:36:20<28:36:10,  9.52s/it][2022-12-22 04:35:45,774] [INFO] [timer.py:197:stop] 0/3182, RunningAvgSamplesPerSec=10.949137990770282, CurrSamplesPerSec=10.946460162574242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9182/20000 [14:36:30<28:57:30,  9.64s/it][2022-12-22 04:35:54,755] [INFO] [timer.py:197:stop] 0/3183, RunningAvgSamplesPerSec=10.949148856280047, CurrSamplesPerSec=10.983810594065467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9183/20000 [14:36:39<28:21:51,  9.44s/it][2022-12-22 04:36:03,654] [INFO] [timer.py:197:stop] 0/3184, RunningAvgSamplesPerSec=10.949176917227296, CurrSamplesPerSec=11.039172701083391, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9184/20000 [14:36:48<27:52:28,  9.28s/it][2022-12-22 04:36:13,375] [INFO] [timer.py:197:stop] 0/3185, RunningAvgSamplesPerSec=10.949049799938889, CurrSamplesPerSec=10.558977434386236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9185/20000 [14:36:57<28:16:18,  9.41s/it][2022-12-22 04:36:22,439] [INFO] [timer.py:197:stop] 0/3186, RunningAvgSamplesPerSec=10.94912875032117, CurrSamplesPerSec=11.206332895923826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9186/20000 [14:37:06<27:57:22,  9.31s/it][2022-12-22 04:36:31,968] [INFO] [timer.py:197:stop] 0/3187, RunningAvgSamplesPerSec=10.949158959980817, CurrSamplesPerSec=11.04619927608394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9187/20000 [14:37:16<28:09:14,  9.37s/it][2022-12-22 04:36:41,053] [INFO] [timer.py:197:stop] 0/3188, RunningAvgSamplesPerSec=10.949249241055691, CurrSamplesPerSec=11.244552034580389, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9188/20000 [14:37:25<27:53:28,  9.29s/it][2022-12-22 04:36:50,112] [INFO] [timer.py:197:stop] 0/3189, RunningAvgSamplesPerSec=10.94919433213654, CurrSamplesPerSec=10.777006495661162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9189/20000 [14:37:34<27:41:00,  9.22s/it][2022-12-22 04:37:01,282] [INFO] [logging.py:68:log_dist] [Rank 0] step=9190, skipped=20, lr=[5.5543589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:37:01,283] [INFO] [timer.py:197:stop] 0/3190, RunningAvgSamplesPerSec=10.949277119368782, CurrSamplesPerSec=11.219636887048937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9190/20000 [14:37:45<29:26:23,  9.80s/it][2022-12-22 04:37:11,138] [INFO] [timer.py:197:stop] 0/3191, RunningAvgSamplesPerSec=10.949217338721999, CurrSamplesPerSec=10.76189811440287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9191/20000 [14:37:55<29:28:59,  9.82s/it][2022-12-22 04:37:20,134] [INFO] [timer.py:197:stop] 0/3192, RunningAvgSamplesPerSec=10.949186051745887, CurrSamplesPerSec=10.850313144190144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9192/20000 [14:38:04<28:44:20,  9.57s/it][2022-12-22 04:37:30,046] [INFO] [timer.py:197:stop] 0/3193, RunningAvgSamplesPerSec=10.949131231671268, CurrSamplesPerSec=10.777005197652432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9193/20000 [14:38:14<29:02:28,  9.67s/it][2022-12-22 04:37:39,397] [INFO] [timer.py:197:stop] 0/3194, RunningAvgSamplesPerSec=10.949105239576932, CurrSamplesPerSec=10.866788223139533, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9194/20000 [14:38:23<28:44:51,  9.58s/it][2022-12-22 04:37:48,800] [INFO] [timer.py:197:stop] 0/3195, RunningAvgSamplesPerSec=10.949022835666831, CurrSamplesPerSec=10.692162166726627, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9195/20000 [14:38:33<28:35:16,  9.52s/it][2022-12-22 04:37:57,940] [INFO] [timer.py:197:stop] 0/3196, RunningAvgSamplesPerSec=10.94901361096067, CurrSamplesPerSec=10.91963817326705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9196/20000 [14:38:42<28:14:19,  9.41s/it][2022-12-22 04:38:07,937] [INFO] [timer.py:197:stop] 0/3197, RunningAvgSamplesPerSec=10.94894472230138, CurrSamplesPerSec=10.733250304241857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9197/20000 [14:38:52<28:45:54,  9.59s/it][2022-12-22 04:38:17,131] [INFO] [timer.py:197:stop] 0/3198, RunningAvgSamplesPerSec=10.949022373579062, CurrSamplesPerSec=11.202872030311202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9198/20000 [14:39:01<28:24:35,  9.47s/it][2022-12-22 04:38:26,894] [INFO] [timer.py:197:stop] 0/3199, RunningAvgSamplesPerSec=10.949099047164625, CurrSamplesPerSec=11.199759545720317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9199/20000 [14:39:11<28:40:23,  9.56s/it][2022-12-22 04:38:35,739] [INFO] [logging.py:68:log_dist] [Rank 0] step=9200, skipped=20, lr=[5.54923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:38:35,740] [INFO] [timer.py:197:stop] 0/3200, RunningAvgSamplesPerSec=10.949176879480575, CurrSamplesPerSec=11.203795030521091, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9200/20000 [14:39:20<28:01:50,  9.34s/it]

                                                          
{'loss': 0.141, 'learning_rate': 5.54923076923077e-06, 'epoch': 0.46}


 46%|████▌     | 9200/20000 [14:39:20<28:01:50,  9.34s/it][2022-12-22 04:38:45,082] [INFO] [timer.py:197:stop] 0/3201, RunningAvgSamplesPerSec=10.949205125707326, CurrSamplesPerSec=11.040288233557295, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9201/20000 [14:39:29<28:01:37,  9.34s/it][2022-12-22 04:38:54,781] [INFO] [timer.py:197:stop] 0/3202, RunningAvgSamplesPerSec=10.949129177150818, CurrSamplesPerSec=10.711445555275391, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9202/20000 [14:39:39<28:20:37,  9.45s/it][2022-12-22 04:39:04,083] [INFO] [timer.py:197:stop] 0/3203, RunningAvgSamplesPerSec=10.949094438858925, CurrSamplesPerSec=10.839049503767122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9203/20000 [14:39:48<28:12:31,  9.41s/it][2022-12-22 04:39:13,543] [INFO] [timer.py:197:stop] 0/3204, RunningAvgSamplesPerSec=10.949186309895616, CurrSamplesPerSec=11.25138464077846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9204/20000 [14:39:58<28:15:18,  9.42s/it][2022-12-22 04:39:22,714] [INFO] [timer.py:197:stop] 0/3205, RunningAvgSamplesPerSec=10.949152281599902, CurrSamplesPerSec=10.84126760973506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9205/20000 [14:40:07<28:01:36,  9.35s/it][2022-12-22 04:39:31,430] [INFO] [timer.py:197:stop] 0/3206, RunningAvgSamplesPerSec=10.949254659135176, CurrSamplesPerSec=11.287296971649038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9206/20000 [14:40:15<27:27:23,  9.16s/it][2022-12-22 04:39:40,811] [INFO] [timer.py:197:stop] 0/3207, RunningAvgSamplesPerSec=10.949348072978237, CurrSamplesPerSec=11.257059884135534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9207/20000 [14:40:25<27:39:18,  9.22s/it][2022-12-22 04:39:50,043] [INFO] [timer.py:197:stop] 0/3208, RunningAvgSamplesPerSec=10.949351004295568, CurrSamplesPerSec=10.958753946865473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9208/20000 [14:40:34<27:39:35,  9.23s/it][2022-12-22 04:40:00,368] [INFO] [timer.py:197:stop] 0/3209, RunningAvgSamplesPerSec=10.949350825141384, CurrSamplesPerSec=10.948776486961725, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9209/20000 [14:40:44<28:38:41,  9.56s/it][2022-12-22 04:40:11,565] [INFO] [logging.py:68:log_dist] [Rank 0] step=9210, skipped=20, lr=[5.544102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:40:11,566] [INFO] [timer.py:197:stop] 0/3210, RunningAvgSamplesPerSec=10.949272068650837, CurrSamplesPerSec=10.702396573644133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9210/20000 [14:40:56<30:07:05, 10.05s/it][2022-12-22 04:40:20,773] [INFO] [timer.py:197:stop] 0/3211, RunningAvgSamplesPerSec=10.949276052715012, CurrSamplesPerSec=10.962071871555535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9211/20000 [14:41:05<29:21:30,  9.80s/it][2022-12-22 04:40:29,803] [INFO] [timer.py:197:stop] 0/3212, RunningAvgSamplesPerSec=10.949217048332262, CurrSamplesPerSec=10.763091657793167, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9212/20000 [14:41:14<28:40:01,  9.57s/it][2022-12-22 04:40:39,641] [INFO] [timer.py:197:stop] 0/3213, RunningAvgSamplesPerSec=10.949188687005549, CurrSamplesPerSec=10.858899792470307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9213/20000 [14:41:24<28:54:33,  9.65s/it][2022-12-22 04:40:49,909] [INFO] [timer.py:197:stop] 0/3214, RunningAvgSamplesPerSec=10.94912498492361, CurrSamplesPerSec=10.748329944559718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9214/20000 [14:41:34<29:27:47,  9.83s/it][2022-12-22 04:41:01,717] [INFO] [timer.py:197:stop] 0/3215, RunningAvgSamplesPerSec=10.949069148869986, CurrSamplesPerSec=10.772614958497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9215/20000 [14:41:46<31:14:07, 10.43s/it][2022-12-22 04:41:11,752] [INFO] [timer.py:197:stop] 0/3216, RunningAvgSamplesPerSec=10.949154119799795, CurrSamplesPerSec=11.229149431076499, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9216/20000 [14:41:56<30:52:50, 10.31s/it][2022-12-22 04:41:20,571] [INFO] [timer.py:197:stop] 0/3217, RunningAvgSamplesPerSec=10.949188059398013, CurrSamplesPerSec=11.059367942550299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9217/20000 [14:42:05<29:32:19,  9.86s/it][2022-12-22 04:41:30,825] [INFO] [timer.py:197:stop] 0/3218, RunningAvgSamplesPerSec=10.949101335375738, CurrSamplesPerSec=10.677209455878302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9218/20000 [14:42:15<29:53:19,  9.98s/it][2022-12-22 04:41:40,000] [INFO] [timer.py:197:stop] 0/3219, RunningAvgSamplesPerSec=10.94919691985273, CurrSamplesPerSec=11.26547900667379, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9219/20000 [14:42:24<29:09:45,  9.74s/it][2022-12-22 04:41:48,840] [INFO] [logging.py:68:log_dist] [Rank 0] step=9220, skipped=20, lr=[5.538974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:41:48,841] [INFO] [timer.py:197:stop] 0/3220, RunningAvgSamplesPerSec=10.949260898781029, CurrSamplesPerSec=11.159025413651463, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9220/20000 [14:42:33<28:21:14,  9.47s/it][2022-12-22 04:41:58,613] [INFO] [timer.py:197:stop] 0/3221, RunningAvgSamplesPerSec=10.949318689580348, CurrSamplesPerSec=11.138503729723308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9221/20000 [14:42:43<28:37:26,  9.56s/it][2022-12-22 04:42:07,628] [INFO] [timer.py:197:stop] 0/3222, RunningAvgSamplesPerSec=10.94925733000086, CurrSamplesPerSec=10.755241826755299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9222/20000 [14:42:52<28:07:56,  9.40s/it][2022-12-22 04:42:17,401] [INFO] [timer.py:197:stop] 0/3223, RunningAvgSamplesPerSec=10.94911167438901, CurrSamplesPerSec=10.49937145076985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9223/20000 [14:43:01<28:28:04,  9.51s/it][2022-12-22 04:42:26,745] [INFO] [timer.py:197:stop] 0/3224, RunningAvgSamplesPerSec=10.949059699953926, CurrSamplesPerSec=10.784171939024446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9224/20000 [14:43:11<28:18:58,  9.46s/it][2022-12-22 04:42:36,993] [INFO] [timer.py:197:stop] 0/3225, RunningAvgSamplesPerSec=10.948957600804842, CurrSamplesPerSec=10.629592504006755, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9225/20000 [14:43:21<29:01:17,  9.70s/it]

                                                          
{'loss': 0.0988, 'learning_rate': 5.536410256410257e-06, 'epoch': 0.46}


 46%|████▌     | 9225/20000 [14:43:21<29:01:17,  9.70s/it][2022-12-22 04:42:46,358] [INFO] [timer.py:197:stop] 0/3226, RunningAvgSamplesPerSec=10.948889751016006, CurrSamplesPerSec=10.734493305264182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9226/20000 [14:43:30<28:43:16,  9.60s/it][2022-12-22 04:42:56,416] [INFO] [timer.py:197:stop] 0/3227, RunningAvgSamplesPerSec=10.948885862836661, CurrSamplesPerSec=10.936364712670304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9227/20000 [14:43:40<29:07:55,  9.74s/it][2022-12-22 04:43:09,132] [INFO] [timer.py:197:stop] 0/3228, RunningAvgSamplesPerSec=10.94882107829339, CurrSamplesPerSec=10.743804357309985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9228/20000 [14:43:53<31:48:19, 10.63s/it][2022-12-22 04:43:18,079] [INFO] [timer.py:197:stop] 0/3229, RunningAvgSamplesPerSec=10.948889219895623, CurrSamplesPerSec=11.173219382658774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9229/20000 [14:44:02<30:17:31, 10.12s/it][2022-12-22 04:43:28,447] [INFO] [logging.py:68:log_dist] [Rank 0] step=9230, skipped=20, lr=[5.533846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:43:28,448] [INFO] [timer.py:197:stop] 0/3230, RunningAvgSamplesPerSec=10.948940366326593, CurrSamplesPerSec=11.11651680883976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9230/20000 [14:44:12<30:30:32, 10.20s/it][2022-12-22 04:43:37,240] [INFO] [timer.py:197:stop] 0/3231, RunningAvgSamplesPerSec=10.948998968328834, CurrSamplesPerSec=11.141493006087872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9231/20000 [14:44:21<29:14:39,  9.78s/it][2022-12-22 04:43:48,107] [INFO] [timer.py:197:stop] 0/3232, RunningAvgSamplesPerSec=10.949079623872523, CurrSamplesPerSec=11.215864123129911, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9232/20000 [14:44:32<30:13:14, 10.10s/it][2022-12-22 04:43:57,084] [INFO] [timer.py:197:stop] 0/3233, RunningAvgSamplesPerSec=10.949030064074014, CurrSamplesPerSec=10.791259285779727, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9233/20000 [14:44:41<29:12:24,  9.77s/it][2022-12-22 04:44:05,790] [INFO] [timer.py:197:stop] 0/3234, RunningAvgSamplesPerSec=10.949142916228217, CurrSamplesPerSec=11.326333200000676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9234/20000 [14:44:50<28:15:15,  9.45s/it][2022-12-22 04:44:15,526] [INFO] [timer.py:197:stop] 0/3235, RunningAvgSamplesPerSec=10.949142047681113, CurrSamplesPerSec=10.946335623169565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9235/20000 [14:44:59<28:30:35,  9.53s/it][2022-12-22 04:44:25,456] [INFO] [timer.py:197:stop] 0/3236, RunningAvgSamplesPerSec=10.949146787603224, CurrSamplesPerSec=10.964492439849588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9236/20000 [14:45:09<28:51:46,  9.65s/it][2022-12-22 04:44:34,393] [INFO] [timer.py:197:stop] 0/3237, RunningAvgSamplesPerSec=10.949171983306874, CurrSamplesPerSec=11.031266015362748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9237/20000 [14:45:18<28:13:02,  9.44s/it][2022-12-22 04:44:44,608] [INFO] [timer.py:197:stop] 0/3238, RunningAvgSamplesPerSec=10.949243706983193, CurrSamplesPerSec=11.18629471509887, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9238/20000 [14:45:29<28:54:41,  9.67s/it][2022-12-22 04:44:53,837] [INFO] [timer.py:197:stop] 0/3239, RunningAvgSamplesPerSec=10.9492921895273, CurrSamplesPerSec=11.10846312531166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9239/20000 [14:45:38<28:30:47,  9.54s/it][2022-12-22 04:45:03,787] [INFO] [logging.py:68:log_dist] [Rank 0] step=9240, skipped=20, lr=[5.528717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:45:03,788] [INFO] [timer.py:197:stop] 0/3240, RunningAvgSamplesPerSec=10.949287946042121, CurrSamplesPerSec=10.935569000599829, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9240/20000 [14:45:48<28:52:43,  9.66s/it][2022-12-22 04:45:13,127] [INFO] [timer.py:197:stop] 0/3241, RunningAvgSamplesPerSec=10.94923960992436, CurrSamplesPerSec=10.794933646468383, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9241/20000 [14:45:57<28:35:11,  9.57s/it][2022-12-22 04:45:22,476] [INFO] [timer.py:197:stop] 0/3242, RunningAvgSamplesPerSec=10.949249023881006, CurrSamplesPerSec=10.979826007469468, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9242/20000 [14:46:06<28:23:25,  9.50s/it][2022-12-22 04:45:32,198] [INFO] [timer.py:197:stop] 0/3243, RunningAvgSamplesPerSec=10.949273039871862, CurrSamplesPerSec=11.027641956590845, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9243/20000 [14:46:16<28:35:09,  9.57s/it][2022-12-22 04:45:41,297] [INFO] [timer.py:197:stop] 0/3244, RunningAvgSamplesPerSec=10.949279893918881, CurrSamplesPerSec=10.971539033717372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9244/20000 [14:46:25<28:09:51,  9.43s/it][2022-12-22 04:45:50,524] [INFO] [timer.py:197:stop] 0/3245, RunningAvgSamplesPerSec=10.94932182800978, CurrSamplesPerSec=11.086981910037968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9245/20000 [14:46:34<27:58:59,  9.37s/it][2022-12-22 04:45:59,707] [INFO] [timer.py:197:stop] 0/3246, RunningAvgSamplesPerSec=10.94934064029257, CurrSamplesPerSec=11.01069081359201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9246/20000 [14:46:44<27:48:58,  9.31s/it][2022-12-22 04:46:10,432] [INFO] [timer.py:197:stop] 0/3247, RunningAvgSamplesPerSec=10.949370470421364, CurrSamplesPerSec=11.047002532120864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9247/20000 [14:46:54<29:04:45,  9.74s/it][2022-12-22 04:46:19,363] [INFO] [timer.py:197:stop] 0/3248, RunningAvgSamplesPerSec=10.949344692536867, CurrSamplesPerSec=10.866329857633044, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9248/20000 [14:47:03<28:21:23,  9.49s/it][2022-12-22 04:46:29,920] [INFO] [timer.py:197:stop] 0/3249, RunningAvgSamplesPerSec=10.949330620945991, CurrSamplesPerSec=10.903844047856191, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▌     | 9249/20000 [14:47:14<29:18:19,  9.81s/it][2022-12-22 04:46:40,884] [INFO] [logging.py:68:log_dist] [Rank 0] step=9250, skipped=20, lr=[5.523589743589745e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:46:40,885] [INFO] [timer.py:197:stop] 0/3250, RunningAvgSamplesPerSec=10.949305553001182, CurrSamplesPerSec=10.868510738605625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9250/20000 [14:47:25<30:20:03, 10.16s/it]

                                                          
{'loss': 0.0718, 'learning_rate': 5.523589743589745e-06, 'epoch': 0.46}


 46%|████▋     | 9250/20000 [14:47:25<30:20:03, 10.16s/it][2022-12-22 04:46:50,584] [INFO] [timer.py:197:stop] 0/3251, RunningAvgSamplesPerSec=10.949274613947406, CurrSamplesPerSec=10.849698734285475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9251/20000 [14:47:35<29:55:12, 10.02s/it][2022-12-22 04:46:59,852] [INFO] [timer.py:197:stop] 0/3252, RunningAvgSamplesPerSec=10.949215280720948, CurrSamplesPerSec=10.759777919298536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9252/20000 [14:47:44<29:14:34,  9.79s/it][2022-12-22 04:47:08,906] [INFO] [timer.py:197:stop] 0/3253, RunningAvgSamplesPerSec=10.949241728370017, CurrSamplesPerSec=11.035876909491039, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9253/20000 [14:47:53<28:34:38,  9.57s/it][2022-12-22 04:47:18,457] [INFO] [timer.py:197:stop] 0/3254, RunningAvgSamplesPerSec=10.949239023475352, CurrSamplesPerSec=10.940452469788633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9254/20000 [14:48:02<28:33:19,  9.57s/it][2022-12-22 04:47:27,329] [INFO] [timer.py:197:stop] 0/3255, RunningAvgSamplesPerSec=10.94934240533291, CurrSamplesPerSec=11.296193487830317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9255/20000 [14:48:11<27:55:49,  9.36s/it][2022-12-22 04:47:36,793] [INFO] [timer.py:197:stop] 0/3256, RunningAvgSamplesPerSec=10.949274846315022, CurrSamplesPerSec=10.733830993681911, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9256/20000 [14:48:21<28:01:23,  9.39s/it][2022-12-22 04:47:46,453] [INFO] [timer.py:197:stop] 0/3257, RunningAvgSamplesPerSec=10.949263708193545, CurrSamplesPerSec=10.913139872118473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9257/20000 [14:48:30<28:15:44,  9.47s/it][2022-12-22 04:47:55,798] [INFO] [timer.py:197:stop] 0/3258, RunningAvgSamplesPerSec=10.949200021979216, CurrSamplesPerSec=10.745754366407285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9258/20000 [14:48:40<28:08:49,  9.43s/it][2022-12-22 04:48:05,903] [INFO] [timer.py:197:stop] 0/3259, RunningAvgSamplesPerSec=10.949155943277846, CurrSamplesPerSec=10.80749316105684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9259/20000 [14:48:50<28:44:47,  9.63s/it][2022-12-22 04:48:16,812] [INFO] [logging.py:68:log_dist] [Rank 0] step=9260, skipped=20, lr=[5.5184615384615396e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:48:16,813] [INFO] [timer.py:197:stop] 0/3260, RunningAvgSamplesPerSec=10.949064750758279, CurrSamplesPerSec=10.659897334603297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9260/20000 [14:49:01<29:53:05, 10.02s/it][2022-12-22 04:48:25,722] [INFO] [timer.py:197:stop] 0/3261, RunningAvgSamplesPerSec=10.94915070801612, CurrSamplesPerSec=11.236552650674554, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9261/20000 [14:49:10<28:53:25,  9.68s/it][2022-12-22 04:48:35,639] [INFO] [timer.py:197:stop] 0/3262, RunningAvgSamplesPerSec=10.949204962254681, CurrSamplesPerSec=11.128922608442394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9262/20000 [14:49:20<29:05:43,  9.75s/it][2022-12-22 04:48:44,889] [INFO] [timer.py:197:stop] 0/3263, RunningAvgSamplesPerSec=10.949172717856605, CurrSamplesPerSec=10.845055853144695, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9263/20000 [14:49:29<28:38:28,  9.60s/it][2022-12-22 04:48:53,943] [INFO] [timer.py:197:stop] 0/3264, RunningAvgSamplesPerSec=10.9491675220485, CurrSamplesPerSec=10.93225017894919, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9264/20000 [14:49:38<28:08:49,  9.44s/it][2022-12-22 04:49:02,940] [INFO] [timer.py:197:stop] 0/3265, RunningAvgSamplesPerSec=10.94918483045276, CurrSamplesPerSec=11.005937583256259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9265/20000 [14:49:47<27:44:59,  9.31s/it][2022-12-22 04:49:12,397] [INFO] [timer.py:197:stop] 0/3266, RunningAvgSamplesPerSec=10.949131678631828, CurrSamplesPerSec=10.77840246868302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9266/20000 [14:49:56<27:52:55,  9.35s/it][2022-12-22 04:49:21,412] [INFO] [timer.py:197:stop] 0/3267, RunningAvgSamplesPerSec=10.94914511314553, CurrSamplesPerSec=10.993171742221566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9267/20000 [14:50:05<27:34:43,  9.25s/it][2022-12-22 04:49:30,985] [INFO] [timer.py:197:stop] 0/3268, RunningAvgSamplesPerSec=10.9491596444864, CurrSamplesPerSec=10.996811018299653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9268/20000 [14:50:15<27:51:54,  9.35s/it][2022-12-22 04:49:40,342] [INFO] [timer.py:197:stop] 0/3269, RunningAvgSamplesPerSec=10.94916261651405, CurrSamplesPerSec=10.958877874212781, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9269/20000 [14:50:24<27:52:16,  9.35s/it][2022-12-22 04:49:50,004] [INFO] [logging.py:68:log_dist] [Rank 0] step=9270, skipped=20, lr=[5.513333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:49:50,005] [INFO] [timer.py:197:stop] 0/3270, RunningAvgSamplesPerSec=10.949092527627247, CurrSamplesPerSec=10.724804154345824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9270/20000 [14:50:34<28:08:53,  9.44s/it][2022-12-22 04:49:58,928] [INFO] [timer.py:197:stop] 0/3271, RunningAvgSamplesPerSec=10.949122603484442, CurrSamplesPerSec=11.048301080931822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9271/20000 [14:50:43<27:40:47,  9.29s/it][2022-12-22 04:50:08,534] [INFO] [timer.py:197:stop] 0/3272, RunningAvgSamplesPerSec=10.949018795631288, CurrSamplesPerSec=10.619875335808208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9272/20000 [14:50:52<27:57:41,  9.38s/it][2022-12-22 04:50:17,693] [INFO] [timer.py:197:stop] 0/3273, RunningAvgSamplesPerSec=10.94891335480819, CurrSamplesPerSec=10.614651305925921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9273/20000 [14:51:02<27:45:31,  9.32s/it][2022-12-22 04:50:27,038] [INFO] [timer.py:197:stop] 0/3274, RunningAvgSamplesPerSec=10.948958444658286, CurrSamplesPerSec=11.098461858789817, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9274/20000 [14:51:11<27:46:58,  9.32s/it][2022-12-22 04:50:36,238] [INFO] [timer.py:197:stop] 0/3275, RunningAvgSamplesPerSec=10.948970695657508, CurrSamplesPerSec=10.989203305708527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9275/20000 [14:51:20<27:40:04,  9.29s/it]

                                                          
{'loss': 0.0821, 'learning_rate': 5.5107692307692315e-06, 'epoch': 0.46}


 46%|████▋     | 9275/20000 [14:51:20<27:40:04,  9.29s/it][2022-12-22 04:50:45,721] [INFO] [timer.py:197:stop] 0/3276, RunningAvgSamplesPerSec=10.949055255938696, CurrSamplesPerSec=11.233000707744587, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9276/20000 [14:51:30<27:50:26,  9.35s/it][2022-12-22 04:50:58,050] [INFO] [timer.py:197:stop] 0/3277, RunningAvgSamplesPerSec=10.949089062196721, CurrSamplesPerSec=11.060901379830012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9277/20000 [14:51:42<30:30:14, 10.24s/it][2022-12-22 04:51:08,729] [INFO] [timer.py:197:stop] 0/3278, RunningAvgSamplesPerSec=10.94896874318092, CurrSamplesPerSec=10.568616716547965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9278/20000 [14:51:53<30:53:30, 10.37s/it][2022-12-22 04:51:18,278] [INFO] [timer.py:197:stop] 0/3279, RunningAvgSamplesPerSec=10.949044504062327, CurrSamplesPerSec=11.2029954622593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9279/20000 [14:52:02<30:09:12, 10.13s/it][2022-12-22 04:51:27,730] [INFO] [logging.py:68:log_dist] [Rank 0] step=9280, skipped=20, lr=[5.5082051282051285e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:51:27,731] [INFO] [timer.py:197:stop] 0/3280, RunningAvgSamplesPerSec=10.949044612897254, CurrSamplesPerSec=10.949401276570715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9280/20000 [14:52:12<29:33:01,  9.92s/it][2022-12-22 04:51:37,178] [INFO] [timer.py:197:stop] 0/3281, RunningAvgSamplesPerSec=10.948983172848324, CurrSamplesPerSec=10.751221518282893, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9281/20000 [14:52:21<29:07:20,  9.78s/it][2022-12-22 04:51:48,003] [INFO] [timer.py:197:stop] 0/3282, RunningAvgSamplesPerSec=10.948912963457703, CurrSamplesPerSec=10.723438736325777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9282/20000 [14:52:32<30:03:08, 10.09s/it][2022-12-22 04:51:57,130] [INFO] [timer.py:197:stop] 0/3283, RunningAvgSamplesPerSec=10.948798186229617, CurrSamplesPerSec=10.584846985371222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9283/20000 [14:52:41<29:11:07,  9.80s/it][2022-12-22 04:52:06,353] [INFO] [timer.py:197:stop] 0/3284, RunningAvgSamplesPerSec=10.948847686373496, CurrSamplesPerSec=11.11370380053785, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9284/20000 [14:52:50<28:39:50,  9.63s/it][2022-12-22 04:52:15,932] [INFO] [timer.py:197:stop] 0/3285, RunningAvgSamplesPerSec=10.948725961056816, CurrSamplesPerSec=10.563291672475906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9285/20000 [14:53:00<28:36:59,  9.61s/it][2022-12-22 04:52:25,341] [INFO] [timer.py:197:stop] 0/3286, RunningAvgSamplesPerSec=10.948755698022921, CurrSamplesPerSec=11.047260762608891, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9286/20000 [14:53:09<28:25:49,  9.55s/it][2022-12-22 04:52:34,532] [INFO] [timer.py:197:stop] 0/3287, RunningAvgSamplesPerSec=10.948850895574504, CurrSamplesPerSec=11.270671582000983, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9287/20000 [14:53:18<28:06:14,  9.44s/it][2022-12-22 04:52:44,682] [INFO] [timer.py:197:stop] 0/3288, RunningAvgSamplesPerSec=10.94875499923516, CurrSamplesPerSec=10.642548434743015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9288/20000 [14:53:29<28:43:56,  9.66s/it][2022-12-22 04:52:54,884] [INFO] [timer.py:197:stop] 0/3289, RunningAvgSamplesPerSec=10.948702727979944, CurrSamplesPerSec=10.779593182735589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9289/20000 [14:53:39<29:12:59,  9.82s/it][2022-12-22 04:53:04,709] [INFO] [logging.py:68:log_dist] [Rank 0] step=9290, skipped=20, lr=[5.5030769230769234e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:53:04,710] [INFO] [timer.py:197:stop] 0/3290, RunningAvgSamplesPerSec=10.948656457300325, CurrSamplesPerSec=10.798649172483785, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9290/20000 [14:53:49<29:13:09,  9.82s/it][2022-12-22 04:53:13,640] [INFO] [timer.py:197:stop] 0/3291, RunningAvgSamplesPerSec=10.948729772681492, CurrSamplesPerSec=11.1952194219242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9291/20000 [14:53:58<28:25:15,  9.55s/it][2022-12-22 04:53:23,241] [INFO] [timer.py:197:stop] 0/3292, RunningAvgSamplesPerSec=10.948813330481382, CurrSamplesPerSec=11.230712930144026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9292/20000 [14:54:07<28:27:34,  9.57s/it][2022-12-22 04:53:33,592] [INFO] [timer.py:197:stop] 0/3293, RunningAvgSamplesPerSec=10.948803299654596, CurrSamplesPerSec=10.915901082141797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9293/20000 [14:54:18<29:09:20,  9.80s/it][2022-12-22 04:53:42,924] [INFO] [timer.py:197:stop] 0/3294, RunningAvgSamplesPerSec=10.948775658524964, CurrSamplesPerSec=10.85855849022869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9294/20000 [14:54:27<28:44:00,  9.66s/it][2022-12-22 04:53:51,992] [INFO] [timer.py:197:stop] 0/3295, RunningAvgSamplesPerSec=10.948864451058519, CurrSamplesPerSec=11.249189779776327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9295/20000 [14:54:36<28:12:02,  9.48s/it][2022-12-22 04:54:01,400] [INFO] [timer.py:197:stop] 0/3296, RunningAvgSamplesPerSec=10.948752011248125, CurrSamplesPerSec=10.590603248905207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9296/20000 [14:54:45<28:07:50,  9.46s/it][2022-12-22 04:54:11,838] [INFO] [timer.py:197:stop] 0/3297, RunningAvgSamplesPerSec=10.948844484751982, CurrSamplesPerSec=11.26217193344902, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9297/20000 [14:54:56<28:59:57,  9.75s/it][2022-12-22 04:54:22,373] [INFO] [timer.py:197:stop] 0/3298, RunningAvgSamplesPerSec=10.948774674525417, CurrSamplesPerSec=10.723484573085116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9298/20000 [14:55:06<29:41:34,  9.99s/it][2022-12-22 04:54:33,966] [INFO] [timer.py:197:stop] 0/3299, RunningAvgSamplesPerSec=10.948904669470188, CurrSamplesPerSec=11.39482343476542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9299/20000 [14:55:18<31:07:17, 10.47s/it][2022-12-22 04:54:45,273] [INFO] [logging.py:68:log_dist] [Rank 0] step=9300, skipped=20, lr=[5.4979487179487175e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:54:45,274] [INFO] [timer.py:197:stop] 0/3300, RunningAvgSamplesPerSec=10.948976236569175, CurrSamplesPerSec=11.190131574230213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 46%|████▋     | 9300/20000 [14:55:29<31:51:57, 10.72s/it]

                                                          
{'loss': 0.0823, 'learning_rate': 5.4979487179487175e-06, 'epoch': 0.47}


 46%|████▋     | 9300/20000 [14:55:29<31:51:57, 10.72s/it][2022-12-22 04:54:56,497] [INFO] [timer.py:197:stop] 0/3301, RunningAvgSamplesPerSec=10.948966144108736, CurrSamplesPerSec=10.915782119838155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9301/20000 [14:55:40<32:18:35, 10.87s/it][2022-12-22 04:55:07,786] [INFO] [timer.py:197:stop] 0/3302, RunningAvgSamplesPerSec=10.948959050454913, CurrSamplesPerSec=10.92560701354116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9302/20000 [14:55:52<32:40:45, 11.00s/it][2022-12-22 04:55:16,733] [INFO] [timer.py:197:stop] 0/3303, RunningAvgSamplesPerSec=10.94903044218031, CurrSamplesPerSec=11.189805516103917, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9303/20000 [14:56:01<30:50:57, 10.38s/it][2022-12-22 04:55:28,373] [INFO] [timer.py:197:stop] 0/3304, RunningAvgSamplesPerSec=10.949067937732229, CurrSamplesPerSec=11.074256365371166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9304/20000 [14:56:12<31:58:02, 10.76s/it][2022-12-22 04:55:37,611] [INFO] [timer.py:197:stop] 0/3305, RunningAvgSamplesPerSec=10.94906072478932, CurrSamplesPerSec=10.925295299117174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9305/20000 [14:56:22<30:36:29, 10.30s/it][2022-12-22 04:55:46,765] [INFO] [timer.py:197:stop] 0/3306, RunningAvgSamplesPerSec=10.949197346921613, CurrSamplesPerSec=11.419864306198104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9306/20000 [14:56:31<29:34:51,  9.96s/it][2022-12-22 04:55:55,743] [INFO] [timer.py:197:stop] 0/3307, RunningAvgSamplesPerSec=10.949204054478631, CurrSamplesPerSec=10.971410784069016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9307/20000 [14:56:40<28:42:18,  9.66s/it][2022-12-22 04:56:06,545] [INFO] [timer.py:197:stop] 0/3308, RunningAvgSamplesPerSec=10.949069717294089, CurrSamplesPerSec=10.522392311326655, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9308/20000 [14:56:51<29:43:01, 10.01s/it][2022-12-22 04:56:15,951] [INFO] [timer.py:197:stop] 0/3309, RunningAvgSamplesPerSec=10.949124855653963, CurrSamplesPerSec=11.134499430987749, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9309/20000 [14:57:00<29:10:44,  9.83s/it][2022-12-22 04:56:26,278] [INFO] [logging.py:68:log_dist] [Rank 0] step=9310, skipped=20, lr=[5.492820512820514e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:56:26,279] [INFO] [timer.py:197:stop] 0/3310, RunningAvgSamplesPerSec=10.94914862716756, CurrSamplesPerSec=11.028329696601586, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9310/20000 [14:57:10<29:37:27,  9.98s/it][2022-12-22 04:56:35,202] [INFO] [timer.py:197:stop] 0/3311, RunningAvgSamplesPerSec=10.949143552276823, CurrSamplesPerSec=10.932381521812127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9311/20000 [14:57:19<28:40:58,  9.66s/it][2022-12-22 04:56:45,070] [INFO] [timer.py:197:stop] 0/3312, RunningAvgSamplesPerSec=10.949011554185716, CurrSamplesPerSec=10.528990554577799, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9312/20000 [14:57:29<28:51:57,  9.72s/it][2022-12-22 04:56:54,021] [INFO] [timer.py:197:stop] 0/3313, RunningAvgSamplesPerSec=10.949121933224395, CurrSamplesPerSec=11.327092637092147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9313/20000 [14:57:38<28:10:30,  9.49s/it][2022-12-22 04:57:03,398] [INFO] [timer.py:197:stop] 0/3314, RunningAvgSamplesPerSec=10.94921907207427, CurrSamplesPerSec=11.280582340715073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9314/20000 [14:57:47<28:04:17,  9.46s/it][2022-12-22 04:57:12,791] [INFO] [timer.py:197:stop] 0/3315, RunningAvgSamplesPerSec=10.949129080169584, CurrSamplesPerSec=10.658976698679082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9315/20000 [14:57:57<28:00:42,  9.44s/it][2022-12-22 04:57:22,173] [INFO] [timer.py:197:stop] 0/3316, RunningAvgSamplesPerSec=10.949147718763443, CurrSamplesPerSec=11.011247709848137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9316/20000 [14:58:06<27:57:35,  9.42s/it][2022-12-22 04:57:31,366] [INFO] [timer.py:197:stop] 0/3317, RunningAvgSamplesPerSec=10.949157106406124, CurrSamplesPerSec=10.980356429941162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9317/20000 [14:58:15<27:45:13,  9.35s/it][2022-12-22 04:57:40,752] [INFO] [timer.py:197:stop] 0/3318, RunningAvgSamplesPerSec=10.949143431664023, CurrSamplesPerSec=10.903998627025063, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9318/20000 [14:58:25<27:46:50,  9.36s/it][2022-12-22 04:57:50,244] [INFO] [timer.py:197:stop] 0/3319, RunningAvgSamplesPerSec=10.949095821235455, CurrSamplesPerSec=10.793464383155976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9319/20000 [14:58:34<27:53:37,  9.40s/it][2022-12-22 04:57:59,596] [INFO] [logging.py:68:log_dist] [Rank 0] step=9320, skipped=20, lr=[5.487692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:57:59,597] [INFO] [timer.py:197:stop] 0/3320, RunningAvgSamplesPerSec=10.949119414109074, CurrSamplesPerSec=11.02794051039392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9320/20000 [14:58:44<27:50:52,  9.39s/it][2022-12-22 04:58:08,835] [INFO] [timer.py:197:stop] 0/3321, RunningAvgSamplesPerSec=10.949192397007879, CurrSamplesPerSec=11.196828128990612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9321/20000 [14:58:53<27:42:47,  9.34s/it][2022-12-22 04:58:17,836] [INFO] [timer.py:197:stop] 0/3322, RunningAvgSamplesPerSec=10.949206023974137, CurrSamplesPerSec=10.99462157959966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9322/20000 [14:59:02<27:24:22,  9.24s/it][2022-12-22 04:58:28,202] [INFO] [timer.py:197:stop] 0/3323, RunningAvgSamplesPerSec=10.949153599518258, CurrSamplesPerSec=10.777828630667827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9323/20000 [14:59:12<28:24:19,  9.58s/it][2022-12-22 04:58:37,464] [INFO] [timer.py:197:stop] 0/3324, RunningAvgSamplesPerSec=10.949219056435451, CurrSamplesPerSec=11.171006095883678, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9324/20000 [14:59:21<28:07:21,  9.48s/it][2022-12-22 04:58:46,499] [INFO] [timer.py:197:stop] 0/3325, RunningAvgSamplesPerSec=10.949199587564218, CurrSamplesPerSec=10.884903898466506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9325/20000 [14:59:30<27:43:14,  9.35s/it]

                                                          
{'loss': 0.0631, 'learning_rate': 5.485128205128205e-06, 'epoch': 0.47}


 47%|████▋     | 9325/20000 [14:59:30<27:43:14,  9.35s/it][2022-12-22 04:58:55,572] [INFO] [timer.py:197:stop] 0/3326, RunningAvgSamplesPerSec=10.949104631552897, CurrSamplesPerSec=10.642407086494611, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9326/20000 [14:59:40<27:28:23,  9.27s/it][2022-12-22 04:59:05,160] [INFO] [timer.py:197:stop] 0/3327, RunningAvgSamplesPerSec=10.94903579122815, CurrSamplesPerSec=10.724896280099207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9327/20000 [14:59:49<27:45:26,  9.36s/it][2022-12-22 04:59:15,113] [INFO] [timer.py:197:stop] 0/3328, RunningAvgSamplesPerSec=10.949065836618455, CurrSamplesPerSec=11.049886942973401, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9328/20000 [14:59:59<28:16:47,  9.54s/it][2022-12-22 04:59:24,471] [INFO] [timer.py:197:stop] 0/3329, RunningAvgSamplesPerSec=10.949001593175984, CurrSamplesPerSec=10.739419208586943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9329/20000 [15:00:08<28:06:56,  9.49s/it][2022-12-22 04:59:33,626] [INFO] [logging.py:68:log_dist] [Rank 0] step=9330, skipped=20, lr=[5.482564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 04:59:33,627] [INFO] [timer.py:197:stop] 0/3330, RunningAvgSamplesPerSec=10.948877129177054, CurrSamplesPerSec=10.549880193714863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9330/20000 [15:00:18<27:49:13,  9.39s/it][2022-12-22 04:59:42,958] [INFO] [timer.py:197:stop] 0/3331, RunningAvgSamplesPerSec=10.948943577659845, CurrSamplesPerSec=11.174644068615075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9331/20000 [15:00:27<27:46:07,  9.37s/it][2022-12-22 04:59:52,856] [INFO] [timer.py:197:stop] 0/3332, RunningAvgSamplesPerSec=10.948909604796366, CurrSamplesPerSec=10.836970552807488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9332/20000 [15:00:37<28:14:08,  9.53s/it][2022-12-22 05:00:01,626] [INFO] [timer.py:197:stop] 0/3333, RunningAvgSamplesPerSec=10.948994181840387, CurrSamplesPerSec=11.238073986579142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9333/20000 [15:00:46<27:33:31,  9.30s/it][2022-12-22 05:00:12,647] [INFO] [timer.py:197:stop] 0/3334, RunningAvgSamplesPerSec=10.948924665700968, CurrSamplesPerSec=10.722163603398174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9334/20000 [15:00:57<29:05:07,  9.82s/it][2022-12-22 05:00:21,903] [INFO] [timer.py:197:stop] 0/3335, RunningAvgSamplesPerSec=10.948929899724403, CurrSamplesPerSec=10.966397497050208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9335/20000 [15:01:06<28:35:00,  9.65s/it][2022-12-22 05:00:30,953] [INFO] [timer.py:197:stop] 0/3336, RunningAvgSamplesPerSec=10.948932783163734, CurrSamplesPerSec=10.9585517320859, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9336/20000 [15:01:15<28:02:55,  9.47s/it][2022-12-22 05:00:39,902] [INFO] [timer.py:197:stop] 0/3337, RunningAvgSamplesPerSec=10.948943923955134, CurrSamplesPerSec=10.986213795404948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9337/20000 [15:01:24<27:35:04,  9.31s/it][2022-12-22 05:00:50,224] [INFO] [timer.py:197:stop] 0/3338, RunningAvgSamplesPerSec=10.94894898205556, CurrSamplesPerSec=10.96584378416416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9338/20000 [15:01:34<28:28:43,  9.62s/it][2022-12-22 05:00:59,533] [INFO] [timer.py:197:stop] 0/3339, RunningAvgSamplesPerSec=10.948882335673852, CurrSamplesPerSec=10.730976220355396, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9339/20000 [15:01:43<28:12:12,  9.52s/it][2022-12-22 05:01:08,805] [INFO] [logging.py:68:log_dist] [Rank 0] step=9340, skipped=20, lr=[5.477435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:01:08,806] [INFO] [timer.py:197:stop] 0/3340, RunningAvgSamplesPerSec=10.948872070083114, CurrSamplesPerSec=10.914722670718948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9340/20000 [15:01:53<27:58:38,  9.45s/it][2022-12-22 05:01:18,188] [INFO] [timer.py:197:stop] 0/3341, RunningAvgSamplesPerSec=10.948886516994406, CurrSamplesPerSec=10.99732370984305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9341/20000 [15:02:02<27:55:00,  9.43s/it][2022-12-22 05:01:27,493] [INFO] [timer.py:197:stop] 0/3342, RunningAvgSamplesPerSec=10.948837622314903, CurrSamplesPerSec=10.787977607373822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9342/20000 [15:02:11<27:48:12,  9.39s/it][2022-12-22 05:01:36,710] [INFO] [timer.py:197:stop] 0/3343, RunningAvgSamplesPerSec=10.948840498412094, CurrSamplesPerSec=10.958455101109626, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9343/20000 [15:02:21<27:38:45,  9.34s/it][2022-12-22 05:01:49,147] [INFO] [timer.py:197:stop] 0/3344, RunningAvgSamplesPerSec=10.948946079574982, CurrSamplesPerSec=11.313439286022401, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9344/20000 [15:02:33<30:23:42, 10.27s/it][2022-12-22 05:01:58,227] [INFO] [timer.py:197:stop] 0/3345, RunningAvgSamplesPerSec=10.949038263247376, CurrSamplesPerSec=11.266038333633903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9345/20000 [15:02:42<29:20:10,  9.91s/it][2022-12-22 05:02:07,261] [INFO] [timer.py:197:stop] 0/3346, RunningAvgSamplesPerSec=10.948983134086339, CurrSamplesPerSec=10.76773803676392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9346/20000 [15:02:51<28:33:17,  9.65s/it][2022-12-22 05:02:17,384] [INFO] [timer.py:197:stop] 0/3347, RunningAvgSamplesPerSec=10.948960124774276, CurrSamplesPerSec=10.872554084520836, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9347/20000 [15:03:01<28:58:22,  9.79s/it][2022-12-22 05:02:26,868] [INFO] [timer.py:197:stop] 0/3348, RunningAvgSamplesPerSec=10.949015057065232, CurrSamplesPerSec=11.135900862088635, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9348/20000 [15:03:11<28:41:50,  9.70s/it][2022-12-22 05:02:36,017] [INFO] [timer.py:197:stop] 0/3349, RunningAvgSamplesPerSec=10.949085109068005, CurrSamplesPerSec=11.188608266789219, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9349/20000 [15:03:20<28:12:24,  9.53s/it][2022-12-22 05:02:45,256] [INFO] [logging.py:68:log_dist] [Rank 0] step=9350, skipped=20, lr=[5.472307692307692e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:02:45,257] [INFO] [timer.py:197:stop] 0/3350, RunningAvgSamplesPerSec=10.949133001458565, CurrSamplesPerSec=11.111811160257226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9350/20000 [15:03:29<27:56:36,  9.45s/it]

                                                          
{'loss': 0.0911, 'learning_rate': 5.472307692307692e-06, 'epoch': 0.47}


 47%|████▋     | 9350/20000 [15:03:29<27:56:36,  9.45s/it][2022-12-22 05:02:54,944] [INFO] [timer.py:197:stop] 0/3351, RunningAvgSamplesPerSec=10.949132397192479, CurrSamplesPerSec=10.947109688192949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9351/20000 [15:03:39<28:09:19,  9.52s/it][2022-12-22 05:03:03,900] [INFO] [timer.py:197:stop] 0/3352, RunningAvgSamplesPerSec=10.949116738328593, CurrSamplesPerSec=10.896925252460466, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9352/20000 [15:03:48<27:39:15,  9.35s/it][2022-12-22 05:03:14,209] [INFO] [timer.py:197:stop] 0/3353, RunningAvgSamplesPerSec=10.949111031573475, CurrSamplesPerSec=10.930026733903784, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9353/20000 [15:03:58<28:30:09,  9.64s/it][2022-12-22 05:03:23,385] [INFO] [timer.py:197:stop] 0/3354, RunningAvgSamplesPerSec=10.949166522043484, CurrSamplesPerSec=11.138328565176092, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9354/20000 [15:04:07<28:05:25,  9.50s/it][2022-12-22 05:03:32,777] [INFO] [timer.py:197:stop] 0/3355, RunningAvgSamplesPerSec=10.94915828574019, CurrSamplesPerSec=10.921619655928167, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9355/20000 [15:04:17<27:59:38,  9.47s/it][2022-12-22 05:03:43,472] [INFO] [timer.py:197:stop] 0/3356, RunningAvgSamplesPerSec=10.949052583148704, CurrSamplesPerSec=10.605747880068945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9356/20000 [15:04:27<29:04:44,  9.84s/it][2022-12-22 05:03:52,595] [INFO] [timer.py:197:stop] 0/3357, RunningAvgSamplesPerSec=10.948950044022123, CurrSamplesPerSec=10.615510565902026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9357/20000 [15:04:37<28:26:40,  9.62s/it][2022-12-22 05:04:02,146] [INFO] [timer.py:197:stop] 0/3358, RunningAvgSamplesPerSec=10.949016058284107, CurrSamplesPerSec=11.175067869995342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9358/20000 [15:04:46<28:22:48,  9.60s/it][2022-12-22 05:04:11,381] [INFO] [timer.py:197:stop] 0/3359, RunningAvgSamplesPerSec=10.949094912163513, CurrSamplesPerSec=11.22028500023052, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9359/20000 [15:04:55<28:03:12,  9.49s/it][2022-12-22 05:04:20,277] [INFO] [logging.py:68:log_dist] [Rank 0] step=9360, skipped=20, lr=[5.467179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:04:20,278] [INFO] [timer.py:197:stop] 0/3360, RunningAvgSamplesPerSec=10.949165901585875, CurrSamplesPerSec=11.192781326068493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9360/20000 [15:05:04<27:31:26,  9.31s/it][2022-12-22 05:04:30,860] [INFO] [timer.py:197:stop] 0/3361, RunningAvgSamplesPerSec=10.94918143913399, CurrSamplesPerSec=11.001606415827105, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9361/20000 [15:05:15<28:38:48,  9.69s/it][2022-12-22 05:04:39,914] [INFO] [timer.py:197:stop] 0/3362, RunningAvgSamplesPerSec=10.949184901283818, CurrSamplesPerSec=10.960826631160021, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9362/20000 [15:05:24<28:04:39,  9.50s/it][2022-12-22 05:04:51,060] [INFO] [timer.py:197:stop] 0/3363, RunningAvgSamplesPerSec=10.949250831078446, CurrSamplesPerSec=11.175350732271799, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9363/20000 [15:05:35<29:31:56,  9.99s/it][2022-12-22 05:04:59,875] [INFO] [timer.py:197:stop] 0/3364, RunningAvgSamplesPerSec=10.949307390015116, CurrSamplesPerSec=11.142761598647239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9364/20000 [15:05:44<28:28:59,  9.64s/it][2022-12-22 05:05:11,306] [INFO] [timer.py:197:stop] 0/3365, RunningAvgSamplesPerSec=10.94916808747511, CurrSamplesPerSec=10.500049090242417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9365/20000 [15:05:55<30:04:02, 10.18s/it][2022-12-22 05:05:20,932] [INFO] [timer.py:197:stop] 0/3366, RunningAvgSamplesPerSec=10.949196411323955, CurrSamplesPerSec=11.045285697297924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9366/20000 [15:06:05<29:34:30, 10.01s/it][2022-12-22 05:05:30,084] [INFO] [timer.py:197:stop] 0/3367, RunningAvgSamplesPerSec=10.949202458188527, CurrSamplesPerSec=10.96958198336211, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9367/20000 [15:06:14<28:48:37,  9.75s/it][2022-12-22 05:05:39,601] [INFO] [timer.py:197:stop] 0/3368, RunningAvgSamplesPerSec=10.949277043473156, CurrSamplesPerSec=11.206146235253069, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9368/20000 [15:06:24<28:35:50,  9.68s/it][2022-12-22 05:05:48,437] [INFO] [timer.py:197:stop] 0/3369, RunningAvgSamplesPerSec=10.949301750766823, CurrSamplesPerSec=11.03310319911566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9369/20000 [15:06:32<27:50:37,  9.43s/it][2022-12-22 05:05:58,043] [INFO] [logging.py:68:log_dist] [Rank 0] step=9370, skipped=20, lr=[5.462051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:05:58,044] [INFO] [timer.py:197:stop] 0/3370, RunningAvgSamplesPerSec=10.949365997993805, CurrSamplesPerSec=11.170047587105708, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9370/20000 [15:06:42<27:59:56,  9.48s/it][2022-12-22 05:06:07,070] [INFO] [timer.py:197:stop] 0/3371, RunningAvgSamplesPerSec=10.949355543862207, CurrSamplesPerSec=10.914258921309479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9371/20000 [15:06:51<27:35:33,  9.35s/it][2022-12-22 05:06:17,490] [INFO] [timer.py:197:stop] 0/3372, RunningAvgSamplesPerSec=10.949428927758959, CurrSamplesPerSec=11.202372252234087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9372/20000 [15:07:01<28:32:29,  9.67s/it][2022-12-22 05:06:26,909] [INFO] [timer.py:197:stop] 0/3373, RunningAvgSamplesPerSec=10.949489705149622, CurrSamplesPerSec=11.15821506106861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9373/20000 [15:07:11<28:19:08,  9.59s/it][2022-12-22 05:06:36,186] [INFO] [timer.py:197:stop] 0/3374, RunningAvgSamplesPerSec=10.949532323777923, CurrSamplesPerSec=11.095110397473228, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9374/20000 [15:07:20<28:02:10,  9.50s/it][2022-12-22 05:06:45,558] [INFO] [timer.py:197:stop] 0/3375, RunningAvgSamplesPerSec=10.949541113656776, CurrSamplesPerSec=10.979261058355041, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9375/20000 [15:07:30<27:55:17,  9.46s/it]

                                                          
{'loss': 0.064, 'learning_rate': 5.45948717948718e-06, 'epoch': 0.47}


 47%|████▋     | 9375/20000 [15:07:30<27:55:17,  9.46s/it][2022-12-22 05:06:55,064] [INFO] [timer.py:197:stop] 0/3376, RunningAvgSamplesPerSec=10.94955627262, CurrSamplesPerSec=11.000927414698134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9376/20000 [15:07:39<27:57:31,  9.47s/it][2022-12-22 05:07:05,875] [INFO] [timer.py:197:stop] 0/3377, RunningAvgSamplesPerSec=10.949572371364576, CurrSamplesPerSec=11.004160408808774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9377/20000 [15:07:50<29:08:23,  9.88s/it][2022-12-22 05:07:15,058] [INFO] [timer.py:197:stop] 0/3378, RunningAvgSamplesPerSec=10.949531540362461, CurrSamplesPerSec=10.813440184800003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9378/20000 [15:07:59<28:31:27,  9.67s/it][2022-12-22 05:07:25,106] [INFO] [timer.py:197:stop] 0/3379, RunningAvgSamplesPerSec=10.949504552812567, CurrSamplesPerSec=10.859146667952547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9379/20000 [15:08:09<28:51:29,  9.78s/it][2022-12-22 05:07:33,942] [INFO] [logging.py:68:log_dist] [Rank 0] step=9380, skipped=20, lr=[5.4569230769230775e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:07:33,943] [INFO] [timer.py:197:stop] 0/3380, RunningAvgSamplesPerSec=10.949575259928366, CurrSamplesPerSec=11.19367792519641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9380/20000 [15:08:18<28:01:10,  9.50s/it][2022-12-22 05:07:44,169] [INFO] [timer.py:197:stop] 0/3381, RunningAvgSamplesPerSec=10.949585464971754, CurrSamplesPerSec=10.984167007012202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9381/20000 [15:08:28<28:39:41,  9.72s/it][2022-12-22 05:07:54,265] [INFO] [timer.py:197:stop] 0/3382, RunningAvgSamplesPerSec=10.949567041537588, CurrSamplesPerSec=10.88766629281423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9382/20000 [15:08:38<28:59:40,  9.83s/it][2022-12-22 05:08:03,436] [INFO] [timer.py:197:stop] 0/3383, RunningAvgSamplesPerSec=10.949648521346404, CurrSamplesPerSec=11.232157956505992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9383/20000 [15:08:47<28:24:30,  9.63s/it][2022-12-22 05:08:12,454] [INFO] [timer.py:197:stop] 0/3384, RunningAvgSamplesPerSec=10.949700973805975, CurrSamplesPerSec=11.129963135830224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9384/20000 [15:08:56<27:51:40,  9.45s/it][2022-12-22 05:08:21,517] [INFO] [timer.py:197:stop] 0/3385, RunningAvgSamplesPerSec=10.949704328082566, CurrSamplesPerSec=10.961060260024565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9385/20000 [15:09:05<27:31:06,  9.33s/it][2022-12-22 05:08:30,491] [INFO] [timer.py:197:stop] 0/3386, RunningAvgSamplesPerSec=10.949810765780756, CurrSamplesPerSec=11.322136864698596, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9386/20000 [15:09:14<27:11:54,  9.23s/it][2022-12-22 05:08:42,659] [INFO] [timer.py:197:stop] 0/3387, RunningAvgSamplesPerSec=10.949763231896398, CurrSamplesPerSec=10.791238028895794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9387/20000 [15:09:27<29:47:57, 10.11s/it][2022-12-22 05:08:52,467] [INFO] [timer.py:197:stop] 0/3388, RunningAvgSamplesPerSec=10.94975032365996, CurrSamplesPerSec=10.906229661440833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9388/20000 [15:09:36<29:31:51, 10.02s/it][2022-12-22 05:09:01,364] [INFO] [timer.py:197:stop] 0/3389, RunningAvgSamplesPerSec=10.949801853702438, CurrSamplesPerSec=11.127108726219205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9389/20000 [15:09:45<28:32:14,  9.68s/it][2022-12-22 05:09:11,074] [INFO] [logging.py:68:log_dist] [Rank 0] step=9390, skipped=20, lr=[5.451794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:09:11,075] [INFO] [timer.py:197:stop] 0/3390, RunningAvgSamplesPerSec=10.949789525621066, CurrSamplesPerSec=10.90819298238271, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9390/20000 [15:09:55<28:33:34,  9.69s/it][2022-12-22 05:09:21,690] [INFO] [timer.py:197:stop] 0/3391, RunningAvgSamplesPerSec=10.949771670375801, CurrSamplesPerSec=10.889610566103011, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9391/20000 [15:10:06<29:22:27,  9.97s/it][2022-12-22 05:09:30,896] [INFO] [timer.py:197:stop] 0/3392, RunningAvgSamplesPerSec=10.949725785959776, CurrSamplesPerSec=10.796401572929291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9392/20000 [15:10:15<28:41:52,  9.74s/it][2022-12-22 05:09:40,003] [INFO] [timer.py:197:stop] 0/3393, RunningAvgSamplesPerSec=10.949798565697678, CurrSamplesPerSec=11.202210967610899, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9393/20000 [15:10:24<28:08:12,  9.55s/it][2022-12-22 05:09:49,945] [INFO] [timer.py:197:stop] 0/3394, RunningAvgSamplesPerSec=10.949763123814424, CurrSamplesPerSec=10.830884877373174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9394/20000 [15:10:34<28:28:50,  9.67s/it][2022-12-22 05:09:59,232] [INFO] [timer.py:197:stop] 0/3395, RunningAvgSamplesPerSec=10.949697081917629, CurrSamplesPerSec=10.730175371624155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9395/20000 [15:10:43<28:08:33,  9.55s/it][2022-12-22 05:10:08,222] [INFO] [timer.py:197:stop] 0/3396, RunningAvgSamplesPerSec=10.9496387627891, CurrSamplesPerSec=10.755275438916742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9396/20000 [15:10:52<27:38:28,  9.38s/it][2022-12-22 05:10:18,958] [INFO] [timer.py:197:stop] 0/3397, RunningAvgSamplesPerSec=10.949662175606681, CurrSamplesPerSec=11.029706340397029, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9397/20000 [15:11:03<28:50:03,  9.79s/it][2022-12-22 05:10:29,080] [INFO] [timer.py:197:stop] 0/3398, RunningAvgSamplesPerSec=10.949615809500948, CurrSamplesPerSec=10.794434442726482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9398/20000 [15:11:13<29:07:28,  9.89s/it][2022-12-22 05:10:37,999] [INFO] [timer.py:197:stop] 0/3399, RunningAvgSamplesPerSec=10.949609609614727, CurrSamplesPerSec=10.928595216122288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9399/20000 [15:11:22<28:15:52,  9.60s/it][2022-12-22 05:10:47,745] [INFO] [logging.py:68:log_dist] [Rank 0] step=9400, skipped=20, lr=[5.4466666666666665e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:10:47,746] [INFO] [timer.py:197:stop] 0/3400, RunningAvgSamplesPerSec=10.94958673331312, CurrSamplesPerSec=10.872423734897923, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9400/20000 [15:11:32<28:23:34,  9.64s/it]

                                                          
{'loss': 0.0708, 'learning_rate': 5.4466666666666665e-06, 'epoch': 0.47}


 47%|████▋     | 9400/20000 [15:11:32<28:23:34,  9.64s/it][2022-12-22 05:10:58,124] [INFO] [timer.py:197:stop] 0/3401, RunningAvgSamplesPerSec=10.949548038597804, CurrSamplesPerSec=10.819624012104125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9401/20000 [15:11:42<29:02:22,  9.86s/it][2022-12-22 05:11:07,386] [INFO] [timer.py:197:stop] 0/3402, RunningAvgSamplesPerSec=10.94955090985577, CurrSamplesPerSec=10.959319024628591, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9402/20000 [15:11:51<28:30:18,  9.68s/it][2022-12-22 05:11:16,681] [INFO] [timer.py:197:stop] 0/3403, RunningAvgSamplesPerSec=10.949603468706512, CurrSamplesPerSec=11.131269261518762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9403/20000 [15:12:01<28:09:36,  9.57s/it][2022-12-22 05:11:25,944] [INFO] [timer.py:197:stop] 0/3404, RunningAvgSamplesPerSec=10.94957945701385, CurrSamplesPerSec=10.868520419673537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9404/20000 [15:12:10<27:53:23,  9.48s/it][2022-12-22 05:11:34,729] [INFO] [timer.py:197:stop] 0/3405, RunningAvgSamplesPerSec=10.949639587622038, CurrSamplesPerSec=11.158099571056004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9405/20000 [15:12:19<27:16:38,  9.27s/it][2022-12-22 05:11:43,982] [INFO] [timer.py:197:stop] 0/3406, RunningAvgSamplesPerSec=10.949663942985351, CurrSamplesPerSec=11.033177569882188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9406/20000 [15:12:28<27:15:40,  9.26s/it][2022-12-22 05:11:53,863] [INFO] [timer.py:197:stop] 0/3407, RunningAvgSamplesPerSec=10.949587317202292, CurrSamplesPerSec=10.694823751548233, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9407/20000 [15:12:38<27:48:13,  9.45s/it][2022-12-22 05:12:06,777] [INFO] [timer.py:197:stop] 0/3408, RunningAvgSamplesPerSec=10.949523710145419, CurrSamplesPerSec=10.737143798604508, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9408/20000 [15:12:51<30:51:32, 10.49s/it][2022-12-22 05:12:16,136] [INFO] [timer.py:197:stop] 0/3409, RunningAvgSamplesPerSec=10.949532688935774, CurrSamplesPerSec=10.980200127392767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9409/20000 [15:13:00<29:51:34, 10.15s/it][2022-12-22 05:12:25,061] [INFO] [logging.py:68:log_dist] [Rank 0] step=9410, skipped=20, lr=[5.441538461538461e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:12:25,062] [INFO] [timer.py:197:stop] 0/3410, RunningAvgSamplesPerSec=10.949532226938503, CurrSamplesPerSec=10.947958428539238, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9410/20000 [15:13:09<28:46:35,  9.78s/it][2022-12-22 05:12:34,396] [INFO] [timer.py:197:stop] 0/3411, RunningAvgSamplesPerSec=10.94954548666241, CurrSamplesPerSec=10.994921950870658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9411/20000 [15:13:18<28:22:41,  9.65s/it][2022-12-22 05:12:43,558] [INFO] [timer.py:197:stop] 0/3412, RunningAvgSamplesPerSec=10.9495785620951, CurrSamplesPerSec=11.06350623548596, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9412/20000 [15:13:28<27:56:51,  9.50s/it][2022-12-22 05:12:52,920] [INFO] [timer.py:197:stop] 0/3413, RunningAvgSamplesPerSec=10.949526815148209, CurrSamplesPerSec=10.775869127254635, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9413/20000 [15:13:37<27:49:13,  9.46s/it][2022-12-22 05:13:04,378] [INFO] [timer.py:197:stop] 0/3414, RunningAvgSamplesPerSec=10.949543288616457, CurrSamplesPerSec=11.006024223339317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9414/20000 [15:13:48<29:34:50, 10.06s/it][2022-12-22 05:13:13,676] [INFO] [timer.py:197:stop] 0/3415, RunningAvgSamplesPerSec=10.949591661966387, CurrSamplesPerSec=11.117168256410537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9415/20000 [15:13:58<28:54:21,  9.83s/it][2022-12-22 05:13:23,314] [INFO] [timer.py:197:stop] 0/3416, RunningAvgSamplesPerSec=10.949469766745606, CurrSamplesPerSec=10.548674188324059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9416/20000 [15:14:07<28:43:59,  9.77s/it][2022-12-22 05:13:33,967] [INFO] [timer.py:197:stop] 0/3417, RunningAvgSamplesPerSec=10.949541356659182, CurrSamplesPerSec=11.199531050290894, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9417/20000 [15:14:18<29:30:21, 10.04s/it][2022-12-22 05:13:43,255] [INFO] [timer.py:197:stop] 0/3418, RunningAvgSamplesPerSec=10.949506997752279, CurrSamplesPerSec=10.83341573686413, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9418/20000 [15:14:27<28:50:34,  9.81s/it][2022-12-22 05:13:52,946] [INFO] [timer.py:197:stop] 0/3419, RunningAvgSamplesPerSec=10.949524614728096, CurrSamplesPerSec=11.010036882443226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9419/20000 [15:14:37<28:43:59,  9.78s/it][2022-12-22 05:14:01,940] [INFO] [logging.py:68:log_dist] [Rank 0] step=9420, skipped=20, lr=[5.436410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:14:01,941] [INFO] [timer.py:197:stop] 0/3420, RunningAvgSamplesPerSec=10.949502746207123, CurrSamplesPerSec=10.875284658628823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9420/20000 [15:14:46<28:02:33,  9.54s/it][2022-12-22 05:14:12,075] [INFO] [timer.py:197:stop] 0/3421, RunningAvgSamplesPerSec=10.94949933355099, CurrSamplesPerSec=10.937847291392501, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9421/20000 [15:14:56<28:33:40,  9.72s/it][2022-12-22 05:14:21,112] [INFO] [timer.py:197:stop] 0/3422, RunningAvgSamplesPerSec=10.949541401166579, CurrSamplesPerSec=11.095285581133892, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9422/20000 [15:15:05<27:57:28,  9.51s/it][2022-12-22 05:14:31,349] [INFO] [timer.py:197:stop] 0/3423, RunningAvgSamplesPerSec=10.949575223434435, CurrSamplesPerSec=11.066482760849729, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9423/20000 [15:15:15<28:35:26,  9.73s/it][2022-12-22 05:14:41,941] [INFO] [timer.py:197:stop] 0/3424, RunningAvgSamplesPerSec=10.949577333740292, CurrSamplesPerSec=10.956801454531442, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9424/20000 [15:15:26<29:20:48,  9.99s/it][2022-12-22 05:14:52,205] [INFO] [timer.py:197:stop] 0/3425, RunningAvgSamplesPerSec=10.949509958076192, CurrSamplesPerSec=10.72370647994648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9425/20000 [15:15:36<29:35:09, 10.07s/it]

                                                          
{'loss': 0.0676, 'learning_rate': 5.433846153846154e-06, 'epoch': 0.47}


 47%|████▋     | 9425/20000 [15:15:36<29:35:09, 10.07s/it][2022-12-22 05:15:01,477] [INFO] [timer.py:197:stop] 0/3426, RunningAvgSamplesPerSec=10.949525855871897, CurrSamplesPerSec=11.004215894531553, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9426/20000 [15:15:45<28:52:42,  9.83s/it][2022-12-22 05:15:12,714] [INFO] [timer.py:197:stop] 0/3427, RunningAvgSamplesPerSec=10.949501068134666, CurrSamplesPerSec=10.865280865221932, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9427/20000 [15:15:57<30:06:48, 10.25s/it][2022-12-22 05:15:21,481] [INFO] [timer.py:197:stop] 0/3428, RunningAvgSamplesPerSec=10.94957352901362, CurrSamplesPerSec=11.20350932372797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9428/20000 [15:16:05<28:48:06,  9.81s/it][2022-12-22 05:15:30,897] [INFO] [timer.py:197:stop] 0/3429, RunningAvgSamplesPerSec=10.949602737123655, CurrSamplesPerSec=11.050592927616075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9429/20000 [15:16:15<28:27:12,  9.69s/it][2022-12-22 05:15:42,050] [INFO] [logging.py:68:log_dist] [Rank 0] step=9430, skipped=20, lr=[5.431282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:15:42,051] [INFO] [timer.py:197:stop] 0/3430, RunningAvgSamplesPerSec=10.949667822267832, CurrSamplesPerSec=11.177353974396498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9430/20000 [15:16:26<29:44:24, 10.13s/it][2022-12-22 05:15:51,090] [INFO] [timer.py:197:stop] 0/3431, RunningAvgSamplesPerSec=10.94962198573996, CurrSamplesPerSec=10.794717897968566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9431/20000 [15:16:35<28:46:38,  9.80s/it][2022-12-22 05:16:00,831] [INFO] [timer.py:197:stop] 0/3432, RunningAvgSamplesPerSec=10.94958421410223, CurrSamplesPerSec=10.821579830659001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9432/20000 [15:16:45<28:43:20,  9.78s/it][2022-12-22 05:16:10,676] [INFO] [timer.py:197:stop] 0/3433, RunningAvgSamplesPerSec=10.949555187728174, CurrSamplesPerSec=10.850892095138436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9433/20000 [15:16:55<28:46:20,  9.80s/it][2022-12-22 05:16:19,636] [INFO] [timer.py:197:stop] 0/3434, RunningAvgSamplesPerSec=10.949570693543347, CurrSamplesPerSec=11.003030967432585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9434/20000 [15:17:04<28:01:39,  9.55s/it][2022-12-22 05:16:28,511] [INFO] [timer.py:197:stop] 0/3435, RunningAvgSamplesPerSec=10.949595840123141, CurrSamplesPerSec=11.036584735097337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9435/20000 [15:17:12<27:25:53,  9.35s/it][2022-12-22 05:16:38,191] [INFO] [timer.py:197:stop] 0/3436, RunningAvgSamplesPerSec=10.949581404814232, CurrSamplesPerSec=10.900248329597188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9436/20000 [15:17:22<27:43:18,  9.45s/it][2022-12-22 05:16:48,177] [INFO] [timer.py:197:stop] 0/3437, RunningAvgSamplesPerSec=10.949598040517785, CurrSamplesPerSec=11.007024744369579, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9437/20000 [15:17:32<28:11:36,  9.61s/it][2022-12-22 05:16:57,343] [INFO] [timer.py:197:stop] 0/3438, RunningAvgSamplesPerSec=10.949454359426701, CurrSamplesPerSec=10.477202662871953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9438/20000 [15:17:41<27:48:05,  9.48s/it][2022-12-22 05:17:06,733] [INFO] [timer.py:197:stop] 0/3439, RunningAvgSamplesPerSec=10.949489659604156, CurrSamplesPerSec=11.072140107592633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9439/20000 [15:17:51<27:43:22,  9.45s/it][2022-12-22 05:17:15,934] [INFO] [logging.py:68:log_dist] [Rank 0] step=9440, skipped=20, lr=[5.426153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:17:15,935] [INFO] [timer.py:197:stop] 0/3440, RunningAvgSamplesPerSec=10.94949609834295, CurrSamplesPerSec=10.971670873893828, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9440/20000 [15:18:00<27:30:06,  9.38s/it][2022-12-22 05:17:26,074] [INFO] [timer.py:197:stop] 0/3441, RunningAvgSamplesPerSec=10.949480396516403, CurrSamplesPerSec=10.895762432963787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9441/20000 [15:18:10<28:10:14,  9.60s/it][2022-12-22 05:17:35,984] [INFO] [timer.py:197:stop] 0/3442, RunningAvgSamplesPerSec=10.949458301637671, CurrSamplesPerSec=10.873997827513131, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9442/20000 [15:18:20<28:26:13,  9.70s/it][2022-12-22 05:17:45,451] [INFO] [timer.py:197:stop] 0/3443, RunningAvgSamplesPerSec=10.94938529876484, CurrSamplesPerSec=10.703887669641588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9443/20000 [15:18:29<28:13:57,  9.63s/it][2022-12-22 05:17:54,838] [INFO] [timer.py:197:stop] 0/3444, RunningAvgSamplesPerSec=10.9493383524286, CurrSamplesPerSec=10.790145364337372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9444/20000 [15:18:39<28:01:05,  9.56s/it][2022-12-22 05:18:04,169] [INFO] [timer.py:197:stop] 0/3445, RunningAvgSamplesPerSec=10.949357302370059, CurrSamplesPerSec=11.01497399533337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9445/20000 [15:18:48<27:49:07,  9.49s/it][2022-12-22 05:18:13,380] [INFO] [timer.py:197:stop] 0/3446, RunningAvgSamplesPerSec=10.949348644326752, CurrSamplesPerSec=10.919619961178638, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9446/20000 [15:18:57<27:34:20,  9.40s/it][2022-12-22 05:18:24,696] [INFO] [timer.py:197:stop] 0/3447, RunningAvgSamplesPerSec=10.949343116482105, CurrSamplesPerSec=10.930338273310397, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9447/20000 [15:19:09<29:14:59,  9.98s/it][2022-12-22 05:18:33,696] [INFO] [timer.py:197:stop] 0/3448, RunningAvgSamplesPerSec=10.949370050521681, CurrSamplesPerSec=11.042951076644249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9448/20000 [15:19:18<28:23:13,  9.68s/it][2022-12-22 05:18:42,690] [INFO] [timer.py:197:stop] 0/3449, RunningAvgSamplesPerSec=10.949389549334253, CurrSamplesPerSec=11.016997466055898, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9449/20000 [15:19:27<27:46:36,  9.48s/it][2022-12-22 05:18:51,943] [INFO] [logging.py:68:log_dist] [Rank 0] step=9450, skipped=20, lr=[5.421025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:18:51,944] [INFO] [timer.py:197:stop] 0/3450, RunningAvgSamplesPerSec=10.949323774596579, CurrSamplesPerSec=10.727199081067411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9450/20000 [15:19:36<27:34:40,  9.41s/it]

                                                          
{'loss': 0.0693, 'learning_rate': 5.421025641025641e-06, 'epoch': 0.47}


 47%|████▋     | 9450/20000 [15:19:36<27:34:40,  9.41s/it][2022-12-22 05:19:01,396] [INFO] [timer.py:197:stop] 0/3451, RunningAvgSamplesPerSec=10.94926679348777, CurrSamplesPerSec=10.75626019611073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9451/20000 [15:19:45<27:36:41,  9.42s/it][2022-12-22 05:19:11,183] [INFO] [timer.py:197:stop] 0/3452, RunningAvgSamplesPerSec=10.94931209786205, CurrSamplesPerSec=11.107829704206614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9452/20000 [15:19:55<27:55:47,  9.53s/it][2022-12-22 05:19:20,378] [INFO] [timer.py:197:stop] 0/3453, RunningAvgSamplesPerSec=10.949283335391453, CurrSamplesPerSec=10.850944291479633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9453/20000 [15:20:04<27:37:48,  9.43s/it][2022-12-22 05:19:29,916] [INFO] [timer.py:197:stop] 0/3454, RunningAvgSamplesPerSec=10.949373615656752, CurrSamplesPerSec=11.270058327023802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9454/20000 [15:20:14<27:43:19,  9.46s/it][2022-12-22 05:19:39,307] [INFO] [timer.py:197:stop] 0/3455, RunningAvgSamplesPerSec=10.949363802293119, CurrSamplesPerSec=10.915592584509543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9455/20000 [15:20:23<27:39:18,  9.44s/it][2022-12-22 05:19:49,445] [INFO] [timer.py:197:stop] 0/3456, RunningAvgSamplesPerSec=10.949369700793625, CurrSamplesPerSec=10.969775191403219, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9456/20000 [15:20:33<28:15:55,  9.65s/it][2022-12-22 05:19:58,928] [INFO] [timer.py:197:stop] 0/3457, RunningAvgSamplesPerSec=10.949369534387102, CurrSamplesPerSec=10.948794796436419, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9457/20000 [15:20:43<28:06:56,  9.60s/it][2022-12-22 05:20:08,271] [INFO] [timer.py:197:stop] 0/3458, RunningAvgSamplesPerSec=10.94934987913735, CurrSamplesPerSec=10.881859692818598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9458/20000 [15:20:52<27:53:12,  9.52s/it][2022-12-22 05:20:17,668] [INFO] [timer.py:197:stop] 0/3459, RunningAvgSamplesPerSec=10.949341154783063, CurrSamplesPerSec=10.919272610535812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9459/20000 [15:21:02<27:46:22,  9.49s/it][2022-12-22 05:20:27,037] [INFO] [logging.py:68:log_dist] [Rank 0] step=9460, skipped=20, lr=[5.415897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:20:27,038] [INFO] [timer.py:197:stop] 0/3460, RunningAvgSamplesPerSec=10.949366201554769, CurrSamplesPerSec=11.036643270894768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9460/20000 [15:21:11<27:40:10,  9.45s/it][2022-12-22 05:20:36,059] [INFO] [timer.py:197:stop] 0/3461, RunningAvgSamplesPerSec=10.949396968644606, CurrSamplesPerSec=11.056833804497915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9461/20000 [15:21:20<27:17:22,  9.32s/it][2022-12-22 05:20:45,477] [INFO] [timer.py:197:stop] 0/3462, RunningAvgSamplesPerSec=10.949402169816338, CurrSamplesPerSec=10.96742264065067, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9462/20000 [15:21:29<27:22:16,  9.35s/it][2022-12-22 05:20:55,801] [INFO] [timer.py:197:stop] 0/3463, RunningAvgSamplesPerSec=10.94943133845673, CurrSamplesPerSec=11.051293997762121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9463/20000 [15:21:40<28:13:24,  9.64s/it][2022-12-22 05:21:04,685] [INFO] [timer.py:197:stop] 0/3464, RunningAvgSamplesPerSec=10.949453595801963, CurrSamplesPerSec=11.027032214070344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9464/20000 [15:21:49<27:33:15,  9.41s/it][2022-12-22 05:21:15,039] [INFO] [timer.py:197:stop] 0/3465, RunningAvgSamplesPerSec=10.94947157929022, CurrSamplesPerSec=11.012086547998253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9465/20000 [15:21:59<28:22:33,  9.70s/it][2022-12-22 05:21:24,332] [INFO] [timer.py:197:stop] 0/3466, RunningAvgSamplesPerSec=10.949413313867122, CurrSamplesPerSec=10.75129213742582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9466/20000 [15:22:08<28:01:10,  9.58s/it][2022-12-22 05:21:33,481] [INFO] [timer.py:197:stop] 0/3467, RunningAvgSamplesPerSec=10.949475740500992, CurrSamplesPerSec=11.170079658696775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9467/20000 [15:22:17<27:38:31,  9.45s/it][2022-12-22 05:21:42,724] [INFO] [timer.py:197:stop] 0/3468, RunningAvgSamplesPerSec=10.949404439784523, CurrSamplesPerSec=10.707800463916806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9468/20000 [15:22:27<27:27:35,  9.39s/it][2022-12-22 05:21:52,155] [INFO] [timer.py:197:stop] 0/3469, RunningAvgSamplesPerSec=10.949357613346173, CurrSamplesPerSec=10.789428464122734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9469/20000 [15:22:36<27:29:46,  9.40s/it][2022-12-22 05:22:01,655] [INFO] [logging.py:68:log_dist] [Rank 0] step=9470, skipped=20, lr=[5.410769230769232e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:22:01,656] [INFO] [timer.py:197:stop] 0/3470, RunningAvgSamplesPerSec=10.949353172238055, CurrSamplesPerSec=10.9339774784112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9470/20000 [15:22:46<27:34:59,  9.43s/it][2022-12-22 05:22:10,536] [INFO] [timer.py:197:stop] 0/3471, RunningAvgSamplesPerSec=10.949380628964525, CurrSamplesPerSec=11.045436131967957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9471/20000 [15:22:54<27:05:51,  9.27s/it][2022-12-22 05:22:20,943] [INFO] [timer.py:197:stop] 0/3472, RunningAvgSamplesPerSec=10.949346855920398, CurrSamplesPerSec=10.833428853205806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9472/20000 [15:23:05<28:05:49,  9.61s/it][2022-12-22 05:22:30,276] [INFO] [timer.py:197:stop] 0/3473, RunningAvgSamplesPerSec=10.949331854769612, CurrSamplesPerSec=10.897524230087477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9473/20000 [15:23:14<27:51:12,  9.53s/it][2022-12-22 05:22:40,581] [INFO] [timer.py:197:stop] 0/3474, RunningAvgSamplesPerSec=10.949373440542566, CurrSamplesPerSec=11.095646513601967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9474/20000 [15:23:25<28:32:04,  9.76s/it][2022-12-22 05:22:49,664] [INFO] [timer.py:197:stop] 0/3475, RunningAvgSamplesPerSec=10.949427964822105, CurrSamplesPerSec=11.142067837430975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9475/20000 [15:23:34<27:56:20,  9.56s/it]

                                                          
{'loss': 0.0684, 'learning_rate': 5.408205128205129e-06, 'epoch': 0.47}


 47%|████▋     | 9475/20000 [15:23:34<27:56:20,  9.56s/it][2022-12-22 05:23:00,072] [INFO] [timer.py:197:stop] 0/3476, RunningAvgSamplesPerSec=10.949264802487873, CurrSamplesPerSec=10.41049335303723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9476/20000 [15:23:44<28:41:00,  9.81s/it][2022-12-22 05:23:09,728] [INFO] [timer.py:197:stop] 0/3477, RunningAvgSamplesPerSec=10.949277126871817, CurrSamplesPerSec=10.992260161440395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9477/20000 [15:23:54<28:32:39,  9.77s/it][2022-12-22 05:23:18,886] [INFO] [timer.py:197:stop] 0/3478, RunningAvgSamplesPerSec=10.949245832337365, CurrSamplesPerSec=10.841567103889489, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9478/20000 [15:24:03<28:00:33,  9.58s/it][2022-12-22 05:23:27,824] [INFO] [timer.py:197:stop] 0/3479, RunningAvgSamplesPerSec=10.949237420615287, CurrSamplesPerSec=10.920076170081723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9479/20000 [15:24:12<27:26:25,  9.39s/it][2022-12-22 05:23:37,318] [INFO] [logging.py:68:log_dist] [Rank 0] step=9480, skipped=20, lr=[5.4056410256410265e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:23:37,319] [INFO] [timer.py:197:stop] 0/3480, RunningAvgSamplesPerSec=10.949262899995972, CurrSamplesPerSec=11.03857757024557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9480/20000 [15:24:21<27:31:50,  9.42s/it][2022-12-22 05:23:46,866] [INFO] [timer.py:197:stop] 0/3481, RunningAvgSamplesPerSec=10.949270142428327, CurrSamplesPerSec=10.974517421114824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9481/20000 [15:24:31<27:38:16,  9.46s/it][2022-12-22 05:23:56,125] [INFO] [timer.py:197:stop] 0/3482, RunningAvgSamplesPerSec=10.94929883240343, CurrSamplesPerSec=11.050029770216085, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9482/20000 [15:24:40<27:27:36,  9.40s/it][2022-12-22 05:24:05,229] [INFO] [timer.py:197:stop] 0/3483, RunningAvgSamplesPerSec=10.949199305314258, CurrSamplesPerSec=10.61346821464715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9483/20000 [15:24:49<27:11:59,  9.31s/it][2022-12-22 05:24:15,734] [INFO] [timer.py:197:stop] 0/3484, RunningAvgSamplesPerSec=10.949217563260122, CurrSamplesPerSec=11.01314465106133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9484/20000 [15:25:00<28:14:37,  9.67s/it][2022-12-22 05:24:25,730] [INFO] [timer.py:197:stop] 0/3485, RunningAvgSamplesPerSec=10.949325109772936, CurrSamplesPerSec=11.337067004154672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9485/20000 [15:25:10<28:31:39,  9.77s/it][2022-12-22 05:24:34,768] [INFO] [timer.py:197:stop] 0/3486, RunningAvgSamplesPerSec=10.949273573943476, CurrSamplesPerSec=10.77267029536775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9486/20000 [15:25:19<27:53:10,  9.55s/it][2022-12-22 05:24:44,562] [INFO] [timer.py:197:stop] 0/3487, RunningAvgSamplesPerSec=10.949230836310678, CurrSamplesPerSec=10.802331176412048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9487/20000 [15:25:29<28:05:54,  9.62s/it][2022-12-22 05:24:53,650] [INFO] [timer.py:197:stop] 0/3488, RunningAvgSamplesPerSec=10.94925620334669, CurrSamplesPerSec=11.03838011538107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9488/20000 [15:25:38<27:37:43,  9.46s/it][2022-12-22 05:25:02,639] [INFO] [timer.py:197:stop] 0/3489, RunningAvgSamplesPerSec=10.949210677375268, CurrSamplesPerSec=10.792775247667306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9489/20000 [15:25:47<27:12:41,  9.32s/it][2022-12-22 05:25:12,479] [INFO] [logging.py:68:log_dist] [Rank 0] step=9490, skipped=20, lr=[5.400512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:25:12,480] [INFO] [timer.py:197:stop] 0/3490, RunningAvgSamplesPerSec=10.949205835346365, CurrSamplesPerSec=10.932347684026997, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9490/20000 [15:25:56<27:39:54,  9.48s/it][2022-12-22 05:25:23,529] [INFO] [timer.py:197:stop] 0/3491, RunningAvgSamplesPerSec=10.949215774579, CurrSamplesPerSec=10.983993966311909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9491/20000 [15:26:07<29:02:25,  9.95s/it][2022-12-22 05:25:32,480] [INFO] [timer.py:197:stop] 0/3492, RunningAvgSamplesPerSec=10.949217974007015, CurrSamplesPerSec=10.956897161877222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9492/20000 [15:26:16<28:09:52,  9.65s/it][2022-12-22 05:25:41,585] [INFO] [timer.py:197:stop] 0/3493, RunningAvgSamplesPerSec=10.949338918356297, CurrSamplesPerSec=11.388363910629442, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9493/20000 [15:26:26<27:41:06,  9.49s/it][2022-12-22 05:25:51,371] [INFO] [timer.py:197:stop] 0/3494, RunningAvgSamplesPerSec=10.949370963604608, CurrSamplesPerSec=11.062396035866442, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9494/20000 [15:26:35<27:56:44,  9.58s/it][2022-12-22 05:26:00,242] [INFO] [timer.py:197:stop] 0/3495, RunningAvgSamplesPerSec=10.949389583198531, CurrSamplesPerSec=11.014797722765683, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9495/20000 [15:26:44<27:19:31,  9.36s/it][2022-12-22 05:26:12,363] [INFO] [timer.py:197:stop] 0/3496, RunningAvgSamplesPerSec=10.949263751973609, CurrSamplesPerSec=10.526702705534664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9496/20000 [15:26:56<29:44:09, 10.19s/it][2022-12-22 05:26:21,872] [INFO] [timer.py:197:stop] 0/3497, RunningAvgSamplesPerSec=10.949156921349799, CurrSamplesPerSec=10.588199590230843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9497/20000 [15:27:06<29:08:11,  9.99s/it][2022-12-22 05:26:30,817] [INFO] [timer.py:197:stop] 0/3498, RunningAvgSamplesPerSec=10.949134159359701, CurrSamplesPerSec=10.870155007211663, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9498/20000 [15:27:15<28:13:19,  9.67s/it][2022-12-22 05:26:40,237] [INFO] [timer.py:197:stop] 0/3499, RunningAvgSamplesPerSec=10.949151011720778, CurrSamplesPerSec=11.008385690759189, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 47%|████▋     | 9499/20000 [15:27:24<27:59:46,  9.60s/it][2022-12-22 05:26:49,479] [INFO] [logging.py:68:log_dist] [Rank 0] step=9500, skipped=20, lr=[5.3953846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:26:49,480] [INFO] [timer.py:197:stop] 0/3500, RunningAvgSamplesPerSec=10.949121722237846, CurrSamplesPerSec=10.847645943395053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9500/20000 [15:27:33<27:40:59,  9.49s/it]

                                                          
{'loss': 0.0661, 'learning_rate': 5.3953846153846155e-06, 'epoch': 0.47}


 48%|████▊     | 9500/20000 [15:27:33<27:40:59,  9.49s/it][2022-12-22 05:26:58,388] [INFO] [timer.py:197:stop] 0/3501, RunningAvgSamplesPerSec=10.949113477942934, CurrSamplesPerSec=10.920350713382236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9501/20000 [15:27:42<27:10:13,  9.32s/it][2022-12-22 05:27:07,736] [INFO] [timer.py:197:stop] 0/3502, RunningAvgSamplesPerSec=10.949063054997056, CurrSamplesPerSec=10.775431808333439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9502/20000 [15:27:52<27:11:44,  9.33s/it][2022-12-22 05:27:16,951] [INFO] [timer.py:197:stop] 0/3503, RunningAvgSamplesPerSec=10.949055990775364, CurrSamplesPerSec=10.924386937558934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9503/20000 [15:28:01<27:05:44,  9.29s/it][2022-12-22 05:27:26,046] [INFO] [timer.py:197:stop] 0/3504, RunningAvgSamplesPerSec=10.949146958227091, CurrSamplesPerSec=11.277167852083265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9504/20000 [15:28:10<26:55:13,  9.23s/it][2022-12-22 05:27:35,099] [INFO] [timer.py:197:stop] 0/3505, RunningAvgSamplesPerSec=10.949166482973157, CurrSamplesPerSec=11.017971944658996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9505/20000 [15:28:19<26:45:34,  9.18s/it][2022-12-22 05:27:44,779] [INFO] [timer.py:197:stop] 0/3506, RunningAvgSamplesPerSec=10.94912138418722, CurrSamplesPerSec=10.793388001082896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9506/20000 [15:28:29<27:11:43,  9.33s/it][2022-12-22 05:27:53,877] [INFO] [timer.py:197:stop] 0/3507, RunningAvgSamplesPerSec=10.9491882540116, CurrSamplesPerSec=11.188625521776862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9507/20000 [15:28:38<26:59:23,  9.26s/it][2022-12-22 05:28:02,929] [INFO] [timer.py:197:stop] 0/3508, RunningAvgSamplesPerSec=10.949210585597308, CurrSamplesPerSec=11.028046525800475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9508/20000 [15:28:47<26:48:23,  9.20s/it][2022-12-22 05:28:12,316] [INFO] [timer.py:197:stop] 0/3509, RunningAvgSamplesPerSec=10.949209589864443, CurrSamplesPerSec=10.945719663483965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9509/20000 [15:28:56<26:58:07,  9.25s/it][2022-12-22 05:28:21,332] [INFO] [logging.py:68:log_dist] [Rank 0] step=9510, skipped=20, lr=[5.39025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:28:21,333] [INFO] [timer.py:197:stop] 0/3510, RunningAvgSamplesPerSec=10.949197183824666, CurrSamplesPerSec=10.905861451287425, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9510/20000 [15:29:05<26:45:31,  9.18s/it][2022-12-22 05:28:30,341] [INFO] [timer.py:197:stop] 0/3511, RunningAvgSamplesPerSec=10.949170900051662, CurrSamplesPerSec=10.85773760783699, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9511/20000 [15:29:14<26:36:11,  9.13s/it][2022-12-22 05:28:40,095] [INFO] [timer.py:197:stop] 0/3512, RunningAvgSamplesPerSec=10.949069172476934, CurrSamplesPerSec=10.603380483176942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9512/20000 [15:29:24<27:08:43,  9.32s/it][2022-12-22 05:28:49,769] [INFO] [timer.py:197:stop] 0/3513, RunningAvgSamplesPerSec=10.949107532599893, CurrSamplesPerSec=11.08542841524544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9513/20000 [15:29:34<27:27:16,  9.42s/it][2022-12-22 05:28:59,035] [INFO] [timer.py:197:stop] 0/3514, RunningAvgSamplesPerSec=10.949139966517349, CurrSamplesPerSec=11.064212593433671, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9514/20000 [15:29:43<27:18:48,  9.38s/it][2022-12-22 05:29:07,783] [INFO] [timer.py:197:stop] 0/3515, RunningAvgSamplesPerSec=10.949214343911665, CurrSamplesPerSec=11.216813638077808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9515/20000 [15:29:52<26:45:38,  9.19s/it][2022-12-22 05:29:18,537] [INFO] [timer.py:197:stop] 0/3516, RunningAvgSamplesPerSec=10.949144739485188, CurrSamplesPerSec=10.709967308592002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9516/20000 [15:30:02<28:07:34,  9.66s/it][2022-12-22 05:29:28,425] [INFO] [timer.py:197:stop] 0/3517, RunningAvgSamplesPerSec=10.949165798093254, CurrSamplesPerSec=11.023669422959205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9517/20000 [15:30:12<28:19:26,  9.73s/it][2022-12-22 05:29:37,513] [INFO] [timer.py:197:stop] 0/3518, RunningAvgSamplesPerSec=10.949229953687833, CurrSamplesPerSec=11.179480383582112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9518/20000 [15:30:21<27:45:48,  9.54s/it][2022-12-22 05:29:47,169] [INFO] [timer.py:197:stop] 0/3519, RunningAvgSamplesPerSec=10.94915617491965, CurrSamplesPerSec=10.695755278379234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9519/20000 [15:30:31<27:52:01,  9.57s/it][2022-12-22 05:29:56,820] [INFO] [logging.py:68:log_dist] [Rank 0] step=9520, skipped=20, lr=[5.385128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:29:56,821] [INFO] [timer.py:197:stop] 0/3520, RunningAvgSamplesPerSec=10.949094218059091, CurrSamplesPerSec=10.735445065197016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9520/20000 [15:30:41<27:56:01,  9.60s/it][2022-12-22 05:30:05,871] [INFO] [timer.py:197:stop] 0/3521, RunningAvgSamplesPerSec=10.949047246120895, CurrSamplesPerSec=10.786257551291644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9521/20000 [15:30:50<27:27:18,  9.43s/it][2022-12-22 05:30:15,343] [INFO] [timer.py:197:stop] 0/3522, RunningAvgSamplesPerSec=10.949006332526865, CurrSamplesPerSec=10.80690055872831, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9522/20000 [15:30:59<27:29:15,  9.44s/it][2022-12-22 05:30:24,766] [INFO] [timer.py:197:stop] 0/3523, RunningAvgSamplesPerSec=10.949007964697238, CurrSamplesPerSec=10.95475622153272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9523/20000 [15:31:09<27:27:56,  9.44s/it][2022-12-22 05:30:34,650] [INFO] [timer.py:197:stop] 0/3524, RunningAvgSamplesPerSec=10.949004719075276, CurrSamplesPerSec=10.93758880269228, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9524/20000 [15:31:19<27:51:13,  9.57s/it][2022-12-22 05:30:43,689] [INFO] [timer.py:197:stop] 0/3525, RunningAvgSamplesPerSec=10.949094615935001, CurrSamplesPerSec=11.275142409676995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9525/20000 [15:31:28<27:23:07,  9.41s/it]

                                                          
{'loss': 0.0649, 'learning_rate': 5.382564102564103e-06, 'epoch': 0.48}


 48%|████▊     | 9525/20000 [15:31:28<27:23:07,  9.41s/it][2022-12-22 05:30:52,704] [INFO] [timer.py:197:stop] 0/3526, RunningAvgSamplesPerSec=10.94916515128915, CurrSamplesPerSec=11.203433574125256, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9526/20000 [15:31:37<27:02:12,  9.29s/it][2022-12-22 05:31:02,684] [INFO] [timer.py:197:stop] 0/3527, RunningAvgSamplesPerSec=10.949134924575645, CurrSamplesPerSec=10.843642562542668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9527/20000 [15:31:47<27:38:02,  9.50s/it][2022-12-22 05:31:11,701] [INFO] [timer.py:197:stop] 0/3528, RunningAvgSamplesPerSec=10.949102188586732, CurrSamplesPerSec=10.834911641745355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9528/20000 [15:31:56<27:12:37,  9.35s/it][2022-12-22 05:31:20,904] [INFO] [timer.py:197:stop] 0/3529, RunningAvgSamplesPerSec=10.949183830934729, CurrSamplesPerSec=11.244829946506144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9529/20000 [15:32:05<27:04:33,  9.31s/it][2022-12-22 05:31:31,398] [INFO] [logging.py:68:log_dist] [Rank 0] step=9530, skipped=20, lr=[5.380000000000001e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:31:31,399] [INFO] [timer.py:197:stop] 0/3530, RunningAvgSamplesPerSec=10.949192700618712, CurrSamplesPerSec=10.980565738598717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9530/20000 [15:32:15<28:06:29,  9.66s/it][2022-12-22 05:31:40,599] [INFO] [timer.py:197:stop] 0/3531, RunningAvgSamplesPerSec=10.949083479329776, CurrSamplesPerSec=10.576854397977709, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9531/20000 [15:32:25<27:42:00,  9.53s/it][2022-12-22 05:31:50,219] [INFO] [timer.py:197:stop] 0/3532, RunningAvgSamplesPerSec=10.949079521139144, CurrSamplesPerSec=10.935128869196307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9532/20000 [15:32:34<27:46:48,  9.55s/it][2022-12-22 05:31:58,981] [INFO] [timer.py:197:stop] 0/3533, RunningAvgSamplesPerSec=10.949136552918121, CurrSamplesPerSec=11.154230877955133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9533/20000 [15:32:43<27:05:11,  9.32s/it][2022-12-22 05:32:08,200] [INFO] [timer.py:197:stop] 0/3534, RunningAvgSamplesPerSec=10.949159194422966, CurrSamplesPerSec=11.029694557260632, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9534/20000 [15:32:52<26:59:58,  9.29s/it][2022-12-22 05:32:17,596] [INFO] [timer.py:197:stop] 0/3535, RunningAvgSamplesPerSec=10.949182016990031, CurrSamplesPerSec=11.030389352132815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9535/20000 [15:33:02<27:05:32,  9.32s/it][2022-12-22 05:32:27,096] [INFO] [timer.py:197:stop] 0/3536, RunningAvgSamplesPerSec=10.949177763369232, CurrSamplesPerSec=10.934170325029458, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9536/20000 [15:33:11<27:14:47,  9.37s/it][2022-12-22 05:32:36,164] [INFO] [timer.py:197:stop] 0/3537, RunningAvgSamplesPerSec=10.94917877413105, CurrSamplesPerSec=10.952751972438616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9537/20000 [15:33:20<26:58:38,  9.28s/it][2022-12-22 05:32:45,107] [INFO] [timer.py:197:stop] 0/3538, RunningAvgSamplesPerSec=10.949269875437086, CurrSamplesPerSec=11.281074899048976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9538/20000 [15:33:29<26:40:44,  9.18s/it][2022-12-22 05:32:54,302] [INFO] [timer.py:197:stop] 0/3539, RunningAvgSamplesPerSec=10.949264761840542, CurrSamplesPerSec=10.931212903838475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9539/20000 [15:33:38<26:41:21,  9.18s/it][2022-12-22 05:33:05,445] [INFO] [logging.py:68:log_dist] [Rank 0] step=9540, skipped=20, lr=[5.374871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:33:05,446] [INFO] [timer.py:197:stop] 0/3540, RunningAvgSamplesPerSec=10.94924333028812, CurrSamplesPerSec=10.873961266751243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9540/20000 [15:33:49<28:23:41,  9.77s/it][2022-12-22 05:33:15,642] [INFO] [timer.py:197:stop] 0/3541, RunningAvgSamplesPerSec=10.949254742217637, CurrSamplesPerSec=10.989779626706353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9541/20000 [15:34:00<28:45:40,  9.90s/it][2022-12-22 05:33:26,372] [INFO] [timer.py:197:stop] 0/3542, RunningAvgSamplesPerSec=10.949280984968196, CurrSamplesPerSec=11.042948805209148, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9542/20000 [15:34:10<29:28:54, 10.15s/it][2022-12-22 05:33:35,750] [INFO] [timer.py:197:stop] 0/3543, RunningAvgSamplesPerSec=10.949289692267927, CurrSamplesPerSec=10.980200576531645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9543/20000 [15:34:20<28:48:26,  9.92s/it][2022-12-22 05:33:45,271] [INFO] [timer.py:197:stop] 0/3544, RunningAvgSamplesPerSec=10.949239081897897, CurrSamplesPerSec=10.772914562567076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9544/20000 [15:34:29<28:27:32,  9.80s/it][2022-12-22 05:33:56,330] [INFO] [timer.py:197:stop] 0/3545, RunningAvgSamplesPerSec=10.94926548904775, CurrSamplesPerSec=11.043605743183603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9545/20000 [15:34:40<29:33:16, 10.18s/it][2022-12-22 05:34:05,475] [INFO] [timer.py:197:stop] 0/3546, RunningAvgSamplesPerSec=10.949320640455882, CurrSamplesPerSec=11.148273593498175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9546/20000 [15:34:49<28:39:12,  9.87s/it][2022-12-22 05:34:14,777] [INFO] [timer.py:197:stop] 0/3547, RunningAvgSamplesPerSec=10.949345066138868, CurrSamplesPerSec=11.036599709311995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9547/20000 [15:34:59<28:09:32,  9.70s/it][2022-12-22 05:34:23,812] [INFO] [timer.py:197:stop] 0/3548, RunningAvgSamplesPerSec=10.949442730273695, CurrSamplesPerSec=11.306970230792631, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9548/20000 [15:35:08<27:34:40,  9.50s/it][2022-12-22 05:34:33,356] [INFO] [timer.py:197:stop] 0/3549, RunningAvgSamplesPerSec=10.949443253606306, CurrSamplesPerSec=10.951299305700186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9549/20000 [15:35:17<27:36:54,  9.51s/it][2022-12-22 05:34:42,718] [INFO] [logging.py:68:log_dist] [Rank 0] step=9550, skipped=20, lr=[5.36974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:34:42,719] [INFO] [timer.py:197:stop] 0/3550, RunningAvgSamplesPerSec=10.949460554861709, CurrSamplesPerSec=11.011174086106099, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9550/20000 [15:35:27<27:28:55,  9.47s/it]

                                                          
{'loss': 0.0593, 'learning_rate': 5.36974358974359e-06, 'epoch': 0.48}


 48%|████▊     | 9550/20000 [15:35:27<27:28:55,  9.47s/it][2022-12-22 05:34:51,908] [INFO] [timer.py:197:stop] 0/3551, RunningAvgSamplesPerSec=10.949534825079118, CurrSamplesPerSec=11.21954544440041, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9551/20000 [15:35:36<27:14:11,  9.38s/it][2022-12-22 05:35:01,308] [INFO] [timer.py:197:stop] 0/3552, RunningAvgSamplesPerSec=10.949494982479353, CurrSamplesPerSec=10.809896868922626, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9552/20000 [15:35:45<27:14:54,  9.39s/it][2022-12-22 05:35:10,661] [INFO] [timer.py:197:stop] 0/3553, RunningAvgSamplesPerSec=10.949552934459243, CurrSamplesPerSec=11.159223033219122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9553/20000 [15:35:55<27:12:53,  9.38s/it][2022-12-22 05:35:19,786] [INFO] [timer.py:197:stop] 0/3554, RunningAvgSamplesPerSec=10.949537117843768, CurrSamplesPerSec=10.893659019373096, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9554/20000 [15:36:04<26:59:31,  9.30s/it][2022-12-22 05:35:29,718] [INFO] [timer.py:197:stop] 0/3555, RunningAvgSamplesPerSec=10.949562477460104, CurrSamplesPerSec=11.040387221279897, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9555/20000 [15:36:14<27:32:13,  9.49s/it][2022-12-22 05:35:38,841] [INFO] [timer.py:197:stop] 0/3556, RunningAvgSamplesPerSec=10.949577041916639, CurrSamplesPerSec=11.001570344602033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9556/20000 [15:36:23<27:12:51,  9.38s/it][2022-12-22 05:35:49,200] [INFO] [timer.py:197:stop] 0/3557, RunningAvgSamplesPerSec=10.949642191703875, CurrSamplesPerSec=11.186187966059988, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9557/20000 [15:36:33<28:03:46,  9.67s/it][2022-12-22 05:35:58,408] [INFO] [timer.py:197:stop] 0/3558, RunningAvgSamplesPerSec=10.949593235917943, CurrSamplesPerSec=10.77827912730277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9558/20000 [15:36:42<27:39:16,  9.53s/it][2022-12-22 05:36:07,395] [INFO] [timer.py:197:stop] 0/3559, RunningAvgSamplesPerSec=10.949568148155837, CurrSamplesPerSec=10.861077252277349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9559/20000 [15:36:51<27:10:34,  9.37s/it][2022-12-22 05:36:16,785] [INFO] [logging.py:68:log_dist] [Rank 0] step=9560, skipped=20, lr=[5.364615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:36:16,786] [INFO] [timer.py:197:stop] 0/3560, RunningAvgSamplesPerSec=10.949586042810813, CurrSamplesPerSec=11.013609612052122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9560/20000 [15:37:01<27:11:29,  9.38s/it][2022-12-22 05:36:26,198] [INFO] [timer.py:197:stop] 0/3561, RunningAvgSamplesPerSec=10.949670934818025, CurrSamplesPerSec=11.260287434986092, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9561/20000 [15:37:10<27:13:11,  9.39s/it][2022-12-22 05:36:35,597] [INFO] [timer.py:197:stop] 0/3562, RunningAvgSamplesPerSec=10.949694817097043, CurrSamplesPerSec=11.035356987755332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9562/20000 [15:37:20<27:13:40,  9.39s/it][2022-12-22 05:36:44,564] [INFO] [timer.py:197:stop] 0/3563, RunningAvgSamplesPerSec=10.949730107290438, CurrSamplesPerSec=11.076821807794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9563/20000 [15:37:29<26:51:24,  9.26s/it][2022-12-22 05:36:53,846] [INFO] [timer.py:197:stop] 0/3564, RunningAvgSamplesPerSec=10.949718505166992, CurrSamplesPerSec=10.908558690209569, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9564/20000 [15:37:38<26:52:11,  9.27s/it][2022-12-22 05:37:03,309] [INFO] [timer.py:197:stop] 0/3565, RunningAvgSamplesPerSec=10.949716151297434, CurrSamplesPerSec=10.941338085040222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9565/20000 [15:37:47<27:02:08,  9.33s/it][2022-12-22 05:37:12,542] [INFO] [timer.py:197:stop] 0/3566, RunningAvgSamplesPerSec=10.949687497069839, CurrSamplesPerSec=10.848535887624013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9566/20000 [15:37:57<26:57:07,  9.30s/it][2022-12-22 05:37:22,070] [INFO] [timer.py:197:stop] 0/3567, RunningAvgSamplesPerSec=10.949649723110992, CurrSamplesPerSec=10.816658919915517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9567/20000 [15:38:06<27:08:52,  9.37s/it][2022-12-22 05:37:31,896] [INFO] [timer.py:197:stop] 0/3568, RunningAvgSamplesPerSec=10.949646422604559, CurrSamplesPerSec=10.937892751013385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9568/20000 [15:38:16<27:32:39,  9.51s/it][2022-12-22 05:37:40,897] [INFO] [timer.py:197:stop] 0/3569, RunningAvgSamplesPerSec=10.949652013733996, CurrSamplesPerSec=10.969626362333251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9569/20000 [15:38:25<27:06:09,  9.35s/it][2022-12-22 05:37:49,860] [INFO] [logging.py:68:log_dist] [Rank 0] step=9570, skipped=20, lr=[5.35948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:37:49,861] [INFO] [timer.py:197:stop] 0/3570, RunningAvgSamplesPerSec=10.949699822745012, CurrSamplesPerSec=11.12293332512345, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9570/20000 [15:38:34<26:45:40,  9.24s/it][2022-12-22 05:37:59,743] [INFO] [timer.py:197:stop] 0/3571, RunningAvgSamplesPerSec=10.949712936286133, CurrSamplesPerSec=10.996702899649087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9571/20000 [15:38:44<27:19:12,  9.43s/it][2022-12-22 05:38:10,441] [INFO] [timer.py:197:stop] 0/3572, RunningAvgSamplesPerSec=10.949738320251216, CurrSamplesPerSec=11.041089721848179, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9572/20000 [15:38:54<28:25:06,  9.81s/it][2022-12-22 05:38:19,577] [INFO] [timer.py:197:stop] 0/3573, RunningAvgSamplesPerSec=10.949768893225418, CurrSamplesPerSec=11.060013620478298, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9573/20000 [15:39:04<27:49:45,  9.61s/it][2022-12-22 05:38:28,610] [INFO] [timer.py:197:stop] 0/3574, RunningAvgSamplesPerSec=10.9498291719144, CurrSamplesPerSec=11.169402011200464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9574/20000 [15:39:13<27:19:34,  9.44s/it][2022-12-22 05:38:37,735] [INFO] [timer.py:197:stop] 0/3575, RunningAvgSamplesPerSec=10.949852369157032, CurrSamplesPerSec=11.033344907772761, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9575/20000 [15:39:22<27:03:14,  9.34s/it]

                                                          
{'loss': 0.0678, 'learning_rate': 5.356923076923078e-06, 'epoch': 0.48}


 48%|████▊     | 9575/20000 [15:39:22<27:03:14,  9.34s/it][2022-12-22 05:38:46,934] [INFO] [timer.py:197:stop] 0/3576, RunningAvgSamplesPerSec=10.949910543943146, CurrSamplesPerSec=11.161792260577291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9576/20000 [15:39:31<26:55:38,  9.30s/it][2022-12-22 05:38:55,734] [INFO] [timer.py:197:stop] 0/3577, RunningAvgSamplesPerSec=10.949969183697483, CurrSamplesPerSec=11.163638361362743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9577/20000 [15:39:40<26:29:27,  9.15s/it][2022-12-22 05:39:05,428] [INFO] [timer.py:197:stop] 0/3578, RunningAvgSamplesPerSec=10.94997661813347, CurrSamplesPerSec=10.976619413054964, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9578/20000 [15:39:49<26:57:39,  9.31s/it][2022-12-22 05:39:16,026] [INFO] [timer.py:197:stop] 0/3579, RunningAvgSamplesPerSec=10.949877409139209, CurrSamplesPerSec=10.606242774858812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9579/20000 [15:40:00<28:04:27,  9.70s/it][2022-12-22 05:39:24,815] [INFO] [logging.py:68:log_dist] [Rank 0] step=9580, skipped=20, lr=[5.3543589743589755e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:39:24,816] [INFO] [timer.py:197:stop] 0/3580, RunningAvgSamplesPerSec=10.94992106380442, CurrSamplesPerSec=11.108333493342833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9580/20000 [15:40:09<27:16:58,  9.43s/it][2022-12-22 05:39:34,199] [INFO] [timer.py:197:stop] 0/3581, RunningAvgSamplesPerSec=10.949923724232, CurrSamplesPerSec=10.959451018724835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9581/20000 [15:40:18<27:14:32,  9.41s/it][2022-12-22 05:39:43,588] [INFO] [timer.py:197:stop] 0/3582, RunningAvgSamplesPerSec=10.949945817031082, CurrSamplesPerSec=11.029591229296773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9582/20000 [15:40:28<27:13:10,  9.41s/it][2022-12-22 05:39:52,994] [INFO] [timer.py:197:stop] 0/3583, RunningAvgSamplesPerSec=10.950025985439563, CurrSamplesPerSec=11.24475599233028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9583/20000 [15:40:37<27:13:00,  9.41s/it][2022-12-22 05:40:02,549] [INFO] [timer.py:197:stop] 0/3584, RunningAvgSamplesPerSec=10.950076665354027, CurrSamplesPerSec=11.134620899021789, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9584/20000 [15:40:47<27:20:36,  9.45s/it][2022-12-22 05:40:12,072] [INFO] [timer.py:197:stop] 0/3585, RunningAvgSamplesPerSec=10.95009460341836, CurrSamplesPerSec=11.014728119254217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9585/20000 [15:40:56<27:24:14,  9.47s/it][2022-12-22 05:40:20,945] [INFO] [timer.py:197:stop] 0/3586, RunningAvgSamplesPerSec=10.950123056582452, CurrSamplesPerSec=11.05302908522654, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9586/20000 [15:41:05<26:52:53,  9.29s/it][2022-12-22 05:40:30,235] [INFO] [timer.py:197:stop] 0/3587, RunningAvgSamplesPerSec=10.95018675513099, CurrSamplesPerSec=11.183344716563404, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9587/20000 [15:41:14<26:52:36,  9.29s/it][2022-12-22 05:40:41,391] [INFO] [timer.py:197:stop] 0/3588, RunningAvgSamplesPerSec=10.950127387633033, CurrSamplesPerSec=10.741353872058722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9588/20000 [15:41:25<28:29:29,  9.85s/it][2022-12-22 05:40:50,489] [INFO] [timer.py:197:stop] 0/3589, RunningAvgSamplesPerSec=10.950205754091968, CurrSamplesPerSec=11.238632007072201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9589/20000 [15:41:34<27:50:05,  9.62s/it][2022-12-22 05:40:59,758] [INFO] [logging.py:68:log_dist] [Rank 0] step=9590, skipped=20, lr=[5.3492307692307696e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:40:59,759] [INFO] [timer.py:197:stop] 0/3590, RunningAvgSamplesPerSec=10.950148372098608, CurrSamplesPerSec=10.748117776283935, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9590/20000 [15:41:44<27:31:26,  9.52s/it][2022-12-22 05:41:11,121] [INFO] [timer.py:197:stop] 0/3591, RunningAvgSamplesPerSec=10.950095795143627, CurrSamplesPerSec=10.764645473087992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9591/20000 [15:41:55<29:07:17, 10.07s/it][2022-12-22 05:41:20,905] [INFO] [timer.py:197:stop] 0/3592, RunningAvgSamplesPerSec=10.950125151897328, CurrSamplesPerSec=11.05651045861694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9592/20000 [15:42:05<28:52:08,  9.99s/it][2022-12-22 05:41:30,440] [INFO] [timer.py:197:stop] 0/3593, RunningAvgSamplesPerSec=10.950125587300986, CurrSamplesPerSec=10.951688909652463, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9593/20000 [15:42:14<28:28:32,  9.85s/it][2022-12-22 05:41:40,423] [INFO] [timer.py:197:stop] 0/3594, RunningAvgSamplesPerSec=10.95002624828872, CurrSamplesPerSec=10.604557556021328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9594/20000 [15:42:24<28:35:16,  9.89s/it][2022-12-22 05:41:49,682] [INFO] [timer.py:197:stop] 0/3595, RunningAvgSamplesPerSec=10.9499688460699, CurrSamplesPerSec=10.747591910502482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9595/20000 [15:42:34<28:02:15,  9.70s/it][2022-12-22 05:41:59,211] [INFO] [timer.py:197:stop] 0/3596, RunningAvgSamplesPerSec=10.950009814286375, CurrSamplesPerSec=11.099214908692693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9596/20000 [15:42:43<27:53:10,  9.65s/it][2022-12-22 05:42:08,318] [INFO] [timer.py:197:stop] 0/3597, RunningAvgSamplesPerSec=10.949971036988506, CurrSamplesPerSec=10.812357391598281, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9597/20000 [15:42:52<27:24:49,  9.49s/it][2022-12-22 05:42:17,957] [INFO] [timer.py:197:stop] 0/3598, RunningAvgSamplesPerSec=10.949970450003276, CurrSamplesPerSec=10.947860644800919, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9598/20000 [15:43:02<27:32:34,  9.53s/it][2022-12-22 05:42:27,691] [INFO] [timer.py:197:stop] 0/3599, RunningAvgSamplesPerSec=10.949906133575382, CurrSamplesPerSec=10.723409606626287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9599/20000 [15:43:12<27:42:54,  9.59s/it][2022-12-22 05:42:36,552] [INFO] [logging.py:68:log_dist] [Rank 0] step=9600, skipped=20, lr=[5.3441025641025645e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:42:36,553] [INFO] [timer.py:197:stop] 0/3600, RunningAvgSamplesPerSec=10.949963954352343, CurrSamplesPerSec=11.161973269357562, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9600/20000 [15:43:21<27:04:43,  9.37s/it]

                                                          
{'loss': 0.0789, 'learning_rate': 5.3441025641025645e-06, 'epoch': 0.48}


 48%|████▊     | 9600/20000 [15:43:21<27:04:43,  9.37s/it][2022-12-22 05:42:46,711] [INFO] [timer.py:197:stop] 0/3601, RunningAvgSamplesPerSec=10.950026481152781, CurrSamplesPerSec=11.17971830497875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9601/20000 [15:43:31<27:45:22,  9.61s/it][2022-12-22 05:42:56,030] [INFO] [timer.py:197:stop] 0/3602, RunningAvgSamplesPerSec=10.950012530460322, CurrSamplesPerSec=10.900033219595167, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9602/20000 [15:43:40<27:30:09,  9.52s/it][2022-12-22 05:43:06,529] [INFO] [timer.py:197:stop] 0/3603, RunningAvgSamplesPerSec=10.949865016911254, CurrSamplesPerSec=10.443386367757604, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9603/20000 [15:43:50<28:20:46,  9.81s/it][2022-12-22 05:43:16,010] [INFO] [timer.py:197:stop] 0/3604, RunningAvgSamplesPerSec=10.949870414255207, CurrSamplesPerSec=10.969340819069421, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9604/20000 [15:44:00<28:03:14,  9.71s/it][2022-12-22 05:43:25,856] [INFO] [timer.py:197:stop] 0/3605, RunningAvgSamplesPerSec=10.949812280027214, CurrSamplesPerSec=10.744343184068995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9605/20000 [15:44:10<28:09:55,  9.75s/it][2022-12-22 05:43:35,720] [INFO] [timer.py:197:stop] 0/3606, RunningAvgSamplesPerSec=10.949762741529524, CurrSamplesPerSec=10.774139091818299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9606/20000 [15:44:20<28:15:27,  9.79s/it][2022-12-22 05:43:44,519] [INFO] [timer.py:197:stop] 0/3607, RunningAvgSamplesPerSec=10.949813021882406, CurrSamplesPerSec=11.134073621015169, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9607/20000 [15:44:28<27:23:55,  9.49s/it][2022-12-22 05:43:53,853] [INFO] [timer.py:197:stop] 0/3608, RunningAvgSamplesPerSec=10.949826846834227, CurrSamplesPerSec=10.99989374457121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9608/20000 [15:44:38<27:15:39,  9.44s/it][2022-12-22 05:44:02,919] [INFO] [timer.py:197:stop] 0/3609, RunningAvgSamplesPerSec=10.949797487903416, CurrSamplesPerSec=10.844943249532736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9609/20000 [15:44:47<26:55:50,  9.33s/it][2022-12-22 05:44:11,951] [INFO] [logging.py:68:log_dist] [Rank 0] step=9610, skipped=20, lr=[5.338974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:44:11,952] [INFO] [timer.py:197:stop] 0/3610, RunningAvgSamplesPerSec=10.949810479652951, CurrSamplesPerSec=10.996873187486425, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9610/20000 [15:44:56<26:40:16,  9.24s/it][2022-12-22 05:44:21,362] [INFO] [timer.py:197:stop] 0/3611, RunningAvgSamplesPerSec=10.949755555678562, CurrSamplesPerSec=10.755113412996135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9611/20000 [15:45:05<26:48:53,  9.29s/it][2022-12-22 05:44:30,604] [INFO] [timer.py:197:stop] 0/3612, RunningAvgSamplesPerSec=10.94970654185054, CurrSamplesPerSec=10.77562861908327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9612/20000 [15:45:15<26:46:08,  9.28s/it][2022-12-22 05:44:40,606] [INFO] [timer.py:197:stop] 0/3613, RunningAvgSamplesPerSec=10.949696801516309, CurrSamplesPerSec=10.91464678175517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9613/20000 [15:45:25<27:23:39,  9.49s/it][2022-12-22 05:44:50,043] [INFO] [timer.py:197:stop] 0/3614, RunningAvgSamplesPerSec=10.949682453106567, CurrSamplesPerSec=10.898114424587153, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9614/20000 [15:45:34<27:20:31,  9.48s/it][2022-12-22 05:45:00,075] [INFO] [timer.py:197:stop] 0/3615, RunningAvgSamplesPerSec=10.949673522851834, CurrSamplesPerSec=10.917512211336746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9615/20000 [15:45:44<27:49:08,  9.64s/it][2022-12-22 05:45:09,281] [INFO] [timer.py:197:stop] 0/3616, RunningAvgSamplesPerSec=10.949740764276747, CurrSamplesPerSec=11.198198112510173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9616/20000 [15:45:53<27:26:15,  9.51s/it][2022-12-22 05:45:19,074] [INFO] [timer.py:197:stop] 0/3617, RunningAvgSamplesPerSec=10.94974693694053, CurrSamplesPerSec=10.972100497541923, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9617/20000 [15:46:03<27:40:39,  9.60s/it][2022-12-22 05:45:28,551] [INFO] [timer.py:197:stop] 0/3618, RunningAvgSamplesPerSec=10.949646025270052, CurrSamplesPerSec=10.596615081310185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9618/20000 [15:46:13<27:34:18,  9.56s/it][2022-12-22 05:45:37,436] [INFO] [timer.py:197:stop] 0/3619, RunningAvgSamplesPerSec=10.94964748226327, CurrSamplesPerSec=10.954918506620668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9619/20000 [15:46:21<26:59:05,  9.36s/it][2022-12-22 05:45:47,766] [INFO] [logging.py:68:log_dist] [Rank 0] step=9620, skipped=20, lr=[5.333846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:45:47,767] [INFO] [timer.py:197:stop] 0/3620, RunningAvgSamplesPerSec=10.949744052011244, CurrSamplesPerSec=11.310549575019257, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9620/20000 [15:46:32<27:49:27,  9.65s/it][2022-12-22 05:45:56,571] [INFO] [timer.py:197:stop] 0/3621, RunningAvgSamplesPerSec=10.949809304573042, CurrSamplesPerSec=11.191096798997803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9621/20000 [15:46:41<27:05:22,  9.40s/it][2022-12-22 05:46:05,935] [INFO] [timer.py:197:stop] 0/3622, RunningAvgSamplesPerSec=10.949783066608868, CurrSamplesPerSec=10.855644458442224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9622/20000 [15:46:50<27:03:33,  9.39s/it][2022-12-22 05:46:15,308] [INFO] [timer.py:197:stop] 0/3623, RunningAvgSamplesPerSec=10.949766193723816, CurrSamplesPerSec=10.889025267679886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9623/20000 [15:46:59<27:02:42,  9.38s/it][2022-12-22 05:46:24,579] [INFO] [timer.py:197:stop] 0/3624, RunningAvgSamplesPerSec=10.949839997939579, CurrSamplesPerSec=11.223772590242119, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9624/20000 [15:47:09<26:56:45,  9.35s/it][2022-12-22 05:46:33,505] [INFO] [timer.py:197:stop] 0/3625, RunningAvgSamplesPerSec=10.949853898954492, CurrSamplesPerSec=11.000436025259305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9625/20000 [15:47:17<26:34:39,  9.22s/it]

                                                          
{'loss': 0.0627, 'learning_rate': 5.331282051282052e-06, 'epoch': 0.48}


 48%|████▊     | 9625/20000 [15:47:17<26:34:39,  9.22s/it][2022-12-22 05:46:43,685] [INFO] [timer.py:197:stop] 0/3626, RunningAvgSamplesPerSec=10.949872234169764, CurrSamplesPerSec=11.016706286412864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9626/20000 [15:47:28<27:24:11,  9.51s/it][2022-12-22 05:46:52,543] [INFO] [timer.py:197:stop] 0/3627, RunningAvgSamplesPerSec=10.949896465508155, CurrSamplesPerSec=11.038420967532083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9627/20000 [15:47:37<26:50:12,  9.31s/it][2022-12-22 05:47:01,523] [INFO] [timer.py:197:stop] 0/3628, RunningAvgSamplesPerSec=10.949903851261071, CurrSamplesPerSec=10.976742847085871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9628/20000 [15:47:45<26:32:44,  9.21s/it][2022-12-22 05:47:11,276] [INFO] [timer.py:197:stop] 0/3629, RunningAvgSamplesPerSec=10.949872557888572, CurrSamplesPerSec=10.83756689517024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9629/20000 [15:47:55<27:00:33,  9.38s/it][2022-12-22 05:47:20,691] [INFO] [logging.py:68:log_dist] [Rank 0] step=9630, skipped=20, lr=[5.32871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:47:20,692] [INFO] [timer.py:197:stop] 0/3630, RunningAvgSamplesPerSec=10.949904915540756, CurrSamplesPerSec=11.068537981120409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9630/20000 [15:48:05<27:02:30,  9.39s/it][2022-12-22 05:47:29,832] [INFO] [timer.py:197:stop] 0/3631, RunningAvgSamplesPerSec=10.949927221626394, CurrSamplesPerSec=11.031456415660347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9631/20000 [15:48:14<26:49:30,  9.31s/it][2022-12-22 05:47:39,917] [INFO] [timer.py:197:stop] 0/3632, RunningAvgSamplesPerSec=10.94999089467596, CurrSamplesPerSec=11.186042995736697, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9632/20000 [15:48:24<27:29:21,  9.54s/it][2022-12-22 05:47:49,173] [INFO] [timer.py:197:stop] 0/3633, RunningAvgSamplesPerSec=10.949978150104222, CurrSamplesPerSec=10.903910042437985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9633/20000 [15:48:33<27:14:12,  9.46s/it][2022-12-22 05:47:58,854] [INFO] [timer.py:197:stop] 0/3634, RunningAvgSamplesPerSec=10.949923386766205, CurrSamplesPerSec=10.754625210151234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9634/20000 [15:48:43<27:25:38,  9.53s/it][2022-12-22 05:48:08,247] [INFO] [timer.py:197:stop] 0/3635, RunningAvgSamplesPerSec=10.94992620175923, CurrSamplesPerSec=10.960159814280043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9635/20000 [15:48:52<27:18:36,  9.49s/it][2022-12-22 05:48:17,524] [INFO] [timer.py:197:stop] 0/3636, RunningAvgSamplesPerSec=10.949922038790131, CurrSamplesPerSec=10.934818838383542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9636/20000 [15:49:01<27:07:38,  9.42s/it][2022-12-22 05:48:27,098] [INFO] [timer.py:197:stop] 0/3637, RunningAvgSamplesPerSec=10.949985384161456, CurrSamplesPerSec=11.185127112554559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9637/20000 [15:49:11<27:15:18,  9.47s/it][2022-12-22 05:48:36,514] [INFO] [timer.py:197:stop] 0/3638, RunningAvgSamplesPerSec=10.950008798812641, CurrSamplesPerSec=11.035787983976048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9638/20000 [15:49:20<27:12:29,  9.45s/it][2022-12-22 05:48:46,462] [INFO] [timer.py:197:stop] 0/3639, RunningAvgSamplesPerSec=10.950006751736836, CurrSamplesPerSec=10.942568641485071, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9639/20000 [15:49:30<27:37:57,  9.60s/it][2022-12-22 05:48:55,914] [INFO] [logging.py:68:log_dist] [Rank 0] step=9640, skipped=20, lr=[5.323589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:48:55,915] [INFO] [timer.py:197:stop] 0/3640, RunningAvgSamplesPerSec=10.949979828374001, CurrSamplesPerSec=10.852927685828705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9640/20000 [15:49:40<27:30:07,  9.56s/it][2022-12-22 05:49:04,807] [INFO] [timer.py:197:stop] 0/3641, RunningAvgSamplesPerSec=10.94999567170063, CurrSamplesPerSec=11.007938775731144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9641/20000 [15:49:49<26:55:31,  9.36s/it][2022-12-22 05:49:14,858] [INFO] [timer.py:197:stop] 0/3642, RunningAvgSamplesPerSec=10.95005282618979, CurrSamplesPerSec=11.162066096650392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9642/20000 [15:49:59<27:31:19,  9.57s/it][2022-12-22 05:49:24,386] [INFO] [timer.py:197:stop] 0/3643, RunningAvgSamplesPerSec=10.9501044618825, CurrSamplesPerSec=11.141341793215288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9643/20000 [15:50:08<27:29:13,  9.55s/it][2022-12-22 05:49:33,637] [INFO] [timer.py:197:stop] 0/3644, RunningAvgSamplesPerSec=10.95004237487839, CurrSamplesPerSec=10.728557309946568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9644/20000 [15:50:18<27:13:21,  9.46s/it][2022-12-22 05:49:43,819] [INFO] [timer.py:197:stop] 0/3645, RunningAvgSamplesPerSec=10.949990963057282, CurrSamplesPerSec=10.765897915710303, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9645/20000 [15:50:28<27:50:24,  9.68s/it][2022-12-22 05:49:54,627] [INFO] [timer.py:197:stop] 0/3646, RunningAvgSamplesPerSec=10.94999302979891, CurrSamplesPerSec=10.957527351523174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9646/20000 [15:50:39<28:48:41, 10.02s/it][2022-12-22 05:50:05,217] [INFO] [timer.py:197:stop] 0/3647, RunningAvgSamplesPerSec=10.95009130396399, CurrSamplesPerSec=11.320313403062146, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9647/20000 [15:50:49<29:18:08, 10.19s/it][2022-12-22 05:50:15,192] [INFO] [timer.py:197:stop] 0/3648, RunningAvgSamplesPerSec=10.950055711146357, CurrSamplesPerSec=10.821839409231414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9648/20000 [15:50:59<29:06:56, 10.13s/it][2022-12-22 05:50:24,534] [INFO] [timer.py:197:stop] 0/3649, RunningAvgSamplesPerSec=10.950074023771924, CurrSamplesPerSec=11.017251582607535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9649/20000 [15:51:08<28:26:12,  9.89s/it][2022-12-22 05:50:34,404] [INFO] [logging.py:68:log_dist] [Rank 0] step=9650, skipped=20, lr=[5.318461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:50:34,405] [INFO] [timer.py:197:stop] 0/3650, RunningAvgSamplesPerSec=10.950059932725452, CurrSamplesPerSec=10.898910005286735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9650/20000 [15:51:18<28:25:03,  9.88s/it]

                                                          
{'loss': 0.0734, 'learning_rate': 5.318461538461539e-06, 'epoch': 0.48}


 48%|████▊     | 9650/20000 [15:51:18<28:25:03,  9.88s/it][2022-12-22 05:50:44,721] [INFO] [timer.py:197:stop] 0/3651, RunningAvgSamplesPerSec=10.95001001796581, CurrSamplesPerSec=10.77090022961778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9651/20000 [15:51:29<28:47:13, 10.01s/it][2022-12-22 05:50:53,853] [INFO] [timer.py:197:stop] 0/3652, RunningAvgSamplesPerSec=10.950059113738739, CurrSamplesPerSec=11.132190195138024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9652/20000 [15:51:38<28:01:24,  9.75s/it][2022-12-22 05:51:02,877] [INFO] [timer.py:197:stop] 0/3653, RunningAvgSamplesPerSec=10.950132922798883, CurrSamplesPerSec=11.226333130806477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9653/20000 [15:51:47<27:23:45,  9.53s/it][2022-12-22 05:51:12,979] [INFO] [timer.py:197:stop] 0/3654, RunningAvgSamplesPerSec=10.950148080171584, CurrSamplesPerSec=11.005768819510864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9654/20000 [15:51:57<27:53:06,  9.70s/it][2022-12-22 05:51:22,447] [INFO] [timer.py:197:stop] 0/3655, RunningAvgSamplesPerSec=10.950266298435498, CurrSamplesPerSec=11.399724930903604, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9655/20000 [15:52:06<27:40:47,  9.63s/it][2022-12-22 05:51:32,025] [INFO] [timer.py:197:stop] 0/3656, RunningAvgSamplesPerSec=10.950201151807159, CurrSamplesPerSec=10.717283893095718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9656/20000 [15:52:16<27:37:47,  9.62s/it][2022-12-22 05:51:42,508] [INFO] [timer.py:197:stop] 0/3657, RunningAvgSamplesPerSec=10.95026682159753, CurrSamplesPerSec=11.195601827378031, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9657/20000 [15:52:26<28:22:27,  9.88s/it][2022-12-22 05:51:51,618] [INFO] [timer.py:197:stop] 0/3658, RunningAvgSamplesPerSec=10.950270501953414, CurrSamplesPerSec=10.963738752113937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9658/20000 [15:52:36<27:42:42,  9.65s/it][2022-12-22 05:52:00,755] [INFO] [timer.py:197:stop] 0/3659, RunningAvgSamplesPerSec=10.95028214921807, CurrSamplesPerSec=10.993030831214806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9659/20000 [15:52:45<27:16:12,  9.49s/it][2022-12-22 05:52:12,070] [INFO] [logging.py:68:log_dist] [Rank 0] step=9660, skipped=20, lr=[5.313333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:52:12,071] [INFO] [timer.py:197:stop] 0/3660, RunningAvgSamplesPerSec=10.95033650859405, CurrSamplesPerSec=11.152805368161609, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9660/20000 [15:52:56<28:50:14, 10.04s/it][2022-12-22 05:52:21,065] [INFO] [timer.py:197:stop] 0/3661, RunningAvgSamplesPerSec=10.950287058066422, CurrSamplesPerSec=10.772337418080955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9661/20000 [15:53:05<27:56:00,  9.73s/it][2022-12-22 05:52:30,492] [INFO] [timer.py:197:stop] 0/3662, RunningAvgSamplesPerSec=10.950333160956552, CurrSamplesPerSec=11.121663713710836, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9662/20000 [15:53:14<27:40:23,  9.64s/it][2022-12-22 05:52:39,761] [INFO] [timer.py:197:stop] 0/3663, RunningAvgSamplesPerSec=10.950409123909711, CurrSamplesPerSec=11.235678327682193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9663/20000 [15:53:24<27:21:12,  9.53s/it][2022-12-22 05:52:49,090] [INFO] [timer.py:197:stop] 0/3664, RunningAvgSamplesPerSec=10.950284693903297, CurrSamplesPerSec=10.512944997380336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9664/20000 [15:53:33<27:10:53,  9.47s/it][2022-12-22 05:52:58,581] [INFO] [timer.py:197:stop] 0/3665, RunningAvgSamplesPerSec=10.950221209844269, CurrSamplesPerSec=10.722576906851689, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9665/20000 [15:53:43<27:11:56,  9.47s/it][2022-12-22 05:53:08,964] [INFO] [timer.py:197:stop] 0/3666, RunningAvgSamplesPerSec=10.950161505327198, CurrSamplesPerSec=10.735747328285825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9666/20000 [15:53:53<27:58:44,  9.75s/it][2022-12-22 05:53:17,983] [INFO] [timer.py:197:stop] 0/3667, RunningAvgSamplesPerSec=10.950166714655063, CurrSamplesPerSec=10.96928702922373, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9667/20000 [15:54:02<27:20:59,  9.53s/it][2022-12-22 05:53:27,173] [INFO] [timer.py:197:stop] 0/3668, RunningAvgSamplesPerSec=10.950148602645223, CurrSamplesPerSec=10.884168173381521, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9668/20000 [15:54:11<27:03:18,  9.43s/it][2022-12-22 05:53:36,794] [INFO] [timer.py:197:stop] 0/3669, RunningAvgSamplesPerSec=10.950145874529104, CurrSamplesPerSec=10.940153729612645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9669/20000 [15:54:21<27:13:10,  9.49s/it][2022-12-22 05:53:45,795] [INFO] [logging.py:68:log_dist] [Rank 0] step=9670, skipped=20, lr=[5.308205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:53:45,796] [INFO] [timer.py:197:stop] 0/3670, RunningAvgSamplesPerSec=10.950226267185647, CurrSamplesPerSec=11.25318454709211, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9670/20000 [15:54:30<26:48:04,  9.34s/it][2022-12-22 05:53:56,305] [INFO] [timer.py:197:stop] 0/3671, RunningAvgSamplesPerSec=10.95033503796574, CurrSamplesPerSec=11.364396543038024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9671/20000 [15:54:40<27:48:16,  9.69s/it][2022-12-22 05:54:05,283] [INFO] [timer.py:197:stop] 0/3672, RunningAvgSamplesPerSec=10.950290553316137, CurrSamplesPerSec=10.7894739994155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9672/20000 [15:54:49<27:11:17,  9.48s/it][2022-12-22 05:54:15,808] [INFO] [timer.py:197:stop] 0/3673, RunningAvgSamplesPerSec=10.950256246352401, CurrSamplesPerSec=10.825781298174464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9673/20000 [15:55:00<28:05:15,  9.79s/it][2022-12-22 05:54:24,875] [INFO] [timer.py:197:stop] 0/3674, RunningAvgSamplesPerSec=10.950340560075928, CurrSamplesPerSec=11.268861820232416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9674/20000 [15:55:09<27:27:44,  9.57s/it][2022-12-22 05:54:34,354] [INFO] [timer.py:197:stop] 0/3675, RunningAvgSamplesPerSec=10.950321176797864, CurrSamplesPerSec=10.879605545612497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9675/20000 [15:55:18<27:22:36,  9.55s/it]

                                                          
{'loss': 0.0721, 'learning_rate': 5.305641025641027e-06, 'epoch': 0.48}


 48%|████▊     | 9675/20000 [15:55:18<27:22:36,  9.55s/it][2022-12-22 05:54:43,519] [INFO] [timer.py:197:stop] 0/3676, RunningAvgSamplesPerSec=10.950200253177373, CurrSamplesPerSec=10.523365410722802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9676/20000 [15:55:27<27:02:50,  9.43s/it][2022-12-22 05:54:53,124] [INFO] [timer.py:197:stop] 0/3677, RunningAvgSamplesPerSec=10.950152401887504, CurrSamplesPerSec=10.77712548112265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9677/20000 [15:55:37<27:11:38,  9.48s/it][2022-12-22 05:55:02,340] [INFO] [timer.py:197:stop] 0/3678, RunningAvgSamplesPerSec=10.950191045580763, CurrSamplesPerSec=11.094073166741982, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9678/20000 [15:55:46<26:57:40,  9.40s/it][2022-12-22 05:55:11,391] [INFO] [timer.py:197:stop] 0/3679, RunningAvgSamplesPerSec=10.950205190873803, CurrSamplesPerSec=11.00245145194732, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9679/20000 [15:55:55<26:39:19,  9.30s/it][2022-12-22 05:55:20,771] [INFO] [logging.py:68:log_dist] [Rank 0] step=9680, skipped=20, lr=[5.303076923076923e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:55:20,772] [INFO] [timer.py:197:stop] 0/3680, RunningAvgSamplesPerSec=10.950255912237736, CurrSamplesPerSec=11.139990770466822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9680/20000 [15:56:05<26:43:30,  9.32s/it][2022-12-22 05:55:30,742] [INFO] [timer.py:197:stop] 0/3681, RunningAvgSamplesPerSec=10.950256232243673, CurrSamplesPerSec=10.951433340629245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9681/20000 [15:56:15<27:16:43,  9.52s/it][2022-12-22 05:55:40,608] [INFO] [timer.py:197:stop] 0/3682, RunningAvgSamplesPerSec=10.950184005073517, CurrSamplesPerSec=10.69075736042469, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9682/20000 [15:56:25<27:34:38,  9.62s/it][2022-12-22 05:55:50,238] [INFO] [timer.py:197:stop] 0/3683, RunningAvgSamplesPerSec=10.950158949005187, CurrSamplesPerSec=10.858722769453205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9683/20000 [15:56:34<27:34:54,  9.62s/it][2022-12-22 05:56:01,850] [INFO] [timer.py:197:stop] 0/3684, RunningAvgSamplesPerSec=10.950189270949943, CurrSamplesPerSec=11.06295407139592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9684/20000 [15:56:46<29:17:13, 10.22s/it][2022-12-22 05:56:12,081] [INFO] [timer.py:197:stop] 0/3685, RunningAvgSamplesPerSec=10.950146352870657, CurrSamplesPerSec=10.794370634793648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9685/20000 [15:56:56<29:17:36, 10.22s/it][2022-12-22 05:56:23,301] [INFO] [timer.py:197:stop] 0/3686, RunningAvgSamplesPerSec=10.950208191595825, CurrSamplesPerSec=11.182799160667642, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9686/20000 [15:57:07<30:08:49, 10.52s/it][2022-12-22 05:56:33,979] [INFO] [timer.py:197:stop] 0/3687, RunningAvgSamplesPerSec=10.950275320204803, CurrSamplesPerSec=11.20329283221274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9687/20000 [15:57:18<30:16:38, 10.57s/it][2022-12-22 05:56:44,067] [INFO] [timer.py:197:stop] 0/3688, RunningAvgSamplesPerSec=10.950303204984193, CurrSamplesPerSec=11.05403225341522, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9688/20000 [15:57:28<29:51:38, 10.42s/it][2022-12-22 05:56:54,697] [INFO] [timer.py:197:stop] 0/3689, RunningAvgSamplesPerSec=10.950350199257032, CurrSamplesPerSec=11.126356037234215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9689/20000 [15:57:39<30:02:05, 10.49s/it][2022-12-22 05:57:04,725] [INFO] [logging.py:68:log_dist] [Rank 0] step=9690, skipped=20, lr=[5.2979487179487185e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:57:04,726] [INFO] [timer.py:197:stop] 0/3690, RunningAvgSamplesPerSec=10.950358099427113, CurrSamplesPerSec=10.979563734513713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9690/20000 [15:57:49<29:38:18, 10.35s/it][2022-12-22 05:57:15,084] [INFO] [timer.py:197:stop] 0/3691, RunningAvgSamplesPerSec=10.950383466721302, CurrSamplesPerSec=11.044744439074123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9691/20000 [15:57:59<29:38:37, 10.35s/it][2022-12-22 05:57:26,038] [INFO] [timer.py:197:stop] 0/3692, RunningAvgSamplesPerSec=10.950399242504798, CurrSamplesPerSec=11.008907137492562, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9692/20000 [15:58:10<30:09:27, 10.53s/it][2022-12-22 05:57:36,459] [INFO] [timer.py:197:stop] 0/3693, RunningAvgSamplesPerSec=10.950330991192946, CurrSamplesPerSec=10.704147181564375, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9693/20000 [15:58:20<30:03:32, 10.50s/it][2022-12-22 05:57:46,868] [INFO] [timer.py:197:stop] 0/3694, RunningAvgSamplesPerSec=10.950337075047864, CurrSamplesPerSec=10.972838739501814, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9694/20000 [15:58:31<29:58:44, 10.47s/it][2022-12-22 05:57:56,928] [INFO] [timer.py:197:stop] 0/3695, RunningAvgSamplesPerSec=10.950273545427496, CurrSamplesPerSec=10.720642150337467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9695/20000 [15:58:41<29:37:19, 10.35s/it][2022-12-22 05:58:06,498] [INFO] [timer.py:197:stop] 0/3696, RunningAvgSamplesPerSec=10.95029723260654, CurrSamplesPerSec=11.038478614970698, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9696/20000 [15:58:50<28:57:05, 10.12s/it][2022-12-22 05:58:16,079] [INFO] [timer.py:197:stop] 0/3697, RunningAvgSamplesPerSec=10.950294411604409, CurrSamplesPerSec=10.939883539862926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9697/20000 [15:59:00<28:29:22,  9.95s/it][2022-12-22 05:58:24,838] [INFO] [timer.py:197:stop] 0/3698, RunningAvgSamplesPerSec=10.950336531129809, CurrSamplesPerSec=11.108212598169414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9698/20000 [15:59:09<27:27:36,  9.60s/it][2022-12-22 05:58:33,668] [INFO] [timer.py:197:stop] 0/3699, RunningAvgSamplesPerSec=10.950354953132138, CurrSamplesPerSec=11.018868798163984, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9699/20000 [15:59:18<26:48:01,  9.37s/it][2022-12-22 05:58:43,076] [INFO] [logging.py:68:log_dist] [Rank 0] step=9700, skipped=20, lr=[5.2928205128205134e-06], mom=[[0.9, 0.999]]
[2022-12-22 05:58:43,077] [INFO] [timer.py:197:stop] 0/3700, RunningAvgSamplesPerSec=10.950379389554008, CurrSamplesPerSec=11.04147257006882, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 48%|████▊     | 9700/20000 [15:59:27<26:50:04,  9.38s/it]

                                                          
{'loss': 0.0688, 'learning_rate': 5.2928205128205134e-06, 'epoch': 0.48}


 48%|████▊     | 9700/20000 [15:59:27<26:50:04,  9.38s/it][2022-12-22 05:58:52,149] [INFO] [timer.py:197:stop] 0/3701, RunningAvgSamplesPerSec=10.950441255030771, CurrSamplesPerSec=11.184102806159894, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9701/20000 [15:59:36<26:34:07,  9.29s/it][2022-12-22 05:59:01,636] [INFO] [timer.py:197:stop] 0/3702, RunningAvgSamplesPerSec=10.950449757052347, CurrSamplesPerSec=10.981989338976883, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9702/20000 [15:59:46<26:44:14,  9.35s/it][2022-12-22 05:59:12,699] [INFO] [timer.py:197:stop] 0/3703, RunningAvgSamplesPerSec=10.950491619448176, CurrSamplesPerSec=11.107605404038331, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9703/20000 [15:59:57<28:12:27,  9.86s/it][2022-12-22 05:59:21,706] [INFO] [timer.py:197:stop] 0/3704, RunningAvgSamplesPerSec=10.950416531840627, CurrSamplesPerSec=10.679397075687788, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9704/20000 [16:00:06<27:28:15,  9.61s/it][2022-12-22 05:59:32,509] [INFO] [timer.py:197:stop] 0/3705, RunningAvgSamplesPerSec=10.95043598329583, CurrSamplesPerSec=11.022922062507234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9705/20000 [16:00:16<28:29:46,  9.96s/it][2022-12-22 05:59:41,739] [INFO] [timer.py:197:stop] 0/3706, RunningAvgSamplesPerSec=10.95044160796016, CurrSamplesPerSec=10.971309442062033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9706/20000 [16:00:26<27:51:46,  9.74s/it][2022-12-22 05:59:50,535] [INFO] [timer.py:197:stop] 0/3707, RunningAvgSamplesPerSec=10.95049807304969, CurrSamplesPerSec=11.163718216561252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9707/20000 [16:00:34<27:02:48,  9.46s/it][2022-12-22 06:00:01,839] [INFO] [timer.py:197:stop] 0/3708, RunningAvgSamplesPerSec=10.950556739543329, CurrSamplesPerSec=11.172319082905387, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9708/20000 [16:00:46<28:37:36, 10.01s/it][2022-12-22 06:00:10,730] [INFO] [timer.py:197:stop] 0/3709, RunningAvgSamplesPerSec=10.950554744218984, CurrSamplesPerSec=10.943165063627282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9709/20000 [16:00:55<27:39:41,  9.68s/it][2022-12-22 06:00:20,565] [INFO] [logging.py:68:log_dist] [Rank 0] step=9710, skipped=20, lr=[5.287692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:00:20,566] [INFO] [timer.py:197:stop] 0/3710, RunningAvgSamplesPerSec=10.950500427140712, CurrSamplesPerSec=10.752783537563838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9710/20000 [16:01:05<27:47:40,  9.72s/it][2022-12-22 06:00:29,992] [INFO] [timer.py:197:stop] 0/3711, RunningAvgSamplesPerSec=10.950511021452785, CurrSamplesPerSec=10.98993620210296, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9711/20000 [16:01:14<27:32:12,  9.63s/it][2022-12-22 06:00:39,155] [INFO] [timer.py:197:stop] 0/3712, RunningAvgSamplesPerSec=10.950498458167534, CurrSamplesPerSec=10.90409872934065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9712/20000 [16:01:23<27:07:48,  9.49s/it][2022-12-22 06:00:49,560] [INFO] [timer.py:197:stop] 0/3713, RunningAvgSamplesPerSec=10.950403052596952, CurrSamplesPerSec=10.607534076845385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9713/20000 [16:01:34<27:54:31,  9.77s/it][2022-12-22 06:00:59,688] [INFO] [timer.py:197:stop] 0/3714, RunningAvgSamplesPerSec=10.950462593649188, CurrSamplesPerSec=11.175970939319122, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9714/20000 [16:01:44<28:12:54,  9.88s/it][2022-12-22 06:01:09,782] [INFO] [timer.py:197:stop] 0/3715, RunningAvgSamplesPerSec=10.950342398979835, CurrSamplesPerSec=10.521651160517317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9715/20000 [16:01:54<28:24:02,  9.94s/it][2022-12-22 06:01:18,708] [INFO] [timer.py:197:stop] 0/3716, RunningAvgSamplesPerSec=10.950413677367777, CurrSamplesPerSec=11.221626954433003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9716/20000 [16:02:03<27:31:41,  9.64s/it][2022-12-22 06:01:28,613] [INFO] [timer.py:197:stop] 0/3717, RunningAvgSamplesPerSec=10.950467887998352, CurrSamplesPerSec=11.155578403092896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9717/20000 [16:02:13<27:45:20,  9.72s/it][2022-12-22 06:01:38,567] [INFO] [timer.py:197:stop] 0/3718, RunningAvgSamplesPerSec=10.950357299477663, CurrSamplesPerSec=10.554381205900535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9718/20000 [16:02:23<27:57:20,  9.79s/it][2022-12-22 06:01:47,969] [INFO] [timer.py:197:stop] 0/3719, RunningAvgSamplesPerSec=10.950340550282649, CurrSamplesPerSec=10.888452398761315, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9719/20000 [16:02:32<27:37:20,  9.67s/it][2022-12-22 06:01:56,984] [INFO] [logging.py:68:log_dist] [Rank 0] step=9720, skipped=20, lr=[5.282564102564102e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:01:56,985] [INFO] [timer.py:197:stop] 0/3720, RunningAvgSamplesPerSec=10.950370186203738, CurrSamplesPerSec=11.061646606138387, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9720/20000 [16:02:41<27:03:25,  9.48s/it][2022-12-22 06:02:06,724] [INFO] [timer.py:197:stop] 0/3721, RunningAvgSamplesPerSec=10.950389109118742, CurrSamplesPerSec=11.02119958123331, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9721/20000 [16:02:51<27:16:49,  9.55s/it][2022-12-22 06:02:15,615] [INFO] [timer.py:197:stop] 0/3722, RunningAvgSamplesPerSec=10.950384238182965, CurrSamplesPerSec=10.932299153885019, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9722/20000 [16:03:00<26:42:35,  9.36s/it][2022-12-22 06:02:26,203] [INFO] [timer.py:197:stop] 0/3723, RunningAvgSamplesPerSec=10.95035730621644, CurrSamplesPerSec=10.851078951586286, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9723/20000 [16:03:10<27:45:45,  9.73s/it][2022-12-22 06:02:35,293] [INFO] [timer.py:197:stop] 0/3724, RunningAvgSamplesPerSec=10.950362113305925, CurrSamplesPerSec=10.968278567284198, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9724/20000 [16:03:19<27:12:59,  9.53s/it][2022-12-22 06:02:44,301] [INFO] [timer.py:197:stop] 0/3725, RunningAvgSamplesPerSec=10.950364334555847, CurrSamplesPerSec=10.958638075094314, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9725/20000 [16:03:28<26:45:43,  9.38s/it]

                                                          
{'loss': 0.0717, 'learning_rate': 5.28e-06, 'epoch': 0.49}


 49%|████▊     | 9725/20000 [16:03:28<26:45:43,  9.38s/it][2022-12-22 06:02:54,661] [INFO] [timer.py:197:stop] 0/3726, RunningAvgSamplesPerSec=10.950388295970402, CurrSamplesPerSec=11.040329553904568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9726/20000 [16:03:39<27:36:06,  9.67s/it][2022-12-22 06:03:03,561] [INFO] [timer.py:197:stop] 0/3727, RunningAvgSamplesPerSec=10.950447078751038, CurrSamplesPerSec=11.173820748384765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9727/20000 [16:03:48<26:56:19,  9.44s/it][2022-12-22 06:03:12,738] [INFO] [timer.py:197:stop] 0/3728, RunningAvgSamplesPerSec=10.950468054966752, CurrSamplesPerSec=11.029166154793048, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9728/20000 [16:03:57<26:42:37,  9.36s/it][2022-12-22 06:03:21,623] [INFO] [timer.py:197:stop] 0/3729, RunningAvgSamplesPerSec=10.950501580321328, CurrSamplesPerSec=11.076858831247819, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9729/20000 [16:04:06<26:18:01,  9.22s/it][2022-12-22 06:03:31,542] [INFO] [logging.py:68:log_dist] [Rank 0] step=9730, skipped=20, lr=[5.277435897435897e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:03:31,543] [INFO] [timer.py:197:stop] 0/3730, RunningAvgSamplesPerSec=10.950246602384837, CurrSamplesPerSec=10.075847749576637, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9730/20000 [16:04:16<26:53:52,  9.43s/it][2022-12-22 06:03:40,424] [INFO] [timer.py:197:stop] 0/3731, RunningAvgSamplesPerSec=10.950313465016476, CurrSamplesPerSec=11.205385154483443, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9731/20000 [16:04:24<26:25:35,  9.26s/it][2022-12-22 06:03:49,551] [INFO] [timer.py:197:stop] 0/3732, RunningAvgSamplesPerSec=10.95033825554013, CurrSamplesPerSec=11.04356939602493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9732/20000 [16:04:34<26:18:23,  9.22s/it][2022-12-22 06:03:59,896] [INFO] [timer.py:197:stop] 0/3733, RunningAvgSamplesPerSec=10.950343247565895, CurrSamplesPerSec=10.968995228504376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9733/20000 [16:04:44<27:15:50,  9.56s/it][2022-12-22 06:04:08,861] [INFO] [timer.py:197:stop] 0/3734, RunningAvgSamplesPerSec=10.950337006592063, CurrSamplesPerSec=10.927101355343352, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9734/20000 [16:04:53<26:45:08,  9.38s/it][2022-12-22 06:04:18,736] [INFO] [timer.py:197:stop] 0/3735, RunningAvgSamplesPerSec=10.950303871867705, CurrSamplesPerSec=10.828026297818038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9735/20000 [16:05:03<27:10:20,  9.53s/it][2022-12-22 06:04:29,147] [INFO] [timer.py:197:stop] 0/3736, RunningAvgSamplesPerSec=10.950215268812071, CurrSamplesPerSec=10.629160242925801, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9736/20000 [16:05:13<27:55:25,  9.79s/it][2022-12-22 06:04:38,152] [INFO] [timer.py:197:stop] 0/3737, RunningAvgSamplesPerSec=10.950151286980427, CurrSamplesPerSec=10.71634561797681, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9737/20000 [16:05:22<27:14:46,  9.56s/it][2022-12-22 06:04:47,432] [INFO] [timer.py:197:stop] 0/3738, RunningAvgSamplesPerSec=10.950148480837672, CurrSamplesPerSec=10.939677562583583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9738/20000 [16:05:31<27:00:22,  9.47s/it][2022-12-22 06:04:56,922] [INFO] [timer.py:197:stop] 0/3739, RunningAvgSamplesPerSec=10.95022066097079, CurrSamplesPerSec=11.226696066353222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9739/20000 [16:05:41<27:01:04,  9.48s/it][2022-12-22 06:05:06,069] [INFO] [logging.py:68:log_dist] [Rank 0] step=9740, skipped=20, lr=[5.272307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:05:06,069] [INFO] [timer.py:197:stop] 0/3740, RunningAvgSamplesPerSec=10.950288969359724, CurrSamplesPerSec=11.211651828295766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9740/20000 [16:05:50<26:43:52,  9.38s/it][2022-12-22 06:05:15,017] [INFO] [timer.py:197:stop] 0/3741, RunningAvgSamplesPerSec=10.950251118505422, CurrSamplesPerSec=10.810569907179513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9741/20000 [16:05:59<26:21:33,  9.25s/it][2022-12-22 06:05:24,996] [INFO] [timer.py:197:stop] 0/3742, RunningAvgSamplesPerSec=10.950202155336916, CurrSamplesPerSec=10.77014007958981, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9742/20000 [16:06:09<26:58:48,  9.47s/it][2022-12-22 06:05:34,422] [INFO] [timer.py:197:stop] 0/3743, RunningAvgSamplesPerSec=10.950271262751611, CurrSamplesPerSec=11.214982708480047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9743/20000 [16:06:18<26:56:28,  9.46s/it][2022-12-22 06:05:43,753] [INFO] [timer.py:197:stop] 0/3744, RunningAvgSamplesPerSec=10.95028168727498, CurrSamplesPerSec=10.989419250288996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9744/20000 [16:06:28<26:49:53,  9.42s/it][2022-12-22 06:05:52,658] [INFO] [timer.py:197:stop] 0/3745, RunningAvgSamplesPerSec=10.950367317485231, CurrSamplesPerSec=11.280457193188663, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9745/20000 [16:06:37<26:23:25,  9.26s/it][2022-12-22 06:06:02,174] [INFO] [timer.py:197:stop] 0/3746, RunningAvgSamplesPerSec=10.950407527003836, CurrSamplesPerSec=11.10300970528836, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9746/20000 [16:06:46<26:36:12,  9.34s/it][2022-12-22 06:06:11,345] [INFO] [timer.py:197:stop] 0/3747, RunningAvgSamplesPerSec=10.950389038485485, CurrSamplesPerSec=10.881602961350847, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9747/20000 [16:06:55<26:27:22,  9.29s/it][2022-12-22 06:06:22,640] [INFO] [timer.py:197:stop] 0/3748, RunningAvgSamplesPerSec=10.950320438298071, CurrSamplesPerSec=10.69930346929313, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9748/20000 [16:07:07<28:10:02,  9.89s/it][2022-12-22 06:06:32,000] [INFO] [timer.py:197:stop] 0/3749, RunningAvgSamplesPerSec=10.950287854510808, CurrSamplesPerSec=10.829574890033214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▊     | 9749/20000 [16:07:16<27:42:38,  9.73s/it][2022-12-22 06:06:41,185] [INFO] [logging.py:68:log_dist] [Rank 0] step=9750, skipped=20, lr=[5.267179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:06:41,185] [INFO] [timer.py:197:stop] 0/3750, RunningAvgSamplesPerSec=10.950331419266556, CurrSamplesPerSec=11.116039436022474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9750/20000 [16:07:25<27:14:29,  9.57s/it]

                                                          
{'loss': 0.0588, 'learning_rate': 5.267179487179488e-06, 'epoch': 0.49}


 49%|████▉     | 9750/20000 [16:07:25<27:14:29,  9.57s/it][2022-12-22 06:06:50,824] [INFO] [timer.py:197:stop] 0/3751, RunningAvgSamplesPerSec=10.950314280025047, CurrSamplesPerSec=10.886451143404939, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9751/20000 [16:07:35<27:17:59,  9.59s/it][2022-12-22 06:06:59,861] [INFO] [timer.py:197:stop] 0/3752, RunningAvgSamplesPerSec=10.950375741497549, CurrSamplesPerSec=11.185748871353251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9752/20000 [16:07:44<26:49:31,  9.42s/it][2022-12-22 06:07:09,607] [INFO] [timer.py:197:stop] 0/3753, RunningAvgSamplesPerSec=10.950378986710376, CurrSamplesPerSec=10.96256207792666, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9753/20000 [16:07:54<27:05:54,  9.52s/it][2022-12-22 06:07:20,443] [INFO] [timer.py:197:stop] 0/3754, RunningAvgSamplesPerSec=10.950289020590926, CurrSamplesPerSec=10.622917635062015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9754/20000 [16:08:04<28:13:08,  9.91s/it][2022-12-22 06:07:29,351] [INFO] [timer.py:197:stop] 0/3755, RunningAvgSamplesPerSec=10.95029482637938, CurrSamplesPerSec=10.972121575977138, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9755/20000 [16:08:13<27:21:24,  9.61s/it][2022-12-22 06:07:38,711] [INFO] [timer.py:197:stop] 0/3756, RunningAvgSamplesPerSec=10.95032847221988, CurrSamplesPerSec=11.078074800721069, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9756/20000 [16:08:23<27:08:15,  9.54s/it][2022-12-22 06:07:48,929] [INFO] [timer.py:197:stop] 0/3757, RunningAvgSamplesPerSec=10.950312180440294, CurrSamplesPerSec=10.88949261788702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9757/20000 [16:08:33<27:42:58,  9.74s/it][2022-12-22 06:07:58,364] [INFO] [timer.py:197:stop] 0/3758, RunningAvgSamplesPerSec=10.950295560935267, CurrSamplesPerSec=10.888243053841252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9758/20000 [16:08:42<27:27:07,  9.65s/it][2022-12-22 06:08:08,107] [INFO] [timer.py:197:stop] 0/3759, RunningAvgSamplesPerSec=10.950326491442915, CurrSamplesPerSec=11.067747561861012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9759/20000 [16:08:52<27:31:48,  9.68s/it][2022-12-22 06:08:18,894] [INFO] [logging.py:68:log_dist] [Rank 0] step=9760, skipped=20, lr=[5.262051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:08:18,895] [INFO] [timer.py:197:stop] 0/3760, RunningAvgSamplesPerSec=10.950393306712042, CurrSamplesPerSec=11.207309340167052, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9760/20000 [16:09:03<28:28:28, 10.01s/it][2022-12-22 06:08:29,148] [INFO] [timer.py:197:stop] 0/3761, RunningAvgSamplesPerSec=10.950413488394954, CurrSamplesPerSec=11.026785346417764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9761/20000 [16:09:13<28:40:44, 10.08s/it][2022-12-22 06:08:39,857] [INFO] [timer.py:197:stop] 0/3762, RunningAvgSamplesPerSec=10.950479865748768, CurrSamplesPerSec=11.205811758628807, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9762/20000 [16:09:24<29:12:34, 10.27s/it][2022-12-22 06:08:49,462] [INFO] [timer.py:197:stop] 0/3763, RunningAvgSamplesPerSec=10.950597975194375, CurrSamplesPerSec=11.413465659891589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9763/20000 [16:09:33<28:38:20, 10.07s/it][2022-12-22 06:09:00,190] [INFO] [timer.py:197:stop] 0/3764, RunningAvgSamplesPerSec=10.950606874918668, CurrSamplesPerSec=10.984181389861279, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9764/20000 [16:09:44<29:11:46, 10.27s/it][2022-12-22 06:09:10,096] [INFO] [timer.py:197:stop] 0/3765, RunningAvgSamplesPerSec=10.950605922467409, CurrSamplesPerSec=10.947023973181214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9765/20000 [16:09:54<28:53:02, 10.16s/it][2022-12-22 06:09:19,921] [INFO] [timer.py:197:stop] 0/3766, RunningAvgSamplesPerSec=10.950560841693688, CurrSamplesPerSec=10.783510414233767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9766/20000 [16:10:04<28:35:45, 10.06s/it][2022-12-22 06:09:31,308] [INFO] [timer.py:197:stop] 0/3767, RunningAvgSamplesPerSec=10.950501078351284, CurrSamplesPerSec=10.730081010604948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9767/20000 [16:10:15<29:43:32, 10.46s/it][2022-12-22 06:09:41,931] [INFO] [timer.py:197:stop] 0/3768, RunningAvgSamplesPerSec=10.9504638194721, CurrSamplesPerSec=10.811958912088434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9768/20000 [16:10:26<29:51:47, 10.51s/it][2022-12-22 06:09:52,509] [INFO] [timer.py:197:stop] 0/3769, RunningAvgSamplesPerSec=10.950412357072826, CurrSamplesPerSec=10.759976315145176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9769/20000 [16:10:36<29:55:16, 10.53s/it][2022-12-22 06:10:02,198] [INFO] [logging.py:68:log_dist] [Rank 0] step=9770, skipped=20, lr=[5.256923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:10:02,199] [INFO] [timer.py:197:stop] 0/3770, RunningAvgSamplesPerSec=10.950336540686227, CurrSamplesPerSec=10.671997613986548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9770/20000 [16:10:46<29:12:13, 10.28s/it][2022-12-22 06:10:11,638] [INFO] [timer.py:197:stop] 0/3771, RunningAvgSamplesPerSec=10.950328657987807, CurrSamplesPerSec=10.92070701831255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9771/20000 [16:10:56<28:29:12, 10.03s/it][2022-12-22 06:10:21,002] [INFO] [timer.py:197:stop] 0/3772, RunningAvgSamplesPerSec=10.950335484272205, CurrSamplesPerSec=10.976124358273895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9772/20000 [16:11:05<27:55:10,  9.83s/it][2022-12-22 06:10:30,284] [INFO] [timer.py:197:stop] 0/3773, RunningAvgSamplesPerSec=10.95036047773161, CurrSamplesPerSec=11.045403863158773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9773/20000 [16:11:14<27:27:10,  9.66s/it][2022-12-22 06:10:40,445] [INFO] [timer.py:197:stop] 0/3774, RunningAvgSamplesPerSec=10.950322042216795, CurrSamplesPerSec=10.807275604928208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9774/20000 [16:11:24<27:52:26,  9.81s/it][2022-12-22 06:10:49,435] [INFO] [timer.py:197:stop] 0/3775, RunningAvgSamplesPerSec=10.950322512185519, CurrSamplesPerSec=10.952095521319228, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9775/20000 [16:11:33<27:10:11,  9.57s/it]

                                                          
{'loss': 0.0601, 'learning_rate': 5.254358974358975e-06, 'epoch': 0.49}


 49%|████▉     | 9775/20000 [16:11:33<27:10:11,  9.57s/it][2022-12-22 06:10:59,086] [INFO] [timer.py:197:stop] 0/3776, RunningAvgSamplesPerSec=10.95028344300442, CurrSamplesPerSec=10.804833920765223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9776/20000 [16:11:43<27:14:23,  9.59s/it][2022-12-22 06:11:08,312] [INFO] [timer.py:197:stop] 0/3777, RunningAvgSamplesPerSec=10.950340819258908, CurrSamplesPerSec=11.171248305754801, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9777/20000 [16:11:52<26:55:33,  9.48s/it][2022-12-22 06:11:17,458] [INFO] [timer.py:197:stop] 0/3778, RunningAvgSamplesPerSec=10.95029411281223, CurrSamplesPerSec=10.776771993825292, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9778/20000 [16:12:01<26:38:12,  9.38s/it][2022-12-22 06:11:26,614] [INFO] [timer.py:197:stop] 0/3779, RunningAvgSamplesPerSec=10.950312915226771, CurrSamplesPerSec=11.021774285236473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9779/20000 [16:12:11<26:26:32,  9.31s/it][2022-12-22 06:11:36,376] [INFO] [logging.py:68:log_dist] [Rank 0] step=9780, skipped=20, lr=[5.251794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:11:36,377] [INFO] [timer.py:197:stop] 0/3780, RunningAvgSamplesPerSec=10.9502457572392, CurrSamplesPerSec=10.702334275870212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9780/20000 [16:12:20<26:49:24,  9.45s/it][2022-12-22 06:11:45,578] [INFO] [timer.py:197:stop] 0/3781, RunningAvgSamplesPerSec=10.950148862804731, CurrSamplesPerSec=10.595926593822057, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9781/20000 [16:12:30<26:36:32,  9.37s/it][2022-12-22 06:11:55,222] [INFO] [timer.py:197:stop] 0/3782, RunningAvgSamplesPerSec=10.950135570817718, CurrSamplesPerSec=10.900134576954002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9782/20000 [16:12:39<26:50:11,  9.45s/it][2022-12-22 06:12:04,576] [INFO] [timer.py:197:stop] 0/3783, RunningAvgSamplesPerSec=10.95015190695349, CurrSamplesPerSec=11.012252794964374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9783/20000 [16:12:49<26:44:54,  9.42s/it][2022-12-22 06:12:14,566] [INFO] [timer.py:197:stop] 0/3784, RunningAvgSamplesPerSec=10.950132223770932, CurrSamplesPerSec=10.87621263477186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9784/20000 [16:12:59<27:13:36,  9.59s/it][2022-12-22 06:12:23,643] [INFO] [timer.py:197:stop] 0/3785, RunningAvgSamplesPerSec=10.950149620738113, CurrSamplesPerSec=11.016342785603541, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9785/20000 [16:13:08<26:46:59,  9.44s/it][2022-12-22 06:12:33,353] [INFO] [timer.py:197:stop] 0/3786, RunningAvgSamplesPerSec=10.950183961028701, CurrSamplesPerSec=11.081653402088856, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9786/20000 [16:13:17<27:00:39,  9.52s/it][2022-12-22 06:12:42,388] [INFO] [timer.py:197:stop] 0/3787, RunningAvgSamplesPerSec=10.950186776945994, CurrSamplesPerSec=10.960852589430928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9787/20000 [16:13:26<26:35:46,  9.37s/it][2022-12-22 06:12:51,239] [INFO] [timer.py:197:stop] 0/3788, RunningAvgSamplesPerSec=10.950233553302862, CurrSamplesPerSec=11.130192493311883, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9788/20000 [16:13:35<26:08:50,  9.22s/it][2022-12-22 06:13:00,806] [INFO] [timer.py:197:stop] 0/3789, RunningAvgSamplesPerSec=10.950263522313094, CurrSamplesPerSec=11.064914480621377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9789/20000 [16:13:45<26:26:29,  9.32s/it][2022-12-22 06:13:10,314] [INFO] [logging.py:68:log_dist] [Rank 0] step=9790, skipped=20, lr=[5.246666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:13:10,315] [INFO] [timer.py:197:stop] 0/3790, RunningAvgSamplesPerSec=10.95026407437787, CurrSamplesPerSec=10.952355143022373, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9790/20000 [16:13:54<26:35:52,  9.38s/it][2022-12-22 06:13:19,893] [INFO] [timer.py:197:stop] 0/3791, RunningAvgSamplesPerSec=10.950266508063391, CurrSamplesPerSec=10.959493078528563, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9791/20000 [16:14:04<26:45:57,  9.44s/it][2022-12-22 06:13:29,515] [INFO] [timer.py:197:stop] 0/3792, RunningAvgSamplesPerSec=10.950289732381508, CurrSamplesPerSec=11.038999738824787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9792/20000 [16:14:13<26:55:07,  9.49s/it][2022-12-22 06:13:38,394] [INFO] [timer.py:197:stop] 0/3793, RunningAvgSamplesPerSec=10.950310095276125, CurrSamplesPerSec=11.028033387028325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9793/20000 [16:14:22<26:23:39,  9.31s/it][2022-12-22 06:13:47,895] [INFO] [timer.py:197:stop] 0/3794, RunningAvgSamplesPerSec=10.950255512683354, CurrSamplesPerSec=10.74717151309156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9794/20000 [16:14:32<26:33:16,  9.37s/it][2022-12-22 06:13:57,479] [INFO] [timer.py:197:stop] 0/3795, RunningAvgSamplesPerSec=10.95021236557531, CurrSamplesPerSec=10.789007822926733, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9795/20000 [16:14:41<26:44:11,  9.43s/it][2022-12-22 06:14:06,783] [INFO] [timer.py:197:stop] 0/3796, RunningAvgSamplesPerSec=10.950164514152824, CurrSamplesPerSec=10.771624178877476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9796/20000 [16:14:51<26:37:32,  9.39s/it][2022-12-22 06:14:16,058] [INFO] [timer.py:197:stop] 0/3797, RunningAvgSamplesPerSec=10.950178156744368, CurrSamplesPerSec=11.00218403853797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9797/20000 [16:15:00<26:31:18,  9.36s/it][2022-12-22 06:14:26,033] [INFO] [timer.py:197:stop] 0/3798, RunningAvgSamplesPerSec=10.950136877223695, CurrSamplesPerSec=10.795691222078535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9798/20000 [16:15:10<27:02:37,  9.54s/it][2022-12-22 06:14:34,860] [INFO] [timer.py:197:stop] 0/3799, RunningAvgSamplesPerSec=10.95016463657429, CurrSamplesPerSec=11.056563285665547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9799/20000 [16:15:19<26:25:58,  9.33s/it][2022-12-22 06:14:44,363] [INFO] [logging.py:68:log_dist] [Rank 0] step=9800, skipped=20, lr=[5.2415384615384624e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:14:44,364] [INFO] [timer.py:197:stop] 0/3800, RunningAvgSamplesPerSec=10.950125268912807, CurrSamplesPerSec=10.802659823739493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9800/20000 [16:15:28<26:34:45,  9.38s/it]

                                                          
{'loss': 0.0668, 'learning_rate': 5.2415384615384624e-06, 'epoch': 0.49}


 49%|████▉     | 9800/20000 [16:15:28<26:34:45,  9.38s/it][2022-12-22 06:14:55,035] [INFO] [timer.py:197:stop] 0/3801, RunningAvgSamplesPerSec=10.950015761595, CurrSamplesPerSec=10.549330015423017, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9801/20000 [16:15:39<27:40:23,  9.77s/it][2022-12-22 06:15:04,672] [INFO] [timer.py:197:stop] 0/3802, RunningAvgSamplesPerSec=10.9499292371795, CurrSamplesPerSec=10.630805295548637, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9802/20000 [16:15:49<27:33:33,  9.73s/it][2022-12-22 06:15:13,483] [INFO] [timer.py:197:stop] 0/3803, RunningAvgSamplesPerSec=10.949986725166646, CurrSamplesPerSec=11.17288919389678, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9803/20000 [16:15:57<26:46:36,  9.45s/it][2022-12-22 06:15:23,735] [INFO] [timer.py:197:stop] 0/3804, RunningAvgSamplesPerSec=10.950012766078057, CurrSamplesPerSec=11.049897404716177, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9804/20000 [16:16:08<27:27:09,  9.69s/it][2022-12-22 06:15:33,081] [INFO] [timer.py:197:stop] 0/3805, RunningAvgSamplesPerSec=10.950016972758416, CurrSamplesPerSec=10.966034172659299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9805/20000 [16:16:17<27:09:16,  9.59s/it][2022-12-22 06:15:42,067] [INFO] [timer.py:197:stop] 0/3806, RunningAvgSamplesPerSec=10.950030485633656, CurrSamplesPerSec=11.001662326693426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9806/20000 [16:16:26<26:38:26,  9.41s/it][2022-12-22 06:15:51,073] [INFO] [timer.py:197:stop] 0/3807, RunningAvgSamplesPerSec=10.950066169583573, CurrSamplesPerSec=11.087512203326376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9807/20000 [16:16:35<26:17:45,  9.29s/it][2022-12-22 06:16:00,152] [INFO] [timer.py:197:stop] 0/3808, RunningAvgSamplesPerSec=10.950067655187135, CurrSamplesPerSec=10.955723297104909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9808/20000 [16:16:44<26:07:00,  9.22s/it][2022-12-22 06:16:09,368] [INFO] [timer.py:197:stop] 0/3809, RunningAvgSamplesPerSec=10.95007729155406, CurrSamplesPerSec=10.986876591433694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9809/20000 [16:16:53<26:06:23,  9.22s/it][2022-12-22 06:16:18,350] [INFO] [logging.py:68:log_dist] [Rank 0] step=9810, skipped=20, lr=[5.236410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:16:18,351] [INFO] [timer.py:197:stop] 0/3810, RunningAvgSamplesPerSec=10.950055784251044, CurrSamplesPerSec=10.868785335588537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9810/20000 [16:17:02<25:54:02,  9.15s/it][2022-12-22 06:16:28,122] [INFO] [timer.py:197:stop] 0/3811, RunningAvgSamplesPerSec=10.950018741755775, CurrSamplesPerSec=10.810755377469246, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9811/20000 [16:17:12<26:25:32,  9.34s/it][2022-12-22 06:16:37,834] [INFO] [timer.py:197:stop] 0/3812, RunningAvgSamplesPerSec=10.950030463193622, CurrSamplesPerSec=10.994860254082889, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9812/20000 [16:17:22<26:44:30,  9.45s/it][2022-12-22 06:16:46,925] [INFO] [timer.py:197:stop] 0/3813, RunningAvgSamplesPerSec=10.950015648696255, CurrSamplesPerSec=10.893861941054135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9813/20000 [16:17:31<26:26:02,  9.34s/it][2022-12-22 06:16:56,923] [INFO] [timer.py:197:stop] 0/3814, RunningAvgSamplesPerSec=10.950076469253299, CurrSamplesPerSec=11.186877442274128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9814/20000 [16:17:41<26:59:21,  9.54s/it][2022-12-22 06:17:06,074] [INFO] [timer.py:197:stop] 0/3815, RunningAvgSamplesPerSec=10.950147144071218, CurrSamplesPerSec=11.226357075378251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9815/20000 [16:17:50<26:39:24,  9.42s/it][2022-12-22 06:17:15,388] [INFO] [timer.py:197:stop] 0/3816, RunningAvgSamplesPerSec=10.950055538165428, CurrSamplesPerSec=10.611562561248578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9816/20000 [16:17:59<26:33:47,  9.39s/it][2022-12-22 06:17:24,486] [INFO] [timer.py:197:stop] 0/3817, RunningAvgSamplesPerSec=10.950058208877188, CurrSamplesPerSec=10.960253790270908, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9817/20000 [16:18:08<26:18:45,  9.30s/it][2022-12-22 06:17:33,753] [INFO] [timer.py:197:stop] 0/3818, RunningAvgSamplesPerSec=10.950069170859988, CurrSamplesPerSec=10.992049506500054, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9818/20000 [16:18:18<26:16:48,  9.29s/it][2022-12-22 06:17:42,619] [INFO] [timer.py:197:stop] 0/3819, RunningAvgSamplesPerSec=10.950085404876935, CurrSamplesPerSec=11.0123869707686, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9819/20000 [16:18:27<25:54:57,  9.16s/it][2022-12-22 06:17:52,572] [INFO] [logging.py:68:log_dist] [Rank 0] step=9820, skipped=20, lr=[5.231282051282051e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:17:52,572] [INFO] [timer.py:197:stop] 0/3820, RunningAvgSamplesPerSec=10.95008030051938, CurrSamplesPerSec=10.93063158163916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9820/20000 [16:18:37<26:34:59,  9.40s/it][2022-12-22 06:18:01,521] [INFO] [timer.py:197:stop] 0/3821, RunningAvgSamplesPerSec=10.950153222852999, CurrSamplesPerSec=11.235836344787126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9821/20000 [16:18:45<26:11:50,  9.27s/it][2022-12-22 06:18:10,911] [INFO] [timer.py:197:stop] 0/3822, RunningAvgSamplesPerSec=10.950214548773724, CurrSamplesPerSec=11.189538246575845, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9822/20000 [16:18:55<26:18:02,  9.30s/it][2022-12-22 06:18:20,731] [INFO] [timer.py:197:stop] 0/3823, RunningAvgSamplesPerSec=10.950211824005542, CurrSamplesPerSec=10.939813096544018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9823/20000 [16:19:05<26:44:11,  9.46s/it][2022-12-22 06:18:30,162] [INFO] [timer.py:197:stop] 0/3824, RunningAvgSamplesPerSec=10.950203957786627, CurrSamplesPerSec=10.92022943284346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9824/20000 [16:19:14<26:42:41,  9.45s/it][2022-12-22 06:18:40,602] [INFO] [timer.py:197:stop] 0/3825, RunningAvgSamplesPerSec=10.950169785003759, CurrSamplesPerSec=10.821101278942471, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9825/20000 [16:19:25<27:32:53,  9.75s/it]

                                                          
{'loss': 0.0611, 'learning_rate': 5.228717948717949e-06, 'epoch': 0.49}


 49%|████▉     | 9825/20000 [16:19:25<27:32:53,  9.75s/it][2022-12-22 06:18:49,495] [INFO] [timer.py:197:stop] 0/3826, RunningAvgSamplesPerSec=10.950174631778113, CurrSamplesPerSec=10.968735265518047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9826/20000 [16:19:33<26:49:17,  9.49s/it][2022-12-22 06:18:58,874] [INFO] [timer.py:197:stop] 0/3827, RunningAvgSamplesPerSec=10.950157306531851, CurrSamplesPerSec=10.884304100699763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9827/20000 [16:19:43<26:43:29,  9.46s/it][2022-12-22 06:19:07,973] [INFO] [timer.py:197:stop] 0/3828, RunningAvgSamplesPerSec=10.950224457223774, CurrSamplesPerSec=11.21324699382438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9828/20000 [16:19:52<26:25:05,  9.35s/it][2022-12-22 06:19:17,061] [INFO] [timer.py:197:stop] 0/3829, RunningAvgSamplesPerSec=10.950198226773207, CurrSamplesPerSec=10.850752176331346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9829/20000 [16:20:01<26:11:38,  9.27s/it][2022-12-22 06:19:26,311] [INFO] [logging.py:68:log_dist] [Rank 0] step=9830, skipped=20, lr=[5.226153846153846e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:19:26,312] [INFO] [timer.py:197:stop] 0/3830, RunningAvgSamplesPerSec=10.950206813937058, CurrSamplesPerSec=10.983168839415693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9830/20000 [16:20:10<26:10:24,  9.26s/it][2022-12-22 06:19:35,557] [INFO] [timer.py:197:stop] 0/3831, RunningAvgSamplesPerSec=10.950257830750246, CurrSamplesPerSec=11.149097320674217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9831/20000 [16:20:20<26:09:14,  9.26s/it][2022-12-22 06:19:45,675] [INFO] [timer.py:197:stop] 0/3832, RunningAvgSamplesPerSec=10.950168387435061, CurrSamplesPerSec=10.618079100648824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9832/20000 [16:20:30<26:52:47,  9.52s/it][2022-12-22 06:19:55,024] [INFO] [timer.py:197:stop] 0/3833, RunningAvgSamplesPerSec=10.950188871866814, CurrSamplesPerSec=11.029210564029341, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9833/20000 [16:20:39<26:44:03,  9.47s/it][2022-12-22 06:20:05,500] [INFO] [timer.py:197:stop] 0/3834, RunningAvgSamplesPerSec=10.950183029231626, CurrSamplesPerSec=10.927845565482633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9834/20000 [16:20:49<27:35:14,  9.77s/it][2022-12-22 06:20:14,768] [INFO] [timer.py:197:stop] 0/3835, RunningAvgSamplesPerSec=10.950064922497665, CurrSamplesPerSec=10.515448067363938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9835/20000 [16:20:59<27:09:35,  9.62s/it][2022-12-22 06:20:24,203] [INFO] [timer.py:197:stop] 0/3836, RunningAvgSamplesPerSec=10.950034979634328, CurrSamplesPerSec=10.836454767410316, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9836/20000 [16:21:08<27:00:07,  9.56s/it][2022-12-22 06:20:33,372] [INFO] [timer.py:197:stop] 0/3837, RunningAvgSamplesPerSec=10.950022486530964, CurrSamplesPerSec=10.902332591999533, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9837/20000 [16:21:17<26:39:52,  9.45s/it][2022-12-22 06:20:42,922] [INFO] [timer.py:197:stop] 0/3838, RunningAvgSamplesPerSec=10.95007012466867, CurrSamplesPerSec=11.135862980933972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9838/20000 [16:21:27<26:45:03,  9.48s/it][2022-12-22 06:20:52,977] [INFO] [timer.py:197:stop] 0/3839, RunningAvgSamplesPerSec=10.95009081534739, CurrSamplesPerSec=11.030039904240342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9839/20000 [16:21:37<27:14:17,  9.65s/it][2022-12-22 06:21:02,118] [INFO] [logging.py:68:log_dist] [Rank 0] step=9840, skipped=20, lr=[5.221025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:21:02,119] [INFO] [timer.py:197:stop] 0/3840, RunningAvgSamplesPerSec=10.950089335441307, CurrSamplesPerSec=10.94441387969568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9840/20000 [16:21:46<26:48:16,  9.50s/it][2022-12-22 06:21:11,234] [INFO] [timer.py:197:stop] 0/3841, RunningAvgSamplesPerSec=10.950152846070704, CurrSamplesPerSec=11.199457690749886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9841/20000 [16:21:55<26:28:41,  9.38s/it][2022-12-22 06:21:21,451] [INFO] [timer.py:197:stop] 0/3842, RunningAvgSamplesPerSec=10.95014027929501, CurrSamplesPerSec=10.902108101487007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9842/20000 [16:22:05<27:10:53,  9.63s/it][2022-12-22 06:21:33,506] [INFO] [timer.py:197:stop] 0/3843, RunningAvgSamplesPerSec=10.95019486450105, CurrSamplesPerSec=11.163893716302459, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9843/20000 [16:22:17<29:13:43, 10.36s/it][2022-12-22 06:21:44,461] [INFO] [timer.py:197:stop] 0/3844, RunningAvgSamplesPerSec=10.950128346979218, CurrSamplesPerSec=10.700461414385453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9844/20000 [16:22:28<29:43:47, 10.54s/it][2022-12-22 06:21:53,499] [INFO] [timer.py:197:stop] 0/3845, RunningAvgSamplesPerSec=10.950151973895089, CurrSamplesPerSec=11.04168557778601, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9845/20000 [16:22:37<28:27:25, 10.09s/it][2022-12-22 06:22:02,227] [INFO] [timer.py:197:stop] 0/3846, RunningAvgSamplesPerSec=10.950221370169846, CurrSamplesPerSec=11.223570331509006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9846/20000 [16:22:46<27:18:12,  9.68s/it][2022-12-22 06:22:12,073] [INFO] [timer.py:197:stop] 0/3847, RunningAvgSamplesPerSec=10.95015219643189, CurrSamplesPerSec=10.690553845297293, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9847/20000 [16:22:56<27:26:28,  9.73s/it][2022-12-22 06:22:21,075] [INFO] [timer.py:197:stop] 0/3848, RunningAvgSamplesPerSec=10.950112106371172, CurrSamplesPerSec=10.798106188323866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9848/20000 [16:23:05<26:49:20,  9.51s/it][2022-12-22 06:22:30,238] [INFO] [timer.py:197:stop] 0/3849, RunningAvgSamplesPerSec=10.950169386023179, CurrSamplesPerSec=11.17499110885439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9849/20000 [16:23:14<26:31:31,  9.41s/it][2022-12-22 06:22:39,305] [INFO] [logging.py:68:log_dist] [Rank 0] step=9850, skipped=20, lr=[5.215897435897437e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:22:39,306] [INFO] [timer.py:197:stop] 0/3850, RunningAvgSamplesPerSec=10.95018368709219, CurrSamplesPerSec=11.005477781895404, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9850/20000 [16:23:23<26:14:08,  9.31s/it]

                                                          
{'loss': 0.0628, 'learning_rate': 5.215897435897437e-06, 'epoch': 0.49}


 49%|████▉     | 9850/20000 [16:23:23<26:14:08,  9.31s/it][2022-12-22 06:22:50,023] [INFO] [timer.py:197:stop] 0/3851, RunningAvgSamplesPerSec=10.950150735122476, CurrSamplesPerSec=10.824803414024325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9851/20000 [16:23:34<27:25:36,  9.73s/it][2022-12-22 06:22:58,897] [INFO] [timer.py:197:stop] 0/3852, RunningAvgSamplesPerSec=10.950155581825852, CurrSamplesPerSec=10.96884238670425, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9852/20000 [16:23:43<26:42:06,  9.47s/it][2022-12-22 06:23:08,242] [INFO] [timer.py:197:stop] 0/3853, RunningAvgSamplesPerSec=10.95015812624599, CurrSamplesPerSec=10.959962917429506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9853/20000 [16:23:52<26:35:28,  9.43s/it][2022-12-22 06:23:17,452] [INFO] [timer.py:197:stop] 0/3854, RunningAvgSamplesPerSec=10.950133860210846, CurrSamplesPerSec=10.857476304281272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9854/20000 [16:24:01<26:23:55,  9.37s/it][2022-12-22 06:23:27,385] [INFO] [timer.py:197:stop] 0/3855, RunningAvgSamplesPerSec=10.950137626794666, CurrSamplesPerSec=10.964665762378225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9855/20000 [16:24:11<26:53:16,  9.54s/it][2022-12-22 06:23:36,798] [INFO] [timer.py:197:stop] 0/3856, RunningAvgSamplesPerSec=10.950162847442991, CurrSamplesPerSec=11.04820831732124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9856/20000 [16:24:21<26:45:49,  9.50s/it][2022-12-22 06:23:46,460] [INFO] [timer.py:197:stop] 0/3857, RunningAvgSamplesPerSec=10.950098834561093, CurrSamplesPerSec=10.70883037478469, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9857/20000 [16:24:30<26:53:59,  9.55s/it][2022-12-22 06:23:55,336] [INFO] [timer.py:197:stop] 0/3858, RunningAvgSamplesPerSec=10.950141181516777, CurrSamplesPerSec=11.115859913942144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9858/20000 [16:24:39<26:19:46,  9.35s/it][2022-12-22 06:24:04,602] [INFO] [timer.py:197:stop] 0/3859, RunningAvgSamplesPerSec=10.950201153016753, CurrSamplesPerSec=11.186441556625276, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9859/20000 [16:24:49<26:15:33,  9.32s/it][2022-12-22 06:24:15,656] [INFO] [logging.py:68:log_dist] [Rank 0] step=9860, skipped=20, lr=[5.210769230769232e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:24:15,657] [INFO] [timer.py:197:stop] 0/3860, RunningAvgSamplesPerSec=10.950260772668583, CurrSamplesPerSec=11.185147619238696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9860/20000 [16:25:00<27:43:16,  9.84s/it][2022-12-22 06:24:24,533] [INFO] [timer.py:197:stop] 0/3861, RunningAvgSamplesPerSec=10.950269783361483, CurrSamplesPerSec=10.985143777930356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9861/20000 [16:25:08<26:54:10,  9.55s/it][2022-12-22 06:24:34,293] [INFO] [timer.py:197:stop] 0/3862, RunningAvgSamplesPerSec=10.9502185423502, CurrSamplesPerSec=10.755987807590536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9862/20000 [16:25:18<27:04:30,  9.61s/it][2022-12-22 06:24:43,858] [INFO] [timer.py:197:stop] 0/3863, RunningAvgSamplesPerSec=10.95022433916492, CurrSamplesPerSec=10.97264587205255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9863/20000 [16:25:28<27:01:52,  9.60s/it][2022-12-22 06:24:52,692] [INFO] [timer.py:197:stop] 0/3864, RunningAvgSamplesPerSec=10.950242645071347, CurrSamplesPerSec=11.021381036416583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9864/20000 [16:25:37<26:22:53,  9.37s/it][2022-12-22 06:25:02,446] [INFO] [timer.py:197:stop] 0/3865, RunningAvgSamplesPerSec=10.950176952606606, CurrSamplesPerSec=10.702219069568951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9865/20000 [16:25:46<26:42:13,  9.49s/it][2022-12-22 06:25:12,572] [INFO] [timer.py:197:stop] 0/3866, RunningAvgSamplesPerSec=10.950088951463105, CurrSamplesPerSec=10.62037911328066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9866/20000 [16:25:57<27:14:29,  9.68s/it][2022-12-22 06:25:23,052] [INFO] [timer.py:197:stop] 0/3867, RunningAvgSamplesPerSec=10.950080963183481, CurrSamplesPerSec=10.919301037379633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9867/20000 [16:26:07<27:54:59,  9.92s/it][2022-12-22 06:25:32,577] [INFO] [timer.py:197:stop] 0/3868, RunningAvgSamplesPerSec=10.95008982896296, CurrSamplesPerSec=10.984463660897598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9868/20000 [16:26:17<27:34:56,  9.80s/it][2022-12-22 06:25:41,364] [INFO] [timer.py:197:stop] 0/3869, RunningAvgSamplesPerSec=10.950150340885315, CurrSamplesPerSec=11.189197764623547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9869/20000 [16:26:25<26:43:26,  9.50s/it][2022-12-22 06:25:51,549] [INFO] [logging.py:68:log_dist] [Rank 0] step=9870, skipped=20, lr=[5.205641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:25:51,550] [INFO] [timer.py:197:stop] 0/3870, RunningAvgSamplesPerSec=10.950171341412814, CurrSamplesPerSec=11.031987304533786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9870/20000 [16:26:36<27:18:12,  9.70s/it][2022-12-22 06:26:01,006] [INFO] [timer.py:197:stop] 0/3871, RunningAvgSamplesPerSec=10.950161558548137, CurrSamplesPerSec=10.912451784127041, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9871/20000 [16:26:45<27:05:33,  9.63s/it][2022-12-22 06:26:09,871] [INFO] [timer.py:197:stop] 0/3872, RunningAvgSamplesPerSec=10.950177308633823, CurrSamplesPerSec=11.011455487681514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9872/20000 [16:26:54<26:26:40,  9.40s/it][2022-12-22 06:26:19,139] [INFO] [timer.py:197:stop] 0/3873, RunningAvgSamplesPerSec=10.95018320505109, CurrSamplesPerSec=10.973050004418889, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9873/20000 [16:27:03<26:19:51,  9.36s/it][2022-12-22 06:26:28,301] [INFO] [timer.py:197:stop] 0/3874, RunningAvgSamplesPerSec=10.950148627140095, CurrSamplesPerSec=10.817914340608468, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9874/20000 [16:27:12<26:09:39,  9.30s/it][2022-12-22 06:26:37,501] [INFO] [timer.py:197:stop] 0/3875, RunningAvgSamplesPerSec=10.950149623820087, CurrSamplesPerSec=10.954010129651987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9875/20000 [16:27:21<26:04:23,  9.27s/it]

                                                          
{'loss': 0.0577, 'learning_rate': 5.203076923076924e-06, 'epoch': 0.49}


 49%|████▉     | 9875/20000 [16:27:21<26:04:23,  9.27s/it][2022-12-22 06:26:46,609] [INFO] [timer.py:197:stop] 0/3876, RunningAvgSamplesPerSec=10.950067189084024, CurrSamplesPerSec=10.639844903917927, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9876/20000 [16:27:31<25:56:01,  9.22s/it][2022-12-22 06:26:55,417] [INFO] [timer.py:197:stop] 0/3877, RunningAvgSamplesPerSec=10.95012510030941, CurrSamplesPerSec=11.179167050500672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9877/20000 [16:27:39<25:34:55,  9.10s/it][2022-12-22 06:27:05,699] [INFO] [timer.py:197:stop] 0/3878, RunningAvgSamplesPerSec=10.950194504508161, CurrSamplesPerSec=11.225909187949968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9878/20000 [16:27:50<26:34:41,  9.45s/it][2022-12-22 06:27:15,818] [INFO] [timer.py:197:stop] 0/3879, RunningAvgSamplesPerSec=10.950141266124616, CurrSamplesPerSec=10.747606971408896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9879/20000 [16:28:00<27:08:15,  9.65s/it][2022-12-22 06:27:25,178] [INFO] [logging.py:68:log_dist] [Rank 0] step=9880, skipped=20, lr=[5.200512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:27:25,179] [INFO] [timer.py:197:stop] 0/3880, RunningAvgSamplesPerSec=10.95014072455947, CurrSamplesPerSec=10.948041479113435, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9880/20000 [16:28:09<26:53:20,  9.57s/it][2022-12-22 06:27:33,943] [INFO] [timer.py:197:stop] 0/3881, RunningAvgSamplesPerSec=10.950206909192923, CurrSamplesPerSec=11.213032936147538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9881/20000 [16:28:18<26:12:38,  9.32s/it][2022-12-22 06:27:43,103] [INFO] [timer.py:197:stop] 0/3882, RunningAvgSamplesPerSec=10.950242234343046, CurrSamplesPerSec=11.089005356719728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9882/20000 [16:28:27<26:04:08,  9.28s/it][2022-12-22 06:27:52,847] [INFO] [timer.py:197:stop] 0/3883, RunningAvgSamplesPerSec=10.950189756956926, CurrSamplesPerSec=10.750295373810566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9883/20000 [16:28:37<26:27:42,  9.42s/it][2022-12-22 06:28:01,722] [INFO] [timer.py:197:stop] 0/3884, RunningAvgSamplesPerSec=10.950206201406987, CurrSamplesPerSec=11.014401356085983, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9884/20000 [16:28:46<26:00:11,  9.25s/it][2022-12-22 06:28:11,426] [INFO] [timer.py:197:stop] 0/3885, RunningAvgSamplesPerSec=10.950215116994022, CurrSamplesPerSec=10.984935193759876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9885/20000 [16:28:55<26:22:46,  9.39s/it][2022-12-22 06:28:21,269] [INFO] [timer.py:197:stop] 0/3886, RunningAvgSamplesPerSec=10.950241039279632, CurrSamplesPerSec=11.051831347944416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9886/20000 [16:29:05<26:45:37,  9.53s/it][2022-12-22 06:28:30,199] [INFO] [timer.py:197:stop] 0/3887, RunningAvgSamplesPerSec=10.950286889071661, CurrSamplesPerSec=11.13131218887292, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9887/20000 [16:29:14<26:15:20,  9.35s/it][2022-12-22 06:28:39,272] [INFO] [timer.py:197:stop] 0/3888, RunningAvgSamplesPerSec=10.950280458351193, CurrSamplesPerSec=10.925353994339835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9888/20000 [16:29:23<26:01:23,  9.26s/it][2022-12-22 06:28:50,073] [INFO] [timer.py:197:stop] 0/3889, RunningAvgSamplesPerSec=10.950269624571941, CurrSamplesPerSec=10.908330840271846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9889/20000 [16:29:34<27:18:52,  9.73s/it][2022-12-22 06:28:59,398] [INFO] [logging.py:68:log_dist] [Rank 0] step=9890, skipped=20, lr=[5.195384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:28:59,399] [INFO] [timer.py:197:stop] 0/3890, RunningAvgSamplesPerSec=10.950281016523387, CurrSamplesPerSec=10.994741365875218, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9890/20000 [16:29:43<26:58:32,  9.61s/it][2022-12-22 06:29:08,277] [INFO] [timer.py:197:stop] 0/3891, RunningAvgSamplesPerSec=10.950303082795774, CurrSamplesPerSec=11.036774411485412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9891/20000 [16:29:52<26:21:36,  9.39s/it][2022-12-22 06:29:17,999] [INFO] [timer.py:197:stop] 0/3892, RunningAvgSamplesPerSec=10.950244251709984, CurrSamplesPerSec=10.726133918072831, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9892/20000 [16:30:02<26:38:22,  9.49s/it][2022-12-22 06:29:27,522] [INFO] [timer.py:197:stop] 0/3893, RunningAvgSamplesPerSec=10.95010501632727, CurrSamplesPerSec=10.434013407180117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9893/20000 [16:30:11<26:40:00,  9.50s/it][2022-12-22 06:29:36,727] [INFO] [timer.py:197:stop] 0/3894, RunningAvgSamplesPerSec=10.950104964269253, CurrSamplesPerSec=10.949902410259373, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9894/20000 [16:30:21<26:24:59,  9.41s/it][2022-12-22 06:29:46,818] [INFO] [timer.py:197:stop] 0/3895, RunningAvgSamplesPerSec=10.9501164869235, CurrSamplesPerSec=10.995147127504005, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9895/20000 [16:30:31<26:59:15,  9.61s/it][2022-12-22 06:29:56,058] [INFO] [timer.py:197:stop] 0/3896, RunningAvgSamplesPerSec=10.950030254140376, CurrSamplesPerSec=10.624314339378419, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9896/20000 [16:30:40<26:40:10,  9.50s/it][2022-12-22 06:30:05,581] [INFO] [timer.py:197:stop] 0/3897, RunningAvgSamplesPerSec=10.950080381498852, CurrSamplesPerSec=11.148819953186955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9897/20000 [16:30:50<26:41:03,  9.51s/it][2022-12-22 06:30:14,976] [INFO] [timer.py:197:stop] 0/3898, RunningAvgSamplesPerSec=10.95001931884131, CurrSamplesPerSec=10.717237681445837, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9898/20000 [16:30:59<26:35:09,  9.47s/it][2022-12-22 06:30:24,481] [INFO] [timer.py:197:stop] 0/3899, RunningAvgSamplesPerSec=10.95000823996639, CurrSamplesPerSec=10.90701446183106, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 49%|████▉     | 9899/20000 [16:31:08<26:36:34,  9.48s/it][2022-12-22 06:30:33,954] [INFO] [logging.py:68:log_dist] [Rank 0] step=9900, skipped=20, lr=[5.19025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:30:33,955] [INFO] [timer.py:197:stop] 0/3900, RunningAvgSamplesPerSec=10.950026860327643, CurrSamplesPerSec=11.023074604531676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9900/20000 [16:31:18<26:35:53,  9.48s/it]

                                                          
{'loss': 0.0583, 'learning_rate': 5.19025641025641e-06, 'epoch': 0.49}


 50%|████▉     | 9900/20000 [16:31:18<26:35:53,  9.48s/it][2022-12-22 06:30:43,365] [INFO] [timer.py:197:stop] 0/3901, RunningAvgSamplesPerSec=10.950038927336685, CurrSamplesPerSec=10.997279106483395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9901/20000 [16:31:27<26:32:11,  9.46s/it][2022-12-22 06:30:52,810] [INFO] [timer.py:197:stop] 0/3902, RunningAvgSamplesPerSec=10.950076545657481, CurrSamplesPerSec=11.098742232888581, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9902/20000 [16:31:37<26:31:19,  9.46s/it][2022-12-22 06:31:01,631] [INFO] [timer.py:197:stop] 0/3903, RunningAvgSamplesPerSec=10.950133855511638, CurrSamplesPerSec=11.178300703794294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9903/20000 [16:31:46<25:59:08,  9.26s/it][2022-12-22 06:31:11,541] [INFO] [timer.py:197:stop] 0/3904, RunningAvgSamplesPerSec=10.950098557498842, CurrSamplesPerSec=10.814111486094927, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9904/20000 [16:31:56<26:31:31,  9.46s/it][2022-12-22 06:31:20,711] [INFO] [timer.py:197:stop] 0/3905, RunningAvgSamplesPerSec=10.950187235387535, CurrSamplesPerSec=11.307502248669932, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9905/20000 [16:32:05<26:16:49,  9.37s/it][2022-12-22 06:31:29,476] [INFO] [timer.py:197:stop] 0/3906, RunningAvgSamplesPerSec=10.950249290245218, CurrSamplesPerSec=11.197929040537657, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9906/20000 [16:32:13<25:46:02,  9.19s/it][2022-12-22 06:31:38,588] [INFO] [timer.py:197:stop] 0/3907, RunningAvgSamplesPerSec=10.950301503970863, CurrSamplesPerSec=11.158011447754877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9907/20000 [16:32:23<25:41:57,  9.17s/it][2022-12-22 06:31:48,501] [INFO] [timer.py:197:stop] 0/3908, RunningAvgSamplesPerSec=10.950254699822995, CurrSamplesPerSec=10.770485785458515, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9908/20000 [16:32:32<26:19:28,  9.39s/it][2022-12-22 06:31:59,321] [INFO] [timer.py:197:stop] 0/3909, RunningAvgSamplesPerSec=10.950271535283214, CurrSamplesPerSec=11.016428233263971, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9909/20000 [16:32:43<27:31:25,  9.82s/it][2022-12-22 06:32:08,345] [INFO] [logging.py:68:log_dist] [Rank 0] step=9910, skipped=20, lr=[5.185128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:32:08,346] [INFO] [timer.py:197:stop] 0/3910, RunningAvgSamplesPerSec=10.95026933000439, CurrSamplesPerSec=10.941660081410035, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9910/20000 [16:32:52<26:51:11,  9.58s/it][2022-12-22 06:32:17,820] [INFO] [timer.py:197:stop] 0/3911, RunningAvgSamplesPerSec=10.950338496820063, CurrSamplesPerSec=11.227485403059914, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9911/20000 [16:33:02<26:45:39,  9.55s/it][2022-12-22 06:32:26,689] [INFO] [timer.py:197:stop] 0/3912, RunningAvgSamplesPerSec=10.950347523661593, CurrSamplesPerSec=10.985747547880626, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9912/20000 [16:33:11<26:11:10,  9.34s/it][2022-12-22 06:32:36,403] [INFO] [timer.py:197:stop] 0/3913, RunningAvgSamplesPerSec=10.950397212036133, CurrSamplesPerSec=11.148188866241064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9913/20000 [16:33:20<26:29:39,  9.46s/it][2022-12-22 06:32:45,976] [INFO] [timer.py:197:stop] 0/3914, RunningAvgSamplesPerSec=10.950402975945885, CurrSamplesPerSec=10.972992141244143, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9914/20000 [16:33:30<26:35:26,  9.49s/it][2022-12-22 06:32:55,449] [INFO] [timer.py:197:stop] 0/3915, RunningAvgSamplesPerSec=10.950349041566549, CurrSamplesPerSec=10.743347278496056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9915/20000 [16:33:39<26:34:21,  9.49s/it][2022-12-22 06:33:04,875] [INFO] [timer.py:197:stop] 0/3916, RunningAvgSamplesPerSec=10.950404646208776, CurrSamplesPerSec=11.17239766734168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9916/20000 [16:33:49<26:31:12,  9.47s/it][2022-12-22 06:33:13,676] [INFO] [timer.py:197:stop] 0/3917, RunningAvgSamplesPerSec=10.950467983431336, CurrSamplesPerSec=11.204113486852265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9917/20000 [16:33:58<25:57:26,  9.27s/it][2022-12-22 06:33:23,040] [INFO] [timer.py:197:stop] 0/3918, RunningAvgSamplesPerSec=10.95047207772306, CurrSamplesPerSec=10.966524733477971, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9918/20000 [16:34:07<26:02:06,  9.30s/it][2022-12-22 06:33:32,282] [INFO] [timer.py:197:stop] 0/3919, RunningAvgSamplesPerSec=10.950453806166639, CurrSamplesPerSec=10.879366998500272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9919/20000 [16:34:16<25:59:14,  9.28s/it][2022-12-22 06:33:41,537] [INFO] [logging.py:68:log_dist] [Rank 0] step=9920, skipped=20, lr=[5.18e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:33:41,538] [INFO] [timer.py:197:stop] 0/3920, RunningAvgSamplesPerSec=10.950399221171885, CurrSamplesPerSec=10.740685556546302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9920/20000 [16:34:25<25:57:48,  9.27s/it][2022-12-22 06:33:56,264] [INFO] [timer.py:197:stop] 0/3921, RunningAvgSamplesPerSec=10.950477448625545, CurrSamplesPerSec=11.265800506507953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9921/20000 [16:34:40<30:32:30, 10.91s/it][2022-12-22 06:34:05,440] [INFO] [timer.py:197:stop] 0/3922, RunningAvgSamplesPerSec=10.950498570744362, CurrSamplesPerSec=11.033906819290985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9922/20000 [16:34:49<29:05:00, 10.39s/it][2022-12-22 06:34:14,632] [INFO] [timer.py:197:stop] 0/3923, RunningAvgSamplesPerSec=10.950515694671408, CurrSamplesPerSec=11.01805560862961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9923/20000 [16:34:59<28:04:30, 10.03s/it][2022-12-22 06:34:24,754] [INFO] [timer.py:197:stop] 0/3924, RunningAvgSamplesPerSec=10.95054842856857, CurrSamplesPerSec=11.080420638776177, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9924/20000 [16:35:09<28:08:59, 10.06s/it][2022-12-22 06:34:33,999] [INFO] [timer.py:197:stop] 0/3925, RunningAvgSamplesPerSec=10.95057269635115, CurrSamplesPerSec=11.046585660841364, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9925/20000 [16:35:18<27:27:54,  9.81s/it]

                                                          
{'loss': 0.0633, 'learning_rate': 5.177435897435897e-06, 'epoch': 0.5}


 50%|████▉     | 9925/20000 [16:35:18<27:27:54,  9.81s/it][2022-12-22 06:34:43,139] [INFO] [timer.py:197:stop] 0/3926, RunningAvgSamplesPerSec=10.950629646455864, CurrSamplesPerSec=11.178699178669861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9926/20000 [16:35:27<26:53:45,  9.61s/it][2022-12-22 06:34:52,153] [INFO] [timer.py:197:stop] 0/3927, RunningAvgSamplesPerSec=10.950632256679567, CurrSamplesPerSec=10.960884366102349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9927/20000 [16:35:36<26:23:33,  9.43s/it][2022-12-22 06:35:01,123] [INFO] [timer.py:197:stop] 0/3928, RunningAvgSamplesPerSec=10.950642999110269, CurrSamplesPerSec=10.992970056017018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9928/20000 [16:35:45<26:00:04,  9.29s/it][2022-12-22 06:35:10,117] [INFO] [timer.py:197:stop] 0/3929, RunningAvgSamplesPerSec=10.950596577550122, CurrSamplesPerSec=10.771329833140273, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9929/20000 [16:35:54<25:44:49,  9.20s/it][2022-12-22 06:35:19,839] [INFO] [logging.py:68:log_dist] [Rank 0] step=9930, skipped=20, lr=[5.174871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:35:19,840] [INFO] [timer.py:197:stop] 0/3930, RunningAvgSamplesPerSec=10.950579302078255, CurrSamplesPerSec=10.883156327689097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9930/20000 [16:36:04<26:10:52,  9.36s/it][2022-12-22 06:35:29,087] [INFO] [timer.py:197:stop] 0/3931, RunningAvgSamplesPerSec=10.950515777936246, CurrSamplesPerSec=10.706553387893381, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9931/20000 [16:36:13<26:05:00,  9.33s/it][2022-12-22 06:35:37,985] [INFO] [timer.py:197:stop] 0/3932, RunningAvgSamplesPerSec=10.950504918809417, CurrSamplesPerSec=10.908005040263062, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9932/20000 [16:36:22<25:43:19,  9.20s/it][2022-12-22 06:35:48,054] [INFO] [timer.py:197:stop] 0/3933, RunningAvgSamplesPerSec=10.950515845064087, CurrSamplesPerSec=10.993625113003553, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9933/20000 [16:36:32<26:27:02,  9.46s/it][2022-12-22 06:35:57,366] [INFO] [timer.py:197:stop] 0/3934, RunningAvgSamplesPerSec=10.950508931879174, CurrSamplesPerSec=10.923400493742479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9934/20000 [16:36:41<26:19:30,  9.41s/it][2022-12-22 06:36:06,346] [INFO] [timer.py:197:stop] 0/3935, RunningAvgSamplesPerSec=10.950460351578482, CurrSamplesPerSec=10.76271837734399, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9935/20000 [16:36:50<25:57:27,  9.28s/it][2022-12-22 06:36:16,003] [INFO] [timer.py:197:stop] 0/3936, RunningAvgSamplesPerSec=10.950506484196444, CurrSamplesPerSec=11.135003794693004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9936/20000 [16:37:00<26:16:02,  9.40s/it][2022-12-22 06:36:26,331] [INFO] [timer.py:197:stop] 0/3937, RunningAvgSamplesPerSec=10.950482718286386, CurrSamplesPerSec=10.857779329737175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9937/20000 [16:37:10<27:02:47,  9.68s/it][2022-12-22 06:36:35,449] [INFO] [timer.py:197:stop] 0/3938, RunningAvgSamplesPerSec=10.950510484902981, CurrSamplesPerSec=11.060873578222681, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9938/20000 [16:37:19<26:34:34,  9.51s/it][2022-12-22 06:36:44,684] [INFO] [timer.py:197:stop] 0/3939, RunningAvgSamplesPerSec=10.950522982076103, CurrSamplesPerSec=10.999933861593705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9939/20000 [16:37:29<26:20:38,  9.43s/it][2022-12-22 06:36:53,831] [INFO] [logging.py:68:log_dist] [Rank 0] step=9940, skipped=20, lr=[5.16974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:36:53,832] [INFO] [timer.py:197:stop] 0/3940, RunningAvgSamplesPerSec=10.950521902240217, CurrSamplesPerSec=10.946272238610916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9940/20000 [16:37:38<26:06:28,  9.34s/it][2022-12-22 06:37:02,944] [INFO] [timer.py:197:stop] 0/3941, RunningAvgSamplesPerSec=10.950550230520035, CurrSamplesPerSec=11.063255452230173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9941/20000 [16:37:47<25:54:44,  9.27s/it][2022-12-22 06:37:12,257] [INFO] [timer.py:197:stop] 0/3942, RunningAvgSamplesPerSec=10.950579112488981, CurrSamplesPerSec=11.065539823550212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9942/20000 [16:37:56<25:56:32,  9.29s/it][2022-12-22 06:37:21,573] [INFO] [timer.py:197:stop] 0/3943, RunningAvgSamplesPerSec=10.950623184364984, CurrSamplesPerSec=11.12706490881157, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9943/20000 [16:38:06<25:57:54,  9.29s/it][2022-12-22 06:37:30,851] [INFO] [timer.py:197:stop] 0/3944, RunningAvgSamplesPerSec=10.95056949298761, CurrSamplesPerSec=10.742983965132655, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9944/20000 [16:38:15<25:56:57,  9.29s/it][2022-12-22 06:37:40,022] [INFO] [timer.py:197:stop] 0/3945, RunningAvgSamplesPerSec=10.95052095666698, CurrSamplesPerSec=10.76247716132334, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9945/20000 [16:38:24<25:50:49,  9.25s/it][2022-12-22 06:37:50,431] [INFO] [timer.py:197:stop] 0/3946, RunningAvgSamplesPerSec=10.950532942330751, CurrSamplesPerSec=10.997997309615867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9946/20000 [16:38:34<26:48:42,  9.60s/it][2022-12-22 06:37:59,580] [INFO] [timer.py:197:stop] 0/3947, RunningAvgSamplesPerSec=10.950496836368636, CurrSamplesPerSec=10.809923423177812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9947/20000 [16:38:44<26:25:55,  9.47s/it][2022-12-22 06:38:08,687] [INFO] [timer.py:197:stop] 0/3948, RunningAvgSamplesPerSec=10.950491515816466, CurrSamplesPerSec=10.929542102901646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9948/20000 [16:38:53<26:07:42,  9.36s/it][2022-12-22 06:38:19,207] [INFO] [timer.py:197:stop] 0/3949, RunningAvgSamplesPerSec=10.95049489339374, CurrSamplesPerSec=10.963839058704746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9949/20000 [16:39:03<27:05:57,  9.71s/it][2022-12-22 06:38:27,977] [INFO] [logging.py:68:log_dist] [Rank 0] step=9950, skipped=20, lr=[5.164615384615384e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:38:27,978] [INFO] [timer.py:197:stop] 0/3950, RunningAvgSamplesPerSec=10.950554957433317, CurrSamplesPerSec=11.192875133200138, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9950/20000 [16:39:12<26:18:47,  9.43s/it]

                                                          
{'loss': 0.0572, 'learning_rate': 5.164615384615384e-06, 'epoch': 0.5}


 50%|████▉     | 9950/20000 [16:39:12<26:18:47,  9.43s/it][2022-12-22 06:38:37,810] [INFO] [timer.py:197:stop] 0/3951, RunningAvgSamplesPerSec=10.950539966719699, CurrSamplesPerSec=10.891674852602439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9951/20000 [16:39:22<26:39:04,  9.55s/it][2022-12-22 06:38:46,777] [INFO] [timer.py:197:stop] 0/3952, RunningAvgSamplesPerSec=10.950554841434107, CurrSamplesPerSec=11.009611959157603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9952/20000 [16:39:31<26:09:44,  9.37s/it][2022-12-22 06:38:56,491] [INFO] [timer.py:197:stop] 0/3953, RunningAvgSamplesPerSec=10.950513721633753, CurrSamplesPerSec=10.790465029321346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9953/20000 [16:39:40<26:26:41,  9.48s/it][2022-12-22 06:39:06,875] [INFO] [timer.py:197:stop] 0/3954, RunningAvgSamplesPerSec=10.950529526573458, CurrSamplesPerSec=11.013333070755012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9954/20000 [16:39:51<27:12:09,  9.75s/it][2022-12-22 06:39:15,803] [INFO] [timer.py:197:stop] 0/3955, RunningAvgSamplesPerSec=10.950546477927501, CurrSamplesPerSec=11.017950689690485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9955/20000 [16:40:00<26:30:47,  9.50s/it][2022-12-22 06:39:25,233] [INFO] [timer.py:197:stop] 0/3956, RunningAvgSamplesPerSec=10.950500838627093, CurrSamplesPerSec=10.773013569595571, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9956/20000 [16:40:09<26:27:01,  9.48s/it][2022-12-22 06:39:34,772] [INFO] [timer.py:197:stop] 0/3957, RunningAvgSamplesPerSec=10.950444031585405, CurrSamplesPerSec=10.730344796710009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9957/20000 [16:40:19<26:29:47,  9.50s/it][2022-12-22 06:39:44,131] [INFO] [timer.py:197:stop] 0/3958, RunningAvgSamplesPerSec=10.950442709243026, CurrSamplesPerSec=10.945215342316956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9958/20000 [16:40:28<26:22:40,  9.46s/it][2022-12-22 06:39:53,343] [INFO] [timer.py:197:stop] 0/3959, RunningAvgSamplesPerSec=10.950428339251584, CurrSamplesPerSec=10.893874319963423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9959/20000 [16:40:37<26:10:14,  9.38s/it][2022-12-22 06:40:02,979] [INFO] [logging.py:68:log_dist] [Rank 0] step=9960, skipped=20, lr=[5.15948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:40:02,980] [INFO] [timer.py:197:stop] 0/3960, RunningAvgSamplesPerSec=10.950474345773957, CurrSamplesPerSec=11.13560059171843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9960/20000 [16:40:47<26:22:51,  9.46s/it][2022-12-22 06:40:12,318] [INFO] [timer.py:197:stop] 0/3961, RunningAvgSamplesPerSec=10.950528471287864, CurrSamplesPerSec=11.169033011408926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9961/20000 [16:40:56<26:16:35,  9.42s/it][2022-12-22 06:40:21,491] [INFO] [timer.py:197:stop] 0/3962, RunningAvgSamplesPerSec=10.950492858474862, CurrSamplesPerSec=10.811294409410158, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9962/20000 [16:41:05<26:03:53,  9.35s/it][2022-12-22 06:40:31,122] [INFO] [timer.py:197:stop] 0/3963, RunningAvgSamplesPerSec=10.950469313300523, CurrSamplesPerSec=10.858017809489285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9963/20000 [16:41:15<26:17:56,  9.43s/it][2022-12-22 06:40:40,088] [INFO] [timer.py:197:stop] 0/3964, RunningAvgSamplesPerSec=10.950516816502054, CurrSamplesPerSec=11.14196748046107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9964/20000 [16:41:24<25:54:23,  9.29s/it][2022-12-22 06:40:50,557] [INFO] [timer.py:197:stop] 0/3965, RunningAvgSamplesPerSec=10.95053731144102, CurrSamplesPerSec=11.032345037294387, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9965/20000 [16:41:35<26:53:13,  9.65s/it][2022-12-22 06:40:59,333] [INFO] [timer.py:197:stop] 0/3966, RunningAvgSamplesPerSec=10.950607717320858, CurrSamplesPerSec=11.236923303100207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9966/20000 [16:41:43<26:09:25,  9.38s/it][2022-12-22 06:41:09,011] [INFO] [timer.py:197:stop] 0/3967, RunningAvgSamplesPerSec=10.95062828896044, CurrSamplesPerSec=11.032786227640598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9967/20000 [16:41:53<26:24:00,  9.47s/it][2022-12-22 06:41:18,051] [INFO] [timer.py:197:stop] 0/3968, RunningAvgSamplesPerSec=10.95063445623968, CurrSamplesPerSec=10.975142459711542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9968/20000 [16:42:02<26:02:07,  9.34s/it][2022-12-22 06:41:27,792] [INFO] [timer.py:197:stop] 0/3969, RunningAvgSamplesPerSec=10.95059008544656, CurrSamplesPerSec=10.777399374005737, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9969/20000 [16:42:12<26:22:04,  9.46s/it][2022-12-22 06:41:37,110] [INFO] [logging.py:68:log_dist] [Rank 0] step=9970, skipped=20, lr=[5.154358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:41:37,111] [INFO] [timer.py:197:stop] 0/3970, RunningAvgSamplesPerSec=10.950573738039884, CurrSamplesPerSec=10.886105458234974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9970/20000 [16:42:21<26:14:33,  9.42s/it][2022-12-22 06:41:47,523] [INFO] [timer.py:197:stop] 0/3971, RunningAvgSamplesPerSec=10.950495558045548, CurrSamplesPerSec=10.648825548823078, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9971/20000 [16:42:31<27:04:11,  9.72s/it][2022-12-22 06:41:56,449] [INFO] [timer.py:197:stop] 0/3972, RunningAvgSamplesPerSec=10.95055103817647, CurrSamplesPerSec=11.175271641048395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9972/20000 [16:42:40<26:24:22,  9.48s/it][2022-12-22 06:42:05,949] [INFO] [timer.py:197:stop] 0/3973, RunningAvgSamplesPerSec=10.950564446881332, CurrSamplesPerSec=11.004057107612269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9973/20000 [16:42:50<26:25:15,  9.49s/it][2022-12-22 06:42:16,182] [INFO] [timer.py:197:stop] 0/3974, RunningAvgSamplesPerSec=10.950629287222691, CurrSamplesPerSec=11.214311782863453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9974/20000 [16:43:00<27:02:31,  9.71s/it][2022-12-22 06:42:25,174] [INFO] [timer.py:197:stop] 0/3975, RunningAvgSamplesPerSec=10.95057735007911, CurrSamplesPerSec=10.748098410428474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9975/20000 [16:43:09<26:26:23,  9.49s/it]

                                                          
{'loss': 0.0505, 'learning_rate': 5.151794871794872e-06, 'epoch': 0.5}


 50%|████▉     | 9975/20000 [16:43:09<26:26:23,  9.49s/it][2022-12-22 06:42:35,290] [INFO] [timer.py:197:stop] 0/3976, RunningAvgSamplesPerSec=10.950587166211815, CurrSamplesPerSec=10.989726086143241, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9976/20000 [16:43:19<26:57:21,  9.68s/it][2022-12-22 06:42:45,090] [INFO] [timer.py:197:stop] 0/3977, RunningAvgSamplesPerSec=10.950565082359153, CurrSamplesPerSec=10.86350177981684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9977/20000 [16:43:29<27:03:10,  9.72s/it][2022-12-22 06:42:53,985] [INFO] [timer.py:197:stop] 0/3978, RunningAvgSamplesPerSec=10.950572832454853, CurrSamplesPerSec=10.981466395853547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9978/20000 [16:43:38<26:21:50,  9.47s/it][2022-12-22 06:43:03,158] [INFO] [timer.py:197:stop] 0/3979, RunningAvgSamplesPerSec=10.950636039944026, CurrSamplesPerSec=11.207853546564506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9979/20000 [16:43:47<26:06:46,  9.38s/it][2022-12-22 06:43:12,320] [INFO] [logging.py:68:log_dist] [Rank 0] step=9980, skipped=20, lr=[5.14923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:43:12,321] [INFO] [timer.py:197:stop] 0/3980, RunningAvgSamplesPerSec=10.950642868332157, CurrSamplesPerSec=10.977866897776678, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9980/20000 [16:43:56<25:55:41,  9.32s/it][2022-12-22 06:43:21,317] [INFO] [timer.py:197:stop] 0/3981, RunningAvgSamplesPerSec=10.950696674917443, CurrSamplesPerSec=11.169007451872888, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9981/20000 [16:44:05<25:39:33,  9.22s/it][2022-12-22 06:43:30,027] [INFO] [timer.py:197:stop] 0/3982, RunningAvgSamplesPerSec=10.95077184265005, CurrSamplesPerSec=11.258264745906972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9982/20000 [16:44:14<25:13:51,  9.07s/it][2022-12-22 06:43:39,423] [INFO] [timer.py:197:stop] 0/3983, RunningAvgSamplesPerSec=10.95079712486221, CurrSamplesPerSec=11.052353733349342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9983/20000 [16:44:23<25:30:13,  9.17s/it][2022-12-22 06:43:48,916] [INFO] [timer.py:197:stop] 0/3984, RunningAvgSamplesPerSec=10.950788107571903, CurrSamplesPerSec=10.915007596598171, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9984/20000 [16:44:33<25:46:27,  9.26s/it][2022-12-22 06:43:58,304] [INFO] [timer.py:197:stop] 0/3985, RunningAvgSamplesPerSec=10.950760782301547, CurrSamplesPerSec=10.843022338038196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9985/20000 [16:44:42<25:52:28,  9.30s/it][2022-12-22 06:44:07,373] [INFO] [timer.py:197:stop] 0/3986, RunningAvgSamplesPerSec=10.950776475684888, CurrSamplesPerSec=11.013642147235407, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9986/20000 [16:44:51<25:40:42,  9.23s/it][2022-12-22 06:44:18,167] [INFO] [timer.py:197:stop] 0/3987, RunningAvgSamplesPerSec=10.950768516216526, CurrSamplesPerSec=10.919149577309001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9987/20000 [16:45:02<26:58:46,  9.70s/it][2022-12-22 06:44:27,624] [INFO] [timer.py:197:stop] 0/3988, RunningAvgSamplesPerSec=10.950768176189305, CurrSamplesPerSec=10.949413335398926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9988/20000 [16:45:12<26:46:29,  9.63s/it][2022-12-22 06:44:36,708] [INFO] [timer.py:197:stop] 0/3989, RunningAvgSamplesPerSec=10.950754226249012, CurrSamplesPerSec=10.895430749809416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9989/20000 [16:45:21<26:19:07,  9.46s/it][2022-12-22 06:44:46,378] [INFO] [logging.py:68:log_dist] [Rank 0] step=9990, skipped=20, lr=[5.144102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:44:46,378] [INFO] [timer.py:197:stop] 0/3990, RunningAvgSamplesPerSec=10.950755271287093, CurrSamplesPerSec=10.954923424425665, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9990/20000 [16:45:30<26:29:15,  9.53s/it][2022-12-22 06:44:55,553] [INFO] [timer.py:197:stop] 0/3991, RunningAvgSamplesPerSec=10.950755820239902, CurrSamplesPerSec=10.952945481896752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9991/20000 [16:45:40<26:11:30,  9.42s/it][2022-12-22 06:45:04,585] [INFO] [timer.py:197:stop] 0/3992, RunningAvgSamplesPerSec=10.950800842912692, CurrSamplesPerSec=11.13339156163059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9992/20000 [16:45:49<25:51:54,  9.30s/it][2022-12-22 06:45:13,621] [INFO] [timer.py:197:stop] 0/3993, RunningAvgSamplesPerSec=10.950892034957382, CurrSamplesPerSec=11.327256581811234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9993/20000 [16:45:58<25:38:20,  9.22s/it][2022-12-22 06:45:23,027] [INFO] [timer.py:197:stop] 0/3994, RunningAvgSamplesPerSec=10.950857768315258, CurrSamplesPerSec=10.815786835622077, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9994/20000 [16:46:07<25:47:21,  9.28s/it][2022-12-22 06:45:32,705] [INFO] [timer.py:197:stop] 0/3995, RunningAvgSamplesPerSec=10.95094067081575, CurrSamplesPerSec=11.292203283964934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9995/20000 [16:46:17<26:07:12,  9.40s/it][2022-12-22 06:45:41,904] [INFO] [timer.py:197:stop] 0/3996, RunningAvgSamplesPerSec=10.95088326436997, CurrSamplesPerSec=10.726360220721254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9996/20000 [16:46:26<25:57:01,  9.34s/it][2022-12-22 06:45:52,610] [INFO] [timer.py:197:stop] 0/3997, RunningAvgSamplesPerSec=10.950754361966233, CurrSamplesPerSec=10.459041235207028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9997/20000 [16:46:37<27:05:16,  9.75s/it][2022-12-22 06:46:02,312] [INFO] [timer.py:197:stop] 0/3998, RunningAvgSamplesPerSec=10.950715770637457, CurrSamplesPerSec=10.798684359741305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9998/20000 [16:46:46<27:02:46,  9.73s/it][2022-12-22 06:46:11,482] [INFO] [timer.py:197:stop] 0/3999, RunningAvgSamplesPerSec=10.950768774417723, CurrSamplesPerSec=11.166750309166641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|████▉     | 9999/20000 [16:46:55<26:34:21,  9.57s/it][2022-12-22 06:46:20,435] [INFO] [logging.py:68:log_dist] [Rank 0] step=10000, skipped=20, lr=[5.138974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:46:20,435] [INFO] [timer.py:197:stop] 0/4000, RunningAvgSamplesPerSec=10.950819613482109, CurrSamplesPerSec=11.157866279246665, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10000/20000 [16:47:04<26:03:36,  9.38s/it]

                                                           
{'loss': 0.0557, 'learning_rate': 5.138974358974359e-06, 'epoch': 0.5}


 50%|█████     | 10000/20000 [16:47:04<26:03:36,  9.38s/it][INFO|trainer.py:2955] 2022-12-22 06:46:20,440 >> ***** Running Evaluation *****
[INFO|trainer.py:2959] 2022-12-22 06:46:20,440 >>   Num examples: Unknown
[INFO|trainer.py:2960] 2022-12-22 06:46:20,440 >>   Batch size = 32
[INFO|trainer_utils.py:689] 2022-12-22 06:46:22,857 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: duration, age, input_length, gender, speaker_id. If duration, age, input_length, gender, speaker_id are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
[INFO|configuration_utils.py:523] 2022-12-22 06:46:22,868 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:46:28,065 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:46:33,770 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:46:39,389 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:46:44,999 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:46:50,515 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:46:56,128 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:01,244 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:06,612 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:11,673 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:16,478 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:22,365 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:27,573 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:33,213 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:37,923 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:43,501 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:50,124 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:47:55,549 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:01,255 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:07,539 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:13,001 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:18,575 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:24,196 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:30,557 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:35,485 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:40,654 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:46,181 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:51,565 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:48:56,826 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:49:01,898 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:49:07,788 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 06:49:11,706 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}



                                                           
{'eval_loss': 0.14794921875, 'eval_wer': 9.801457652676552, 'eval_runtime': 208.1675, 'eval_samples_per_second': 4.804, 'eval_steps_per_second': 0.154, 'epoch': 0.5}


 50%|█████     | 10000/20000 [16:50:33<26:03:36,  9.38s/it][2022-12-22 06:49:58,310] [INFO] [timer.py:197:stop] 0/4001, RunningAvgSamplesPerSec=10.950770440264339, CurrSamplesPerSec=10.757643901451997, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10001/20000 [16:50:42<199:47:04, 71.93s/it][2022-12-22 06:50:08,100] [INFO] [timer.py:197:stop] 0/4002, RunningAvgSamplesPerSec=10.950828179748068, CurrSamplesPerSec=11.186703083938367, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10002/20000 [16:50:52<147:59:30, 53.29s/it][2022-12-22 06:50:16,912] [INFO] [timer.py:197:stop] 0/4003, RunningAvgSamplesPerSec=10.95086489606462, CurrSamplesPerSec=11.09972709607757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10003/20000 [16:51:01<110:55:28, 39.94s/it][2022-12-22 06:50:26,341] [INFO] [timer.py:197:stop] 0/4004, RunningAvgSamplesPerSec=10.950834127241468, CurrSamplesPerSec=10.829096941543227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10004/20000 [16:51:10<85:29:39, 30.79s/it] [2022-12-22 06:50:35,786] [INFO] [timer.py:197:stop] 0/4005, RunningAvgSamplesPerSec=10.95081036976307, CurrSamplesPerSec=10.856551522476746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10005/20000 [16:51:20<67:42:23, 24.39s/it][2022-12-22 06:50:44,983] [INFO] [timer.py:197:stop] 0/4006, RunningAvgSamplesPerSec=10.950804746093182, CurrSamplesPerSec=10.928339389061941, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10006/20000 [16:51:29<55:02:57, 19.83s/it][2022-12-22 06:50:54,001] [INFO] [timer.py:197:stop] 0/4007, RunningAvgSamplesPerSec=10.950744389263601, CurrSamplesPerSec=10.714295076936757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10007/20000 [16:51:38<46:02:27, 16.59s/it][2022-12-22 06:51:03,654] [INFO] [timer.py:197:stop] 0/4008, RunningAvgSamplesPerSec=10.950806651473274, CurrSamplesPerSec=11.205978760545337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10008/20000 [16:51:48<40:15:46, 14.51s/it][2022-12-22 06:51:12,747] [INFO] [timer.py:197:stop] 0/4009, RunningAvgSamplesPerSec=10.950861856851233, CurrSamplesPerSec=11.176573997321224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10009/20000 [16:51:57<35:45:07, 12.88s/it][2022-12-22 06:51:22,072] [INFO] [logging.py:68:log_dist] [Rank 0] step=10010, skipped=20, lr=[5.1338461538461545e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:51:22,073] [INFO] [timer.py:197:stop] 0/4010, RunningAvgSamplesPerSec=10.950915411658034, CurrSamplesPerSec=11.169799851890707, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10010/20000 [16:52:06<32:47:15, 11.82s/it][2022-12-22 06:51:31,902] [INFO] [timer.py:197:stop] 0/4011, RunningAvgSamplesPerSec=10.950850536241516, CurrSamplesPerSec=10.696862156818638, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10011/20000 [16:52:16<31:07:52, 11.22s/it][2022-12-22 06:51:41,207] [INFO] [timer.py:197:stop] 0/4012, RunningAvgSamplesPerSec=10.950862503399032, CurrSamplesPerSec=10.999050002640816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10012/20000 [16:52:25<29:32:03, 10.65s/it][2022-12-22 06:51:50,765] [INFO] [timer.py:197:stop] 0/4013, RunningAvgSamplesPerSec=10.950856778367427, CurrSamplesPerSec=10.927947440747328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10013/20000 [16:52:35<28:37:34, 10.32s/it][2022-12-22 06:52:00,398] [INFO] [timer.py:197:stop] 0/4014, RunningAvgSamplesPerSec=10.950866419343775, CurrSamplesPerSec=10.989673445930128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10014/20000 [16:52:44<28:03:10, 10.11s/it][2022-12-22 06:52:09,649] [INFO] [timer.py:197:stop] 0/4015, RunningAvgSamplesPerSec=10.95080339586049, CurrSamplesPerSec=10.703661033831501, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10015/20000 [16:52:54<27:19:57,  9.85s/it][2022-12-22 06:52:18,591] [INFO] [timer.py:197:stop] 0/4016, RunningAvgSamplesPerSec=10.950800686169911, CurrSamplesPerSec=10.939937487574989, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10016/20000 [16:53:03<26:34:13,  9.58s/it][2022-12-22 06:52:28,103] [INFO] [timer.py:197:stop] 0/4017, RunningAvgSamplesPerSec=10.950789794487665, CurrSamplesPerSec=10.907244472730188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10017/20000 [16:53:12<26:30:38,  9.56s/it][2022-12-22 06:52:38,784] [INFO] [timer.py:197:stop] 0/4018, RunningAvgSamplesPerSec=10.950691641634213, CurrSamplesPerSec=10.570300520337403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10018/20000 [16:53:23<27:26:27,  9.90s/it][2022-12-22 06:52:48,063] [INFO] [timer.py:197:stop] 0/4019, RunningAvgSamplesPerSec=10.95064729642929, CurrSamplesPerSec=10.775407585968788, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10019/20000 [16:53:32<26:55:26,  9.71s/it][2022-12-22 06:52:56,958] [INFO] [logging.py:68:log_dist] [Rank 0] step=10020, skipped=20, lr=[5.128717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:52:56,959] [INFO] [timer.py:197:stop] 0/4020, RunningAvgSamplesPerSec=10.950646589591502, CurrSamplesPerSec=10.947807958396647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10020/20000 [16:53:41<26:14:35,  9.47s/it][2022-12-22 06:53:05,952] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 65536.0
[2022-12-22 06:53:05,954] [INFO] [timer.py:197:stop] 0/4021, RunningAvgSamplesPerSec=10.950867439617394, CurrSamplesPerSec=11.916510741843762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10021/20000 [16:53:50<25:50:54,  9.33s/it][2022-12-22 06:53:14,972] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0
[2022-12-22 06:53:14,973] [INFO] [timer.py:197:stop] 0/4022, RunningAvgSamplesPerSec=10.95094893755618, CurrSamplesPerSec=11.288590441458474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10022/20000 [16:53:59<25:35:30,  9.23s/it][2022-12-22 06:53:24,590] [INFO] [timer.py:197:stop] 0/4023, RunningAvgSamplesPerSec=10.950959493246996, CurrSamplesPerSec=10.993558478210852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10023/20000 [16:54:09<25:54:29,  9.35s/it][2022-12-22 06:53:33,455] [INFO] [timer.py:197:stop] 0/4024, RunningAvgSamplesPerSec=10.951035012452273, CurrSamplesPerSec=11.26336040350736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10024/20000 [16:54:17<25:30:15,  9.20s/it][2022-12-22 06:53:42,740] [INFO] [timer.py:197:stop] 0/4025, RunningAvgSamplesPerSec=10.951111818006295, CurrSamplesPerSec=11.26899286058344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10025/20000 [16:54:27<25:34:08,  9.23s/it]

                                                           
{'loss': 0.0446, 'learning_rate': 5.127179487179488e-06, 'epoch': 0.5}


 50%|█████     | 10025/20000 [16:54:27<25:34:08,  9.23s/it][2022-12-22 06:53:51,951] [INFO] [timer.py:197:stop] 0/4026, RunningAvgSamplesPerSec=10.951162195648273, CurrSamplesPerSec=11.157653866958977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10026/20000 [16:54:36<25:33:08,  9.22s/it][2022-12-22 06:54:00,896] [INFO] [timer.py:197:stop] 0/4027, RunningAvgSamplesPerSec=10.951181768037147, CurrSamplesPerSec=11.03051173211593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10027/20000 [16:54:45<25:19:08,  9.14s/it][2022-12-22 06:54:12,131] [INFO] [timer.py:197:stop] 0/4028, RunningAvgSamplesPerSec=10.951187372069413, CurrSamplesPerSec=10.973790168619203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10028/20000 [16:54:56<27:03:27,  9.77s/it][2022-12-22 06:54:21,085] [INFO] [timer.py:197:stop] 0/4029, RunningAvgSamplesPerSec=10.951208667395846, CurrSamplesPerSec=11.03762032048621, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10029/20000 [16:55:05<26:22:40,  9.52s/it][2022-12-22 06:54:30,843] [INFO] [logging.py:68:log_dist] [Rank 0] step=10030, skipped=22, lr=[5.124615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:54:30,844] [INFO] [timer.py:197:stop] 0/4030, RunningAvgSamplesPerSec=10.95117597372545, CurrSamplesPerSec=10.821082957840154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10030/20000 [16:55:15<26:34:15,  9.59s/it][2022-12-22 06:54:40,159] [INFO] [timer.py:197:stop] 0/4031, RunningAvgSamplesPerSec=10.951181619815944, CurrSamplesPerSec=10.97397141191992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10031/20000 [16:55:24<26:20:10,  9.51s/it][2022-12-22 06:54:49,652] [INFO] [timer.py:197:stop] 0/4032, RunningAvgSamplesPerSec=10.951190049372071, CurrSamplesPerSec=10.985258412690046, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10032/20000 [16:55:34<26:19:10,  9.51s/it][2022-12-22 06:54:59,970] [INFO] [timer.py:197:stop] 0/4033, RunningAvgSamplesPerSec=10.951173373158975, CurrSamplesPerSec=10.884378244304338, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10033/20000 [16:55:44<26:59:28,  9.75s/it][2022-12-22 06:55:08,933] [INFO] [timer.py:197:stop] 0/4034, RunningAvgSamplesPerSec=10.951137833316034, CurrSamplesPerSec=10.809727098899039, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10034/20000 [16:55:53<26:20:09,  9.51s/it][2022-12-22 06:55:17,771] [INFO] [timer.py:197:stop] 0/4035, RunningAvgSamplesPerSec=10.9512096380646, CurrSamplesPerSec=11.248590172947278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10035/20000 [16:56:02<25:46:20,  9.31s/it][2022-12-22 06:55:28,854] [INFO] [timer.py:197:stop] 0/4036, RunningAvgSamplesPerSec=10.95120457559671, CurrSamplesPerSec=10.930825645574643, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10036/20000 [16:56:13<27:14:29,  9.84s/it][2022-12-22 06:55:41,018] [INFO] [timer.py:197:stop] 0/4037, RunningAvgSamplesPerSec=10.951172353564772, CurrSamplesPerSec=10.82271377892592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10037/20000 [16:56:25<29:09:58, 10.54s/it][2022-12-22 06:55:50,165] [INFO] [timer.py:197:stop] 0/4038, RunningAvgSamplesPerSec=10.95122952946414, CurrSamplesPerSec=11.186900286416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10038/20000 [16:56:34<28:00:28, 10.12s/it][2022-12-22 06:56:00,249] [INFO] [timer.py:197:stop] 0/4039, RunningAvgSamplesPerSec=10.951117452185839, CurrSamplesPerSec=10.516721062484187, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10039/20000 [16:56:44<27:58:27, 10.11s/it][2022-12-22 06:56:09,161] [INFO] [logging.py:68:log_dist] [Rank 0] step=10040, skipped=22, lr=[5.11948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:56:09,161] [INFO] [timer.py:197:stop] 0/4040, RunningAvgSamplesPerSec=10.951169886991963, CurrSamplesPerSec=11.167022530361013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10040/20000 [16:56:53<26:58:37,  9.75s/it][2022-12-22 06:56:18,457] [INFO] [timer.py:197:stop] 0/4041, RunningAvgSamplesPerSec=10.951176990545939, CurrSamplesPerSec=10.979936489211816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10041/20000 [16:57:02<26:35:48,  9.61s/it][2022-12-22 06:56:27,360] [INFO] [timer.py:197:stop] 0/4042, RunningAvgSamplesPerSec=10.951190219504044, CurrSamplesPerSec=11.004884022654112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10042/20000 [16:57:11<26:00:14,  9.40s/it][2022-12-22 06:56:38,777] [INFO] [timer.py:197:stop] 0/4043, RunningAvgSamplesPerSec=10.95124770561483, CurrSamplesPerSec=11.18852479070865, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10043/20000 [16:57:23<27:40:25, 10.01s/it][2022-12-22 06:56:47,771] [INFO] [timer.py:197:stop] 0/4044, RunningAvgSamplesPerSec=10.95120805229572, CurrSamplesPerSec=10.79328037363299, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10044/20000 [16:57:32<26:49:56,  9.70s/it][2022-12-22 06:56:57,819] [INFO] [timer.py:197:stop] 0/4045, RunningAvgSamplesPerSec=10.95129151610517, CurrSamplesPerSec=11.299377883875755, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10045/20000 [16:57:42<27:06:59,  9.81s/it][2022-12-22 06:57:07,794] [INFO] [timer.py:197:stop] 0/4046, RunningAvgSamplesPerSec=10.95117939925544, CurrSamplesPerSec=10.515911912742936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10046/20000 [16:57:52<27:15:12,  9.86s/it][2022-12-22 06:57:17,909] [INFO] [timer.py:197:stop] 0/4047, RunningAvgSamplesPerSec=10.95109035537978, CurrSamplesPerSec=10.602463301521718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10047/20000 [16:58:02<27:27:53,  9.93s/it][2022-12-22 06:57:27,135] [INFO] [timer.py:197:stop] 0/4048, RunningAvgSamplesPerSec=10.951040777181671, CurrSamplesPerSec=10.754104308244672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10048/20000 [16:58:11<26:52:29,  9.72s/it][2022-12-22 06:57:36,766] [INFO] [timer.py:197:stop] 0/4049, RunningAvgSamplesPerSec=10.951040589699042, CurrSamplesPerSec=10.950282087533413, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10049/20000 [16:58:21<26:47:51,  9.69s/it][2022-12-22 06:57:45,714] [INFO] [logging.py:68:log_dist] [Rank 0] step=10050, skipped=22, lr=[5.114358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:57:45,715] [INFO] [timer.py:197:stop] 0/4050, RunningAvgSamplesPerSec=10.951088423767036, CurrSamplesPerSec=11.14815738321688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10050/20000 [16:58:30<26:10:34,  9.47s/it]

                                                           
{'loss': 0.0585, 'learning_rate': 5.114358974358975e-06, 'epoch': 0.5}


 50%|█████     | 10050/20000 [16:58:30<26:10:34,  9.47s/it][2022-12-22 06:57:54,749] [INFO] [timer.py:197:stop] 0/4051, RunningAvgSamplesPerSec=10.951155675803793, CurrSamplesPerSec=11.2303337604257, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10051/20000 [16:58:39<25:48:43,  9.34s/it][2022-12-22 06:58:03,889] [INFO] [timer.py:197:stop] 0/4052, RunningAvgSamplesPerSec=10.95114603576045, CurrSamplesPerSec=10.91225216168407, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10052/20000 [16:58:48<25:38:36,  9.28s/it][2022-12-22 06:58:13,523] [INFO] [timer.py:197:stop] 0/4053, RunningAvgSamplesPerSec=10.951106173236312, CurrSamplesPerSec=10.792008969853466, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10053/20000 [16:58:57<25:56:02,  9.39s/it][2022-12-22 06:58:22,448] [INFO] [timer.py:197:stop] 0/4054, RunningAvgSamplesPerSec=10.951100275176417, CurrSamplesPerSec=10.927259263547086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10054/20000 [16:59:06<25:32:57,  9.25s/it][2022-12-22 06:58:32,248] [INFO] [timer.py:197:stop] 0/4055, RunningAvgSamplesPerSec=10.951097685050941, CurrSamplesPerSec=10.940612547730474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10055/20000 [16:59:16<26:00:18,  9.41s/it][2022-12-22 06:58:41,176] [INFO] [timer.py:197:stop] 0/4056, RunningAvgSamplesPerSec=10.951116575266415, CurrSamplesPerSec=11.028217785763095, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10056/20000 [16:59:25<25:35:58,  9.27s/it][2022-12-22 06:58:50,842] [INFO] [timer.py:197:stop] 0/4057, RunningAvgSamplesPerSec=10.951081229673953, CurrSamplesPerSec=10.809641345298825, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10057/20000 [16:59:35<25:55:36,  9.39s/it][2022-12-22 06:59:00,166] [INFO] [timer.py:197:stop] 0/4058, RunningAvgSamplesPerSec=10.951081524002158, CurrSamplesPerSec=10.952275154989517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10058/20000 [16:59:44<25:52:18,  9.37s/it][2022-12-22 06:59:09,145] [INFO] [timer.py:197:stop] 0/4059, RunningAvgSamplesPerSec=10.951138741989205, CurrSamplesPerSec=11.18824079482368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10059/20000 [16:59:53<25:32:50,  9.25s/it][2022-12-22 06:59:18,413] [INFO] [logging.py:68:log_dist] [Rank 0] step=10060, skipped=22, lr=[5.109230769230769e-06], mom=[[0.9, 0.999]]
[2022-12-22 06:59:18,414] [INFO] [timer.py:197:stop] 0/4060, RunningAvgSamplesPerSec=10.951140780987108, CurrSamplesPerSec=10.959419250363688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10060/20000 [17:00:02<25:33:32,  9.26s/it][2022-12-22 06:59:28,001] [INFO] [timer.py:197:stop] 0/4061, RunningAvgSamplesPerSec=10.951144855014084, CurrSamplesPerSec=10.967702258533432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10061/20000 [17:00:12<25:49:48,  9.36s/it][2022-12-22 06:59:37,358] [INFO] [timer.py:197:stop] 0/4062, RunningAvgSamplesPerSec=10.951146272085158, CurrSamplesPerSec=10.95690118698915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10062/20000 [17:00:21<25:49:41,  9.36s/it][2022-12-22 06:59:46,328] [INFO] [timer.py:197:stop] 0/4063, RunningAvgSamplesPerSec=10.951110392982848, CurrSamplesPerSec=10.807353924125486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10063/20000 [17:00:30<25:30:20,  9.24s/it][2022-12-22 06:59:55,899] [INFO] [timer.py:197:stop] 0/4064, RunningAvgSamplesPerSec=10.95113740344841, CurrSamplesPerSec=11.06193697531507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10064/20000 [17:00:40<25:46:38,  9.34s/it][2022-12-22 07:00:05,173] [INFO] [timer.py:197:stop] 0/4065, RunningAvgSamplesPerSec=10.951133234937084, CurrSamplesPerSec=10.934226888722725, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10065/20000 [17:00:49<25:43:13,  9.32s/it][2022-12-22 07:00:14,721] [INFO] [timer.py:197:stop] 0/4066, RunningAvgSamplesPerSec=10.951031491268328, CurrSamplesPerSec=10.552687535191454, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10066/20000 [17:00:59<25:54:21,  9.39s/it][2022-12-22 07:00:23,498] [INFO] [timer.py:197:stop] 0/4067, RunningAvgSamplesPerSec=10.951077476253392, CurrSamplesPerSec=11.141205843861433, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10067/20000 [17:01:07<25:23:53,  9.21s/it][2022-12-22 07:00:32,903] [INFO] [timer.py:197:stop] 0/4068, RunningAvgSamplesPerSec=10.951080416727368, CurrSamplesPerSec=10.963046507562849, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10068/20000 [17:01:17<25:33:38,  9.26s/it][2022-12-22 07:00:45,292] [INFO] [timer.py:197:stop] 0/4069, RunningAvgSamplesPerSec=10.951014623913055, CurrSamplesPerSec=10.689881619225101, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10069/20000 [17:01:29<28:08:37, 10.20s/it][2022-12-22 07:00:55,599] [INFO] [logging.py:68:log_dist] [Rank 0] step=10070, skipped=22, lr=[5.104102564102564e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:00:55,600] [INFO] [timer.py:197:stop] 0/4070, RunningAvgSamplesPerSec=10.950970066295818, CurrSamplesPerSec=10.772704881200665, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10070/20000 [17:01:40<28:13:42, 10.23s/it][2022-12-22 07:01:05,009] [INFO] [timer.py:197:stop] 0/4071, RunningAvgSamplesPerSec=10.951016273842535, CurrSamplesPerSec=11.142272256758428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10071/20000 [17:01:49<27:32:33,  9.99s/it][2022-12-22 07:01:14,660] [INFO] [timer.py:197:stop] 0/4072, RunningAvgSamplesPerSec=10.951011416790019, CurrSamplesPerSec=10.93128368159031, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10072/20000 [17:01:59<27:15:47,  9.89s/it][2022-12-22 07:01:23,538] [INFO] [timer.py:197:stop] 0/4073, RunningAvgSamplesPerSec=10.951028306710679, CurrSamplesPerSec=11.02020462523075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10073/20000 [17:02:07<26:25:34,  9.58s/it][2022-12-22 07:01:33,739] [INFO] [timer.py:197:stop] 0/4074, RunningAvgSamplesPerSec=10.950922169685297, CurrSamplesPerSec=10.535243545091754, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10074/20000 [17:02:18<26:56:04,  9.77s/it][2022-12-22 07:01:42,957] [INFO] [timer.py:197:stop] 0/4075, RunningAvgSamplesPerSec=10.95093089262522, CurrSamplesPerSec=10.98656631739403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10075/20000 [17:02:27<26:28:33,  9.60s/it]

                                                           
{'loss': 0.0514, 'learning_rate': 5.101538461538462e-06, 'epoch': 0.5}


 50%|█████     | 10075/20000 [17:02:27<26:28:33,  9.60s/it][2022-12-22 07:01:52,071] [INFO] [timer.py:197:stop] 0/4076, RunningAvgSamplesPerSec=10.950940656560652, CurrSamplesPerSec=10.99085414761912, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10076/20000 [17:02:36<26:04:07,  9.46s/it][2022-12-22 07:02:02,914] [INFO] [timer.py:197:stop] 0/4077, RunningAvgSamplesPerSec=10.950976638699203, CurrSamplesPerSec=11.099557279609751, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10077/20000 [17:02:47<27:12:45,  9.87s/it][2022-12-22 07:02:12,295] [INFO] [timer.py:197:stop] 0/4078, RunningAvgSamplesPerSec=10.950994636605936, CurrSamplesPerSec=11.024830726104012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10078/20000 [17:02:56<26:48:12,  9.73s/it][2022-12-22 07:02:21,350] [INFO] [timer.py:197:stop] 0/4079, RunningAvgSamplesPerSec=10.950995669818468, CurrSamplesPerSec=10.955208664670339, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10079/20000 [17:03:05<26:14:47,  9.52s/it][2022-12-22 07:02:30,984] [INFO] [logging.py:68:log_dist] [Rank 0] step=10080, skipped=22, lr=[5.098974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:02:30,985] [INFO] [timer.py:197:stop] 0/4080, RunningAvgSamplesPerSec=10.951067493493937, CurrSamplesPerSec=11.251939739150439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10080/20000 [17:03:15<26:20:09,  9.56s/it][2022-12-22 07:02:40,375] [INFO] [timer.py:197:stop] 0/4081, RunningAvgSamplesPerSec=10.951043423543751, CurrSamplesPerSec=10.853758373555133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10081/20000 [17:03:24<26:11:41,  9.51s/it][2022-12-22 07:02:49,865] [INFO] [timer.py:197:stop] 0/4082, RunningAvgSamplesPerSec=10.951059522112033, CurrSamplesPerSec=11.017121809878951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10082/20000 [17:03:34<26:10:40,  9.50s/it][2022-12-22 07:03:00,361] [INFO] [timer.py:197:stop] 0/4083, RunningAvgSamplesPerSec=10.951157101654188, CurrSamplesPerSec=11.364305131085016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10083/20000 [17:03:44<26:59:49,  9.80s/it][2022-12-22 07:03:10,106] [INFO] [timer.py:197:stop] 0/4084, RunningAvgSamplesPerSec=10.951116731785477, CurrSamplesPerSec=10.788809655914985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10084/20000 [17:03:54<26:56:54,  9.78s/it][2022-12-22 07:03:19,586] [INFO] [timer.py:197:stop] 0/4085, RunningAvgSamplesPerSec=10.951159767433706, CurrSamplesPerSec=11.129695948591909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10085/20000 [17:04:04<26:41:42,  9.69s/it][2022-12-22 07:03:28,464] [INFO] [timer.py:197:stop] 0/4086, RunningAvgSamplesPerSec=10.951176344228584, CurrSamplesPerSec=11.019280413702086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10086/20000 [17:04:12<26:01:09,  9.45s/it][2022-12-22 07:03:38,374] [INFO] [timer.py:197:stop] 0/4087, RunningAvgSamplesPerSec=10.951124008714034, CurrSamplesPerSec=10.741478518880136, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10087/20000 [17:04:22<26:23:53,  9.59s/it][2022-12-22 07:03:47,230] [INFO] [timer.py:197:stop] 0/4088, RunningAvgSamplesPerSec=10.951171778961415, CurrSamplesPerSec=11.149854479142745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10088/20000 [17:04:31<25:47:31,  9.37s/it][2022-12-22 07:03:56,565] [INFO] [timer.py:197:stop] 0/4089, RunningAvgSamplesPerSec=10.951139019821607, CurrSamplesPerSec=10.818901881410028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10089/20000 [17:04:41<25:45:45,  9.36s/it][2022-12-22 07:04:05,931] [INFO] [logging.py:68:log_dist] [Rank 0] step=10090, skipped=22, lr=[5.093846153846155e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:04:05,932] [INFO] [timer.py:197:stop] 0/4090, RunningAvgSamplesPerSec=10.951159369696738, CurrSamplesPerSec=11.03496594452546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10090/20000 [17:04:50<25:46:02,  9.36s/it][2022-12-22 07:04:15,145] [INFO] [timer.py:197:stop] 0/4091, RunningAvgSamplesPerSec=10.951145226512319, CurrSamplesPerSec=10.893631610052358, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10091/20000 [17:04:59<25:38:35,  9.32s/it][2022-12-22 07:04:24,715] [INFO] [timer.py:197:stop] 0/4092, RunningAvgSamplesPerSec=10.951093994692503, CurrSamplesPerSec=10.74554014906627, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10092/20000 [17:05:09<25:50:59,  9.39s/it][2022-12-22 07:04:33,650] [INFO] [timer.py:197:stop] 0/4093, RunningAvgSamplesPerSec=10.951110604103954, CurrSamplesPerSec=11.019467233976593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10093/20000 [17:05:18<25:28:11,  9.26s/it][2022-12-22 07:04:44,044] [INFO] [timer.py:197:stop] 0/4094, RunningAvgSamplesPerSec=10.95107068152061, CurrSamplesPerSec=10.790147966689537, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10094/20000 [17:05:28<26:24:24,  9.60s/it][2022-12-22 07:04:52,990] [INFO] [timer.py:197:stop] 0/4095, RunningAvgSamplesPerSec=10.951077331032476, CurrSamplesPerSec=10.978354925949448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10095/20000 [17:05:37<25:52:01,  9.40s/it][2022-12-22 07:05:04,125] [INFO] [timer.py:197:stop] 0/4096, RunningAvgSamplesPerSec=10.951128576994556, CurrSamplesPerSec=11.16497515788409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10096/20000 [17:05:48<27:17:43,  9.92s/it][2022-12-22 07:05:14,514] [INFO] [timer.py:197:stop] 0/4097, RunningAvgSamplesPerSec=10.951061629960655, CurrSamplesPerSec=10.68367423045717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10097/20000 [17:05:58<27:40:41, 10.06s/it][2022-12-22 07:05:23,895] [INFO] [timer.py:197:stop] 0/4098, RunningAvgSamplesPerSec=10.950989699847286, CurrSamplesPerSec=10.664152949837906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10098/20000 [17:06:08<27:06:48,  9.86s/it][2022-12-22 07:05:33,409] [INFO] [timer.py:197:stop] 0/4099, RunningAvgSamplesPerSec=10.950948567160747, CurrSamplesPerSec=10.785022466364737, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10099/20000 [17:06:17<26:49:39,  9.75s/it][2022-12-22 07:05:42,625] [INFO] [logging.py:68:log_dist] [Rank 0] step=10100, skipped=22, lr=[5.08871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:05:42,626] [INFO] [timer.py:197:stop] 0/4100, RunningAvgSamplesPerSec=10.951017384172653, CurrSamplesPerSec=11.240413244181216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 50%|█████     | 10100/20000 [17:06:27<26:22:52,  9.59s/it]

                                                           
{'loss': 0.0605, 'learning_rate': 5.08871794871795e-06, 'epoch': 0.51}


 50%|█████     | 10100/20000 [17:06:27<26:22:52,  9.59s/it][2022-12-22 07:05:52,010] [INFO] [timer.py:197:stop] 0/4101, RunningAvgSamplesPerSec=10.95102094262804, CurrSamplesPerSec=10.965622941791795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10101/20000 [17:06:36<26:12:21,  9.53s/it][2022-12-22 07:06:01,211] [INFO] [timer.py:197:stop] 0/4102, RunningAvgSamplesPerSec=10.950953555300638, CurrSamplesPerSec=10.681530336970901, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10102/20000 [17:06:45<25:55:56,  9.43s/it][2022-12-22 07:06:10,820] [INFO] [timer.py:197:stop] 0/4103, RunningAvgSamplesPerSec=10.95095037499259, CurrSamplesPerSec=10.937926623133437, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10103/20000 [17:06:55<26:04:31,  9.48s/it][2022-12-22 07:06:19,790] [INFO] [timer.py:197:stop] 0/4104, RunningAvgSamplesPerSec=10.950974825036056, CurrSamplesPerSec=11.052171256877205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10104/20000 [17:07:04<25:38:55,  9.33s/it][2022-12-22 07:06:28,994] [INFO] [timer.py:197:stop] 0/4105, RunningAvgSamplesPerSec=10.950930989296966, CurrSamplesPerSec=10.77402233443992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10105/20000 [17:07:13<25:32:27,  9.29s/it][2022-12-22 07:06:39,140] [INFO] [timer.py:197:stop] 0/4106, RunningAvgSamplesPerSec=10.950904770525156, CurrSamplesPerSec=10.844375885584485, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10106/20000 [17:07:23<26:14:34,  9.55s/it][2022-12-22 07:06:48,632] [INFO] [timer.py:197:stop] 0/4107, RunningAvgSamplesPerSec=10.950954314666001, CurrSamplesPerSec=11.158131110259905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10107/20000 [17:07:33<26:11:34,  9.53s/it][2022-12-22 07:06:58,655] [INFO] [timer.py:197:stop] 0/4108, RunningAvgSamplesPerSec=10.950959733676823, CurrSamplesPerSec=10.973250063198225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10108/20000 [17:07:43<26:35:45,  9.68s/it][2022-12-22 07:07:07,565] [INFO] [timer.py:197:stop] 0/4109, RunningAvgSamplesPerSec=10.950967498893311, CurrSamplesPerSec=10.982944602495492, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10109/20000 [17:07:52<25:57:32,  9.45s/it][2022-12-22 07:07:17,080] [INFO] [logging.py:68:log_dist] [Rank 0] step=10110, skipped=22, lr=[5.083589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:07:17,081] [INFO] [timer.py:197:stop] 0/4110, RunningAvgSamplesPerSec=10.950970454722054, CurrSamplesPerSec=10.963123518805645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10110/20000 [17:08:01<26:00:42,  9.47s/it][2022-12-22 07:07:26,092] [INFO] [timer.py:197:stop] 0/4111, RunningAvgSamplesPerSec=10.950968686319031, CurrSamplesPerSec=10.943708903830633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10111/20000 [17:08:10<25:37:58,  9.33s/it][2022-12-22 07:07:35,238] [INFO] [timer.py:197:stop] 0/4112, RunningAvgSamplesPerSec=10.950988471977155, CurrSamplesPerSec=11.032895963915523, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10112/20000 [17:08:19<25:28:38,  9.28s/it][2022-12-22 07:07:44,507] [INFO] [timer.py:197:stop] 0/4113, RunningAvgSamplesPerSec=10.950959983334416, CurrSamplesPerSec=10.835110631282621, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10113/20000 [17:08:28<25:28:09,  9.27s/it][2022-12-22 07:07:53,500] [INFO] [timer.py:197:stop] 0/4114, RunningAvgSamplesPerSec=10.950971238849194, CurrSamplesPerSec=10.99743904950103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10114/20000 [17:08:37<25:14:08,  9.19s/it][2022-12-22 07:08:03,387] [INFO] [timer.py:197:stop] 0/4115, RunningAvgSamplesPerSec=10.950975257796388, CurrSamplesPerSec=10.967526151377875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10115/20000 [17:08:47<25:48:26,  9.40s/it][2022-12-22 07:08:12,449] [INFO] [timer.py:197:stop] 0/4116, RunningAvgSamplesPerSec=10.950999841581485, CurrSamplesPerSec=11.053055482056681, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10116/20000 [17:08:56<25:31:39,  9.30s/it][2022-12-22 07:08:21,506] [INFO] [timer.py:197:stop] 0/4117, RunningAvgSamplesPerSec=10.950959698678952, CurrSamplesPerSec=10.788265926495395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10117/20000 [17:09:05<25:19:35,  9.23s/it][2022-12-22 07:08:31,119] [INFO] [timer.py:197:stop] 0/4118, RunningAvgSamplesPerSec=10.950983497840092, CurrSamplesPerSec=11.049800975489518, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10118/20000 [17:09:15<25:38:36,  9.34s/it][2022-12-22 07:08:41,324] [INFO] [timer.py:197:stop] 0/4119, RunningAvgSamplesPerSec=10.950977919345364, CurrSamplesPerSec=10.928064888824476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10119/20000 [17:09:25<26:21:05,  9.60s/it][2022-12-22 07:08:50,369] [INFO] [logging.py:68:log_dist] [Rank 0] step=10120, skipped=22, lr=[5.078461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:08:50,370] [INFO] [timer.py:197:stop] 0/4120, RunningAvgSamplesPerSec=10.951027185068975, CurrSamplesPerSec=11.157682620987506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10120/20000 [17:09:34<25:53:30,  9.43s/it][2022-12-22 07:08:59,421] [INFO] [timer.py:197:stop] 0/4121, RunningAvgSamplesPerSec=10.951000488388756, CurrSamplesPerSec=10.842156507667895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10121/20000 [17:09:43<25:34:24,  9.32s/it][2022-12-22 07:09:10,001] [INFO] [timer.py:197:stop] 0/4122, RunningAvgSamplesPerSec=10.951041075187536, CurrSamplesPerSec=11.120810402798561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10122/20000 [17:09:54<26:36:30,  9.70s/it][2022-12-22 07:09:19,061] [INFO] [timer.py:197:stop] 0/4123, RunningAvgSamplesPerSec=10.951018737946988, CurrSamplesPerSec=10.859756436994546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10123/20000 [17:10:03<26:04:54,  9.51s/it][2022-12-22 07:09:28,029] [INFO] [timer.py:197:stop] 0/4124, RunningAvgSamplesPerSec=10.951029052441562, CurrSamplesPerSec=10.993700753476872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10124/20000 [17:10:12<25:38:08,  9.34s/it][2022-12-22 07:09:37,462] [INFO] [timer.py:197:stop] 0/4125, RunningAvgSamplesPerSec=10.951028694203767, CurrSamplesPerSec=10.949552237150007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10125/20000 [17:10:21<25:42:20,  9.37s/it]

                                                           
{'loss': 0.05, 'learning_rate': 5.075897435897437e-06, 'epoch': 0.51}


 51%|█████     | 10125/20000 [17:10:21<25:42:20,  9.37s/it][2022-12-22 07:09:46,711] [INFO] [timer.py:197:stop] 0/4126, RunningAvgSamplesPerSec=10.951000660333554, CurrSamplesPerSec=10.836624503070752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10126/20000 [17:10:31<25:36:09,  9.33s/it][2022-12-22 07:09:55,814] [INFO] [timer.py:197:stop] 0/4127, RunningAvgSamplesPerSec=10.950952637705145, CurrSamplesPerSec=10.756426135753012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10127/20000 [17:10:40<25:24:36,  9.27s/it][2022-12-22 07:10:05,761] [INFO] [timer.py:197:stop] 0/4128, RunningAvgSamplesPerSec=10.950923257675504, CurrSamplesPerSec=10.831057497733202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10128/20000 [17:10:50<25:58:03,  9.47s/it][2022-12-22 07:10:15,222] [INFO] [timer.py:197:stop] 0/4129, RunningAvgSamplesPerSec=10.950884133057702, CurrSamplesPerSec=10.791801581545917, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10129/20000 [17:10:59<25:57:29,  9.47s/it][2022-12-22 07:10:25,585] [INFO] [logging.py:68:log_dist] [Rank 0] step=10130, skipped=22, lr=[5.073333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:10:25,586] [INFO] [timer.py:197:stop] 0/4130, RunningAvgSamplesPerSec=10.95083474431859, CurrSamplesPerSec=10.750732807567516, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10130/20000 [17:11:10<26:41:35,  9.74s/it][2022-12-22 07:10:35,544] [INFO] [timer.py:197:stop] 0/4131, RunningAvgSamplesPerSec=10.950843489328555, CurrSamplesPerSec=10.987062314569208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10131/20000 [17:11:20<26:52:22,  9.80s/it][2022-12-22 07:10:44,832] [INFO] [timer.py:197:stop] 0/4132, RunningAvgSamplesPerSec=10.950786985962376, CurrSamplesPerSec=10.722352476981643, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10132/20000 [17:11:29<26:26:49,  9.65s/it][2022-12-22 07:10:53,982] [INFO] [timer.py:197:stop] 0/4133, RunningAvgSamplesPerSec=10.950737424545421, CurrSamplesPerSec=10.749805455822854, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10133/20000 [17:11:38<26:02:05,  9.50s/it][2022-12-22 07:11:03,846] [INFO] [timer.py:197:stop] 0/4134, RunningAvgSamplesPerSec=10.950758462895386, CurrSamplesPerSec=11.038363320695582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10134/20000 [17:11:48<26:19:56,  9.61s/it][2022-12-22 07:11:13,094] [INFO] [timer.py:197:stop] 0/4135, RunningAvgSamplesPerSec=10.950706904017686, CurrSamplesPerSec=10.74173211961924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10135/20000 [17:11:57<26:01:57,  9.50s/it][2022-12-22 07:11:22,539] [INFO] [timer.py:197:stop] 0/4136, RunningAvgSamplesPerSec=10.950702755943766, CurrSamplesPerSec=10.933585570909294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10136/20000 [17:12:07<25:59:07,  9.48s/it][2022-12-22 07:11:31,625] [INFO] [timer.py:197:stop] 0/4137, RunningAvgSamplesPerSec=10.950698420492309, CurrSamplesPerSec=10.932804957070786, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10137/20000 [17:12:16<25:39:21,  9.36s/it][2022-12-22 07:11:40,962] [INFO] [timer.py:197:stop] 0/4138, RunningAvgSamplesPerSec=10.950650949952182, CurrSamplesPerSec=10.757817644129505, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10138/20000 [17:12:25<25:37:51,  9.36s/it][2022-12-22 07:11:50,630] [INFO] [timer.py:197:stop] 0/4139, RunningAvgSamplesPerSec=10.95059934903685, CurrSamplesPerSec=10.74125888452675, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10139/20000 [17:12:35<25:53:03,  9.45s/it][2022-12-22 07:11:59,775] [INFO] [logging.py:68:log_dist] [Rank 0] step=10140, skipped=22, lr=[5.0682051282051285e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:11:59,775] [INFO] [timer.py:197:stop] 0/4140, RunningAvgSamplesPerSec=10.950620253478728, CurrSamplesPerSec=11.037790516344526, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10140/20000 [17:12:44<25:37:53,  9.36s/it][2022-12-22 07:12:09,683] [INFO] [timer.py:197:stop] 0/4141, RunningAvgSamplesPerSec=10.95067396315655, CurrSamplesPerSec=11.177529903126018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10141/20000 [17:12:54<26:04:47,  9.52s/it][2022-12-22 07:12:18,944] [INFO] [timer.py:197:stop] 0/4142, RunningAvgSamplesPerSec=10.950698448874185, CurrSamplesPerSec=11.052991765785265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10142/20000 [17:13:03<25:51:44,  9.44s/it][2022-12-22 07:12:28,046] [INFO] [timer.py:197:stop] 0/4143, RunningAvgSamplesPerSec=10.950750055164889, CurrSamplesPerSec=11.168652418779796, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10143/20000 [17:13:12<25:34:42,  9.34s/it][2022-12-22 07:12:37,057] [INFO] [timer.py:197:stop] 0/4144, RunningAvgSamplesPerSec=10.950701529909287, CurrSamplesPerSec=10.753380127325798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10144/20000 [17:13:21<25:18:15,  9.24s/it][2022-12-22 07:12:46,782] [INFO] [timer.py:197:stop] 0/4145, RunningAvgSamplesPerSec=10.950727722542457, CurrSamplesPerSec=11.060303448212212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10145/20000 [17:13:31<25:41:49,  9.39s/it][2022-12-22 07:12:55,999] [INFO] [timer.py:197:stop] 0/4146, RunningAvgSamplesPerSec=10.9507415097102, CurrSamplesPerSec=11.008161325850576, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10146/20000 [17:13:40<25:33:19,  9.34s/it][2022-12-22 07:13:05,315] [INFO] [timer.py:197:stop] 0/4147, RunningAvgSamplesPerSec=10.950800448980013, CurrSamplesPerSec=11.200618005519372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10147/20000 [17:13:49<25:32:10,  9.33s/it][2022-12-22 07:13:14,624] [INFO] [timer.py:197:stop] 0/4148, RunningAvgSamplesPerSec=10.950794601601581, CurrSamplesPerSec=10.926610756999729, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10148/20000 [17:13:59<25:30:55,  9.32s/it][2022-12-22 07:13:24,348] [INFO] [timer.py:197:stop] 0/4149, RunningAvgSamplesPerSec=10.950799146929336, CurrSamplesPerSec=10.969676569278967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10149/20000 [17:14:08<25:50:32,  9.44s/it][2022-12-22 07:13:33,676] [INFO] [logging.py:68:log_dist] [Rank 0] step=10150, skipped=22, lr=[5.063076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:13:33,677] [INFO] [timer.py:197:stop] 0/4150, RunningAvgSamplesPerSec=10.950812188529348, CurrSamplesPerSec=11.005164200452514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10150/20000 [17:14:18<25:44:41,  9.41s/it]

                                                           
{'loss': 0.0596, 'learning_rate': 5.063076923076924e-06, 'epoch': 0.51}


 51%|█████     | 10150/20000 [17:14:18<25:44:41,  9.41s/it][2022-12-22 07:13:43,209] [INFO] [timer.py:197:stop] 0/4151, RunningAvgSamplesPerSec=10.950704554327208, CurrSamplesPerSec=10.521731580847161, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10151/20000 [17:14:27<25:50:35,  9.45s/it][2022-12-22 07:13:56,167] [INFO] [timer.py:197:stop] 0/4152, RunningAvgSamplesPerSec=10.95070001752858, CurrSamplesPerSec=10.931909147471767, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10152/20000 [17:14:40<28:43:21, 10.50s/it][2022-12-22 07:14:06,207] [INFO] [timer.py:197:stop] 0/4153, RunningAvgSamplesPerSec=10.950563094616749, CurrSamplesPerSec=10.410370617251498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10153/20000 [17:14:50<28:20:31, 10.36s/it][2022-12-22 07:14:15,352] [INFO] [timer.py:197:stop] 0/4154, RunningAvgSamplesPerSec=10.95055476277414, CurrSamplesPerSec=10.91607819873365, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10154/20000 [17:14:59<27:20:27, 10.00s/it][2022-12-22 07:14:24,814] [INFO] [timer.py:197:stop] 0/4155, RunningAvgSamplesPerSec=10.950514727448716, CurrSamplesPerSec=10.786774204048042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10155/20000 [17:15:09<26:53:58,  9.84s/it][2022-12-22 07:14:36,328] [INFO] [timer.py:197:stop] 0/4156, RunningAvgSamplesPerSec=10.950457475086733, CurrSamplesPerSec=10.717742608120012, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10156/20000 [17:15:20<28:16:24, 10.34s/it][2022-12-22 07:14:45,608] [INFO] [timer.py:197:stop] 0/4157, RunningAvgSamplesPerSec=10.950480707588959, CurrSamplesPerSec=11.047846826937514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10157/20000 [17:15:30<27:24:03, 10.02s/it][2022-12-22 07:14:54,619] [INFO] [timer.py:197:stop] 0/4158, RunningAvgSamplesPerSec=10.950584557811965, CurrSamplesPerSec=11.399786898007042, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10158/20000 [17:15:39<26:34:09,  9.72s/it][2022-12-22 07:15:03,680] [INFO] [timer.py:197:stop] 0/4159, RunningAvgSamplesPerSec=10.950544777251315, CurrSamplesPerSec=10.787676297843445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10159/20000 [17:15:48<26:01:40,  9.52s/it][2022-12-22 07:15:14,242] [INFO] [logging.py:68:log_dist] [Rank 0] step=10160, skipped=22, lr=[5.057948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:15:14,243] [INFO] [timer.py:197:stop] 0/4160, RunningAvgSamplesPerSec=10.950608343762964, CurrSamplesPerSec=11.221390060474217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10160/20000 [17:15:58<26:52:43,  9.83s/it][2022-12-22 07:15:23,654] [INFO] [timer.py:197:stop] 0/4161, RunningAvgSamplesPerSec=10.950643624828041, CurrSamplesPerSec=11.099334690217303, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10161/20000 [17:16:08<26:31:45,  9.71s/it][2022-12-22 07:15:33,748] [INFO] [timer.py:197:stop] 0/4162, RunningAvgSamplesPerSec=10.950631106866064, CurrSamplesPerSec=10.898815308279412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10162/20000 [17:16:18<26:50:41,  9.82s/it][2022-12-22 07:15:43,041] [INFO] [timer.py:197:stop] 0/4163, RunningAvgSamplesPerSec=10.950642404504867, CurrSamplesPerSec=10.997843207940475, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10163/20000 [17:16:27<26:24:25,  9.66s/it][2022-12-22 07:15:53,373] [INFO] [timer.py:197:stop] 0/4164, RunningAvgSamplesPerSec=10.950706698838642, CurrSamplesPerSec=11.224936540860417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10164/20000 [17:16:37<26:57:06,  9.86s/it][2022-12-22 07:16:02,652] [INFO] [timer.py:197:stop] 0/4165, RunningAvgSamplesPerSec=10.95065096199643, CurrSamplesPerSec=10.723487571765272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10165/20000 [17:16:47<26:28:08,  9.69s/it][2022-12-22 07:16:12,092] [INFO] [timer.py:197:stop] 0/4166, RunningAvgSamplesPerSec=10.950669832097907, CurrSamplesPerSec=11.029793808311972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10166/20000 [17:16:56<26:15:44,  9.61s/it][2022-12-22 07:16:22,833] [INFO] [timer.py:197:stop] 0/4167, RunningAvgSamplesPerSec=10.950614577860982, CurrSamplesPerSec=10.725271655344889, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10167/20000 [17:17:07<27:11:00,  9.95s/it][2022-12-22 07:16:31,780] [INFO] [timer.py:197:stop] 0/4168, RunningAvgSamplesPerSec=10.95061020733345, CurrSamplesPerSec=10.932437176519574, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10168/20000 [17:17:16<26:21:23,  9.65s/it][2022-12-22 07:16:41,171] [INFO] [timer.py:197:stop] 0/4169, RunningAvgSamplesPerSec=10.950584594880684, CurrSamplesPerSec=10.844913017832758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10169/20000 [17:17:25<26:08:29,  9.57s/it][2022-12-22 07:16:50,147] [INFO] [logging.py:68:log_dist] [Rank 0] step=10170, skipped=22, lr=[5.052820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:16:50,148] [INFO] [timer.py:197:stop] 0/4170, RunningAvgSamplesPerSec=10.950586762756556, CurrSamplesPerSec=10.959627761561432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10170/20000 [17:17:34<25:39:03,  9.39s/it][2022-12-22 07:17:01,063] [INFO] [timer.py:197:stop] 0/4171, RunningAvgSamplesPerSec=10.950634721068878, CurrSamplesPerSec=11.154242465190812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10171/20000 [17:17:45<26:53:39,  9.85s/it][2022-12-22 07:17:09,897] [INFO] [timer.py:197:stop] 0/4172, RunningAvgSamplesPerSec=10.950693801211003, CurrSamplesPerSec=11.202667719010769, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10172/20000 [17:17:54<26:03:32,  9.55s/it][2022-12-22 07:17:21,731] [INFO] [timer.py:197:stop] 0/4173, RunningAvgSamplesPerSec=10.950759876938871, CurrSamplesPerSec=11.23340920323215, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10173/20000 [17:18:06<27:55:49, 10.23s/it][2022-12-22 07:17:31,583] [INFO] [timer.py:197:stop] 0/4174, RunningAvgSamplesPerSec=10.950786407801147, CurrSamplesPerSec=11.062576570612446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10174/20000 [17:18:16<27:37:01, 10.12s/it][2022-12-22 07:17:43,217] [INFO] [timer.py:197:stop] 0/4175, RunningAvgSamplesPerSec=10.950691475723561, CurrSamplesPerSec=10.56846234616434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10175/20000 [17:18:27<28:51:16, 10.57s/it]

                                                           
{'loss': 0.0486, 'learning_rate': 5.050256410256411e-06, 'epoch': 0.51}


 51%|█████     | 10175/20000 [17:18:27<28:51:16, 10.57s/it][2022-12-22 07:17:54,703] [INFO] [timer.py:197:stop] 0/4176, RunningAvgSamplesPerSec=10.950646029902156, CurrSamplesPerSec=10.764229783544854, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10176/20000 [17:18:39<29:35:59, 10.85s/it][2022-12-22 07:18:03,564] [INFO] [timer.py:197:stop] 0/4177, RunningAvgSamplesPerSec=10.95068697667674, CurrSamplesPerSec=11.124309256722439, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10177/20000 [17:18:48<27:58:14, 10.25s/it][2022-12-22 07:18:13,724] [INFO] [timer.py:197:stop] 0/4178, RunningAvgSamplesPerSec=10.950747972525711, CurrSamplesPerSec=11.211470141228741, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10178/20000 [17:18:58<27:53:37, 10.22s/it][2022-12-22 07:18:23,118] [INFO] [timer.py:197:stop] 0/4179, RunningAvgSamplesPerSec=10.950704910222475, CurrSamplesPerSec=10.773782773519805, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10179/20000 [17:19:07<27:12:42,  9.97s/it][2022-12-22 07:18:32,318] [INFO] [logging.py:68:log_dist] [Rank 0] step=10180, skipped=22, lr=[5.047692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:18:32,319] [INFO] [timer.py:197:stop] 0/4180, RunningAvgSamplesPerSec=10.950728486780344, CurrSamplesPerSec=11.050101640097646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10180/20000 [17:19:16<26:34:34,  9.74s/it][2022-12-22 07:18:41,396] [INFO] [timer.py:197:stop] 0/4181, RunningAvgSamplesPerSec=10.950679030989878, CurrSamplesPerSec=10.747880226612585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10181/20000 [17:19:25<26:01:41,  9.54s/it][2022-12-22 07:18:52,002] [INFO] [timer.py:197:stop] 0/4182, RunningAvgSamplesPerSec=10.950583364636788, CurrSamplesPerSec=10.564878559695053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10182/20000 [17:19:36<26:53:43,  9.86s/it][2022-12-22 07:19:01,904] [INFO] [timer.py:197:stop] 0/4183, RunningAvgSamplesPerSec=10.95063369141068, CurrSamplesPerSec=11.165120975825797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10183/20000 [17:19:46<26:55:31,  9.87s/it][2022-12-22 07:19:12,241] [INFO] [timer.py:197:stop] 0/4184, RunningAvgSamplesPerSec=10.950625837642376, CurrSamplesPerSec=10.917887425418186, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10184/20000 [17:19:56<27:18:05, 10.01s/it][2022-12-22 07:19:21,425] [INFO] [timer.py:197:stop] 0/4185, RunningAvgSamplesPerSec=10.950593079125476, CurrSamplesPerSec=10.815290058870275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10185/20000 [17:20:05<26:37:17,  9.76s/it][2022-12-22 07:19:31,831] [INFO] [timer.py:197:stop] 0/4186, RunningAvgSamplesPerSec=10.950550690836707, CurrSamplesPerSec=10.77606638657412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10186/20000 [17:20:16<27:08:34,  9.96s/it][2022-12-22 07:19:41,089] [INFO] [timer.py:197:stop] 0/4187, RunningAvgSamplesPerSec=10.950503516139428, CurrSamplesPerSec=10.756620097668751, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10187/20000 [17:20:25<26:34:09,  9.75s/it][2022-12-22 07:19:50,412] [INFO] [timer.py:197:stop] 0/4188, RunningAvgSamplesPerSec=10.950527827385462, CurrSamplesPerSec=11.053224788861469, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10188/20000 [17:20:34<26:13:08,  9.62s/it][2022-12-22 07:20:00,469] [INFO] [timer.py:197:stop] 0/4189, RunningAvgSamplesPerSec=10.950551827644038, CurrSamplesPerSec=11.05194737876382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10189/20000 [17:20:44<26:34:27,  9.75s/it][2022-12-22 07:20:09,754] [INFO] [logging.py:68:log_dist] [Rank 0] step=10190, skipped=22, lr=[5.042564102564102e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:20:09,755] [INFO] [timer.py:197:stop] 0/4190, RunningAvgSamplesPerSec=10.950489543256658, CurrSamplesPerSec=10.695772325212765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10190/20000 [17:20:54<26:11:26,  9.61s/it][2022-12-22 07:20:20,958] [INFO] [timer.py:197:stop] 0/4191, RunningAvgSamplesPerSec=10.950393784511386, CurrSamplesPerSec=10.56352778374073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10191/20000 [17:21:05<27:29:23, 10.09s/it][2022-12-22 07:20:30,358] [INFO] [timer.py:197:stop] 0/4192, RunningAvgSamplesPerSec=10.950458148604259, CurrSamplesPerSec=11.226887168626819, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10192/20000 [17:21:14<26:55:25,  9.88s/it][2022-12-22 07:20:40,986] [INFO] [timer.py:197:stop] 0/4193, RunningAvgSamplesPerSec=10.950499863439038, CurrSamplesPerSec=11.128120773743326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10193/20000 [17:21:25<27:31:50, 10.11s/it][2022-12-22 07:20:50,770] [INFO] [timer.py:197:stop] 0/4194, RunningAvgSamplesPerSec=10.950496455391287, CurrSamplesPerSec=10.936231937434112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10194/20000 [17:21:35<27:15:53, 10.01s/it][2022-12-22 07:20:59,999] [INFO] [timer.py:197:stop] 0/4195, RunningAvgSamplesPerSec=10.950509717644833, CurrSamplesPerSec=11.006388848638599, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10195/20000 [17:21:44<26:37:26,  9.78s/it][2022-12-22 07:21:09,459] [INFO] [timer.py:197:stop] 0/4196, RunningAvgSamplesPerSec=10.950349133144615, CurrSamplesPerSec=10.316031462660783, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10196/20000 [17:21:53<26:21:49,  9.68s/it][2022-12-22 07:21:18,943] [INFO] [timer.py:197:stop] 0/4197, RunningAvgSamplesPerSec=10.95036035655301, CurrSamplesPerSec=10.997634591792554, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10197/20000 [17:22:03<26:12:00,  9.62s/it][2022-12-22 07:21:29,983] [INFO] [timer.py:197:stop] 0/4198, RunningAvgSamplesPerSec=10.950332329945173, CurrSamplesPerSec=10.834009939012258, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10198/20000 [17:22:14<27:21:21, 10.05s/it][2022-12-22 07:21:38,928] [INFO] [timer.py:197:stop] 0/4199, RunningAvgSamplesPerSec=10.950351272422868, CurrSamplesPerSec=11.0304151876809, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10199/20000 [17:22:23<26:27:12,  9.72s/it][2022-12-22 07:21:49,296] [INFO] [logging.py:68:log_dist] [Rank 0] step=10200, skipped=22, lr=[5.037435897435899e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:21:49,297] [INFO] [timer.py:197:stop] 0/4200, RunningAvgSamplesPerSec=10.950258909685383, CurrSamplesPerSec=10.57586929826044, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10200/20000 [17:22:33<26:59:01,  9.91s/it]

                                                           
{'loss': 0.0439, 'learning_rate': 5.037435897435899e-06, 'epoch': 0.51}


 51%|█████     | 10200/20000 [17:22:33<26:59:01,  9.91s/it][2022-12-22 07:21:58,581] [INFO] [timer.py:197:stop] 0/4201, RunningAvgSamplesPerSec=10.950326476862315, CurrSamplesPerSec=11.241518036002697, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10201/20000 [17:22:43<26:28:02,  9.72s/it][2022-12-22 07:22:09,786] [INFO] [timer.py:197:stop] 0/4202, RunningAvgSamplesPerSec=10.950322482384543, CurrSamplesPerSec=10.93357532824905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10202/20000 [17:22:54<27:40:27, 10.17s/it][2022-12-22 07:22:19,413] [INFO] [timer.py:197:stop] 0/4203, RunningAvgSamplesPerSec=10.950269043874238, CurrSamplesPerSec=10.730336218096056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10203/20000 [17:23:03<27:13:47, 10.01s/it][2022-12-22 07:22:31,314] [INFO] [timer.py:197:stop] 0/4204, RunningAvgSamplesPerSec=10.950289603319302, CurrSamplesPerSec=11.037346656551257, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10204/20000 [17:23:15<28:46:26, 10.57s/it][2022-12-22 07:22:41,997] [INFO] [timer.py:197:stop] 0/4205, RunningAvgSamplesPerSec=10.95026308673046, CurrSamplesPerSec=10.83996298908115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10205/20000 [17:23:26<28:51:33, 10.61s/it][2022-12-22 07:22:51,030] [INFO] [timer.py:197:stop] 0/4206, RunningAvgSamplesPerSec=10.95032205675486, CurrSamplesPerSec=11.203914274163639, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10206/20000 [17:23:35<27:34:19, 10.13s/it][2022-12-22 07:23:00,183] [INFO] [timer.py:197:stop] 0/4207, RunningAvgSamplesPerSec=10.950286988216595, CurrSamplesPerSec=10.80481782923333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10207/20000 [17:23:44<26:46:04,  9.84s/it][2022-12-22 07:23:10,104] [INFO] [timer.py:197:stop] 0/4208, RunningAvgSamplesPerSec=10.95029734770967, CurrSamplesPerSec=10.994033043599918, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10208/20000 [17:23:54<26:49:54,  9.86s/it][2022-12-22 07:23:19,335] [INFO] [timer.py:197:stop] 0/4209, RunningAvgSamplesPerSec=10.950255065176117, CurrSamplesPerSec=10.77525749624441, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10209/20000 [17:24:03<26:18:43,  9.67s/it][2022-12-22 07:23:28,764] [INFO] [logging.py:68:log_dist] [Rank 0] step=10210, skipped=22, lr=[5.032307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:23:28,765] [INFO] [timer.py:197:stop] 0/4210, RunningAvgSamplesPerSec=10.950217054785828, CurrSamplesPerSec=10.792609486391509, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10210/20000 [17:24:13<26:06:33,  9.60s/it][2022-12-22 07:23:38,803] [INFO] [timer.py:197:stop] 0/4211, RunningAvgSamplesPerSec=10.950223282182769, CurrSamplesPerSec=10.976491044607613, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10211/20000 [17:24:23<26:27:48,  9.73s/it][2022-12-22 07:23:51,732] [INFO] [timer.py:197:stop] 0/4212, RunningAvgSamplesPerSec=10.950243238182672, CurrSamplesPerSec=11.034887467030742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10212/20000 [17:24:36<29:04:06, 10.69s/it][2022-12-22 07:24:01,261] [INFO] [timer.py:197:stop] 0/4213, RunningAvgSamplesPerSec=10.950195941066518, CurrSamplesPerSec=10.754632104145896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10213/20000 [17:24:45<28:07:02, 10.34s/it][2022-12-22 07:24:11,861] [INFO] [timer.py:197:stop] 0/4214, RunningAvgSamplesPerSec=10.950066801708797, CurrSamplesPerSec=10.431995694688666, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10214/20000 [17:24:56<28:19:26, 10.42s/it][2022-12-22 07:24:21,362] [INFO] [timer.py:197:stop] 0/4215, RunningAvgSamplesPerSec=10.950133762643686, CurrSamplesPerSec=11.23963150099479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10215/20000 [17:25:05<27:34:21, 10.14s/it][2022-12-22 07:24:31,515] [INFO] [timer.py:197:stop] 0/4216, RunningAvgSamplesPerSec=10.950142769553274, CurrSamplesPerSec=10.98822086501325, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10216/20000 [17:25:15<27:34:37, 10.15s/it][2022-12-22 07:24:40,934] [INFO] [timer.py:197:stop] 0/4217, RunningAvgSamplesPerSec=10.950191218941386, CurrSamplesPerSec=11.158236860656478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10217/20000 [17:25:25<26:58:50,  9.93s/it][2022-12-22 07:24:50,510] [INFO] [timer.py:197:stop] 0/4218, RunningAvgSamplesPerSec=10.950156270061088, CurrSamplesPerSec=10.804802607558088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10218/20000 [17:25:34<26:41:25,  9.82s/it][2022-12-22 07:24:59,423] [INFO] [timer.py:197:stop] 0/4219, RunningAvgSamplesPerSec=10.950154429478859, CurrSamplesPerSec=10.942400031306457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10219/20000 [17:25:43<25:56:47,  9.55s/it][2022-12-22 07:25:09,895] [INFO] [logging.py:68:log_dist] [Rank 0] step=10220, skipped=22, lr=[5.027179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:25:09,896] [INFO] [timer.py:197:stop] 0/4220, RunningAvgSamplesPerSec=10.950086044838052, CurrSamplesPerSec=10.669109479936894, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10220/20000 [17:25:54<26:41:44,  9.83s/it][2022-12-22 07:25:19,184] [INFO] [timer.py:197:stop] 0/4221, RunningAvgSamplesPerSec=10.950135562325274, CurrSamplesPerSec=11.163062694898942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10221/20000 [17:26:03<26:15:16,  9.67s/it][2022-12-22 07:25:28,079] [INFO] [timer.py:197:stop] 0/4222, RunningAvgSamplesPerSec=10.950146122784654, CurrSamplesPerSec=10.99488277107848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10222/20000 [17:26:12<25:37:26,  9.43s/it][2022-12-22 07:25:37,674] [INFO] [timer.py:197:stop] 0/4223, RunningAvgSamplesPerSec=10.950072771868282, CurrSamplesPerSec=10.649043531578396, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10223/20000 [17:26:22<25:45:10,  9.48s/it][2022-12-22 07:25:48,018] [INFO] [timer.py:197:stop] 0/4224, RunningAvgSamplesPerSec=10.950122262589574, CurrSamplesPerSec=11.1630863703328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10224/20000 [17:26:32<26:27:05,  9.74s/it][2022-12-22 07:25:57,481] [INFO] [timer.py:197:stop] 0/4225, RunningAvgSamplesPerSec=10.950045786199844, CurrSamplesPerSec=10.636412737363448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10225/20000 [17:26:41<26:13:23,  9.66s/it]

                                                           
{'loss': 0.0464, 'learning_rate': 5.0246153846153856e-06, 'epoch': 0.51}


 51%|█████     | 10225/20000 [17:26:41<26:13:23,  9.66s/it][2022-12-22 07:26:07,405] [INFO] [timer.py:197:stop] 0/4226, RunningAvgSamplesPerSec=10.950052945383787, CurrSamplesPerSec=10.980369904507125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10226/20000 [17:26:51<26:26:11,  9.74s/it][2022-12-22 07:26:18,043] [INFO] [timer.py:197:stop] 0/4227, RunningAvgSamplesPerSec=10.950046382791347, CurrSamplesPerSec=10.922396006707027, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10227/20000 [17:27:02<27:10:03, 10.01s/it][2022-12-22 07:26:28,280] [INFO] [timer.py:197:stop] 0/4228, RunningAvgSamplesPerSec=10.950100937781125, CurrSamplesPerSec=11.185553107754194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10228/20000 [17:27:12<27:21:08, 10.08s/it][2022-12-22 07:26:37,273] [INFO] [timer.py:197:stop] 0/4229, RunningAvgSamplesPerSec=10.95010040693701, CurrSamplesPerSec=10.947857519322108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10229/20000 [17:27:21<26:28:00,  9.75s/it][2022-12-22 07:26:46,903] [INFO] [logging.py:68:log_dist] [Rank 0] step=10230, skipped=22, lr=[5.022051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:26:46,903] [INFO] [timer.py:197:stop] 0/4230, RunningAvgSamplesPerSec=10.950143476287504, CurrSamplesPerSec=11.135276317906154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10230/20000 [17:27:31<26:21:56,  9.72s/it][2022-12-22 07:26:57,135] [INFO] [timer.py:197:stop] 0/4231, RunningAvgSamplesPerSec=10.95015212005588, CurrSamplesPerSec=10.986820381068705, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10231/20000 [17:27:41<26:46:59,  9.87s/it][2022-12-22 07:27:06,256] [INFO] [timer.py:197:stop] 0/4232, RunningAvgSamplesPerSec=10.950166222718604, CurrSamplesPerSec=11.010133070481302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10232/20000 [17:27:50<26:10:15,  9.65s/it][2022-12-22 07:27:15,631] [INFO] [timer.py:197:stop] 0/4233, RunningAvgSamplesPerSec=10.950160100504693, CurrSamplesPerSec=10.924324251510981, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10233/20000 [17:28:00<25:56:52,  9.56s/it][2022-12-22 07:27:26,016] [INFO] [timer.py:197:stop] 0/4234, RunningAvgSamplesPerSec=10.950219219635565, CurrSamplesPerSec=11.206200969692608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10234/20000 [17:28:10<26:36:50,  9.81s/it][2022-12-22 07:27:34,965] [INFO] [timer.py:197:stop] 0/4235, RunningAvgSamplesPerSec=10.950273607095642, CurrSamplesPerSec=11.185384383674013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10235/20000 [17:28:19<25:54:34,  9.55s/it][2022-12-22 07:27:44,369] [INFO] [timer.py:197:stop] 0/4236, RunningAvgSamplesPerSec=10.95029294484023, CurrSamplesPerSec=11.032766275825141, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10236/20000 [17:28:28<25:47:12,  9.51s/it][2022-12-22 07:27:54,283] [INFO] [timer.py:197:stop] 0/4237, RunningAvgSamplesPerSec=10.950247515165517, CurrSamplesPerSec=10.761219474785552, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10237/20000 [17:28:38<26:06:53,  9.63s/it][2022-12-22 07:28:05,944] [INFO] [timer.py:197:stop] 0/4238, RunningAvgSamplesPerSec=10.950284854488904, CurrSamplesPerSec=11.110734474033745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10238/20000 [17:28:50<27:45:52, 10.24s/it][2022-12-22 07:28:15,058] [INFO] [timer.py:197:stop] 0/4239, RunningAvgSamplesPerSec=10.950252739026078, CurrSamplesPerSec=10.815881402682878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10239/20000 [17:28:59<26:50:49,  9.90s/it][2022-12-22 07:28:25,240] [INFO] [logging.py:68:log_dist] [Rank 0] step=10240, skipped=22, lr=[5.016923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:28:25,241] [INFO] [timer.py:197:stop] 0/4240, RunningAvgSamplesPerSec=10.950278376533095, CurrSamplesPerSec=11.059993114374395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10240/20000 [17:29:09<27:04:21,  9.99s/it][2022-12-22 07:28:34,990] [INFO] [timer.py:197:stop] 0/4241, RunningAvgSamplesPerSec=10.95034591086336, CurrSamplesPerSec=11.244239753332959, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10241/20000 [17:29:19<26:52:38,  9.91s/it][2022-12-22 07:28:44,651] [INFO] [timer.py:197:stop] 0/4242, RunningAvgSamplesPerSec=10.950446890940324, CurrSamplesPerSec=11.395919118680293, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10242/20000 [17:29:29<26:40:05,  9.84s/it][2022-12-22 07:28:54,119] [INFO] [timer.py:197:stop] 0/4243, RunningAvgSamplesPerSec=10.950442713949174, CurrSamplesPerSec=10.932760875530056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10243/20000 [17:29:38<26:21:52,  9.73s/it][2022-12-22 07:29:04,177] [INFO] [timer.py:197:stop] 0/4244, RunningAvgSamplesPerSec=10.95045106591771, CurrSamplesPerSec=10.985986736459667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10244/20000 [17:29:48<26:37:49,  9.83s/it][2022-12-22 07:29:13,296] [INFO] [timer.py:197:stop] 0/4245, RunningAvgSamplesPerSec=10.950401243018144, CurrSamplesPerSec=10.743055335995903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10245/20000 [17:29:57<26:03:07,  9.61s/it][2022-12-22 07:29:23,063] [INFO] [timer.py:197:stop] 0/4246, RunningAvgSamplesPerSec=10.950335556215965, CurrSamplesPerSec=10.678545708939303, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10246/20000 [17:30:07<26:10:25,  9.66s/it][2022-12-22 07:29:34,856] [INFO] [timer.py:197:stop] 0/4247, RunningAvgSamplesPerSec=10.950412454362628, CurrSamplesPerSec=11.28679580211882, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10247/20000 [17:30:19<27:54:16, 10.30s/it][2022-12-22 07:29:43,769] [INFO] [timer.py:197:stop] 0/4248, RunningAvgSamplesPerSec=10.950426658699216, CurrSamplesPerSec=11.011058006500424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10248/20000 [17:30:28<26:46:26,  9.88s/it][2022-12-22 07:29:53,413] [INFO] [timer.py:197:stop] 0/4249, RunningAvgSamplesPerSec=10.95048870373994, CurrSamplesPerSec=11.22042757641893, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████     | 10249/20000 [17:30:37<26:34:35,  9.81s/it][2022-12-22 07:30:03,291] [INFO] [logging.py:68:log_dist] [Rank 0] step=10250, skipped=22, lr=[5.0117948717948715e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:30:03,292] [INFO] [timer.py:197:stop] 0/4250, RunningAvgSamplesPerSec=10.950557985309544, CurrSamplesPerSec=11.252923204206327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10250/20000 [17:30:47<26:37:41,  9.83s/it]

                                                           
{'loss': 0.0445, 'learning_rate': 5.0117948717948715e-06, 'epoch': 0.51}


 51%|█████▏    | 10250/20000 [17:30:47<26:37:41,  9.83s/it][2022-12-22 07:30:12,698] [INFO] [timer.py:197:stop] 0/4251, RunningAvgSamplesPerSec=10.950534526072879, CurrSamplesPerSec=10.851778623849576, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10251/20000 [17:30:57<26:16:47,  9.70s/it][2022-12-22 07:30:22,072] [INFO] [timer.py:197:stop] 0/4252, RunningAvgSamplesPerSec=10.950501549011445, CurrSamplesPerSec=10.812152704465483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10252/20000 [17:31:06<26:00:31,  9.61s/it][2022-12-22 07:30:32,319] [INFO] [timer.py:197:stop] 0/4253, RunningAvgSamplesPerSec=10.95040723890867, CurrSamplesPerSec=10.563745614056835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10253/20000 [17:31:16<26:31:36,  9.80s/it][2022-12-22 07:30:41,144] [INFO] [timer.py:197:stop] 0/4254, RunningAvgSamplesPerSec=10.950455366401648, CurrSamplesPerSec=11.158941450648701, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10254/20000 [17:31:25<25:44:04,  9.51s/it][2022-12-22 07:30:51,174] [INFO] [timer.py:197:stop] 0/4255, RunningAvgSamplesPerSec=10.950419503996624, CurrSamplesPerSec=10.800027294227915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10255/20000 [17:31:35<26:09:27,  9.66s/it][2022-12-22 07:31:02,128] [INFO] [timer.py:197:stop] 0/4256, RunningAvgSamplesPerSec=10.950485841620957, CurrSamplesPerSec=11.240082837345744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10256/20000 [17:31:46<27:12:10, 10.05s/it][2022-12-22 07:31:11,395] [INFO] [timer.py:197:stop] 0/4257, RunningAvgSamplesPerSec=10.950502358295543, CurrSamplesPerSec=11.02121813373344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10257/20000 [17:31:55<26:33:52,  9.82s/it][2022-12-22 07:31:21,139] [INFO] [timer.py:197:stop] 0/4258, RunningAvgSamplesPerSec=10.950501895408234, CurrSamplesPerSec=10.94853266418519, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10258/20000 [17:32:05<26:30:13,  9.79s/it][2022-12-22 07:31:32,841] [INFO] [timer.py:197:stop] 0/4259, RunningAvgSamplesPerSec=10.950517484086534, CurrSamplesPerSec=11.017267408759196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10259/20000 [17:32:17<28:02:57, 10.37s/it][2022-12-22 07:31:45,365] [INFO] [logging.py:68:log_dist] [Rank 0] step=10260, skipped=22, lr=[5.006666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:31:45,366] [INFO] [timer.py:197:stop] 0/4260, RunningAvgSamplesPerSec=10.95046916744939, CurrSamplesPerSec=10.748578273850173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10260/20000 [17:32:29<29:47:55, 11.01s/it][2022-12-22 07:31:56,533] [INFO] [timer.py:197:stop] 0/4261, RunningAvgSamplesPerSec=10.950547051406947, CurrSamplesPerSec=11.2925362870998, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10261/20000 [17:32:40<29:55:11, 11.06s/it][2022-12-22 07:32:05,532] [INFO] [timer.py:197:stop] 0/4262, RunningAvgSamplesPerSec=10.95051182918629, CurrSamplesPerSec=10.802528101576067, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10262/20000 [17:32:49<28:14:39, 10.44s/it][2022-12-22 07:32:16,292] [INFO] [timer.py:197:stop] 0/4263, RunningAvgSamplesPerSec=10.950515251686571, CurrSamplesPerSec=10.965114545394684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10263/20000 [17:33:00<28:30:04, 10.54s/it][2022-12-22 07:32:25,556] [INFO] [timer.py:197:stop] 0/4264, RunningAvgSamplesPerSec=10.950562871866607, CurrSamplesPerSec=11.157304192730189, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10264/20000 [17:33:10<27:27:51, 10.16s/it][2022-12-22 07:32:34,134] [INFO] [timer.py:197:stop] 0/4265, RunningAvgSamplesPerSec=10.950688168237694, CurrSamplesPerSec=11.512084355106726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10265/20000 [17:33:18<26:10:53,  9.68s/it][2022-12-22 07:32:44,208] [INFO] [timer.py:197:stop] 0/4266, RunningAvgSamplesPerSec=10.950742641527942, CurrSamplesPerSec=11.187994583458542, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10266/20000 [17:33:28<26:29:49,  9.80s/it][2022-12-22 07:32:54,337] [INFO] [timer.py:197:stop] 0/4267, RunningAvgSamplesPerSec=10.950763314114829, CurrSamplesPerSec=11.039626696049142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10267/20000 [17:33:38<26:45:39,  9.90s/it][2022-12-22 07:33:03,494] [INFO] [timer.py:197:stop] 0/4268, RunningAvgSamplesPerSec=10.950813938089665, CurrSamplesPerSec=11.171068855590683, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10268/20000 [17:33:47<26:09:27,  9.68s/it][2022-12-22 07:33:13,590] [INFO] [timer.py:197:stop] 0/4269, RunningAvgSamplesPerSec=10.95089229080701, CurrSamplesPerSec=11.295671089266348, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10269/20000 [17:33:58<26:29:42,  9.80s/it][2022-12-22 07:33:24,707] [INFO] [logging.py:68:log_dist] [Rank 0] step=10270, skipped=22, lr=[5.001538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:33:24,708] [INFO] [timer.py:197:stop] 0/4270, RunningAvgSamplesPerSec=10.950875650862399, CurrSamplesPerSec=10.880330510833355, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10270/20000 [17:34:09<27:33:34, 10.20s/it][2022-12-22 07:33:34,094] [INFO] [timer.py:197:stop] 0/4271, RunningAvgSamplesPerSec=10.95092639743436, CurrSamplesPerSec=11.171883866043332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10271/20000 [17:34:18<26:53:58,  9.95s/it][2022-12-22 07:33:43,262] [INFO] [timer.py:197:stop] 0/4272, RunningAvgSamplesPerSec=10.950966457799097, CurrSamplesPerSec=11.124697898045499, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10272/20000 [17:34:27<26:15:35,  9.72s/it][2022-12-22 07:33:53,065] [INFO] [timer.py:197:stop] 0/4273, RunningAvgSamplesPerSec=10.950981417424781, CurrSamplesPerSec=11.015233894666746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10273/20000 [17:34:37<26:19:32,  9.74s/it][2022-12-22 07:34:02,518] [INFO] [timer.py:197:stop] 0/4274, RunningAvgSamplesPerSec=10.951051573632137, CurrSamplesPerSec=11.259119919877866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10274/20000 [17:34:46<26:05:17,  9.66s/it][2022-12-22 07:34:11,753] [INFO] [timer.py:197:stop] 0/4275, RunningAvgSamplesPerSec=10.951058375002964, CurrSamplesPerSec=10.980191144622903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10275/20000 [17:34:56<25:44:37,  9.53s/it]

                                                           
{'loss': 0.0588, 'learning_rate': 4.998974358974359e-06, 'epoch': 0.51}


 51%|█████▏    | 10275/20000 [17:34:56<25:44:37,  9.53s/it][2022-12-22 07:34:20,677] [INFO] [timer.py:197:stop] 0/4276, RunningAvgSamplesPerSec=10.951131084276597, CurrSamplesPerSec=11.270891631884702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10276/20000 [17:35:05<25:15:00,  9.35s/it][2022-12-22 07:34:30,579] [INFO] [timer.py:197:stop] 0/4277, RunningAvgSamplesPerSec=10.951092094261275, CurrSamplesPerSec=10.786947155079377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10277/20000 [17:35:15<25:41:47,  9.51s/it][2022-12-22 07:34:40,188] [INFO] [timer.py:197:stop] 0/4278, RunningAvgSamplesPerSec=10.951008266229822, CurrSamplesPerSec=10.604001660231432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10278/20000 [17:35:24<25:46:14,  9.54s/it][2022-12-22 07:34:49,105] [INFO] [timer.py:197:stop] 0/4279, RunningAvgSamplesPerSec=10.951083461309109, CurrSamplesPerSec=11.282346078416827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10279/20000 [17:35:33<25:15:41,  9.36s/it][2022-12-22 07:34:59,098] [INFO] [logging.py:68:log_dist] [Rank 0] step=10280, skipped=22, lr=[4.996410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:34:59,099] [INFO] [timer.py:197:stop] 0/4280, RunningAvgSamplesPerSec=10.951136065008116, CurrSamplesPerSec=11.180842399351764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10280/20000 [17:35:43<25:46:34,  9.55s/it][2022-12-22 07:35:07,965] [INFO] [timer.py:197:stop] 0/4281, RunningAvgSamplesPerSec=10.951186156232234, CurrSamplesPerSec=11.169754303272285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10281/20000 [17:35:52<25:13:19,  9.34s/it][2022-12-22 07:35:18,452] [INFO] [timer.py:197:stop] 0/4282, RunningAvgSamplesPerSec=10.951134812164, CurrSamplesPerSec=10.7357554861903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10282/20000 [17:36:02<26:08:47,  9.69s/it][2022-12-22 07:35:29,346] [INFO] [timer.py:197:stop] 0/4283, RunningAvgSamplesPerSec=10.951063693439497, CurrSamplesPerSec=10.65490918048453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10283/20000 [17:36:13<27:07:19, 10.05s/it][2022-12-22 07:35:38,401] [INFO] [timer.py:197:stop] 0/4284, RunningAvgSamplesPerSec=10.951110519426264, CurrSamplesPerSec=11.155311375343851, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10284/20000 [17:36:22<26:18:54,  9.75s/it][2022-12-22 07:35:49,181] [INFO] [timer.py:197:stop] 0/4285, RunningAvgSamplesPerSec=10.951090587333097, CurrSamplesPerSec=10.866401557171502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10285/20000 [17:36:33<27:08:44, 10.06s/it][2022-12-22 07:35:59,552] [INFO] [timer.py:197:stop] 0/4286, RunningAvgSamplesPerSec=10.951042654758103, CurrSamplesPerSec=10.749526076191179, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10286/20000 [17:36:44<27:23:45, 10.15s/it][2022-12-22 07:36:08,842] [INFO] [timer.py:197:stop] 0/4287, RunningAvgSamplesPerSec=10.95103224481195, CurrSamplesPerSec=10.906616951414067, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10287/20000 [17:36:53<26:41:42,  9.89s/it][2022-12-22 07:36:21,534] [INFO] [timer.py:197:stop] 0/4288, RunningAvgSamplesPerSec=10.951056204545058, CurrSamplesPerSec=11.054695518576086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10288/20000 [17:37:05<28:57:21, 10.73s/it][2022-12-22 07:36:32,563] [INFO] [timer.py:197:stop] 0/4289, RunningAvgSamplesPerSec=10.95110246455946, CurrSamplesPerSec=11.153029643986558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10289/20000 [17:37:17<29:11:31, 10.82s/it][2022-12-22 07:36:41,761] [INFO] [logging.py:68:log_dist] [Rank 0] step=10290, skipped=22, lr=[4.991282051282051e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:36:41,762] [INFO] [timer.py:197:stop] 0/4290, RunningAvgSamplesPerSec=10.951025007464958, CurrSamplesPerSec=10.628741063227073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10290/20000 [17:37:26<27:52:31, 10.33s/it][2022-12-22 07:36:52,207] [INFO] [timer.py:197:stop] 0/4291, RunningAvgSamplesPerSec=10.950914676900883, CurrSamplesPerSec=10.497413769505052, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10291/20000 [17:37:36<27:57:44, 10.37s/it][2022-12-22 07:37:01,528] [INFO] [timer.py:197:stop] 0/4292, RunningAvgSamplesPerSec=10.950914967642683, CurrSamplesPerSec=10.952162101270943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10292/20000 [17:37:45<27:06:44, 10.05s/it][2022-12-22 07:37:11,048] [INFO] [timer.py:197:stop] 0/4293, RunningAvgSamplesPerSec=10.950925454610145, CurrSamplesPerSec=10.996100177135082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10293/20000 [17:37:55<26:40:37,  9.89s/it][2022-12-22 07:37:21,556] [INFO] [timer.py:197:stop] 0/4294, RunningAvgSamplesPerSec=10.950905444997092, CurrSamplesPerSec=10.86571231305115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10294/20000 [17:38:06<27:10:18, 10.08s/it][2022-12-22 07:37:30,448] [INFO] [timer.py:197:stop] 0/4295, RunningAvgSamplesPerSec=10.950908575399787, CurrSamplesPerSec=10.96436077213378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10295/20000 [17:38:14<26:12:32,  9.72s/it][2022-12-22 07:37:39,678] [INFO] [timer.py:197:stop] 0/4296, RunningAvgSamplesPerSec=10.950919011363698, CurrSamplesPerSec=10.995904689404265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10296/20000 [17:38:24<25:48:31,  9.57s/it][2022-12-22 07:37:49,069] [INFO] [timer.py:197:stop] 0/4297, RunningAvgSamplesPerSec=10.950971652639538, CurrSamplesPerSec=11.181778541052285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10297/20000 [17:38:33<25:39:28,  9.52s/it][2022-12-22 07:37:59,129] [INFO] [timer.py:197:stop] 0/4298, RunningAvgSamplesPerSec=10.950977978119163, CurrSamplesPerSec=10.978213496576837, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10298/20000 [17:38:43<26:05:30,  9.68s/it][2022-12-22 07:38:12,352] [INFO] [timer.py:197:stop] 0/4299, RunningAvgSamplesPerSec=10.950935043598475, CurrSamplesPerSec=10.76954422119359, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 51%|█████▏    | 10299/20000 [17:38:56<28:57:08, 10.74s/it][2022-12-22 07:38:21,721] [INFO] [logging.py:68:log_dist] [Rank 0] step=10300, skipped=22, lr=[4.986153846153847e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:38:21,722] [INFO] [timer.py:197:stop] 0/4300, RunningAvgSamplesPerSec=10.950922195852275, CurrSamplesPerSec=10.895992411805668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10300/20000 [17:39:06<27:50:17, 10.33s/it]

                                                           
{'loss': 0.0514, 'learning_rate': 4.986153846153847e-06, 'epoch': 0.52}


 52%|█████▏    | 10300/20000 [17:39:06<27:50:17, 10.33s/it][2022-12-22 07:38:34,572] [INFO] [timer.py:197:stop] 0/4301, RunningAvgSamplesPerSec=10.950910460326279, CurrSamplesPerSec=10.900702478595477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10301/20000 [17:39:19<29:52:15, 11.09s/it][2022-12-22 07:38:43,975] [INFO] [timer.py:197:stop] 0/4302, RunningAvgSamplesPerSec=10.950863880860494, CurrSamplesPerSec=10.754215464217872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10302/20000 [17:39:28<28:30:23, 10.58s/it][2022-12-22 07:38:52,888] [INFO] [timer.py:197:stop] 0/4303, RunningAvgSamplesPerSec=10.950878924033693, CurrSamplesPerSec=11.015949020128618, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10303/20000 [17:39:37<27:09:19, 10.08s/it][2022-12-22 07:39:03,457] [INFO] [timer.py:197:stop] 0/4304, RunningAvgSamplesPerSec=10.950910092097601, CurrSamplesPerSec=11.08662566203276, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10304/20000 [17:39:47<27:32:48, 10.23s/it][2022-12-22 07:39:12,458] [INFO] [timer.py:197:stop] 0/4305, RunningAvgSamplesPerSec=10.9509577174276, CurrSamplesPerSec=11.159749125058614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10305/20000 [17:39:56<26:33:09,  9.86s/it][2022-12-22 07:39:21,614] [INFO] [timer.py:197:stop] 0/4306, RunningAvgSamplesPerSec=10.950953171935856, CurrSamplesPerSec=10.931428801104857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10306/20000 [17:40:06<25:58:53,  9.65s/it][2022-12-22 07:39:32,536] [INFO] [timer.py:197:stop] 0/4307, RunningAvgSamplesPerSec=10.950978654430573, CurrSamplesPerSec=11.061765122328445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10307/20000 [17:40:16<27:00:25, 10.03s/it][2022-12-22 07:39:42,252] [INFO] [timer.py:197:stop] 0/4308, RunningAvgSamplesPerSec=10.950921311775097, CurrSamplesPerSec=10.709504558937404, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10308/20000 [17:40:26<26:45:02,  9.94s/it][2022-12-22 07:39:54,389] [INFO] [timer.py:197:stop] 0/4309, RunningAvgSamplesPerSec=10.950985524723253, CurrSamplesPerSec=11.234650384434614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10309/20000 [17:40:38<28:31:30, 10.60s/it][2022-12-22 07:40:03,739] [INFO] [logging.py:68:log_dist] [Rank 0] step=10310, skipped=22, lr=[4.981025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:40:03,740] [INFO] [timer.py:197:stop] 0/4310, RunningAvgSamplesPerSec=10.95099490261843, CurrSamplesPerSec=10.991535056256819, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10310/20000 [17:40:48<27:30:57, 10.22s/it][2022-12-22 07:40:14,033] [INFO] [timer.py:197:stop] 0/4311, RunningAvgSamplesPerSec=10.95105313302794, CurrSamplesPerSec=11.20779224466435, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10311/20000 [17:40:58<27:34:13, 10.24s/it][2022-12-22 07:40:24,325] [INFO] [timer.py:197:stop] 0/4312, RunningAvgSamplesPerSec=10.951113091536323, CurrSamplesPerSec=11.215718382599515, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10312/20000 [17:41:08<27:36:20, 10.26s/it][2022-12-22 07:40:34,822] [INFO] [timer.py:197:stop] 0/4313, RunningAvgSamplesPerSec=10.951102501670638, CurrSamplesPerSec=10.905649664171483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10313/20000 [17:41:19<27:47:44, 10.33s/it][2022-12-22 07:40:44,427] [INFO] [timer.py:197:stop] 0/4314, RunningAvgSamplesPerSec=10.951110423354203, CurrSamplesPerSec=10.985367655099123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10314/20000 [17:41:28<27:12:29, 10.11s/it][2022-12-22 07:40:54,941] [INFO] [timer.py:197:stop] 0/4315, RunningAvgSamplesPerSec=10.951119243602779, CurrSamplesPerSec=10.989284733814008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10315/20000 [17:41:39<27:31:45, 10.23s/it][2022-12-22 07:41:03,959] [INFO] [timer.py:197:stop] 0/4316, RunningAvgSamplesPerSec=10.951088424610003, CurrSamplesPerSec=10.819760512614783, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10316/20000 [17:41:48<26:32:47,  9.87s/it][2022-12-22 07:41:13,414] [INFO] [timer.py:197:stop] 0/4317, RunningAvgSamplesPerSec=10.95112896348124, CurrSamplesPerSec=11.128852477896869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10317/20000 [17:41:57<26:12:33,  9.74s/it][2022-12-22 07:41:23,860] [INFO] [timer.py:197:stop] 0/4318, RunningAvgSamplesPerSec=10.951132552112533, CurrSamplesPerSec=10.966639427999427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10318/20000 [17:42:08<26:46:24,  9.96s/it][2022-12-22 07:41:33,329] [INFO] [timer.py:197:stop] 0/4319, RunningAvgSamplesPerSec=10.95116150339209, CurrSamplesPerSec=11.077557752506895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10319/20000 [17:42:17<26:22:42,  9.81s/it][2022-12-22 07:41:42,992] [INFO] [logging.py:68:log_dist] [Rank 0] step=10320, skipped=22, lr=[4.975897435897437e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:41:42,993] [INFO] [timer.py:197:stop] 0/4320, RunningAvgSamplesPerSec=10.951190136602467, CurrSamplesPerSec=11.076211185050047, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10320/20000 [17:42:27<26:15:30,  9.77s/it][2022-12-22 07:41:52,457] [INFO] [timer.py:197:stop] 0/4321, RunningAvgSamplesPerSec=10.95120835591607, CurrSamplesPerSec=11.03044872874844, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10321/20000 [17:42:36<26:00:43,  9.67s/it][2022-12-22 07:42:02,207] [INFO] [timer.py:197:stop] 0/4322, RunningAvgSamplesPerSec=10.95116335864356, CurrSamplesPerSec=10.76020965527503, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10322/20000 [17:42:46<26:04:13,  9.70s/it][2022-12-22 07:42:11,413] [INFO] [timer.py:197:stop] 0/4323, RunningAvgSamplesPerSec=10.951131597707358, CurrSamplesPerSec=10.815622545628223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10323/20000 [17:42:55<25:40:16,  9.55s/it][2022-12-22 07:42:20,871] [INFO] [timer.py:197:stop] 0/4324, RunningAvgSamplesPerSec=10.951110117353302, CurrSamplesPerSec=10.859073746268294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10324/20000 [17:43:05<25:35:40,  9.52s/it][2022-12-22 07:42:30,755] [INFO] [timer.py:197:stop] 0/4325, RunningAvgSamplesPerSec=10.951120319151952, CurrSamplesPerSec=10.995390779010245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10325/20000 [17:43:15<25:52:58,  9.63s/it]

                                                           
{'loss': 0.0558, 'learning_rate': 4.973333333333334e-06, 'epoch': 0.52}


 52%|█████▏    | 10325/20000 [17:43:15<25:52:58,  9.63s/it][2022-12-22 07:42:40,076] [INFO] [timer.py:197:stop] 0/4326, RunningAvgSamplesPerSec=10.951178391381651, CurrSamplesPerSec=11.20811607602742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10326/20000 [17:43:24<25:37:48,  9.54s/it][2022-12-22 07:42:49,042] [INFO] [timer.py:197:stop] 0/4327, RunningAvgSamplesPerSec=10.951162235212946, CurrSamplesPerSec=10.881745882528827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10327/20000 [17:43:33<25:10:02,  9.37s/it][2022-12-22 07:42:58,637] [INFO] [timer.py:197:stop] 0/4328, RunningAvgSamplesPerSec=10.951219457432726, CurrSamplesPerSec=11.204429155266324, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10328/20000 [17:43:43<25:20:53,  9.43s/it][2022-12-22 07:43:08,409] [INFO] [timer.py:197:stop] 0/4329, RunningAvgSamplesPerSec=10.951231182809295, CurrSamplesPerSec=11.002191253568938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10329/20000 [17:43:52<25:37:04,  9.54s/it][2022-12-22 07:43:18,068] [INFO] [logging.py:68:log_dist] [Rank 0] step=10330, skipped=22, lr=[4.970769230769232e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:43:18,068] [INFO] [timer.py:197:stop] 0/4330, RunningAvgSamplesPerSec=10.95118050027019, CurrSamplesPerSec=10.736183578888427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10330/20000 [17:44:02<25:42:51,  9.57s/it][2022-12-22 07:43:27,579] [INFO] [timer.py:197:stop] 0/4331, RunningAvgSamplesPerSec=10.95120977205091, CurrSamplesPerSec=11.079381122468774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10331/20000 [17:44:12<25:39:40,  9.55s/it][2022-12-22 07:43:38,043] [INFO] [timer.py:197:stop] 0/4332, RunningAvgSamplesPerSec=10.95117489760074, CurrSamplesPerSec=10.802256842289612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10332/20000 [17:44:22<26:23:30,  9.83s/it][2022-12-22 07:43:47,364] [INFO] [timer.py:197:stop] 0/4333, RunningAvgSamplesPerSec=10.951172974000386, CurrSamplesPerSec=10.942850116085287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10333/20000 [17:44:31<25:58:52,  9.68s/it][2022-12-22 07:43:57,573] [INFO] [timer.py:197:stop] 0/4334, RunningAvgSamplesPerSec=10.951146410258145, CurrSamplesPerSec=10.837295185925296, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10334/20000 [17:44:42<26:24:28,  9.84s/it][2022-12-22 07:44:09,837] [INFO] [timer.py:197:stop] 0/4335, RunningAvgSamplesPerSec=10.95118526279944, CurrSamplesPerSec=11.12212221506672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10335/20000 [17:44:54<28:21:40, 10.56s/it][2022-12-22 07:44:22,528] [INFO] [timer.py:197:stop] 0/4336, RunningAvgSamplesPerSec=10.95121003687641, CurrSamplesPerSec=11.059619005249452, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10336/20000 [17:45:06<30:04:17, 11.20s/it][2022-12-22 07:44:31,887] [INFO] [timer.py:197:stop] 0/4337, RunningAvgSamplesPerSec=10.951209294300611, CurrSamplesPerSec=10.947991916522392, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10337/20000 [17:45:16<28:35:03, 10.65s/it][2022-12-22 07:44:40,921] [INFO] [timer.py:197:stop] 0/4338, RunningAvgSamplesPerSec=10.951217531785355, CurrSamplesPerSec=10.987043876882776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10338/20000 [17:45:25<27:16:49, 10.16s/it][2022-12-22 07:44:50,699] [INFO] [timer.py:197:stop] 0/4339, RunningAvgSamplesPerSec=10.951263931884075, CurrSamplesPerSec=11.156220991007046, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10339/20000 [17:45:35<26:57:58, 10.05s/it][2022-12-22 07:45:00,380] [INFO] [logging.py:68:log_dist] [Rank 0] step=10340, skipped=22, lr=[4.965641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:45:00,381] [INFO] [timer.py:197:stop] 0/4340, RunningAvgSamplesPerSec=10.951257555324187, CurrSamplesPerSec=10.923672092540418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10340/20000 [17:45:44<26:40:06,  9.94s/it][2022-12-22 07:45:10,073] [INFO] [timer.py:197:stop] 0/4341, RunningAvgSamplesPerSec=10.951263338417268, CurrSamplesPerSec=10.976408010672698, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10341/20000 [17:45:54<26:28:03,  9.86s/it][2022-12-22 07:45:19,516] [INFO] [timer.py:197:stop] 0/4342, RunningAvgSamplesPerSec=10.951219005936931, CurrSamplesPerSec=10.762181589349831, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10342/20000 [17:46:03<26:07:31,  9.74s/it][2022-12-22 07:45:29,116] [INFO] [timer.py:197:stop] 0/4343, RunningAvgSamplesPerSec=10.951270518002596, CurrSamplesPerSec=11.179492954517968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10343/20000 [17:46:13<26:00:40,  9.70s/it][2022-12-22 07:45:38,500] [INFO] [timer.py:197:stop] 0/4344, RunningAvgSamplesPerSec=10.951179377163198, CurrSamplesPerSec=10.56933536796352, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10344/20000 [17:46:22<25:45:26,  9.60s/it][2022-12-22 07:45:47,989] [INFO] [timer.py:197:stop] 0/4345, RunningAvgSamplesPerSec=10.951235790708301, CurrSamplesPerSec=11.201788844625504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10345/20000 [17:46:32<25:39:46,  9.57s/it][2022-12-22 07:45:57,577] [INFO] [timer.py:197:stop] 0/4346, RunningAvgSamplesPerSec=10.951256042904053, CurrSamplesPerSec=11.039923628953911, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10346/20000 [17:46:42<25:40:32,  9.57s/it][2022-12-22 07:46:07,632] [INFO] [timer.py:197:stop] 0/4347, RunningAvgSamplesPerSec=10.951249415724657, CurrSamplesPerSec=10.922536445996961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10347/20000 [17:46:52<26:03:32,  9.72s/it][2022-12-22 07:46:19,066] [INFO] [timer.py:197:stop] 0/4348, RunningAvgSamplesPerSec=10.95118937606816, CurrSamplesPerSec=10.696388178513802, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10348/20000 [17:47:03<27:26:11, 10.23s/it][2022-12-22 07:46:28,647] [INFO] [timer.py:197:stop] 0/4349, RunningAvgSamplesPerSec=10.951216641260023, CurrSamplesPerSec=11.071007627634353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10349/20000 [17:47:13<26:54:32, 10.04s/it][2022-12-22 07:46:38,826] [INFO] [logging.py:68:log_dist] [Rank 0] step=10350, skipped=22, lr=[4.960512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:46:38,827] [INFO] [timer.py:197:stop] 0/4350, RunningAvgSamplesPerSec=10.951267431476753, CurrSamplesPerSec=11.176596334052652, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10350/20000 [17:47:23<27:01:15, 10.08s/it]

                                                           
{'loss': 0.073, 'learning_rate': 4.960512820512821e-06, 'epoch': 0.52}


 52%|█████▏    | 10350/20000 [17:47:23<27:01:15, 10.08s/it][2022-12-22 07:46:49,580] [INFO] [timer.py:197:stop] 0/4351, RunningAvgSamplesPerSec=10.95123361950965, CurrSamplesPerSec=10.806167074930709, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10351/20000 [17:47:34<27:33:34, 10.28s/it][2022-12-22 07:46:58,920] [INFO] [timer.py:197:stop] 0/4352, RunningAvgSamplesPerSec=10.951240710254693, CurrSamplesPerSec=10.982165461617758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10352/20000 [17:47:43<26:47:55, 10.00s/it][2022-12-22 07:47:07,832] [INFO] [timer.py:197:stop] 0/4353, RunningAvgSamplesPerSec=10.951302329022951, CurrSamplesPerSec=11.226070686215014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10353/20000 [17:47:52<25:55:16,  9.67s/it][2022-12-22 07:47:17,364] [INFO] [timer.py:197:stop] 0/4354, RunningAvgSamplesPerSec=10.951264388682057, CurrSamplesPerSec=10.788637945966753, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10354/20000 [17:48:01<25:48:19,  9.63s/it][2022-12-22 07:47:27,204] [INFO] [timer.py:197:stop] 0/4355, RunningAvgSamplesPerSec=10.951304143894522, CurrSamplesPerSec=11.12709673405229, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10355/20000 [17:48:11<25:58:14,  9.69s/it][2022-12-22 07:47:36,294] [INFO] [timer.py:197:stop] 0/4356, RunningAvgSamplesPerSec=10.951316789673854, CurrSamplesPerSec=11.006642024721737, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10356/20000 [17:48:20<25:28:59,  9.51s/it][2022-12-22 07:47:46,469] [INFO] [timer.py:197:stop] 0/4357, RunningAvgSamplesPerSec=10.951368509068372, CurrSamplesPerSec=11.181283437628904, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10357/20000 [17:48:30<26:00:44,  9.71s/it][2022-12-22 07:47:55,387] [INFO] [timer.py:197:stop] 0/4358, RunningAvgSamplesPerSec=10.951428284310207, CurrSamplesPerSec=11.218089596876199, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10358/20000 [17:48:39<25:22:21,  9.47s/it][2022-12-22 07:48:04,529] [INFO] [timer.py:197:stop] 0/4359, RunningAvgSamplesPerSec=10.951465546416845, CurrSamplesPerSec=11.116221725914155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10359/20000 [17:48:48<25:06:13,  9.37s/it][2022-12-22 07:48:13,869] [INFO] [logging.py:68:log_dist] [Rank 0] step=10360, skipped=22, lr=[4.9553846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:48:13,869] [INFO] [timer.py:197:stop] 0/4360, RunningAvgSamplesPerSec=10.951421655962243, CurrSamplesPerSec=10.763473595802832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10360/20000 [17:48:58<25:04:27,  9.36s/it][2022-12-22 07:48:23,410] [INFO] [timer.py:197:stop] 0/4361, RunningAvgSamplesPerSec=10.951412737452529, CurrSamplesPerSec=10.912683355310977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10361/20000 [17:49:07<25:12:50,  9.42s/it][2022-12-22 07:48:34,469] [INFO] [timer.py:197:stop] 0/4362, RunningAvgSamplesPerSec=10.951485553245732, CurrSamplesPerSec=11.278365649593852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10362/20000 [17:49:18<26:31:47,  9.91s/it][2022-12-22 07:48:43,865] [INFO] [timer.py:197:stop] 0/4363, RunningAvgSamplesPerSec=10.95151386018402, CurrSamplesPerSec=11.07633915430034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10363/20000 [17:49:28<26:06:52,  9.76s/it][2022-12-22 07:48:53,260] [INFO] [timer.py:197:stop] 0/4364, RunningAvgSamplesPerSec=10.951504401572247, CurrSamplesPerSec=10.910410213006157, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10364/20000 [17:49:37<25:49:21,  9.65s/it][2022-12-22 07:49:02,547] [INFO] [timer.py:197:stop] 0/4365, RunningAvgSamplesPerSec=10.951402816955168, CurrSamplesPerSec=10.525526343061507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10365/20000 [17:49:47<25:31:49,  9.54s/it][2022-12-22 07:49:11,591] [INFO] [timer.py:197:stop] 0/4366, RunningAvgSamplesPerSec=10.951358057375923, CurrSamplesPerSec=10.759494139696063, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10366/20000 [17:49:56<25:07:49,  9.39s/it][2022-12-22 07:49:21,465] [INFO] [timer.py:197:stop] 0/4367, RunningAvgSamplesPerSec=10.951287776188286, CurrSamplesPerSec=10.652938308624943, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10367/20000 [17:50:05<25:30:57,  9.54s/it][2022-12-22 07:49:31,287] [INFO] [timer.py:197:stop] 0/4368, RunningAvgSamplesPerSec=10.95120015604056, CurrSamplesPerSec=10.581647500212965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10368/20000 [17:50:15<25:44:36,  9.62s/it][2022-12-22 07:49:40,543] [INFO] [timer.py:197:stop] 0/4369, RunningAvgSamplesPerSec=10.951197233974554, CurrSamplesPerSec=10.938454342202649, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10369/20000 [17:50:25<25:26:50,  9.51s/it][2022-12-22 07:49:50,355] [INFO] [logging.py:68:log_dist] [Rank 0] step=10370, skipped=22, lr=[4.95025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:49:50,356] [INFO] [timer.py:197:stop] 0/4370, RunningAvgSamplesPerSec=10.951123653310544, CurrSamplesPerSec=10.638958509024045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10370/20000 [17:50:34<25:41:12,  9.60s/it][2022-12-22 07:50:00,030] [INFO] [timer.py:197:stop] 0/4371, RunningAvgSamplesPerSec=10.951135790699674, CurrSamplesPerSec=11.004409873406969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10371/20000 [17:50:44<25:44:26,  9.62s/it][2022-12-22 07:50:08,909] [INFO] [timer.py:197:stop] 0/4372, RunningAvgSamplesPerSec=10.951193456924038, CurrSamplesPerSec=11.209071300362389, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10372/20000 [17:50:53<25:08:25,  9.40s/it][2022-12-22 07:50:18,123] [INFO] [timer.py:197:stop] 0/4373, RunningAvgSamplesPerSec=10.951246000819577, CurrSamplesPerSec=11.185781499285959, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10373/20000 [17:51:02<24:59:19,  9.34s/it][2022-12-22 07:50:27,334] [INFO] [timer.py:197:stop] 0/4374, RunningAvgSamplesPerSec=10.951194471947785, CurrSamplesPerSec=10.730501787767677, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10374/20000 [17:51:11<24:52:41,  9.30s/it][2022-12-22 07:50:36,371] [INFO] [timer.py:197:stop] 0/4375, RunningAvgSamplesPerSec=10.951193662762147, CurrSamplesPerSec=10.947657045909649, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10375/20000 [17:51:20<24:39:41,  9.22s/it]

                                                           
{'loss': 0.0533, 'learning_rate': 4.947692307692308e-06, 'epoch': 0.52}


 52%|█████▏    | 10375/20000 [17:51:20<24:39:41,  9.22s/it][2022-12-22 07:50:45,727] [INFO] [timer.py:197:stop] 0/4376, RunningAvgSamplesPerSec=10.951200713469838, CurrSamplesPerSec=10.982120531835903, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10376/20000 [17:51:30<24:45:54,  9.26s/it][2022-12-22 07:50:55,692] [INFO] [timer.py:197:stop] 0/4377, RunningAvgSamplesPerSec=10.951194905843714, CurrSamplesPerSec=10.925851150382087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10377/20000 [17:51:40<25:19:28,  9.47s/it][2022-12-22 07:51:05,108] [INFO] [timer.py:197:stop] 0/4378, RunningAvgSamplesPerSec=10.951210049425782, CurrSamplesPerSec=11.017866575087616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10378/20000 [17:51:49<25:16:31,  9.46s/it][2022-12-22 07:51:14,522] [INFO] [timer.py:197:stop] 0/4379, RunningAvgSamplesPerSec=10.951200221485205, CurrSamplesPerSec=10.908361426578077, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10379/20000 [17:51:58<25:14:18,  9.44s/it][2022-12-22 07:51:23,471] [INFO] [logging.py:68:log_dist] [Rank 0] step=10380, skipped=22, lr=[4.945128205128206e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:51:23,472] [INFO] [timer.py:197:stop] 0/4380, RunningAvgSamplesPerSec=10.951195104637154, CurrSamplesPerSec=10.928844380946456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10380/20000 [17:52:07<24:50:25,  9.30s/it][2022-12-22 07:51:32,923] [INFO] [timer.py:197:stop] 0/4381, RunningAvgSamplesPerSec=10.95115865499167, CurrSamplesPerSec=10.793874521296187, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10381/20000 [17:52:17<24:57:44,  9.34s/it][2022-12-22 07:51:42,161] [INFO] [timer.py:197:stop] 0/4382, RunningAvgSamplesPerSec=10.951132485554997, CurrSamplesPerSec=10.837723538897201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10382/20000 [17:52:26<24:52:34,  9.31s/it][2022-12-22 07:51:50,970] [INFO] [timer.py:197:stop] 0/4383, RunningAvgSamplesPerSec=10.951186441003442, CurrSamplesPerSec=11.192724855866835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10383/20000 [17:52:35<24:28:14,  9.16s/it][2022-12-22 07:52:00,391] [INFO] [timer.py:197:stop] 0/4384, RunningAvgSamplesPerSec=10.951184812432063, CurrSamplesPerSec=10.944054687605428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10384/20000 [17:52:44<24:40:36,  9.24s/it][2022-12-22 07:52:09,558] [INFO] [timer.py:197:stop] 0/4385, RunningAvgSamplesPerSec=10.951210176276387, CurrSamplesPerSec=11.063494380021474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10385/20000 [17:52:54<24:37:03,  9.22s/it][2022-12-22 07:52:18,924] [INFO] [timer.py:197:stop] 0/4386, RunningAvgSamplesPerSec=10.951178690928769, CurrSamplesPerSec=10.814896156062028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10386/20000 [17:53:03<24:44:01,  9.26s/it][2022-12-22 07:52:28,399] [INFO] [timer.py:197:stop] 0/4387, RunningAvgSamplesPerSec=10.951161227987614, CurrSamplesPerSec=10.875135298347923, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10387/20000 [17:53:12<24:54:08,  9.33s/it][2022-12-22 07:52:37,778] [INFO] [timer.py:197:stop] 0/4388, RunningAvgSamplesPerSec=10.951084725747126, CurrSamplesPerSec=10.625595324848916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10388/20000 [17:53:22<24:56:32,  9.34s/it][2022-12-22 07:52:47,934] [INFO] [timer.py:197:stop] 0/4389, RunningAvgSamplesPerSec=10.951054444547307, CurrSamplesPerSec=10.819832907254558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10389/20000 [17:53:32<25:35:32,  9.59s/it][2022-12-22 07:52:57,424] [INFO] [logging.py:68:log_dist] [Rank 0] step=10390, skipped=22, lr=[4.94e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:52:57,424] [INFO] [timer.py:197:stop] 0/4390, RunningAvgSamplesPerSec=10.951017507147776, CurrSamplesPerSec=10.791336505368886, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10390/20000 [17:53:41<25:30:45,  9.56s/it][2022-12-22 07:53:06,474] [INFO] [timer.py:197:stop] 0/4391, RunningAvgSamplesPerSec=10.951011038294284, CurrSamplesPerSec=10.922699111207484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10391/20000 [17:53:50<25:06:13,  9.41s/it][2022-12-22 07:53:16,032] [INFO] [timer.py:197:stop] 0/4392, RunningAvgSamplesPerSec=10.951053353320805, CurrSamplesPerSec=11.139978750516775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10392/20000 [17:54:00<25:13:23,  9.45s/it][2022-12-22 07:53:25,079] [INFO] [timer.py:197:stop] 0/4393, RunningAvgSamplesPerSec=10.951067419285001, CurrSamplesPerSec=11.013167243010567, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10393/20000 [17:54:09<24:53:50,  9.33s/it][2022-12-22 07:53:34,124] [INFO] [timer.py:197:stop] 0/4394, RunningAvgSamplesPerSec=10.95103448507165, CurrSamplesPerSec=10.808305593062661, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10394/20000 [17:54:18<24:40:01,  9.24s/it][2022-12-22 07:53:43,589] [INFO] [timer.py:197:stop] 0/4395, RunningAvgSamplesPerSec=10.951090959752802, CurrSamplesPerSec=11.20487720112423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10395/20000 [17:54:28<24:50:28,  9.31s/it][2022-12-22 07:53:53,076] [INFO] [timer.py:197:stop] 0/4396, RunningAvgSamplesPerSec=10.951137961667744, CurrSamplesPerSec=11.161586196188946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10396/20000 [17:54:37<24:58:45,  9.36s/it][2022-12-22 07:54:03,037] [INFO] [timer.py:197:stop] 0/4397, RunningAvgSamplesPerSec=10.951191128130507, CurrSamplesPerSec=11.18989787398763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10397/20000 [17:54:47<25:27:18,  9.54s/it][2022-12-22 07:54:12,370] [INFO] [timer.py:197:stop] 0/4398, RunningAvgSamplesPerSec=10.951129813432608, CurrSamplesPerSec=10.688125034864207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10398/20000 [17:54:56<25:17:04,  9.48s/it][2022-12-22 07:54:21,803] [INFO] [timer.py:197:stop] 0/4399, RunningAvgSamplesPerSec=10.951050196310156, CurrSamplesPerSec=10.611895225092093, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10399/20000 [17:55:06<25:14:41,  9.47s/it][2022-12-22 07:54:31,759] [INFO] [logging.py:68:log_dist] [Rank 0] step=10400, skipped=22, lr=[4.934871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:54:31,760] [INFO] [timer.py:197:stop] 0/4400, RunningAvgSamplesPerSec=10.951070400746532, CurrSamplesPerSec=11.040636060642267, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10400/20000 [17:55:16<25:38:04,  9.61s/it]

                                                           
{'loss': 0.0507, 'learning_rate': 4.934871794871795e-06, 'epoch': 0.52}


 52%|█████▏    | 10400/20000 [17:55:16<25:38:04,  9.61s/it][2022-12-22 07:54:40,772] [INFO] [timer.py:197:stop] 0/4401, RunningAvgSamplesPerSec=10.951037659207948, CurrSamplesPerSec=10.80890966559742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10401/20000 [17:55:25<25:09:06,  9.43s/it][2022-12-22 07:54:49,957] [INFO] [timer.py:197:stop] 0/4402, RunningAvgSamplesPerSec=10.951092081566241, CurrSamplesPerSec=11.19584790672805, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10402/20000 [17:55:34<24:57:03,  9.36s/it][2022-12-22 07:54:59,443] [INFO] [timer.py:197:stop] 0/4403, RunningAvgSamplesPerSec=10.951138992843584, CurrSamplesPerSec=11.161514725182757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10403/20000 [17:55:43<25:02:59,  9.40s/it][2022-12-22 07:55:08,935] [INFO] [timer.py:197:stop] 0/4404, RunningAvgSamplesPerSec=10.951179585930124, CurrSamplesPerSec=11.132793154518561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10404/20000 [17:55:53<25:07:26,  9.43s/it][2022-12-22 07:55:18,148] [INFO] [timer.py:197:stop] 0/4405, RunningAvgSamplesPerSec=10.951193094912721, CurrSamplesPerSec=11.010984385295156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10405/20000 [17:56:02<24:57:04,  9.36s/it][2022-12-22 07:55:27,448] [INFO] [timer.py:197:stop] 0/4406, RunningAvgSamplesPerSec=10.951144963045138, CurrSamplesPerSec=10.743244516366115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10406/20000 [17:56:11<24:54:00,  9.34s/it][2022-12-22 07:55:36,896] [INFO] [timer.py:197:stop] 0/4407, RunningAvgSamplesPerSec=10.951142144771115, CurrSamplesPerSec=10.93874452024578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10407/20000 [17:56:21<24:58:50,  9.37s/it][2022-12-22 07:55:49,274] [INFO] [timer.py:197:stop] 0/4408, RunningAvgSamplesPerSec=10.951100717659472, CurrSamplesPerSec=10.771606024930406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10408/20000 [17:56:33<27:22:43, 10.28s/it][2022-12-22 07:55:59,351] [INFO] [timer.py:197:stop] 0/4409, RunningAvgSamplesPerSec=10.951102367797702, CurrSamplesPerSec=10.958377708084516, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10409/20000 [17:56:43<27:13:00, 10.22s/it][2022-12-22 07:56:09,699] [INFO] [logging.py:68:log_dist] [Rank 0] step=10410, skipped=22, lr=[4.92974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:56:09,699] [INFO] [timer.py:197:stop] 0/4410, RunningAvgSamplesPerSec=10.951018442620084, CurrSamplesPerSec=10.593246276821711, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10410/20000 [17:56:54<27:19:11, 10.26s/it][2022-12-22 07:56:19,047] [INFO] [timer.py:197:stop] 0/4411, RunningAvgSamplesPerSec=10.950999514870345, CurrSamplesPerSec=10.868196993332287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10411/20000 [17:57:03<26:35:28,  9.98s/it][2022-12-22 07:56:27,931] [INFO] [timer.py:197:stop] 0/4412, RunningAvgSamplesPerSec=10.951017830972983, CurrSamplesPerSec=11.032373602507421, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10412/20000 [17:57:12<25:42:38,  9.65s/it][2022-12-22 07:56:37,160] [INFO] [timer.py:197:stop] 0/4413, RunningAvgSamplesPerSec=10.951017686851507, CurrSamplesPerSec=10.950382148045765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10413/20000 [17:57:21<25:22:06,  9.53s/it][2022-12-22 07:56:46,456] [INFO] [timer.py:197:stop] 0/4414, RunningAvgSamplesPerSec=10.951014255524688, CurrSamplesPerSec=10.935899567926066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10414/20000 [17:57:30<25:10:56,  9.46s/it][2022-12-22 07:56:55,222] [INFO] [timer.py:197:stop] 0/4415, RunningAvgSamplesPerSec=10.951093228258928, CurrSamplesPerSec=11.31097373904252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10415/20000 [17:57:39<24:37:40,  9.25s/it][2022-12-22 07:57:04,669] [INFO] [timer.py:197:stop] 0/4416, RunningAvgSamplesPerSec=10.951142724728786, CurrSamplesPerSec=11.174017031797993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10416/20000 [17:57:49<24:46:57,  9.31s/it][2022-12-22 07:57:13,656] [INFO] [timer.py:197:stop] 0/4417, RunningAvgSamplesPerSec=10.951140158737973, CurrSamplesPerSec=10.939825580104015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10417/20000 [17:57:58<24:31:20,  9.21s/it][2022-12-22 07:57:23,376] [INFO] [timer.py:197:stop] 0/4418, RunningAvgSamplesPerSec=10.951146921643542, CurrSamplesPerSec=10.9810867990981, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10418/20000 [17:58:07<24:55:31,  9.36s/it][2022-12-22 07:57:32,567] [INFO] [timer.py:197:stop] 0/4419, RunningAvgSamplesPerSec=10.951117504917715, CurrSamplesPerSec=10.822736469042212, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10419/20000 [17:58:17<24:47:04,  9.31s/it][2022-12-22 07:57:41,725] [INFO] [logging.py:68:log_dist] [Rank 0] step=10420, skipped=22, lr=[4.924615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:57:41,726] [INFO] [timer.py:197:stop] 0/4420, RunningAvgSamplesPerSec=10.951112431555618, CurrSamplesPerSec=10.92874916304737, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10420/20000 [17:58:26<24:39:32,  9.27s/it][2022-12-22 07:57:51,664] [INFO] [timer.py:197:stop] 0/4421, RunningAvgSamplesPerSec=10.951127288702553, CurrSamplesPerSec=11.017162052662878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10421/20000 [17:58:36<25:11:32,  9.47s/it][2022-12-22 07:58:01,554] [INFO] [timer.py:197:stop] 0/4422, RunningAvgSamplesPerSec=10.951094878426899, CurrSamplesPerSec=10.809723181192213, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10422/20000 [17:58:46<25:31:36,  9.59s/it][2022-12-22 07:58:10,784] [INFO] [timer.py:197:stop] 0/4423, RunningAvgSamplesPerSec=10.951155169716593, CurrSamplesPerSec=11.224290706189349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10423/20000 [17:58:55<25:13:59,  9.49s/it][2022-12-22 07:58:19,802] [INFO] [timer.py:197:stop] 0/4424, RunningAvgSamplesPerSec=10.951157860478013, CurrSamplesPerSec=10.96306665574861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10424/20000 [17:59:04<24:51:28,  9.35s/it][2022-12-22 07:58:29,249] [INFO] [timer.py:197:stop] 0/4425, RunningAvgSamplesPerSec=10.95109980984007, CurrSamplesPerSec=10.700280562246999, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10425/20000 [17:59:13<24:56:11,  9.38s/it]

                                                           
{'loss': 0.0435, 'learning_rate': 4.922051282051282e-06, 'epoch': 0.52}


 52%|█████▏    | 10425/20000 [17:59:13<24:56:11,  9.38s/it][2022-12-22 07:58:39,469] [INFO] [timer.py:197:stop] 0/4426, RunningAvgSamplesPerSec=10.951158422489149, CurrSamplesPerSec=11.216689432758686, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10426/20000 [17:59:23<25:36:28,  9.63s/it][2022-12-22 07:58:48,674] [INFO] [timer.py:197:stop] 0/4427, RunningAvgSamplesPerSec=10.951214733821878, CurrSamplesPerSec=11.206136411179491, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10427/20000 [17:59:33<25:15:58,  9.50s/it][2022-12-22 07:58:57,811] [INFO] [timer.py:197:stop] 0/4428, RunningAvgSamplesPerSec=10.951189400314085, CurrSamplesPerSec=10.840224763613154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10428/20000 [17:59:42<24:58:22,  9.39s/it][2022-12-22 07:59:07,481] [INFO] [timer.py:197:stop] 0/4429, RunningAvgSamplesPerSec=10.951083810732834, CurrSamplesPerSec=10.50287599545525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10429/20000 [17:59:51<25:11:32,  9.48s/it][2022-12-22 07:59:16,909] [INFO] [logging.py:68:log_dist] [Rank 0] step=10430, skipped=22, lr=[4.91948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 07:59:16,910] [INFO] [timer.py:197:stop] 0/4430, RunningAvgSamplesPerSec=10.95109624751964, CurrSamplesPerSec=11.0064321720621, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10430/20000 [18:00:01<25:09:08,  9.46s/it][2022-12-22 07:59:27,458] [INFO] [timer.py:197:stop] 0/4431, RunningAvgSamplesPerSec=10.951016583158069, CurrSamplesPerSec=10.609273493551726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10431/20000 [18:00:11<26:00:57,  9.79s/it][2022-12-22 07:59:36,948] [INFO] [timer.py:197:stop] 0/4432, RunningAvgSamplesPerSec=10.951020912021884, CurrSamplesPerSec=10.970227082722282, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10432/20000 [18:00:21<25:46:32,  9.70s/it][2022-12-22 07:59:47,926] [INFO] [timer.py:197:stop] 0/4433, RunningAvgSamplesPerSec=10.951039628083253, CurrSamplesPerSec=11.034584454578972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10433/20000 [18:00:32<26:47:35, 10.08s/it][2022-12-22 07:59:59,046] [INFO] [timer.py:197:stop] 0/4434, RunningAvgSamplesPerSec=10.9510152209661, CurrSamplesPerSec=10.843925103582364, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10434/20000 [18:00:43<27:37:05, 10.39s/it][2022-12-22 08:00:10,767] [INFO] [timer.py:197:stop] 0/4435, RunningAvgSamplesPerSec=10.951009755595713, CurrSamplesPerSec=10.926840705588544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10435/20000 [18:00:55<28:40:22, 10.79s/it][2022-12-22 08:00:21,020] [INFO] [timer.py:197:stop] 0/4436, RunningAvgSamplesPerSec=10.950972288851798, CurrSamplesPerSec=10.78736416759051, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10436/20000 [18:01:05<28:14:26, 10.63s/it][2022-12-22 08:00:30,381] [INFO] [timer.py:197:stop] 0/4437, RunningAvgSamplesPerSec=10.950923619502943, CurrSamplesPerSec=10.739295039201052, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10437/20000 [18:01:14<27:13:35, 10.25s/it][2022-12-22 08:00:39,691] [INFO] [timer.py:197:stop] 0/4438, RunningAvgSamplesPerSec=10.950941772497012, CurrSamplesPerSec=11.032046698354268, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10438/20000 [18:01:24<26:28:31,  9.97s/it][2022-12-22 08:00:48,461] [INFO] [timer.py:197:stop] 0/4439, RunningAvgSamplesPerSec=10.95101631407433, CurrSamplesPerSec=11.291980501106734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10439/20000 [18:01:32<25:31:04,  9.61s/it][2022-12-22 08:00:58,029] [INFO] [logging.py:68:log_dist] [Rank 0] step=10440, skipped=22, lr=[4.914358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:00:58,030] [INFO] [timer.py:197:stop] 0/4440, RunningAvgSamplesPerSec=10.951069428435687, CurrSamplesPerSec=11.191922200564942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10440/20000 [18:01:42<25:29:01,  9.60s/it][2022-12-22 08:01:07,202] [INFO] [timer.py:197:stop] 0/4441, RunningAvgSamplesPerSec=10.95107344670397, CurrSamplesPerSec=10.96893561521349, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10441/20000 [18:01:51<25:08:35,  9.47s/it][2022-12-22 08:01:18,400] [INFO] [timer.py:197:stop] 0/4442, RunningAvgSamplesPerSec=10.951029578299769, CurrSamplesPerSec=10.759700719413848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10442/20000 [18:02:02<26:31:04,  9.99s/it][2022-12-22 08:01:29,149] [INFO] [timer.py:197:stop] 0/4443, RunningAvgSamplesPerSec=10.951018307890546, CurrSamplesPerSec=10.901205362181054, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10443/20000 [18:02:13<27:07:15, 10.22s/it][2022-12-22 08:01:38,701] [INFO] [timer.py:197:stop] 0/4444, RunningAvgSamplesPerSec=10.950984768599099, CurrSamplesPerSec=10.804035925516736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10444/20000 [18:02:23<26:35:22, 10.02s/it][2022-12-22 08:01:47,670] [INFO] [timer.py:197:stop] 0/4445, RunningAvgSamplesPerSec=10.950963508257635, CurrSamplesPerSec=10.85733270247242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10445/20000 [18:02:32<25:45:07,  9.70s/it][2022-12-22 08:01:57,188] [INFO] [timer.py:197:stop] 0/4446, RunningAvgSamplesPerSec=10.95093228495112, CurrSamplesPerSec=10.813942890586377, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10446/20000 [18:02:41<25:36:08,  9.65s/it][2022-12-22 08:02:06,583] [INFO] [timer.py:197:stop] 0/4447, RunningAvgSamplesPerSec=10.950913465349048, CurrSamplesPerSec=10.867913186073936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10447/20000 [18:02:51<25:23:57,  9.57s/it][2022-12-22 08:02:15,485] [INFO] [timer.py:197:stop] 0/4448, RunningAvgSamplesPerSec=10.95091667402808, CurrSamplesPerSec=10.965197856464421, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10448/20000 [18:02:59<24:51:48,  9.37s/it][2022-12-22 08:02:24,464] [INFO] [timer.py:197:stop] 0/4449, RunningAvgSamplesPerSec=10.950890063945304, CurrSamplesPerSec=10.833846406681163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10449/20000 [18:03:08<24:32:56,  9.25s/it][2022-12-22 08:02:34,569] [INFO] [logging.py:68:log_dist] [Rank 0] step=10450, skipped=22, lr=[4.9092307692307695e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:02:34,570] [INFO] [timer.py:197:stop] 0/4450, RunningAvgSamplesPerSec=10.950851588737152, CurrSamplesPerSec=10.782385098816103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10450/20000 [18:03:19<25:13:31,  9.51s/it]

                                                           
{'loss': 0.0445, 'learning_rate': 4.9092307692307695e-06, 'epoch': 0.52}


 52%|█████▏    | 10450/20000 [18:03:19<25:13:31,  9.51s/it][2022-12-22 08:02:43,504] [INFO] [timer.py:197:stop] 0/4451, RunningAvgSamplesPerSec=10.950828946184178, CurrSamplesPerSec=10.851032894821945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10451/20000 [18:03:27<24:45:54,  9.34s/it][2022-12-22 08:02:52,720] [INFO] [timer.py:197:stop] 0/4452, RunningAvgSamplesPerSec=10.950828111417051, CurrSamplesPerSec=10.947115491862053, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10452/20000 [18:03:37<24:39:59,  9.30s/it][2022-12-22 08:03:01,932] [INFO] [timer.py:197:stop] 0/4453, RunningAvgSamplesPerSec=10.950848365340013, CurrSamplesPerSec=11.04172645440723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10453/20000 [18:03:46<24:35:37,  9.27s/it][2022-12-22 08:03:12,267] [INFO] [timer.py:197:stop] 0/4454, RunningAvgSamplesPerSec=10.950814526367475, CurrSamplesPerSec=10.802241193131037, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10454/20000 [18:03:56<25:26:05,  9.59s/it][2022-12-22 08:03:21,474] [INFO] [timer.py:197:stop] 0/4455, RunningAvgSamplesPerSec=10.950812082511646, CurrSamplesPerSec=10.939942837790309, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10455/20000 [18:04:05<25:07:33,  9.48s/it][2022-12-22 08:03:31,068] [INFO] [timer.py:197:stop] 0/4456, RunningAvgSamplesPerSec=10.95078746861152, CurrSamplesPerSec=10.842268177565787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10456/20000 [18:04:15<25:13:00,  9.51s/it][2022-12-22 08:03:40,150] [INFO] [timer.py:197:stop] 0/4457, RunningAvgSamplesPerSec=10.95079860469739, CurrSamplesPerSec=11.000624461157393, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10457/20000 [18:04:24<24:52:20,  9.38s/it][2022-12-22 08:03:49,415] [INFO] [timer.py:197:stop] 0/4458, RunningAvgSamplesPerSec=10.950797578059605, CurrSamplesPerSec=10.94622581658294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10458/20000 [18:04:33<24:46:34,  9.35s/it][2022-12-22 08:03:58,660] [INFO] [timer.py:197:stop] 0/4459, RunningAvgSamplesPerSec=10.950806667263763, CurrSamplesPerSec=10.99145854546114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10459/20000 [18:04:43<24:41:32,  9.32s/it][2022-12-22 08:04:08,381] [INFO] [logging.py:68:log_dist] [Rank 0] step=10460, skipped=22, lr=[4.9041025641025644e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:04:08,382] [INFO] [timer.py:197:stop] 0/4460, RunningAvgSamplesPerSec=10.950733740989717, CurrSamplesPerSec=10.635072681556311, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10460/20000 [18:04:52<25:00:41,  9.44s/it][2022-12-22 08:04:18,284] [INFO] [timer.py:197:stop] 0/4461, RunningAvgSamplesPerSec=10.950779405667678, CurrSamplesPerSec=11.158209495230038, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10461/20000 [18:05:02<25:22:37,  9.58s/it][2022-12-22 08:04:27,603] [INFO] [timer.py:197:stop] 0/4462, RunningAvgSamplesPerSec=10.950781828627917, CurrSamplesPerSec=10.961596480403895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10462/20000 [18:05:12<25:10:10,  9.50s/it][2022-12-22 08:04:36,705] [INFO] [timer.py:197:stop] 0/4463, RunningAvgSamplesPerSec=10.950853901042393, CurrSamplesPerSec=11.282019840198942, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10463/20000 [18:05:21<24:51:03,  9.38s/it][2022-12-22 08:04:46,341] [INFO] [timer.py:197:stop] 0/4464, RunningAvgSamplesPerSec=10.950826769532801, CurrSamplesPerSec=10.831116495826757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10464/20000 [18:05:30<25:03:04,  9.46s/it][2022-12-22 08:04:55,484] [INFO] [timer.py:197:stop] 0/4465, RunningAvgSamplesPerSec=10.950829258449547, CurrSamplesPerSec=10.961946081372796, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10465/20000 [18:05:39<24:47:55,  9.36s/it][2022-12-22 08:05:06,054] [INFO] [timer.py:197:stop] 0/4466, RunningAvgSamplesPerSec=10.950747655696702, CurrSamplesPerSec=10.598279365250077, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10466/20000 [18:05:50<25:45:18,  9.73s/it][2022-12-22 08:05:15,040] [INFO] [timer.py:197:stop] 0/4467, RunningAvgSamplesPerSec=10.950719023341614, CurrSamplesPerSec=10.824379137111729, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10467/20000 [18:05:59<25:09:56,  9.50s/it][2022-12-22 08:05:24,442] [INFO] [timer.py:197:stop] 0/4468, RunningAvgSamplesPerSec=10.95076131762803, CurrSamplesPerSec=11.142919788299205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10468/20000 [18:06:08<25:04:54,  9.47s/it][2022-12-22 08:05:33,783] [INFO] [timer.py:197:stop] 0/4469, RunningAvgSamplesPerSec=10.950733381210874, CurrSamplesPerSec=10.827375104029304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10469/20000 [18:06:18<24:58:30,  9.43s/it][2022-12-22 08:05:42,954] [INFO] [logging.py:68:log_dist] [Rank 0] step=10470, skipped=22, lr=[4.898974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:05:42,955] [INFO] [timer.py:197:stop] 0/4470, RunningAvgSamplesPerSec=10.950779932340634, CurrSamplesPerSec=11.162749817225798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10470/20000 [18:06:27<24:45:50,  9.35s/it][2022-12-22 08:05:51,869] [INFO] [timer.py:197:stop] 0/4471, RunningAvgSamplesPerSec=10.950842148604268, CurrSamplesPerSec=11.236066324050975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10471/20000 [18:06:36<24:24:41,  9.22s/it][2022-12-22 08:06:01,027] [INFO] [timer.py:197:stop] 0/4472, RunningAvgSamplesPerSec=10.950921387147332, CurrSamplesPerSec=11.316874823566074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10472/20000 [18:06:45<24:21:30,  9.20s/it][2022-12-22 08:06:10,221] [INFO] [timer.py:197:stop] 0/4473, RunningAvgSamplesPerSec=10.950871226225994, CurrSamplesPerSec=10.731151676666894, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10473/20000 [18:06:54<24:20:53,  9.20s/it][2022-12-22 08:06:19,517] [INFO] [timer.py:197:stop] 0/4474, RunningAvgSamplesPerSec=10.950910694586028, CurrSamplesPerSec=11.130264486744275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10474/20000 [18:07:03<24:25:15,  9.23s/it][2022-12-22 08:06:29,952] [INFO] [timer.py:197:stop] 0/4475, RunningAvgSamplesPerSec=10.950930726062541, CurrSamplesPerSec=11.041250487618239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10475/20000 [18:07:14<25:22:33,  9.59s/it]

                                                           
{'loss': 0.0508, 'learning_rate': 4.896410256410256e-06, 'epoch': 0.52}


 52%|█████▏    | 10475/20000 [18:07:14<25:22:33,  9.59s/it][2022-12-22 08:06:39,406] [INFO] [timer.py:197:stop] 0/4476, RunningAvgSamplesPerSec=10.950920801565715, CurrSamplesPerSec=10.90670779572208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10476/20000 [18:07:23<25:15:51,  9.55s/it][2022-12-22 08:06:48,828] [INFO] [timer.py:197:stop] 0/4477, RunningAvgSamplesPerSec=10.950959014390714, CurrSamplesPerSec=11.124635197252395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10477/20000 [18:07:33<25:09:38,  9.51s/it][2022-12-22 08:06:57,927] [INFO] [timer.py:197:stop] 0/4478, RunningAvgSamplesPerSec=10.951016110806203, CurrSamplesPerSec=11.21262779464671, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10478/20000 [18:07:42<24:49:49,  9.39s/it][2022-12-22 08:07:07,145] [INFO] [timer.py:197:stop] 0/4479, RunningAvgSamplesPerSec=10.95102229500965, CurrSamplesPerSec=10.978772949618914, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10479/20000 [18:07:51<24:41:36,  9.34s/it][2022-12-22 08:07:16,737] [INFO] [logging.py:68:log_dist] [Rank 0] step=10480, skipped=22, lr=[4.893846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:07:16,738] [INFO] [timer.py:197:stop] 0/4480, RunningAvgSamplesPerSec=10.95107446902571, CurrSamplesPerSec=11.189749542370931, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10480/20000 [18:08:01<24:53:39,  9.41s/it][2022-12-22 08:07:26,417] [INFO] [timer.py:197:stop] 0/4481, RunningAvgSamplesPerSec=10.951123003941625, CurrSamplesPerSec=11.172864081747258, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10481/20000 [18:08:10<25:06:06,  9.49s/it][2022-12-22 08:07:35,899] [INFO] [timer.py:197:stop] 0/4482, RunningAvgSamplesPerSec=10.951019581881459, CurrSamplesPerSec=10.50659548175086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10482/20000 [18:08:20<25:05:24,  9.49s/it][2022-12-22 08:07:45,564] [INFO] [timer.py:197:stop] 0/4483, RunningAvgSamplesPerSec=10.950990767130532, CurrSamplesPerSec=10.823404997470504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10483/20000 [18:08:30<25:13:35,  9.54s/it][2022-12-22 08:07:54,695] [INFO] [timer.py:197:stop] 0/4484, RunningAvgSamplesPerSec=10.950999530005113, CurrSamplesPerSec=10.990407304986059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10484/20000 [18:08:39<24:53:54,  9.42s/it][2022-12-22 08:08:03,774] [INFO] [timer.py:197:stop] 0/4485, RunningAvgSamplesPerSec=10.950950226534504, CurrSamplesPerSec=10.734343923900195, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10485/20000 [18:08:48<24:37:30,  9.32s/it][2022-12-22 08:08:13,354] [INFO] [timer.py:197:stop] 0/4486, RunningAvgSamplesPerSec=10.950899981369885, CurrSamplesPerSec=10.730191670513742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10486/20000 [18:08:57<24:49:50,  9.40s/it][2022-12-22 08:08:24,232] [INFO] [timer.py:197:stop] 0/4487, RunningAvgSamplesPerSec=10.95091269183607, CurrSamplesPerSec=11.008204663228902, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10487/20000 [18:09:08<26:00:12,  9.84s/it][2022-12-22 08:08:35,801] [INFO] [timer.py:197:stop] 0/4488, RunningAvgSamplesPerSec=10.950935520685137, CurrSamplesPerSec=11.054289446998203, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10488/20000 [18:09:20<27:22:14, 10.36s/it][2022-12-22 08:08:45,378] [INFO] [timer.py:197:stop] 0/4489, RunningAvgSamplesPerSec=10.950991423930892, CurrSamplesPerSec=11.207652329098885, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10489/20000 [18:09:29<26:44:54, 10.12s/it][2022-12-22 08:08:54,600] [INFO] [logging.py:68:log_dist] [Rank 0] step=10490, skipped=22, lr=[4.888717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:08:54,601] [INFO] [timer.py:197:stop] 0/4490, RunningAvgSamplesPerSec=10.95098741262996, CurrSamplesPerSec=10.933018245505968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10490/20000 [18:09:39<26:01:51,  9.85s/it][2022-12-22 08:09:03,835] [INFO] [timer.py:197:stop] 0/4491, RunningAvgSamplesPerSec=10.950963069627946, CurrSamplesPerSec=10.842791086044036, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10491/20000 [18:09:48<25:32:13,  9.67s/it][2022-12-22 08:09:13,428] [INFO] [timer.py:197:stop] 0/4492, RunningAvgSamplesPerSec=10.950983120948017, CurrSamplesPerSec=11.04173962582743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10492/20000 [18:09:57<25:28:29,  9.65s/it][2022-12-22 08:09:22,507] [INFO] [timer.py:197:stop] 0/4493, RunningAvgSamplesPerSec=10.950978250720661, CurrSamplesPerSec=10.929154518036443, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10493/20000 [18:10:06<25:01:22,  9.48s/it][2022-12-22 08:09:32,993] [INFO] [timer.py:197:stop] 0/4494, RunningAvgSamplesPerSec=10.95098163205146, CurrSamplesPerSec=10.966188280188321, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10494/20000 [18:10:17<25:49:16,  9.78s/it][2022-12-22 08:09:42,775] [INFO] [timer.py:197:stop] 0/4495, RunningAvgSamplesPerSec=10.950956867073652, CurrSamplesPerSec=10.840831533800491, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10495/20000 [18:10:27<25:49:16,  9.78s/it][2022-12-22 08:09:52,190] [INFO] [timer.py:197:stop] 0/4496, RunningAvgSamplesPerSec=10.951010170762911, CurrSamplesPerSec=11.195859580590263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10496/20000 [18:10:36<25:31:46,  9.67s/it][2022-12-22 08:10:02,354] [INFO] [timer.py:197:stop] 0/4497, RunningAvgSamplesPerSec=10.950951800464864, CurrSamplesPerSec=10.694773472464954, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10497/20000 [18:10:46<25:55:04,  9.82s/it][2022-12-22 08:10:12,618] [INFO] [timer.py:197:stop] 0/4498, RunningAvgSamplesPerSec=10.951005546954645, CurrSamplesPerSec=11.198047225072003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10498/20000 [18:10:57<26:16:04,  9.95s/it][2022-12-22 08:10:22,811] [INFO] [timer.py:197:stop] 0/4499, RunningAvgSamplesPerSec=10.950958746954225, CurrSamplesPerSec=10.744513486926227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▏    | 10499/20000 [18:11:07<26:27:19, 10.02s/it][2022-12-22 08:10:32,198] [INFO] [logging.py:68:log_dist] [Rank 0] step=10500, skipped=22, lr=[4.883589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:10:32,199] [INFO] [timer.py:197:stop] 0/4500, RunningAvgSamplesPerSec=10.950958894077681, CurrSamplesPerSec=10.951620548238168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 52%|█████▎    | 10500/20000 [18:11:16<25:56:57,  9.83s/it]

                                                           
{'loss': 0.0533, 'learning_rate': 4.883589743589744e-06, 'epoch': 0.53}


 52%|█████▎    | 10500/20000 [18:11:16<25:56:57,  9.83s/it][2022-12-22 08:10:41,416] [INFO] [timer.py:197:stop] 0/4501, RunningAvgSamplesPerSec=10.950937450618223, CurrSamplesPerSec=10.85532706573569, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10501/20000 [18:11:25<25:27:31,  9.65s/it][2022-12-22 08:10:51,344] [INFO] [timer.py:197:stop] 0/4502, RunningAvgSamplesPerSec=10.950934965900034, CurrSamplesPerSec=10.939767620959245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10502/20000 [18:11:35<25:40:37,  9.73s/it][2022-12-22 08:11:04,162] [INFO] [timer.py:197:stop] 0/4503, RunningAvgSamplesPerSec=10.950972727544071, CurrSamplesPerSec=11.123579071736447, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10503/20000 [18:11:48<28:06:58, 10.66s/it][2022-12-22 08:11:14,065] [INFO] [timer.py:197:stop] 0/4504, RunningAvgSamplesPerSec=10.950917469329378, CurrSamplesPerSec=10.707724862338745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10504/20000 [18:11:58<27:30:58, 10.43s/it][2022-12-22 08:11:23,272] [INFO] [timer.py:197:stop] 0/4505, RunningAvgSamplesPerSec=10.950847272710789, CurrSamplesPerSec=10.64368821855727, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10505/20000 [18:12:07<26:32:41, 10.06s/it][2022-12-22 08:11:32,222] [INFO] [timer.py:197:stop] 0/4506, RunningAvgSamplesPerSec=10.950853177726472, CurrSamplesPerSec=10.977508200043815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10506/20000 [18:12:16<25:39:35,  9.73s/it][2022-12-22 08:11:41,723] [INFO] [timer.py:197:stop] 0/4507, RunningAvgSamplesPerSec=10.950859719151119, CurrSamplesPerSec=10.980401794444987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10507/20000 [18:12:26<25:28:32,  9.66s/it][2022-12-22 08:11:51,691] [INFO] [timer.py:197:stop] 0/4508, RunningAvgSamplesPerSec=10.950810581837136, CurrSamplesPerSec=10.733833998151336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10508/20000 [18:12:36<25:42:57,  9.75s/it][2022-12-22 08:12:01,382] [INFO] [timer.py:197:stop] 0/4509, RunningAvgSamplesPerSec=10.950731821252669, CurrSamplesPerSec=10.606979545458497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10509/20000 [18:12:45<25:39:50,  9.73s/it][2022-12-22 08:12:10,781] [INFO] [logging.py:68:log_dist] [Rank 0] step=10510, skipped=22, lr=[4.878461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:12:10,782] [INFO] [timer.py:197:stop] 0/4510, RunningAvgSamplesPerSec=10.95065608666919, CurrSamplesPerSec=10.619640480077274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10510/20000 [18:12:55<25:23:51,  9.63s/it][2022-12-22 08:12:20,119] [INFO] [timer.py:197:stop] 0/4511, RunningAvgSamplesPerSec=10.950600783759215, CurrSamplesPerSec=10.706845912182354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10511/20000 [18:13:04<25:09:32,  9.55s/it][2022-12-22 08:12:29,331] [INFO] [timer.py:197:stop] 0/4512, RunningAvgSamplesPerSec=10.950657038415619, CurrSamplesPerSec=11.210325367202419, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10512/20000 [18:13:13<24:53:35,  9.45s/it][2022-12-22 08:12:38,632] [INFO] [timer.py:197:stop] 0/4513, RunningAvgSamplesPerSec=10.950666269190513, CurrSamplesPerSec=10.992455969747057, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10513/20000 [18:13:23<24:46:34,  9.40s/it][2022-12-22 08:12:47,472] [INFO] [timer.py:197:stop] 0/4514, RunningAvgSamplesPerSec=10.950721153492172, CurrSamplesPerSec=11.204032585070427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10514/20000 [18:13:31<24:19:46,  9.23s/it][2022-12-22 08:12:57,851] [INFO] [timer.py:197:stop] 0/4515, RunningAvgSamplesPerSec=10.950726499225791, CurrSamplesPerSec=10.97489970475123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10515/20000 [18:13:42<25:13:56,  9.58s/it][2022-12-22 08:13:06,731] [INFO] [timer.py:197:stop] 0/4516, RunningAvgSamplesPerSec=10.950772336060878, CurrSamplesPerSec=11.161617755106368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10516/20000 [18:13:51<24:40:46,  9.37s/it][2022-12-22 08:13:16,454] [INFO] [timer.py:197:stop] 0/4517, RunningAvgSamplesPerSec=10.950821359004184, CurrSamplesPerSec=11.176675909383953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10517/20000 [18:14:00<24:57:26,  9.47s/it][2022-12-22 08:13:25,642] [INFO] [timer.py:197:stop] 0/4518, RunningAvgSamplesPerSec=10.95086137607113, CurrSamplesPerSec=11.134570094578667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10518/20000 [18:14:10<24:43:40,  9.39s/it][2022-12-22 08:13:34,801] [INFO] [timer.py:197:stop] 0/4519, RunningAvgSamplesPerSec=10.950866520502334, CurrSamplesPerSec=10.9741481747668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10519/20000 [18:14:19<24:32:38,  9.32s/it][2022-12-22 08:13:44,266] [INFO] [logging.py:68:log_dist] [Rank 0] step=10520, skipped=22, lr=[4.873333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:13:44,267] [INFO] [timer.py:197:stop] 0/4520, RunningAvgSamplesPerSec=10.950783353468172, CurrSamplesPerSec=10.587580263097383, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10520/20000 [18:14:28<24:39:26,  9.36s/it][2022-12-22 08:13:53,977] [INFO] [timer.py:197:stop] 0/4521, RunningAvgSamplesPerSec=10.950800093262758, CurrSamplesPerSec=11.02695656721137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10521/20000 [18:14:38<24:55:42,  9.47s/it][2022-12-22 08:14:03,014] [INFO] [timer.py:197:stop] 0/4522, RunningAvgSamplesPerSec=10.950817575470683, CurrSamplesPerSec=11.030393884676357, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10522/20000 [18:14:47<24:35:08,  9.34s/it][2022-12-22 08:14:11,886] [INFO] [timer.py:197:stop] 0/4523, RunningAvgSamplesPerSec=10.95083789002504, CurrSamplesPerSec=11.04343627659907, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10523/20000 [18:14:56<24:12:55,  9.20s/it][2022-12-22 08:14:21,300] [INFO] [timer.py:197:stop] 0/4524, RunningAvgSamplesPerSec=10.950889664272951, CurrSamplesPerSec=11.190074664289993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10524/20000 [18:15:05<24:22:55,  9.26s/it][2022-12-22 08:14:31,362] [INFO] [timer.py:197:stop] 0/4525, RunningAvgSamplesPerSec=10.950852571089372, CurrSamplesPerSec=10.785648207375958, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10525/20000 [18:15:15<25:00:40,  9.50s/it]

                                                           
{'loss': 0.0607, 'learning_rate': 4.870769230769231e-06, 'epoch': 0.53}


 53%|█████▎    | 10525/20000 [18:15:15<25:00:40,  9.50s/it][2022-12-22 08:14:40,618] [INFO] [timer.py:197:stop] 0/4526, RunningAvgSamplesPerSec=10.950884794805585, CurrSamplesPerSec=11.098599061366112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10526/20000 [18:15:25<24:48:48,  9.43s/it][2022-12-22 08:14:50,155] [INFO] [timer.py:197:stop] 0/4527, RunningAvgSamplesPerSec=10.950865071848776, CurrSamplesPerSec=10.86235970833156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10527/20000 [18:15:34<24:53:46,  9.46s/it][2022-12-22 08:14:58,990] [INFO] [timer.py:197:stop] 0/4528, RunningAvgSamplesPerSec=10.950925000378618, CurrSamplesPerSec=11.228988783663327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10528/20000 [18:15:43<24:23:57,  9.27s/it][2022-12-22 08:15:07,977] [INFO] [timer.py:197:stop] 0/4529, RunningAvgSamplesPerSec=10.950902908283037, CurrSamplesPerSec=10.851818983873514, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10529/20000 [18:15:52<24:10:15,  9.19s/it][2022-12-22 08:15:17,891] [INFO] [logging.py:68:log_dist] [Rank 0] step=10530, skipped=22, lr=[4.868205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:15:17,892] [INFO] [timer.py:197:stop] 0/4530, RunningAvgSamplesPerSec=10.950922676133478, CurrSamplesPerSec=11.04114921372023, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10530/20000 [18:16:02<24:44:32,  9.41s/it][2022-12-22 08:15:26,880] [INFO] [timer.py:197:stop] 0/4531, RunningAvgSamplesPerSec=10.950967321217636, CurrSamplesPerSec=11.156923007864924, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10531/20000 [18:16:11<24:24:36,  9.28s/it][2022-12-22 08:15:35,911] [INFO] [timer.py:197:stop] 0/4532, RunningAvgSamplesPerSec=10.951005535394918, CurrSamplesPerSec=11.126857357358976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10532/20000 [18:16:20<24:12:36,  9.21s/it][2022-12-22 08:15:46,380] [INFO] [timer.py:197:stop] 0/4533, RunningAvgSamplesPerSec=10.950996863840196, CurrSamplesPerSec=10.911855156532326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10533/20000 [18:16:30<25:12:16,  9.58s/it][2022-12-22 08:15:56,219] [INFO] [timer.py:197:stop] 0/4534, RunningAvgSamplesPerSec=10.95099597111896, CurrSamplesPerSec=10.946952545030117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10534/20000 [18:16:40<25:24:08,  9.66s/it][2022-12-22 08:16:05,495] [INFO] [timer.py:197:stop] 0/4535, RunningAvgSamplesPerSec=10.951004616918258, CurrSamplesPerSec=10.99032811008234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10535/20000 [18:16:49<25:05:47,  9.55s/it][2022-12-22 08:16:14,609] [INFO] [timer.py:197:stop] 0/4536, RunningAvgSamplesPerSec=10.950999190313832, CurrSamplesPerSec=10.926455536054617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10536/20000 [18:16:59<24:45:14,  9.42s/it][2022-12-22 08:16:24,545] [INFO] [timer.py:197:stop] 0/4537, RunningAvgSamplesPerSec=10.951016838298301, CurrSamplesPerSec=11.031621887923663, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10537/20000 [18:17:09<25:09:39,  9.57s/it][2022-12-22 08:16:33,931] [INFO] [timer.py:197:stop] 0/4538, RunningAvgSamplesPerSec=10.950984280490056, CurrSamplesPerSec=10.805299291207222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10538/20000 [18:17:18<25:00:41,  9.52s/it][2022-12-22 08:16:42,901] [INFO] [timer.py:197:stop] 0/4539, RunningAvgSamplesPerSec=10.95100300531866, CurrSamplesPerSec=11.036602885665783, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10539/20000 [18:17:27<24:34:41,  9.35s/it][2022-12-22 08:16:52,224] [INFO] [logging.py:68:log_dist] [Rank 0] step=10540, skipped=22, lr=[4.863076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:16:52,225] [INFO] [timer.py:197:stop] 0/4540, RunningAvgSamplesPerSec=10.950987669549523, CurrSamplesPerSec=10.88184866458558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10540/20000 [18:17:36<24:33:12,  9.34s/it][2022-12-22 08:17:01,354] [INFO] [timer.py:197:stop] 0/4541, RunningAvgSamplesPerSec=10.950971261154079, CurrSamplesPerSec=10.877012954091777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10541/20000 [18:17:45<24:22:53,  9.28s/it][2022-12-22 08:17:11,102] [INFO] [timer.py:197:stop] 0/4542, RunningAvgSamplesPerSec=10.950974815606223, CurrSamplesPerSec=10.967132283324178, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10542/20000 [18:17:55<24:44:54,  9.42s/it][2022-12-22 08:17:20,187] [INFO] [timer.py:197:stop] 0/4543, RunningAvgSamplesPerSec=10.950898820458017, CurrSamplesPerSec=10.616421189080658, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10543/20000 [18:18:04<24:28:55,  9.32s/it][2022-12-22 08:17:29,646] [INFO] [timer.py:197:stop] 0/4544, RunningAvgSamplesPerSec=10.950901618114786, CurrSamplesPerSec=10.96362053598815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10544/20000 [18:18:14<24:35:19,  9.36s/it][2022-12-22 08:17:39,221] [INFO] [timer.py:197:stop] 0/4545, RunningAvgSamplesPerSec=10.950815535052234, CurrSamplesPerSec=10.573307814745768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10545/20000 [18:18:23<24:45:18,  9.43s/it][2022-12-22 08:17:48,263] [INFO] [timer.py:197:stop] 0/4546, RunningAvgSamplesPerSec=10.950810733685607, CurrSamplesPerSec=10.929041496168928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10546/20000 [18:18:32<24:27:00,  9.31s/it][2022-12-22 08:17:57,909] [INFO] [timer.py:197:stop] 0/4547, RunningAvgSamplesPerSec=10.950815157678411, CurrSamplesPerSec=10.970954759780495, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10547/20000 [18:18:42<24:42:43,  9.41s/it][2022-12-22 08:18:06,973] [INFO] [timer.py:197:stop] 0/4548, RunningAvgSamplesPerSec=10.950799333943234, CurrSamplesPerSec=10.879349802347432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10548/20000 [18:18:51<24:26:09,  9.31s/it][2022-12-22 08:18:17,286] [INFO] [timer.py:197:stop] 0/4549, RunningAvgSamplesPerSec=10.95085570875863, CurrSamplesPerSec=11.213278377146647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10549/20000 [18:19:01<25:13:31,  9.61s/it][2022-12-22 08:18:26,609] [INFO] [logging.py:68:log_dist] [Rank 0] step=10550, skipped=22, lr=[4.8579487179487185e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:18:26,610] [INFO] [timer.py:197:stop] 0/4550, RunningAvgSamplesPerSec=10.9508999504765, CurrSamplesPerSec=11.155832462193414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10550/20000 [18:19:11<24:59:54,  9.52s/it]

                                                           
{'loss': 0.0603, 'learning_rate': 4.8579487179487185e-06, 'epoch': 0.53}


 53%|█████▎    | 10550/20000 [18:19:11<24:59:54,  9.52s/it][2022-12-22 08:18:35,701] [INFO] [timer.py:197:stop] 0/4551, RunningAvgSamplesPerSec=10.95091223395489, CurrSamplesPerSec=11.007064010744493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10551/20000 [18:19:20<24:39:20,  9.39s/it][2022-12-22 08:18:44,624] [INFO] [timer.py:197:stop] 0/4552, RunningAvgSamplesPerSec=10.950910472832568, CurrSamplesPerSec=10.942904985245336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10552/20000 [18:19:29<24:16:56,  9.25s/it][2022-12-22 08:18:54,995] [INFO] [timer.py:197:stop] 0/4553, RunningAvgSamplesPerSec=10.950865213893675, CurrSamplesPerSec=10.7487388117165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10553/20000 [18:19:39<25:09:39,  9.59s/it][2022-12-22 08:19:04,194] [INFO] [timer.py:197:stop] 0/4554, RunningAvgSamplesPerSec=10.950876189772371, CurrSamplesPerSec=11.001056355344561, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10554/20000 [18:19:48<24:51:07,  9.47s/it][2022-12-22 08:19:13,246] [INFO] [timer.py:197:stop] 0/4555, RunningAvgSamplesPerSec=10.950820625934142, CurrSamplesPerSec=10.70360512327138, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10555/20000 [18:19:57<24:31:08,  9.35s/it][2022-12-22 08:19:22,651] [INFO] [timer.py:197:stop] 0/4556, RunningAvgSamplesPerSec=10.95083856627945, CurrSamplesPerSec=11.033134942612875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10556/20000 [18:20:07<24:33:47,  9.36s/it][2022-12-22 08:19:32,204] [INFO] [timer.py:197:stop] 0/4557, RunningAvgSamplesPerSec=10.950866288289465, CurrSamplesPerSec=11.078585038844833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10557/20000 [18:20:16<24:42:35,  9.42s/it][2022-12-22 08:19:41,358] [INFO] [timer.py:197:stop] 0/4558, RunningAvgSamplesPerSec=10.950886431171847, CurrSamplesPerSec=11.043412651643795, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10558/20000 [18:20:25<24:29:51,  9.34s/it][2022-12-22 08:19:50,297] [INFO] [timer.py:197:stop] 0/4559, RunningAvgSamplesPerSec=10.950903615512958, CurrSamplesPerSec=11.02975936482237, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10559/20000 [18:20:34<24:10:45,  9.22s/it][2022-12-22 08:19:59,551] [INFO] [logging.py:68:log_dist] [Rank 0] step=10560, skipped=22, lr=[4.852820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:19:59,552] [INFO] [timer.py:197:stop] 0/4560, RunningAvgSamplesPerSec=10.95095751413231, CurrSamplesPerSec=11.202210032641116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10560/20000 [18:20:44<24:12:15,  9.23s/it][2022-12-22 08:20:09,006] [INFO] [timer.py:197:stop] 0/4561, RunningAvgSamplesPerSec=10.95102237339093, CurrSamplesPerSec=11.25485478647803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10561/20000 [18:20:53<24:22:40,  9.30s/it][2022-12-22 08:20:18,375] [INFO] [timer.py:197:stop] 0/4562, RunningAvgSamplesPerSec=10.950987829034947, CurrSamplesPerSec=10.795733336851, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10562/20000 [18:21:02<24:25:52,  9.32s/it][2022-12-22 08:20:27,715] [INFO] [timer.py:197:stop] 0/4563, RunningAvgSamplesPerSec=10.950930868784562, CurrSamplesPerSec=10.697211273817777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10563/20000 [18:21:12<24:26:42,  9.33s/it][2022-12-22 08:20:38,504] [INFO] [timer.py:197:stop] 0/4564, RunningAvgSamplesPerSec=10.950916250471755, CurrSamplesPerSec=10.88464569927166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10564/20000 [18:21:22<25:35:36,  9.76s/it][2022-12-22 08:20:48,657] [INFO] [timer.py:197:stop] 0/4565, RunningAvgSamplesPerSec=10.950935907876534, CurrSamplesPerSec=11.041353579996565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10565/20000 [18:21:33<25:53:48,  9.88s/it][2022-12-22 08:20:58,322] [INFO] [timer.py:197:stop] 0/4566, RunningAvgSamplesPerSec=10.950938986993103, CurrSamplesPerSec=10.96500704911078, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10566/20000 [18:21:42<25:43:26,  9.82s/it][2022-12-22 08:21:07,183] [INFO] [timer.py:197:stop] 0/4567, RunningAvgSamplesPerSec=10.950991241666301, CurrSamplesPerSec=11.194792223282752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10567/20000 [18:21:51<24:58:12,  9.53s/it][2022-12-22 08:21:15,932] [INFO] [timer.py:197:stop] 0/4568, RunningAvgSamplesPerSec=10.951050118359275, CurrSamplesPerSec=11.226586197229834, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10568/20000 [18:22:00<24:21:16,  9.30s/it][2022-12-22 08:21:26,148] [INFO] [timer.py:197:stop] 0/4569, RunningAvgSamplesPerSec=10.951003705173848, CurrSamplesPerSec=10.743105210174058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10569/20000 [18:22:10<25:04:28,  9.57s/it][2022-12-22 08:21:35,300] [INFO] [logging.py:68:log_dist] [Rank 0] step=10570, skipped=22, lr=[4.847692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:21:35,301] [INFO] [timer.py:197:stop] 0/4570, RunningAvgSamplesPerSec=10.950998754079773, CurrSamplesPerSec=10.928433709992875, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10570/20000 [18:22:19<24:44:35,  9.45s/it][2022-12-22 08:21:44,589] [INFO] [timer.py:197:stop] 0/4571, RunningAvgSamplesPerSec=10.951038178861145, CurrSamplesPerSec=11.13414243191722, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10571/20000 [18:22:29<24:36:59,  9.40s/it][2022-12-22 08:21:54,925] [INFO] [timer.py:197:stop] 0/4572, RunningAvgSamplesPerSec=10.951050901506784, CurrSamplesPerSec=11.00949094556165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10572/20000 [18:22:39<25:21:01,  9.68s/it][2022-12-22 08:22:04,232] [INFO] [timer.py:197:stop] 0/4573, RunningAvgSamplesPerSec=10.95101666921008, CurrSamplesPerSec=10.79677893056022, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10573/20000 [18:22:48<25:03:17,  9.57s/it][2022-12-22 08:22:14,519] [INFO] [timer.py:197:stop] 0/4574, RunningAvgSamplesPerSec=10.951012101471672, CurrSamplesPerSec=10.930172710157443, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10574/20000 [18:22:58<25:37:00,  9.78s/it][2022-12-22 08:22:23,836] [INFO] [timer.py:197:stop] 0/4575, RunningAvgSamplesPerSec=10.950896273573083, CurrSamplesPerSec=10.445763741885028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10575/20000 [18:23:08<25:14:49,  9.64s/it]

                                                           
{'loss': 0.0867, 'learning_rate': 4.845128205128205e-06, 'epoch': 0.53}


 53%|█████▎    | 10575/20000 [18:23:08<25:14:49,  9.64s/it][2022-12-22 08:22:32,962] [INFO] [timer.py:197:stop] 0/4576, RunningAvgSamplesPerSec=10.95093601125402, CurrSamplesPerSec=11.135723469635558, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10576/20000 [18:23:17<24:50:19,  9.49s/it][2022-12-22 08:22:42,131] [INFO] [timer.py:197:stop] 0/4577, RunningAvgSamplesPerSec=10.95097357065014, CurrSamplesPerSec=11.125508922731278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10577/20000 [18:23:26<24:35:05,  9.39s/it][2022-12-22 08:22:51,262] [INFO] [timer.py:197:stop] 0/4578, RunningAvgSamplesPerSec=10.95087836421081, CurrSamplesPerSec=10.531974385886318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10578/20000 [18:23:35<24:22:38,  9.31s/it][2022-12-22 08:23:00,873] [INFO] [timer.py:197:stop] 0/4579, RunningAvgSamplesPerSec=10.950840683512116, CurrSamplesPerSec=10.78108724952595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10579/20000 [18:23:45<24:36:27,  9.40s/it][2022-12-22 08:23:10,347] [INFO] [logging.py:68:log_dist] [Rank 0] step=10580, skipped=22, lr=[4.842564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:23:10,348] [INFO] [timer.py:197:stop] 0/4580, RunningAvgSamplesPerSec=10.95081128973972, CurrSamplesPerSec=10.817909109084324, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10580/20000 [18:23:54<24:39:40,  9.42s/it][2022-12-22 08:23:19,393] [INFO] [timer.py:197:stop] 0/4581, RunningAvgSamplesPerSec=10.95086035359086, CurrSamplesPerSec=11.180179277401002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10581/20000 [18:24:03<24:21:38,  9.31s/it][2022-12-22 08:23:28,642] [INFO] [timer.py:197:stop] 0/4582, RunningAvgSamplesPerSec=10.950812356711708, CurrSamplesPerSec=10.735359627437843, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10582/20000 [18:24:13<24:18:35,  9.29s/it][2022-12-22 08:23:37,830] [INFO] [timer.py:197:stop] 0/4583, RunningAvgSamplesPerSec=10.95077832047652, CurrSamplesPerSec=10.79708074880173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10583/20000 [18:24:22<24:13:30,  9.26s/it][2022-12-22 08:23:48,086] [INFO] [timer.py:197:stop] 0/4584, RunningAvgSamplesPerSec=10.950786242391747, CurrSamplesPerSec=10.987197226352906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10584/20000 [18:24:32<25:00:13,  9.56s/it][2022-12-22 08:23:57,410] [INFO] [timer.py:197:stop] 0/4585, RunningAvgSamplesPerSec=10.950769117945589, CurrSamplesPerSec=10.872863237001445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10585/20000 [18:24:41<24:48:56,  9.49s/it][2022-12-22 08:24:06,159] [INFO] [timer.py:197:stop] 0/4586, RunningAvgSamplesPerSec=10.95083185834168, CurrSamplesPerSec=11.246126422275315, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10586/20000 [18:24:50<24:13:57,  9.27s/it][2022-12-22 08:24:16,262] [INFO] [timer.py:197:stop] 0/4587, RunningAvgSamplesPerSec=10.950921418143617, CurrSamplesPerSec=11.3774575707403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10587/20000 [18:25:00<24:53:10,  9.52s/it][2022-12-22 08:24:25,889] [INFO] [timer.py:197:stop] 0/4588, RunningAvgSamplesPerSec=10.950843938013234, CurrSamplesPerSec=10.606762024035525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10588/20000 [18:25:10<24:58:09,  9.55s/it][2022-12-22 08:24:35,375] [INFO] [timer.py:197:stop] 0/4589, RunningAvgSamplesPerSec=10.95086591436457, CurrSamplesPerSec=11.05258581936317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10589/20000 [18:25:19<24:54:56,  9.53s/it][2022-12-22 08:24:44,882] [INFO] [logging.py:68:log_dist] [Rank 0] step=10590, skipped=22, lr=[4.837435897435897e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:24:44,883] [INFO] [timer.py:197:stop] 0/4590, RunningAvgSamplesPerSec=10.950862941316672, CurrSamplesPerSec=10.93724253611421, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10590/20000 [18:25:29<24:53:43,  9.52s/it][2022-12-22 08:24:54,315] [INFO] [timer.py:197:stop] 0/4591, RunningAvgSamplesPerSec=10.950840748799942, CurrSamplesPerSec=10.849959663609988, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10591/20000 [18:25:38<24:49:13,  9.50s/it][2022-12-22 08:25:03,713] [INFO] [timer.py:197:stop] 0/4592, RunningAvgSamplesPerSec=10.950804958739075, CurrSamplesPerSec=10.788991778499584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10592/20000 [18:25:48<24:44:24,  9.47s/it][2022-12-22 08:25:14,370] [INFO] [timer.py:197:stop] 0/4593, RunningAvgSamplesPerSec=10.950854981529215, CurrSamplesPerSec=11.185377858535576, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10593/20000 [18:25:58<25:40:14,  9.82s/it][2022-12-22 08:25:24,088] [INFO] [timer.py:197:stop] 0/4594, RunningAvgSamplesPerSec=10.950901140901736, CurrSamplesPerSec=11.167001625532615, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10594/20000 [18:26:08<25:35:04,  9.79s/it][2022-12-22 08:25:34,746] [INFO] [timer.py:197:stop] 0/4595, RunningAvgSamplesPerSec=10.95085604076234, CurrSamplesPerSec=10.747600947041265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10595/20000 [18:26:19<26:15:39, 10.05s/it][2022-12-22 08:25:43,860] [INFO] [timer.py:197:stop] 0/4596, RunningAvgSamplesPerSec=10.950866311175153, CurrSamplesPerSec=10.998242439307575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10596/20000 [18:26:28<25:31:21,  9.77s/it][2022-12-22 08:25:53,062] [INFO] [timer.py:197:stop] 0/4597, RunningAvgSamplesPerSec=10.950886905420257, CurrSamplesPerSec=11.046321552571879, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10597/20000 [18:26:37<25:04:28,  9.60s/it][2022-12-22 08:26:02,992] [INFO] [timer.py:197:stop] 0/4598, RunningAvgSamplesPerSec=10.95093920145515, CurrSamplesPerSec=11.196631977403143, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10598/20000 [18:26:47<25:19:50,  9.70s/it][2022-12-22 08:26:12,113] [INFO] [timer.py:197:stop] 0/4599, RunningAvgSamplesPerSec=10.950924226228498, CurrSamplesPerSec=10.882528045463824, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10599/20000 [18:26:56<24:52:29,  9.53s/it][2022-12-22 08:26:21,148] [INFO] [logging.py:68:log_dist] [Rank 0] step=10600, skipped=22, lr=[4.832307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:26:21,149] [INFO] [timer.py:197:stop] 0/4600, RunningAvgSamplesPerSec=10.95090854322971, CurrSamplesPerSec=10.879285427488703, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10600/20000 [18:27:05<24:29:20,  9.38s/it]

                                                           
{'loss': 0.0616, 'learning_rate': 4.832307692307693e-06, 'epoch': 0.53}


 53%|█████▎    | 10600/20000 [18:27:05<24:29:20,  9.38s/it][2022-12-22 08:26:30,778] [INFO] [timer.py:197:stop] 0/4601, RunningAvgSamplesPerSec=10.950959408529517, CurrSamplesPerSec=11.189943120577972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10601/20000 [18:27:15<24:40:55,  9.45s/it][2022-12-22 08:26:39,878] [INFO] [timer.py:197:stop] 0/4602, RunningAvgSamplesPerSec=10.950947203704871, CurrSamplesPerSec=10.89510350888828, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10602/20000 [18:27:24<24:24:09,  9.35s/it][2022-12-22 08:26:50,138] [INFO] [timer.py:197:stop] 0/4603, RunningAvgSamplesPerSec=10.950936480782211, CurrSamplesPerSec=10.901832260913155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10603/20000 [18:27:34<25:06:52,  9.62s/it][2022-12-22 08:26:59,195] [INFO] [timer.py:197:stop] 0/4604, RunningAvgSamplesPerSec=10.950899346373529, CurrSamplesPerSec=10.782669220959447, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10604/20000 [18:27:43<24:40:11,  9.45s/it][2022-12-22 08:27:08,895] [INFO] [timer.py:197:stop] 0/4605, RunningAvgSamplesPerSec=10.95090210693817, CurrSamplesPerSec=10.963620983771696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10605/20000 [18:27:53<24:51:41,  9.53s/it][2022-12-22 08:27:18,884] [INFO] [timer.py:197:stop] 0/4606, RunningAvgSamplesPerSec=10.95095798871042, CurrSamplesPerSec=11.214370345100058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10606/20000 [18:28:03<25:13:14,  9.67s/it][2022-12-22 08:27:28,239] [INFO] [timer.py:197:stop] 0/4607, RunningAvgSamplesPerSec=10.950873433646228, CurrSamplesPerSec=10.574948537649034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10607/20000 [18:28:12<24:58:31,  9.57s/it][2022-12-22 08:27:37,793] [INFO] [timer.py:197:stop] 0/4608, RunningAvgSamplesPerSec=10.950870772514678, CurrSamplesPerSec=10.938629962712104, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10608/20000 [18:28:22<24:57:30,  9.57s/it][2022-12-22 08:27:50,541] [INFO] [timer.py:197:stop] 0/4609, RunningAvgSamplesPerSec=10.95079918624795, CurrSamplesPerSec=10.630712674147498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10609/20000 [18:28:35<27:26:43, 10.52s/it][2022-12-22 08:28:02,952] [INFO] [logging.py:68:log_dist] [Rank 0] step=10610, skipped=22, lr=[4.827179487179487e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:28:02,952] [INFO] [timer.py:197:stop] 0/4610, RunningAvgSamplesPerSec=10.950812839896017, CurrSamplesPerSec=11.014078679535517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10610/20000 [18:28:47<28:55:17, 11.09s/it][2022-12-22 08:28:13,015] [INFO] [timer.py:197:stop] 0/4611, RunningAvgSamplesPerSec=10.950786689057596, CurrSamplesPerSec=10.83159549673354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10611/20000 [18:28:57<28:06:57, 10.78s/it][2022-12-22 08:28:22,134] [INFO] [timer.py:197:stop] 0/4612, RunningAvgSamplesPerSec=10.950739796575402, CurrSamplesPerSec=10.738796242333816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10612/20000 [18:29:06<26:48:46, 10.28s/it][2022-12-22 08:28:32,290] [INFO] [timer.py:197:stop] 0/4613, RunningAvgSamplesPerSec=10.950771619794713, CurrSamplesPerSec=11.09946916067961, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10613/20000 [18:29:16<26:42:44, 10.24s/it][2022-12-22 08:28:41,180] [INFO] [timer.py:197:stop] 0/4614, RunningAvgSamplesPerSec=10.95076804554635, CurrSamplesPerSec=10.93431195805624, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10614/20000 [18:29:25<25:39:00,  9.84s/it][2022-12-22 08:28:50,927] [INFO] [timer.py:197:stop] 0/4615, RunningAvgSamplesPerSec=10.950766683375027, CurrSamplesPerSec=10.944487952052839, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10615/20000 [18:29:35<25:34:31,  9.81s/it][2022-12-22 08:29:00,038] [INFO] [timer.py:197:stop] 0/4616, RunningAvgSamplesPerSec=10.950764171846538, CurrSamplesPerSec=10.93919073802766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10616/20000 [18:29:44<25:01:34,  9.60s/it][2022-12-22 08:29:09,500] [INFO] [timer.py:197:stop] 0/4617, RunningAvgSamplesPerSec=10.950729052166546, CurrSamplesPerSec=10.791050191091733, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10617/20000 [18:29:53<24:54:53,  9.56s/it][2022-12-22 08:29:18,355] [INFO] [timer.py:197:stop] 0/4618, RunningAvgSamplesPerSec=10.950735565621786, CurrSamplesPerSec=10.98087791976992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10618/20000 [18:30:02<24:21:40,  9.35s/it][2022-12-22 08:29:27,877] [INFO] [timer.py:197:stop] 0/4619, RunningAvgSamplesPerSec=10.950784521498523, CurrSamplesPerSec=11.181527490657222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10619/20000 [18:30:12<24:29:43,  9.40s/it][2022-12-22 08:29:37,037] [INFO] [logging.py:68:log_dist] [Rank 0] step=10620, skipped=22, lr=[4.822051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:29:37,038] [INFO] [timer.py:197:stop] 0/4620, RunningAvgSamplesPerSec=10.950819769059672, CurrSamplesPerSec=11.116013197818154, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10620/20000 [18:30:21<24:18:21,  9.33s/it][2022-12-22 08:29:46,094] [INFO] [timer.py:197:stop] 0/4621, RunningAvgSamplesPerSec=10.950808417268117, CurrSamplesPerSec=10.89863565399356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10621/20000 [18:30:30<24:05:24,  9.25s/it][2022-12-22 08:29:54,951] [INFO] [timer.py:197:stop] 0/4622, RunningAvgSamplesPerSec=10.95081573533542, CurrSamplesPerSec=10.984722571928664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10622/20000 [18:30:39<23:47:00,  9.13s/it][2022-12-22 08:30:04,908] [INFO] [timer.py:197:stop] 0/4623, RunningAvgSamplesPerSec=10.950880497710735, CurrSamplesPerSec=11.258489033524308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10623/20000 [18:30:49<24:25:36,  9.38s/it][2022-12-22 08:30:15,599] [INFO] [timer.py:197:stop] 0/4624, RunningAvgSamplesPerSec=10.950896441549094, CurrSamplesPerSec=11.025072072433206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10624/20000 [18:31:00<25:27:00,  9.77s/it][2022-12-22 08:30:26,141] [INFO] [timer.py:197:stop] 0/4625, RunningAvgSamplesPerSec=10.950906888771124, CurrSamplesPerSec=10.999407856006446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10625/20000 [18:31:10<26:02:57, 10.00s/it]

                                                           
{'loss': 0.0797, 'learning_rate': 4.81948717948718e-06, 'epoch': 0.53}


 53%|█████▎    | 10625/20000 [18:31:10<26:02:57, 10.00s/it][2022-12-22 08:30:35,456] [INFO] [timer.py:197:stop] 0/4626, RunningAvgSamplesPerSec=10.950962684660412, CurrSamplesPerSec=11.21513077271069, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10626/20000 [18:31:19<25:30:32,  9.80s/it][2022-12-22 08:30:45,621] [INFO] [timer.py:197:stop] 0/4627, RunningAvgSamplesPerSec=10.950980449838918, CurrSamplesPerSec=11.033747627893181, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10627/20000 [18:31:30<25:47:39,  9.91s/it][2022-12-22 08:30:55,704] [INFO] [timer.py:197:stop] 0/4628, RunningAvgSamplesPerSec=10.95096642659802, CurrSamplesPerSec=10.886490878739293, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10628/20000 [18:31:40<25:55:44,  9.96s/it][2022-12-22 08:31:04,673] [INFO] [timer.py:197:stop] 0/4629, RunningAvgSamplesPerSec=10.950957908519507, CurrSamplesPerSec=10.911694588351752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10629/20000 [18:31:49<25:09:08,  9.66s/it][2022-12-22 08:31:14,206] [INFO] [logging.py:68:log_dist] [Rank 0] step=10630, skipped=22, lr=[4.816923076923078e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:31:14,207] [INFO] [timer.py:197:stop] 0/4630, RunningAvgSamplesPerSec=10.950865288089226, CurrSamplesPerSec=10.538453502487457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10630/20000 [18:31:58<25:02:55,  9.62s/it][2022-12-22 08:31:23,493] [INFO] [timer.py:197:stop] 0/4631, RunningAvgSamplesPerSec=10.950875941630263, CurrSamplesPerSec=11.000403568053015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10631/20000 [18:32:07<24:46:57,  9.52s/it][2022-12-22 08:31:32,462] [INFO] [timer.py:197:stop] 0/4632, RunningAvgSamplesPerSec=10.95088279867114, CurrSamplesPerSec=10.982716330627253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10632/20000 [18:32:16<24:20:52,  9.36s/it][2022-12-22 08:31:44,027] [INFO] [timer.py:197:stop] 0/4633, RunningAvgSamplesPerSec=10.950798668573755, CurrSamplesPerSec=10.574658593747507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10633/20000 [18:32:28<26:04:07, 10.02s/it][2022-12-22 08:31:53,004] [INFO] [timer.py:197:stop] 0/4634, RunningAvgSamplesPerSec=10.950802588092662, CurrSamplesPerSec=10.968984022949117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10634/20000 [18:32:37<25:15:10,  9.71s/it][2022-12-22 08:32:03,919] [INFO] [timer.py:197:stop] 0/4635, RunningAvgSamplesPerSec=10.950710885760781, CurrSamplesPerSec=10.541809897287088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10635/20000 [18:32:48<26:11:37, 10.07s/it][2022-12-22 08:32:12,980] [INFO] [timer.py:197:stop] 0/4636, RunningAvgSamplesPerSec=10.950724285265473, CurrSamplesPerSec=11.01315820621975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10636/20000 [18:32:57<25:24:15,  9.77s/it][2022-12-22 08:32:22,455] [INFO] [timer.py:197:stop] 0/4637, RunningAvgSamplesPerSec=10.950643918769561, CurrSamplesPerSec=10.590477065196726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10637/20000 [18:33:06<25:10:24,  9.68s/it][2022-12-22 08:32:31,764] [INFO] [timer.py:197:stop] 0/4638, RunningAvgSamplesPerSec=10.950595747837761, CurrSamplesPerSec=10.731785769556707, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10638/20000 [18:33:16<24:52:54,  9.57s/it][2022-12-22 08:32:41,821] [INFO] [timer.py:197:stop] 0/4639, RunningAvgSamplesPerSec=10.950585354578337, CurrSamplesPerSec=10.90261332884506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10639/20000 [18:33:26<25:15:39,  9.71s/it][2022-12-22 08:32:50,955] [INFO] [logging.py:68:log_dist] [Rank 0] step=10640, skipped=22, lr=[4.811794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:32:50,956] [INFO] [timer.py:197:stop] 0/4640, RunningAvgSamplesPerSec=10.95054070537108, CurrSamplesPerSec=10.747344917659747, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10640/20000 [18:33:35<24:48:20,  9.54s/it][2022-12-22 08:33:00,471] [INFO] [timer.py:197:stop] 0/4641, RunningAvgSamplesPerSec=10.95049810297803, CurrSamplesPerSec=10.756411050119416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10641/20000 [18:33:44<24:47:01,  9.53s/it][2022-12-22 08:33:09,521] [INFO] [timer.py:197:stop] 0/4642, RunningAvgSamplesPerSec=10.950512733153591, CurrSamplesPerSec=11.018805475425953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10642/20000 [18:33:53<24:24:14,  9.39s/it][2022-12-22 08:33:18,752] [INFO] [timer.py:197:stop] 0/4643, RunningAvgSamplesPerSec=10.950536935881283, CurrSamplesPerSec=11.064001451814127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10643/20000 [18:34:03<24:16:42,  9.34s/it][2022-12-22 08:33:28,013] [INFO] [timer.py:197:stop] 0/4644, RunningAvgSamplesPerSec=10.950545347118972, CurrSamplesPerSec=10.989721586960018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10644/20000 [18:34:12<24:12:49,  9.32s/it][2022-12-22 08:33:37,066] [INFO] [timer.py:197:stop] 0/4645, RunningAvgSamplesPerSec=10.950607777342226, CurrSamplesPerSec=11.248288508147647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10645/20000 [18:34:21<24:00:19,  9.24s/it][2022-12-22 08:33:46,352] [INFO] [timer.py:197:stop] 0/4646, RunningAvgSamplesPerSec=10.95060477831919, CurrSamplesPerSec=10.936698001627251, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10646/20000 [18:34:30<24:02:26,  9.25s/it][2022-12-22 08:33:55,560] [INFO] [timer.py:197:stop] 0/4647, RunningAvgSamplesPerSec=10.950552164039157, CurrSamplesPerSec=10.711545572823402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10647/20000 [18:34:40<24:00:13,  9.24s/it][2022-12-22 08:34:04,996] [INFO] [timer.py:197:stop] 0/4648, RunningAvgSamplesPerSec=10.950563532865559, CurrSamplesPerSec=11.003627684126757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10648/20000 [18:34:49<24:09:14,  9.30s/it][2022-12-22 08:34:14,294] [INFO] [timer.py:197:stop] 0/4649, RunningAvgSamplesPerSec=10.950536334873437, CurrSamplesPerSec=10.825616267832636, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10649/20000 [18:34:58<24:09:07,  9.30s/it][2022-12-22 08:34:24,295] [INFO] [logging.py:68:log_dist] [Rank 0] step=10650, skipped=22, lr=[4.8066666666666675e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:34:24,296] [INFO] [timer.py:197:stop] 0/4650, RunningAvgSamplesPerSec=10.9505461232002, CurrSamplesPerSec=10.996222247883967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10650/20000 [18:35:08<24:41:50,  9.51s/it]

                                                           
{'loss': 0.0707, 'learning_rate': 4.8066666666666675e-06, 'epoch': 0.53}


 53%|█████▎    | 10650/20000 [18:35:08<24:41:50,  9.51s/it][2022-12-22 08:34:33,623] [INFO] [timer.py:197:stop] 0/4651, RunningAvgSamplesPerSec=10.950563206149873, CurrSamplesPerSec=11.03054482050365, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10651/20000 [18:35:18<24:33:09,  9.45s/it][2022-12-22 08:34:42,794] [INFO] [timer.py:197:stop] 0/4652, RunningAvgSamplesPerSec=10.950572528210628, CurrSamplesPerSec=10.994083023933506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10652/20000 [18:35:27<24:19:47,  9.37s/it][2022-12-22 08:34:51,932] [INFO] [timer.py:197:stop] 0/4653, RunningAvgSamplesPerSec=10.950537544045323, CurrSamplesPerSec=10.790242953402679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10653/20000 [18:35:36<24:08:47,  9.30s/it][2022-12-22 08:35:01,529] [INFO] [timer.py:197:stop] 0/4654, RunningAvgSamplesPerSec=10.950507533925121, CurrSamplesPerSec=10.812687520366778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10654/20000 [18:35:45<24:22:30,  9.39s/it][2022-12-22 08:35:10,954] [INFO] [timer.py:197:stop] 0/4655, RunningAvgSamplesPerSec=10.950508465591279, CurrSamplesPerSec=10.954844293008602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10655/20000 [18:35:55<24:24:02,  9.40s/it][2022-12-22 08:35:19,870] [INFO] [timer.py:197:stop] 0/4656, RunningAvgSamplesPerSec=10.950518024360244, CurrSamplesPerSec=10.99517640114379, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10656/20000 [18:36:04<24:01:16,  9.25s/it][2022-12-22 08:35:28,738] [INFO] [timer.py:197:stop] 0/4657, RunningAvgSamplesPerSec=10.950531101128552, CurrSamplesPerSec=11.01173057952818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10657/20000 [18:36:13<23:43:01,  9.14s/it][2022-12-22 08:35:38,350] [INFO] [timer.py:197:stop] 0/4658, RunningAvgSamplesPerSec=10.950590367029129, CurrSamplesPerSec=11.2336047650976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10658/20000 [18:36:22<24:05:00,  9.28s/it][2022-12-22 08:35:47,506] [INFO] [timer.py:197:stop] 0/4659, RunningAvgSamplesPerSec=10.95055583819113, CurrSamplesPerSec=10.792116138064877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10659/20000 [18:36:31<23:59:02,  9.24s/it][2022-12-22 08:35:57,255] [INFO] [logging.py:68:log_dist] [Rank 0] step=10660, skipped=22, lr=[4.8015384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:35:57,256] [INFO] [timer.py:197:stop] 0/4660, RunningAvgSamplesPerSec=10.95049672131962, CurrSamplesPerSec=10.681942639098107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10660/20000 [18:36:41<24:22:30,  9.40s/it][2022-12-22 08:36:07,205] [INFO] [timer.py:197:stop] 0/4661, RunningAvgSamplesPerSec=10.9504746438236, CurrSamplesPerSec=10.848594637848674, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10661/20000 [18:36:51<24:48:14,  9.56s/it][2022-12-22 08:36:16,354] [INFO] [timer.py:197:stop] 0/4662, RunningAvgSamplesPerSec=10.950511025812004, CurrSamplesPerSec=11.12268030139311, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10662/20000 [18:37:00<24:28:51,  9.44s/it][2022-12-22 08:36:25,892] [INFO] [timer.py:197:stop] 0/4663, RunningAvgSamplesPerSec=10.950469218981695, CurrSamplesPerSec=10.759055561458538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10663/20000 [18:37:10<24:33:19,  9.47s/it][2022-12-22 08:36:34,807] [INFO] [timer.py:197:stop] 0/4664, RunningAvgSamplesPerSec=10.950459548428244, CurrSamplesPerSec=10.905569913833002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10664/20000 [18:37:19<24:07:23,  9.30s/it][2022-12-22 08:36:44,411] [INFO] [timer.py:197:stop] 0/4665, RunningAvgSamplesPerSec=10.95040050801178, CurrSamplesPerSec=10.681904382921955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10665/20000 [18:37:28<24:21:19,  9.39s/it][2022-12-22 08:36:53,543] [INFO] [timer.py:197:stop] 0/4666, RunningAvgSamplesPerSec=10.950403628037115, CurrSamplesPerSec=10.964971665378398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10666/20000 [18:37:38<24:09:01,  9.31s/it][2022-12-22 08:37:03,512] [INFO] [timer.py:197:stop] 0/4667, RunningAvgSamplesPerSec=10.950402685784036, CurrSamplesPerSec=10.946009780786582, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10667/20000 [18:37:47<24:39:24,  9.51s/it][2022-12-22 08:37:12,824] [INFO] [timer.py:197:stop] 0/4668, RunningAvgSamplesPerSec=10.950476129625756, CurrSamplesPerSec=11.30415998781805, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10668/20000 [18:37:57<24:29:56,  9.45s/it][2022-12-22 08:37:22,045] [INFO] [timer.py:197:stop] 0/4669, RunningAvgSamplesPerSec=10.950467313118143, CurrSamplesPerSec=10.909483486304676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10669/20000 [18:38:06<24:19:03,  9.38s/it][2022-12-22 08:37:30,821] [INFO] [logging.py:68:log_dist] [Rank 0] step=10670, skipped=22, lr=[4.7964102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:37:30,822] [INFO] [timer.py:197:stop] 0/4670, RunningAvgSamplesPerSec=10.950511254810513, CurrSamplesPerSec=11.159501846437434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10670/20000 [18:38:15<23:50:40,  9.20s/it][2022-12-22 08:37:40,012] [INFO] [timer.py:197:stop] 0/4671, RunningAvgSamplesPerSec=10.950540198636995, CurrSamplesPerSec=11.08733818093864, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10671/20000 [18:38:24<23:50:02,  9.20s/it][2022-12-22 08:37:49,627] [INFO] [timer.py:197:stop] 0/4672, RunningAvgSamplesPerSec=10.95048163836721, CurrSamplesPerSec=10.683725680869196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10672/20000 [18:38:34<24:09:21,  9.32s/it][2022-12-22 08:37:58,749] [INFO] [timer.py:197:stop] 0/4673, RunningAvgSamplesPerSec=10.950503537983774, CurrSamplesPerSec=11.053739112846241, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10673/20000 [18:38:43<23:59:50,  9.26s/it][2022-12-22 08:38:08,649] [INFO] [timer.py:197:stop] 0/4674, RunningAvgSamplesPerSec=10.950472498447795, CurrSamplesPerSec=10.807381771224742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10674/20000 [18:38:53<24:29:27,  9.45s/it][2022-12-22 08:38:17,889] [INFO] [timer.py:197:stop] 0/4675, RunningAvgSamplesPerSec=10.950458552155055, CurrSamplesPerSec=10.885686956910336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10675/20000 [18:39:02<24:19:17,  9.39s/it]

                                                           
{'loss': 0.0677, 'learning_rate': 4.793846153846154e-06, 'epoch': 0.53}


 53%|█████▎    | 10675/20000 [18:39:02<24:19:17,  9.39s/it][2022-12-22 08:38:27,816] [INFO] [timer.py:197:stop] 0/4676, RunningAvgSamplesPerSec=10.950484100450433, CurrSamplesPerSec=11.071187530342245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10676/20000 [18:39:12<24:44:13,  9.55s/it][2022-12-22 08:38:37,046] [INFO] [timer.py:197:stop] 0/4677, RunningAvgSamplesPerSec=10.950506814517398, CurrSamplesPerSec=11.057711943375516, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10677/20000 [18:39:21<24:29:05,  9.45s/it][2022-12-22 08:38:46,544] [INFO] [timer.py:197:stop] 0/4678, RunningAvgSamplesPerSec=10.950465007360691, CurrSamplesPerSec=10.758444544016827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10678/20000 [18:39:31<24:30:57,  9.47s/it][2022-12-22 08:38:55,589] [INFO] [timer.py:197:stop] 0/4679, RunningAvgSamplesPerSec=10.950429853571805, CurrSamplesPerSec=10.788482284348277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10679/20000 [18:39:40<24:11:06,  9.34s/it][2022-12-22 08:39:07,320] [INFO] [logging.py:68:log_dist] [Rank 0] step=10680, skipped=22, lr=[4.791282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:39:07,321] [INFO] [timer.py:197:stop] 0/4680, RunningAvgSamplesPerSec=10.950480804746658, CurrSamplesPerSec=11.194081698413306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10680/20000 [18:39:51<26:02:22, 10.06s/it][2022-12-22 08:39:16,853] [INFO] [timer.py:197:stop] 0/4681, RunningAvgSamplesPerSec=10.950410084656054, CurrSamplesPerSec=10.629285245681453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10681/20000 [18:40:01<25:37:41,  9.90s/it][2022-12-22 08:39:27,372] [INFO] [timer.py:197:stop] 0/4682, RunningAvgSamplesPerSec=10.95036768634814, CurrSamplesPerSec=10.755516763167718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10682/20000 [18:40:11<26:06:20, 10.09s/it][2022-12-22 08:39:36,686] [INFO] [timer.py:197:stop] 0/4683, RunningAvgSamplesPerSec=10.950414026552663, CurrSamplesPerSec=11.171669059962465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10683/20000 [18:40:21<25:30:11,  9.85s/it][2022-12-22 08:39:45,643] [INFO] [timer.py:197:stop] 0/4684, RunningAvgSamplesPerSec=10.95045168853038, CurrSamplesPerSec=11.129632729999512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10684/20000 [18:40:30<24:48:14,  9.59s/it][2022-12-22 08:39:55,489] [INFO] [timer.py:197:stop] 0/4685, RunningAvgSamplesPerSec=10.950407413186955, CurrSamplesPerSec=10.746962402370297, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10685/20000 [18:40:39<25:00:14,  9.66s/it][2022-12-22 08:40:04,690] [INFO] [timer.py:197:stop] 0/4686, RunningAvgSamplesPerSec=10.950437573138045, CurrSamplesPerSec=11.0935225319811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10686/20000 [18:40:49<24:38:33,  9.52s/it][2022-12-22 08:40:13,732] [INFO] [timer.py:197:stop] 0/4687, RunningAvgSamplesPerSec=10.950415261838135, CurrSamplesPerSec=10.846897275832651, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10687/20000 [18:40:58<24:15:55,  9.38s/it][2022-12-22 08:40:23,342] [INFO] [timer.py:197:stop] 0/4688, RunningAvgSamplesPerSec=10.950418456257248, CurrSamplesPerSec=10.965404795889448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10688/20000 [18:41:07<24:26:28,  9.45s/it][2022-12-22 08:40:32,557] [INFO] [timer.py:197:stop] 0/4689, RunningAvgSamplesPerSec=10.950374929611609, CurrSamplesPerSec=10.750139525108432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10689/20000 [18:41:17<24:15:23,  9.38s/it][2022-12-22 08:40:41,633] [INFO] [logging.py:68:log_dist] [Rank 0] step=10690, skipped=22, lr=[4.786153846153846e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:40:41,634] [INFO] [timer.py:197:stop] 0/4690, RunningAvgSamplesPerSec=10.950424699606472, CurrSamplesPerSec=11.188775222687239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10690/20000 [18:41:26<24:01:12,  9.29s/it][2022-12-22 08:40:50,708] [INFO] [timer.py:197:stop] 0/4691, RunningAvgSamplesPerSec=10.950422700598033, CurrSamplesPerSec=10.941059363873661, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10691/20000 [18:41:35<23:51:05,  9.22s/it][2022-12-22 08:40:59,640] [INFO] [timer.py:197:stop] 0/4692, RunningAvgSamplesPerSec=10.950440498123854, CurrSamplesPerSec=11.034534105319842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10692/20000 [18:41:44<23:37:20,  9.14s/it][2022-12-22 08:41:09,393] [INFO] [timer.py:197:stop] 0/4693, RunningAvgSamplesPerSec=10.95037554892293, CurrSamplesPerSec=10.654009702679277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10693/20000 [18:41:53<24:05:52,  9.32s/it][2022-12-22 08:41:18,825] [INFO] [timer.py:197:stop] 0/4694, RunningAvgSamplesPerSec=10.950393818216396, CurrSamplesPerSec=11.036771235032894, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10694/20000 [18:42:03<24:10:52,  9.35s/it][2022-12-22 08:41:27,802] [INFO] [timer.py:197:stop] 0/4695, RunningAvgSamplesPerSec=10.950414702620268, CurrSamplesPerSec=11.049289291952652, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10695/20000 [18:42:12<23:53:11,  9.24s/it][2022-12-22 08:41:37,030] [INFO] [timer.py:197:stop] 0/4696, RunningAvgSamplesPerSec=10.95043260675665, CurrSamplesPerSec=11.035106571730147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10696/20000 [18:42:21<23:52:25,  9.24s/it][2022-12-22 08:41:46,158] [INFO] [timer.py:197:stop] 0/4697, RunningAvgSamplesPerSec=10.950365492098415, CurrSamplesPerSec=10.6441410771471, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10697/20000 [18:42:30<23:47:09,  9.20s/it][2022-12-22 08:41:55,367] [INFO] [timer.py:197:stop] 0/4698, RunningAvgSamplesPerSec=10.950374957143762, CurrSamplesPerSec=10.994994456739818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10698/20000 [18:42:39<23:47:13,  9.21s/it][2022-12-22 08:42:06,114] [INFO] [timer.py:197:stop] 0/4699, RunningAvgSamplesPerSec=10.950398839368038, CurrSamplesPerSec=11.063710518249476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 53%|█████▎    | 10699/20000 [18:42:50<24:58:42,  9.67s/it][2022-12-22 08:42:14,988] [INFO] [logging.py:68:log_dist] [Rank 0] step=10700, skipped=22, lr=[4.781025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:42:14,989] [INFO] [timer.py:197:stop] 0/4700, RunningAvgSamplesPerSec=10.950390492019197, CurrSamplesPerSec=10.911322904451142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10700/20000 [18:42:59<24:21:41,  9.43s/it]

                                                           
{'loss': 0.0722, 'learning_rate': 4.781025641025641e-06, 'epoch': 0.54}


 54%|█████▎    | 10700/20000 [18:42:59<24:21:41,  9.43s/it][2022-12-22 08:42:25,304] [INFO] [timer.py:197:stop] 0/4701, RunningAvgSamplesPerSec=10.950359891473466, CurrSamplesPerSec=10.808461827252055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10701/20000 [18:43:09<25:02:38,  9.70s/it][2022-12-22 08:42:34,818] [INFO] [timer.py:197:stop] 0/4702, RunningAvgSamplesPerSec=10.950317256865322, CurrSamplesPerSec=10.75357742572609, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10702/20000 [18:43:19<24:54:04,  9.64s/it][2022-12-22 08:42:43,728] [INFO] [timer.py:197:stop] 0/4703, RunningAvgSamplesPerSec=10.950323175042008, CurrSamplesPerSec=10.978209455791163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10703/20000 [18:43:28<24:19:55,  9.42s/it][2022-12-22 08:42:53,709] [INFO] [timer.py:197:stop] 0/4704, RunningAvgSamplesPerSec=10.95032539570898, CurrSamplesPerSec=10.960774714987064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10704/20000 [18:43:38<24:45:43,  9.59s/it][2022-12-22 08:43:02,943] [INFO] [timer.py:197:stop] 0/4705, RunningAvgSamplesPerSec=10.950323057458553, CurrSamplesPerSec=10.939339633979083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10705/20000 [18:43:47<24:29:02,  9.48s/it][2022-12-22 08:43:15,025] [INFO] [timer.py:197:stop] 0/4706, RunningAvgSamplesPerSec=10.950363900209911, CurrSamplesPerSec=11.145877651617996, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10706/20000 [18:43:59<26:29:40, 10.26s/it][2022-12-22 08:43:25,917] [INFO] [timer.py:197:stop] 0/4707, RunningAvgSamplesPerSec=10.950375987823021, CurrSamplesPerSec=11.007532972207642, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10707/20000 [18:44:10<26:58:46, 10.45s/it][2022-12-22 08:43:35,246] [INFO] [timer.py:197:stop] 0/4708, RunningAvgSamplesPerSec=10.95025125088294, CurrSamplesPerSec=10.393224574576791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10708/20000 [18:44:19<26:06:26, 10.11s/it][2022-12-22 08:43:45,289] [INFO] [timer.py:197:stop] 0/4709, RunningAvgSamplesPerSec=10.950218273776066, CurrSamplesPerSec=10.797197137897914, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10709/20000 [18:44:29<26:02:54, 10.09s/it][2022-12-22 08:43:55,908] [INFO] [logging.py:68:log_dist] [Rank 0] step=10710, skipped=22, lr=[4.775897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:43:55,909] [INFO] [timer.py:197:stop] 0/4710, RunningAvgSamplesPerSec=10.950145644137379, CurrSamplesPerSec=10.618630172728922, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10710/20000 [18:44:40<26:27:13, 10.25s/it][2022-12-22 08:44:05,604] [INFO] [timer.py:197:stop] 0/4711, RunningAvgSamplesPerSec=10.95016385189926, CurrSamplesPerSec=11.03656250073235, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10711/20000 [18:44:50<26:01:14, 10.08s/it][2022-12-22 08:44:14,787] [INFO] [timer.py:197:stop] 0/4712, RunningAvgSamplesPerSec=10.95021214565345, CurrSamplesPerSec=11.182451635307102, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10712/20000 [18:44:59<25:19:11,  9.81s/it][2022-12-22 08:44:24,165] [INFO] [timer.py:197:stop] 0/4713, RunningAvgSamplesPerSec=10.950267873256406, CurrSamplesPerSec=11.219192349086791, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10713/20000 [18:45:08<24:58:48,  9.68s/it][2022-12-22 08:44:32,976] [INFO] [timer.py:197:stop] 0/4714, RunningAvgSamplesPerSec=10.950311726162845, CurrSamplesPerSec=11.16087616772498, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10714/20000 [18:45:17<24:18:09,  9.42s/it][2022-12-22 08:44:42,525] [INFO] [timer.py:197:stop] 0/4715, RunningAvgSamplesPerSec=10.950328800162957, CurrSamplesPerSec=11.031377081404262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10715/20000 [18:45:26<24:23:55,  9.46s/it][2022-12-22 08:44:52,997] [INFO] [timer.py:197:stop] 0/4716, RunningAvgSamplesPerSec=10.950309831187703, CurrSamplesPerSec=10.86163318044758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10716/20000 [18:45:37<25:10:42,  9.76s/it][2022-12-22 08:45:02,723] [INFO] [timer.py:197:stop] 0/4717, RunningAvgSamplesPerSec=10.950351050608543, CurrSamplesPerSec=11.148170346793538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10717/20000 [18:45:47<25:08:48,  9.75s/it][2022-12-22 08:45:12,238] [INFO] [timer.py:197:stop] 0/4718, RunningAvgSamplesPerSec=10.950329474783684, CurrSamplesPerSec=10.84953604352951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10718/20000 [18:45:56<24:57:38,  9.68s/it][2022-12-22 08:45:21,613] [INFO] [timer.py:197:stop] 0/4719, RunningAvgSamplesPerSec=10.950378186909905, CurrSamplesPerSec=11.18502830867584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10719/20000 [18:46:06<24:43:18,  9.59s/it][2022-12-22 08:45:35,882] [INFO] [logging.py:68:log_dist] [Rank 0] step=10720, skipped=22, lr=[4.770769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:45:35,883] [INFO] [timer.py:197:stop] 0/4720, RunningAvgSamplesPerSec=10.950328883966957, CurrSamplesPerSec=10.72260431877735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10720/20000 [18:46:20<28:20:18, 10.99s/it][2022-12-22 08:45:45,029] [INFO] [timer.py:197:stop] 0/4721, RunningAvgSamplesPerSec=10.950383992789481, CurrSamplesPerSec=11.216712398817954, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10721/20000 [18:46:29<26:54:25, 10.44s/it][2022-12-22 08:45:54,342] [INFO] [timer.py:197:stop] 0/4722, RunningAvgSamplesPerSec=10.950392230383258, CurrSamplesPerSec=10.98940395393526, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10722/20000 [18:46:38<26:02:02, 10.10s/it][2022-12-22 08:46:04,047] [INFO] [timer.py:197:stop] 0/4723, RunningAvgSamplesPerSec=10.950409974455292, CurrSamplesPerSec=11.034807629800026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10723/20000 [18:46:48<25:43:27,  9.98s/it][2022-12-22 08:46:12,957] [INFO] [timer.py:197:stop] 0/4724, RunningAvgSamplesPerSec=10.950484595589224, CurrSamplesPerSec=11.314483606092002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10724/20000 [18:46:57<24:53:31,  9.66s/it][2022-12-22 08:46:22,386] [INFO] [timer.py:197:stop] 0/4725, RunningAvgSamplesPerSec=10.950425066866432, CurrSamplesPerSec=10.676366930399878, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10725/20000 [18:47:06<24:42:39,  9.59s/it]

                                                           
{'loss': 0.0798, 'learning_rate': 4.768205128205128e-06, 'epoch': 0.54}


 54%|█████▎    | 10725/20000 [18:47:06<24:42:39,  9.59s/it][2022-12-22 08:46:31,708] [INFO] [timer.py:197:stop] 0/4726, RunningAvgSamplesPerSec=10.95047280506767, CurrSamplesPerSec=11.180681268384877, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10726/20000 [18:47:16<24:30:01,  9.51s/it][2022-12-22 08:46:40,907] [INFO] [timer.py:197:stop] 0/4727, RunningAvgSamplesPerSec=10.950518484476977, CurrSamplesPerSec=11.17064675202871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10727/20000 [18:47:25<24:15:23,  9.42s/it][2022-12-22 08:46:50,543] [INFO] [timer.py:197:stop] 0/4728, RunningAvgSamplesPerSec=10.950437289842313, CurrSamplesPerSec=10.579781192989449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10728/20000 [18:47:35<24:25:25,  9.48s/it][2022-12-22 08:47:00,147] [INFO] [timer.py:197:stop] 0/4729, RunningAvgSamplesPerSec=10.950499793268426, CurrSamplesPerSec=11.254081885270901, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10729/20000 [18:47:44<24:30:51,  9.52s/it][2022-12-22 08:47:08,993] [INFO] [logging.py:68:log_dist] [Rank 0] step=10730, skipped=22, lr=[4.765641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:47:08,994] [INFO] [timer.py:197:stop] 0/4730, RunningAvgSamplesPerSec=10.950528133373234, CurrSamplesPerSec=11.086151310768368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10730/20000 [18:47:53<23:59:30,  9.32s/it][2022-12-22 08:47:18,310] [INFO] [timer.py:197:stop] 0/4731, RunningAvgSamplesPerSec=10.950561657501654, CurrSamplesPerSec=11.111392143081257, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10731/20000 [18:48:02<23:59:19,  9.32s/it][2022-12-22 08:47:27,691] [INFO] [timer.py:197:stop] 0/4732, RunningAvgSamplesPerSec=10.950581100903667, CurrSamplesPerSec=11.043307703545112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10732/20000 [18:48:12<24:02:08,  9.34s/it][2022-12-22 08:47:37,473] [INFO] [timer.py:197:stop] 0/4733, RunningAvgSamplesPerSec=10.950624103527412, CurrSamplesPerSec=11.157876946452548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10733/20000 [18:48:21<24:22:38,  9.47s/it][2022-12-22 08:47:46,169] [INFO] [timer.py:197:stop] 0/4734, RunningAvgSamplesPerSec=10.950692794096861, CurrSamplesPerSec=11.28560902413313, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10734/20000 [18:48:30<23:46:37,  9.24s/it][2022-12-22 08:47:55,445] [INFO] [timer.py:197:stop] 0/4735, RunningAvgSamplesPerSec=10.950745952040135, CurrSamplesPerSec=11.208204524552016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10735/20000 [18:48:39<23:48:13,  9.25s/it][2022-12-22 08:48:04,813] [INFO] [timer.py:197:stop] 0/4736, RunningAvgSamplesPerSec=10.950735921197717, CurrSamplesPerSec=10.903464926675353, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10736/20000 [18:48:49<23:53:33,  9.28s/it][2022-12-22 08:48:14,750] [INFO] [timer.py:197:stop] 0/4737, RunningAvgSamplesPerSec=10.950738459979545, CurrSamplesPerSec=10.962770261017916, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10737/20000 [18:48:59<24:23:37,  9.48s/it][2022-12-22 08:48:24,133] [INFO] [timer.py:197:stop] 0/4738, RunningAvgSamplesPerSec=10.950727889855047, CurrSamplesPerSec=10.900906105443239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10738/20000 [18:49:08<24:18:57,  9.45s/it][2022-12-22 08:48:33,907] [INFO] [timer.py:197:stop] 0/4739, RunningAvgSamplesPerSec=10.95075237882634, CurrSamplesPerSec=11.067973905956336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10739/20000 [18:49:18<24:33:45,  9.55s/it][2022-12-22 08:48:43,639] [INFO] [logging.py:68:log_dist] [Rank 0] step=10740, skipped=22, lr=[4.760512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:48:43,640] [INFO] [timer.py:197:stop] 0/4740, RunningAvgSamplesPerSec=10.950810481977797, CurrSamplesPerSec=11.233142667134848, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10740/20000 [18:49:28<24:42:08,  9.60s/it][2022-12-22 08:48:53,044] [INFO] [timer.py:197:stop] 0/4741, RunningAvgSamplesPerSec=10.950848034110132, CurrSamplesPerSec=11.13170916719066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10741/20000 [18:49:37<24:32:45,  9.54s/it][2022-12-22 08:49:02,442] [INFO] [timer.py:197:stop] 0/4742, RunningAvgSamplesPerSec=10.950848417147999, CurrSamplesPerSec=10.95266393460181, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10742/20000 [18:49:46<24:25:50,  9.50s/it][2022-12-22 08:49:11,833] [INFO] [timer.py:197:stop] 0/4743, RunningAvgSamplesPerSec=10.950800304213612, CurrSamplesPerSec=10.727398420779055, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10743/20000 [18:49:56<24:20:39,  9.47s/it][2022-12-22 08:49:21,575] [INFO] [timer.py:197:stop] 0/4744, RunningAvgSamplesPerSec=10.950778016301928, CurrSamplesPerSec=10.846121102604208, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10744/20000 [18:50:06<24:33:11,  9.55s/it][2022-12-22 08:49:31,139] [INFO] [timer.py:197:stop] 0/4745, RunningAvgSamplesPerSec=10.950731470040022, CurrSamplesPerSec=10.734370966769953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10745/20000 [18:50:15<24:33:41,  9.55s/it][2022-12-22 08:49:40,531] [INFO] [timer.py:197:stop] 0/4746, RunningAvgSamplesPerSec=10.950745637488328, CurrSamplesPerSec=11.018356809444589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10746/20000 [18:50:24<24:26:03,  9.51s/it][2022-12-22 08:49:50,127] [INFO] [timer.py:197:stop] 0/4747, RunningAvgSamplesPerSec=10.95073373213414, CurrSamplesPerSec=10.894544591479724, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10747/20000 [18:50:34<24:30:04,  9.53s/it][2022-12-22 08:49:59,536] [INFO] [timer.py:197:stop] 0/4748, RunningAvgSamplesPerSec=10.95078631416563, CurrSamplesPerSec=11.206106471251973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10748/20000 [18:50:43<24:24:13,  9.50s/it][2022-12-22 08:50:08,658] [INFO] [timer.py:197:stop] 0/4749, RunningAvgSamplesPerSec=10.950761862072019, CurrSamplesPerSec=10.835929407996804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▎    | 10749/20000 [18:50:53<24:06:45,  9.38s/it][2022-12-22 08:50:18,310] [INFO] [logging.py:68:log_dist] [Rank 0] step=10750, skipped=22, lr=[4.755384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:50:18,311] [INFO] [timer.py:197:stop] 0/4750, RunningAvgSamplesPerSec=10.950814845819306, CurrSamplesPerSec=11.208242431489898, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10750/20000 [18:51:02<24:19:05,  9.46s/it]

                                                           
{'loss': 0.0804, 'learning_rate': 4.755384615384616e-06, 'epoch': 0.54}


 54%|█████▍    | 10750/20000 [18:51:02<24:19:05,  9.46s/it][2022-12-22 08:50:27,612] [INFO] [timer.py:197:stop] 0/4751, RunningAvgSamplesPerSec=10.950793425139937, CurrSamplesPerSec=10.85002413043531, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10751/20000 [18:51:12<24:11:23,  9.42s/it][2022-12-22 08:50:36,878] [INFO] [timer.py:197:stop] 0/4752, RunningAvgSamplesPerSec=10.950833506598208, CurrSamplesPerSec=11.144548200156551, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10752/20000 [18:51:21<24:04:19,  9.37s/it][2022-12-22 08:50:45,893] [INFO] [timer.py:197:stop] 0/4753, RunningAvgSamplesPerSec=10.950836188129161, CurrSamplesPerSec=10.963588295669016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10753/20000 [18:51:30<23:47:42,  9.26s/it][2022-12-22 08:50:55,491] [INFO] [timer.py:197:stop] 0/4754, RunningAvgSamplesPerSec=10.95090379814833, CurrSamplesPerSec=11.281827804721049, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10754/20000 [18:51:39<24:03:00,  9.36s/it][2022-12-22 08:51:04,760] [INFO] [timer.py:197:stop] 0/4755, RunningAvgSamplesPerSec=10.950906317168315, CurrSamplesPerSec=10.96288980197935, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10755/20000 [18:51:49<23:58:26,  9.34s/it][2022-12-22 08:51:15,631] [INFO] [timer.py:197:stop] 0/4756, RunningAvgSamplesPerSec=10.950964490030707, CurrSamplesPerSec=11.234623583307103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10756/20000 [18:52:00<25:09:15,  9.80s/it][2022-12-22 08:51:25,061] [INFO] [timer.py:197:stop] 0/4757, RunningAvgSamplesPerSec=10.950970813164817, CurrSamplesPerSec=10.981113751848318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10757/20000 [18:52:09<24:52:10,  9.69s/it][2022-12-22 08:51:35,130] [INFO] [timer.py:197:stop] 0/4758, RunningAvgSamplesPerSec=10.950987336044594, CurrSamplesPerSec=11.030121485424699, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10758/20000 [18:52:19<25:09:41,  9.80s/it][2022-12-22 08:51:46,004] [INFO] [timer.py:197:stop] 0/4759, RunningAvgSamplesPerSec=10.951004723370614, CurrSamplesPerSec=11.034328177096812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10759/20000 [18:52:30<25:59:06, 10.12s/it][2022-12-22 08:51:54,874] [INFO] [logging.py:68:log_dist] [Rank 0] step=10760, skipped=22, lr=[4.7502564102564106e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:51:54,875] [INFO] [timer.py:197:stop] 0/4760, RunningAvgSamplesPerSec=10.951019053716637, CurrSamplesPerSec=11.019615609071082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10760/20000 [18:52:39<25:01:05,  9.75s/it][2022-12-22 08:52:04,724] [INFO] [timer.py:197:stop] 0/4761, RunningAvgSamplesPerSec=10.950988236106939, CurrSamplesPerSec=10.806295840681168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10761/20000 [18:52:49<25:05:36,  9.78s/it][2022-12-22 08:52:13,591] [INFO] [timer.py:197:stop] 0/4762, RunningAvgSamplesPerSec=10.951048177660084, CurrSamplesPerSec=11.243941147669618, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10762/20000 [18:52:58<24:23:23,  9.50s/it][2022-12-22 08:52:22,634] [INFO] [timer.py:197:stop] 0/4763, RunningAvgSamplesPerSec=10.951047962220136, CurrSamplesPerSec=10.950022564101895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10763/20000 [18:53:07<24:01:56,  9.37s/it][2022-12-22 08:52:32,116] [INFO] [timer.py:197:stop] 0/4764, RunningAvgSamplesPerSec=10.951038117396607, CurrSamplesPerSec=10.904366711399538, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10764/20000 [18:53:16<24:07:07,  9.40s/it][2022-12-22 08:52:41,547] [INFO] [timer.py:197:stop] 0/4765, RunningAvgSamplesPerSec=10.951013622825698, CurrSamplesPerSec=10.835600045435694, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10765/20000 [18:53:26<24:08:19,  9.41s/it][2022-12-22 08:52:50,886] [INFO] [timer.py:197:stop] 0/4766, RunningAvgSamplesPerSec=10.95097118765475, CurrSamplesPerSec=10.752516062854175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10766/20000 [18:53:35<24:04:53,  9.39s/it][2022-12-22 08:53:00,070] [INFO] [timer.py:197:stop] 0/4767, RunningAvgSamplesPerSec=10.950989441975082, CurrSamplesPerSec=11.038649291232616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10767/20000 [18:53:44<23:55:20,  9.33s/it][2022-12-22 08:53:09,111] [INFO] [timer.py:197:stop] 0/4768, RunningAvgSamplesPerSec=10.950980709180273, CurrSamplesPerSec=10.909526493581685, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10768/20000 [18:53:53<23:41:54,  9.24s/it][2022-12-22 08:53:18,597] [INFO] [timer.py:197:stop] 0/4769, RunningAvgSamplesPerSec=10.950968247768424, CurrSamplesPerSec=10.891897587812034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10769/20000 [18:54:03<23:53:03,  9.31s/it][2022-12-22 08:53:28,340] [INFO] [logging.py:68:log_dist] [Rank 0] step=10770, skipped=22, lr=[4.7451282051282055e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:53:28,341] [INFO] [timer.py:197:stop] 0/4770, RunningAvgSamplesPerSec=10.950922586542674, CurrSamplesPerSec=10.737498556489202, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10770/20000 [18:54:12<24:12:43,  9.44s/it][2022-12-22 08:53:38,414] [INFO] [timer.py:197:stop] 0/4771, RunningAvgSamplesPerSec=10.950847215476346, CurrSamplesPerSec=10.602898838322252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10771/20000 [18:54:22<24:41:37,  9.63s/it][2022-12-22 08:53:48,234] [INFO] [timer.py:197:stop] 0/4772, RunningAvgSamplesPerSec=10.950835540845084, CurrSamplesPerSec=10.895440921126006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10772/20000 [18:54:32<24:50:07,  9.69s/it][2022-12-22 08:53:57,509] [INFO] [timer.py:197:stop] 0/4773, RunningAvgSamplesPerSec=10.950826641363639, CurrSamplesPerSec=10.908540071764161, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10773/20000 [18:54:41<24:30:53,  9.56s/it][2022-12-22 08:54:09,941] [INFO] [timer.py:197:stop] 0/4774, RunningAvgSamplesPerSec=10.950824938848692, CurrSamplesPerSec=10.942708261782679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10774/20000 [18:54:54<26:43:00, 10.42s/it][2022-12-22 08:54:19,111] [INFO] [timer.py:197:stop] 0/4775, RunningAvgSamplesPerSec=10.950759826433707, CurrSamplesPerSec=10.648618135533608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10775/20000 [18:55:03<25:44:56, 10.05s/it]

                                                           
{'loss': 0.0689, 'learning_rate': 4.7425641025641025e-06, 'epoch': 0.54}


 54%|█████▍    | 10775/20000 [18:55:03<25:44:56, 10.05s/it][2022-12-22 08:54:28,378] [INFO] [timer.py:197:stop] 0/4776, RunningAvgSamplesPerSec=10.950718049284918, CurrSamplesPerSec=10.754882448314872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10776/20000 [18:55:12<25:08:43,  9.81s/it][2022-12-22 08:54:37,685] [INFO] [timer.py:197:stop] 0/4777, RunningAvgSamplesPerSec=10.950717465781974, CurrSamplesPerSec=10.947932531306074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10777/20000 [18:55:22<24:45:12,  9.66s/it][2022-12-22 08:54:47,000] [INFO] [timer.py:197:stop] 0/4778, RunningAvgSamplesPerSec=10.950726935550216, CurrSamplesPerSec=10.996132608951587, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10778/20000 [18:55:31<24:29:01,  9.56s/it][2022-12-22 08:54:56,256] [INFO] [timer.py:197:stop] 0/4779, RunningAvgSamplesPerSec=10.95074079340751, CurrSamplesPerSec=11.017328452912949, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10779/20000 [18:55:40<24:14:58,  9.47s/it][2022-12-22 08:55:05,520] [INFO] [logging.py:68:log_dist] [Rank 0] step=10780, skipped=22, lr=[4.74e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:55:05,521] [INFO] [timer.py:197:stop] 0/4780, RunningAvgSamplesPerSec=10.950761298349594, CurrSamplesPerSec=11.049597660890159, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10780/20000 [18:55:49<24:05:27,  9.41s/it][2022-12-22 08:55:14,685] [INFO] [timer.py:197:stop] 0/4781, RunningAvgSamplesPerSec=10.95071441443446, CurrSamplesPerSec=10.731194576393476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10781/20000 [18:55:59<23:54:06,  9.33s/it][2022-12-22 08:55:23,444] [INFO] [timer.py:197:stop] 0/4782, RunningAvgSamplesPerSec=10.950758009297608, CurrSamplesPerSec=11.163139292253971, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10782/20000 [18:56:07<23:27:29,  9.16s/it][2022-12-22 08:55:33,805] [INFO] [timer.py:197:stop] 0/4783, RunningAvgSamplesPerSec=10.95067821863068, CurrSamplesPerSec=10.58211803865771, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10783/20000 [18:56:18<24:22:36,  9.52s/it][2022-12-22 08:55:43,901] [INFO] [timer.py:197:stop] 0/4784, RunningAvgSamplesPerSec=10.950708591591454, CurrSamplesPerSec=11.097873623987557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10784/20000 [18:56:28<24:48:56,  9.69s/it][2022-12-22 08:55:52,752] [INFO] [timer.py:197:stop] 0/4785, RunningAvgSamplesPerSec=10.95074310094049, CurrSamplesPerSec=11.118292240502623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10785/20000 [18:56:37<24:09:56,  9.44s/it][2022-12-22 08:56:02,024] [INFO] [timer.py:197:stop] 0/4786, RunningAvgSamplesPerSec=10.950751207398826, CurrSamplesPerSec=10.989662198086734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10786/20000 [18:56:46<24:02:02,  9.39s/it][2022-12-22 08:56:11,128] [INFO] [timer.py:197:stop] 0/4787, RunningAvgSamplesPerSec=10.950759743303637, CurrSamplesPerSec=10.991748391983258, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10787/20000 [18:56:55<23:48:41,  9.30s/it][2022-12-22 08:56:19,999] [INFO] [timer.py:197:stop] 0/4788, RunningAvgSamplesPerSec=10.950762787434169, CurrSamplesPerSec=10.965348357089812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10788/20000 [18:57:04<23:28:34,  9.17s/it][2022-12-22 08:56:30,710] [INFO] [timer.py:197:stop] 0/4789, RunningAvgSamplesPerSec=10.950744500205923, CurrSamplesPerSec=10.863915938966779, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10789/20000 [18:57:15<24:39:10,  9.64s/it][2022-12-22 08:56:40,055] [INFO] [logging.py:68:log_dist] [Rank 0] step=10790, skipped=22, lr=[4.734871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:56:40,056] [INFO] [timer.py:197:stop] 0/4790, RunningAvgSamplesPerSec=10.950730329987241, CurrSamplesPerSec=10.88331517457163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10790/20000 [18:57:24<24:25:40,  9.55s/it][2022-12-22 08:56:49,990] [INFO] [timer.py:197:stop] 0/4791, RunningAvgSamplesPerSec=10.950652167843062, CurrSamplesPerSec=10.588781397763317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10791/20000 [18:57:34<24:43:18,  9.66s/it][2022-12-22 08:56:59,174] [INFO] [timer.py:197:stop] 0/4792, RunningAvgSamplesPerSec=10.950659890269801, CurrSamplesPerSec=10.987767939848688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10792/20000 [18:57:43<24:21:01,  9.52s/it][2022-12-22 08:57:08,318] [INFO] [timer.py:197:stop] 0/4793, RunningAvgSamplesPerSec=10.950667566125817, CurrSamplesPerSec=10.987558806271823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10793/20000 [18:57:52<24:03:33,  9.41s/it][2022-12-22 08:57:17,868] [INFO] [timer.py:197:stop] 0/4794, RunningAvgSamplesPerSec=10.950611545085101, CurrSamplesPerSec=10.688637010864337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10794/20000 [18:58:02<24:09:56,  9.45s/it][2022-12-22 08:57:27,431] [INFO] [timer.py:197:stop] 0/4795, RunningAvgSamplesPerSec=10.950568290112773, CurrSamplesPerSec=10.747141824036715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10795/20000 [18:58:11<24:14:59,  9.48s/it][2022-12-22 08:57:37,212] [INFO] [timer.py:197:stop] 0/4796, RunningAvgSamplesPerSec=10.950616085353635, CurrSamplesPerSec=11.18459443117433, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10796/20000 [18:58:21<24:28:31,  9.57s/it][2022-12-22 08:57:46,162] [INFO] [timer.py:197:stop] 0/4797, RunningAvgSamplesPerSec=10.950611367554574, CurrSamplesPerSec=10.928040865148771, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10797/20000 [18:58:30<23:59:41,  9.39s/it][2022-12-22 08:57:55,499] [INFO] [timer.py:197:stop] 0/4798, RunningAvgSamplesPerSec=10.950605797032923, CurrSamplesPerSec=10.923960153159411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10798/20000 [18:58:39<23:57:16,  9.37s/it][2022-12-22 08:58:07,467] [INFO] [timer.py:197:stop] 0/4799, RunningAvgSamplesPerSec=10.95061041430187, CurrSamplesPerSec=10.97279971693589, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10799/20000 [18:58:51<25:56:33, 10.15s/it][2022-12-22 08:58:16,941] [INFO] [logging.py:68:log_dist] [Rank 0] step=10800, skipped=22, lr=[4.72974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:58:16,941] [INFO] [timer.py:197:stop] 0/4800, RunningAvgSamplesPerSec=10.95056795954558, CurrSamplesPerSec=10.750631626319276, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10800/20000 [18:59:01<25:25:17,  9.95s/it]

                                                           
{'loss': 0.0639, 'learning_rate': 4.72974358974359e-06, 'epoch': 0.54}


 54%|█████▍    | 10800/20000 [18:59:01<25:25:17,  9.95s/it][2022-12-22 08:58:26,078] [INFO] [timer.py:197:stop] 0/4801, RunningAvgSamplesPerSec=10.950524610765543, CurrSamplesPerSec=10.746414708537399, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10801/20000 [18:59:10<24:47:51,  9.70s/it][2022-12-22 08:58:35,392] [INFO] [timer.py:197:stop] 0/4802, RunningAvgSamplesPerSec=10.950448853650254, CurrSamplesPerSec=10.598575208990194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10802/20000 [18:59:19<24:29:43,  9.59s/it][2022-12-22 08:58:44,530] [INFO] [timer.py:197:stop] 0/4803, RunningAvgSamplesPerSec=10.950449141128283, CurrSamplesPerSec=10.951829209607174, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10803/20000 [18:59:28<24:08:54,  9.45s/it][2022-12-22 08:58:54,266] [INFO] [timer.py:197:stop] 0/4804, RunningAvgSamplesPerSec=10.950492468003823, CurrSamplesPerSec=11.16253350552857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10804/20000 [18:59:38<24:21:45,  9.54s/it][2022-12-22 08:59:03,667] [INFO] [timer.py:197:stop] 0/4805, RunningAvgSamplesPerSec=10.950470055267596, CurrSamplesPerSec=10.843891811159743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10805/20000 [18:59:48<24:15:20,  9.50s/it][2022-12-22 08:59:12,608] [INFO] [timer.py:197:stop] 0/4806, RunningAvgSamplesPerSec=10.950450895703181, CurrSamplesPerSec=10.859194550795973, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10806/20000 [18:59:57<23:49:40,  9.33s/it][2022-12-22 08:59:21,455] [INFO] [timer.py:197:stop] 0/4807, RunningAvgSamplesPerSec=10.950465016178839, CurrSamplesPerSec=11.01872270465867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10807/20000 [19:00:05<23:27:17,  9.18s/it][2022-12-22 08:59:31,291] [INFO] [timer.py:197:stop] 0/4808, RunningAvgSamplesPerSec=10.950412980013253, CurrSamplesPerSec=10.705961982503009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10808/20000 [19:00:15<23:57:05,  9.38s/it][2022-12-22 08:59:40,552] [INFO] [timer.py:197:stop] 0/4809, RunningAvgSamplesPerSec=10.950387342234391, CurrSamplesPerSec=10.828543465252269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10809/20000 [19:00:25<23:51:25,  9.34s/it][2022-12-22 08:59:49,724] [INFO] [logging.py:68:log_dist] [Rank 0] step=10810, skipped=22, lr=[4.724615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 08:59:49,725] [INFO] [timer.py:197:stop] 0/4810, RunningAvgSamplesPerSec=10.950325575584182, CurrSamplesPerSec=10.661252969435992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10810/20000 [19:00:34<23:43:22,  9.29s/it][2022-12-22 08:59:59,020] [INFO] [timer.py:197:stop] 0/4811, RunningAvgSamplesPerSec=10.950382271773803, CurrSamplesPerSec=11.229938173215734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10811/20000 [19:00:43<23:43:20,  9.29s/it][2022-12-22 09:00:08,995] [INFO] [timer.py:197:stop] 0/4812, RunningAvgSamplesPerSec=10.950378015721403, CurrSamplesPerSec=10.929948851826978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10812/20000 [19:00:53<24:14:27,  9.50s/it][2022-12-22 09:00:18,587] [INFO] [timer.py:197:stop] 0/4813, RunningAvgSamplesPerSec=10.950372842596517, CurrSamplesPerSec=10.925546536884193, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10813/20000 [19:01:03<24:18:38,  9.53s/it][2022-12-22 09:00:27,823] [INFO] [timer.py:197:stop] 0/4814, RunningAvgSamplesPerSec=10.9503871064305, CurrSamplesPerSec=11.019443259107646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10814/20000 [19:01:12<24:05:11,  9.44s/it][2022-12-22 09:00:37,375] [INFO] [timer.py:197:stop] 0/4815, RunningAvgSamplesPerSec=10.950372352427399, CurrSamplesPerSec=10.879833520003482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10815/20000 [19:01:21<24:10:09,  9.47s/it][2022-12-22 09:00:46,412] [INFO] [timer.py:197:stop] 0/4816, RunningAvgSamplesPerSec=10.950368637854597, CurrSamplesPerSec=10.93251954652653, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10816/20000 [19:01:30<23:49:56,  9.34s/it][2022-12-22 09:00:55,481] [INFO] [timer.py:197:stop] 0/4817, RunningAvgSamplesPerSec=10.950418462181288, CurrSamplesPerSec=11.195645252359638, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10817/20000 [19:01:39<23:37:16,  9.26s/it][2022-12-22 09:01:04,469] [INFO] [timer.py:197:stop] 0/4818, RunningAvgSamplesPerSec=10.950437160569352, CurrSamplesPerSec=11.041216426682865, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10818/20000 [19:01:48<23:24:36,  9.18s/it][2022-12-22 09:01:13,566] [INFO] [timer.py:197:stop] 0/4819, RunningAvgSamplesPerSec=10.950477644607604, CurrSamplesPerSec=11.148983871536478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10819/20000 [19:01:58<23:20:44,  9.15s/it][2022-12-22 09:01:22,657] [INFO] [logging.py:68:log_dist] [Rank 0] step=10820, skipped=22, lr=[4.71948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:01:22,658] [INFO] [timer.py:197:stop] 0/4820, RunningAvgSamplesPerSec=10.95042693087974, CurrSamplesPerSec=10.711470773199002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10820/20000 [19:02:07<23:17:42,  9.14s/it][2022-12-22 09:01:32,348] [INFO] [timer.py:197:stop] 0/4821, RunningAvgSamplesPerSec=10.950443739707195, CurrSamplesPerSec=11.032032189881075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10821/20000 [19:02:16<23:43:02,  9.30s/it][2022-12-22 09:01:41,294] [INFO] [timer.py:197:stop] 0/4822, RunningAvgSamplesPerSec=10.950416009520014, CurrSamplesPerSec=10.818395662476945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10822/20000 [19:02:25<23:26:33,  9.20s/it][2022-12-22 09:01:51,846] [INFO] [timer.py:197:stop] 0/4823, RunningAvgSamplesPerSec=10.95037560808351, CurrSamplesPerSec=10.759043918275735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10823/20000 [19:02:36<24:28:38,  9.60s/it][2022-12-22 09:02:01,586] [INFO] [timer.py:197:stop] 0/4824, RunningAvgSamplesPerSec=10.950362575235355, CurrSamplesPerSec=10.887889747339411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10824/20000 [19:02:46<24:34:48,  9.64s/it][2022-12-22 09:02:10,590] [INFO] [timer.py:197:stop] 0/4825, RunningAvgSamplesPerSec=10.95034224947155, CurrSamplesPerSec=10.853201057133585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10825/20000 [19:02:55<24:05:18,  9.45s/it]

                                                           
{'loss': 0.072, 'learning_rate': 4.716923076923077e-06, 'epoch': 0.54}


 54%|█████▍    | 10825/20000 [19:02:55<24:05:18,  9.45s/it][2022-12-22 09:02:21,578] [INFO] [timer.py:197:stop] 0/4826, RunningAvgSamplesPerSec=10.95036277586499, CurrSamplesPerSec=11.050264942860922, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10826/20000 [19:03:06<25:15:36,  9.91s/it][2022-12-22 09:02:33,667] [INFO] [timer.py:197:stop] 0/4827, RunningAvgSamplesPerSec=10.950384585701162, CurrSamplesPerSec=11.056616113218963, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10827/20000 [19:03:18<26:55:15, 10.57s/it][2022-12-22 09:02:42,675] [INFO] [timer.py:197:stop] 0/4828, RunningAvgSamplesPerSec=10.95036106956419, CurrSamplesPerSec=10.838059594348351, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10828/20000 [19:03:27<25:43:41, 10.10s/it][2022-12-22 09:02:52,233] [INFO] [timer.py:197:stop] 0/4829, RunningAvgSamplesPerSec=10.950357972380854, CurrSamplesPerSec=10.93543134435936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10829/20000 [19:03:36<25:18:44,  9.94s/it][2022-12-22 09:03:01,610] [INFO] [logging.py:68:log_dist] [Rank 0] step=10830, skipped=22, lr=[4.714358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:03:01,611] [INFO] [timer.py:197:stop] 0/4830, RunningAvgSamplesPerSec=10.950313963100236, CurrSamplesPerSec=10.741924692246892, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10830/20000 [19:03:46<24:53:02,  9.77s/it][2022-12-22 09:03:10,881] [INFO] [timer.py:197:stop] 0/4831, RunningAvgSamplesPerSec=10.950331154878647, CurrSamplesPerSec=11.033967140878243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10831/20000 [19:03:55<24:29:57,  9.62s/it][2022-12-22 09:03:20,074] [INFO] [timer.py:197:stop] 0/4832, RunningAvgSamplesPerSec=10.950342291757984, CurrSamplesPerSec=11.004387768492196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10832/20000 [19:04:04<24:10:15,  9.49s/it][2022-12-22 09:03:29,208] [INFO] [timer.py:197:stop] 0/4833, RunningAvgSamplesPerSec=10.950353024136435, CurrSamplesPerSec=11.002437021212307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10833/20000 [19:04:13<23:53:43,  9.38s/it][2022-12-22 09:03:38,326] [INFO] [timer.py:197:stop] 0/4834, RunningAvgSamplesPerSec=10.950311363582337, CurrSamplesPerSec=10.75268231771093, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10834/20000 [19:04:22<23:41:22,  9.30s/it][2022-12-22 09:03:47,703] [INFO] [timer.py:197:stop] 0/4835, RunningAvgSamplesPerSec=10.950244502278654, CurrSamplesPerSec=10.63643128138477, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10835/20000 [19:04:32<23:44:33,  9.33s/it][2022-12-22 09:03:56,729] [INFO] [timer.py:197:stop] 0/4836, RunningAvgSamplesPerSec=10.950300512840206, CurrSamplesPerSec=11.227862501947572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10836/20000 [19:04:41<23:30:38,  9.24s/it][2022-12-22 09:04:05,847] [INFO] [timer.py:197:stop] 0/4837, RunningAvgSamplesPerSec=10.950324221577922, CurrSamplesPerSec=11.06614470824525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10837/20000 [19:04:50<23:25:04,  9.20s/it][2022-12-22 09:04:15,417] [INFO] [timer.py:197:stop] 0/4838, RunningAvgSamplesPerSec=10.950293475487367, CurrSamplesPerSec=10.803627623674029, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10838/20000 [19:04:59<23:41:52,  9.31s/it][2022-12-22 09:04:25,096] [INFO] [timer.py:197:stop] 0/4839, RunningAvgSamplesPerSec=10.950234899717207, CurrSamplesPerSec=10.674107121909957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10839/20000 [19:05:09<23:58:33,  9.42s/it][2022-12-22 09:04:34,546] [INFO] [logging.py:68:log_dist] [Rank 0] step=10840, skipped=22, lr=[4.70923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:04:34,547] [INFO] [timer.py:197:stop] 0/4840, RunningAvgSamplesPerSec=10.950187006848578, CurrSamplesPerSec=10.72332950076871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10840/20000 [19:05:19<23:59:43,  9.43s/it][2022-12-22 09:04:43,685] [INFO] [timer.py:197:stop] 0/4841, RunningAvgSamplesPerSec=10.95013400246454, CurrSamplesPerSec=10.699567876662234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10841/20000 [19:05:28<23:46:10,  9.34s/it][2022-12-22 09:04:54,098] [INFO] [timer.py:197:stop] 0/4842, RunningAvgSamplesPerSec=10.950136589580122, CurrSamplesPerSec=10.962669973982617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10842/20000 [19:05:38<24:35:00,  9.66s/it][2022-12-22 09:05:02,949] [INFO] [timer.py:197:stop] 0/4843, RunningAvgSamplesPerSec=10.950199649787335, CurrSamplesPerSec=11.264163885196908, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10843/20000 [19:05:47<23:57:38,  9.42s/it][2022-12-22 09:05:12,364] [INFO] [timer.py:197:stop] 0/4844, RunningAvgSamplesPerSec=10.95020207442607, CurrSamplesPerSec=10.961952348431007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10844/20000 [19:05:56<23:57:14,  9.42s/it][2022-12-22 09:05:22,179] [INFO] [timer.py:197:stop] 0/4845, RunningAvgSamplesPerSec=10.95011210972019, CurrSamplesPerSec=10.531172389940245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10845/20000 [19:06:06<24:15:14,  9.54s/it][2022-12-22 09:05:31,477] [INFO] [timer.py:197:stop] 0/4846, RunningAvgSamplesPerSec=10.950143860250849, CurrSamplesPerSec=11.106102183248243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10846/20000 [19:06:15<24:04:09,  9.47s/it][2022-12-22 09:05:40,756] [INFO] [timer.py:197:stop] 0/4847, RunningAvgSamplesPerSec=10.95018102806924, CurrSamplesPerSec=11.133232257157964, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10847/20000 [19:06:25<23:55:27,  9.41s/it][2022-12-22 09:05:51,771] [INFO] [timer.py:197:stop] 0/4848, RunningAvgSamplesPerSec=10.950208664000968, CurrSamplesPerSec=11.085762611084059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10848/20000 [19:06:36<25:08:45,  9.89s/it][2022-12-22 09:06:01,083] [INFO] [timer.py:197:stop] 0/4849, RunningAvgSamplesPerSec=10.950260000477469, CurrSamplesPerSec=11.204821076506674, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10849/20000 [19:06:45<24:42:03,  9.72s/it][2022-12-22 09:06:10,435] [INFO] [logging.py:68:log_dist] [Rank 0] step=10850, skipped=22, lr=[4.704102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:06:10,436] [INFO] [timer.py:197:stop] 0/4850, RunningAvgSamplesPerSec=10.950268314926882, CurrSamplesPerSec=10.990717346015371, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10850/20000 [19:06:54<24:25:14,  9.61s/it]

                                                           
{'loss': 0.0674, 'learning_rate': 4.704102564102565e-06, 'epoch': 0.54}


 54%|█████▍    | 10850/20000 [19:06:54<24:25:14,  9.61s/it][2022-12-22 09:06:20,010] [INFO] [timer.py:197:stop] 0/4851, RunningAvgSamplesPerSec=10.950220491554816, CurrSamplesPerSec=10.723180858310803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10851/20000 [19:07:04<24:23:31,  9.60s/it][2022-12-22 09:06:29,077] [INFO] [timer.py:197:stop] 0/4852, RunningAvgSamplesPerSec=10.95023041635241, CurrSamplesPerSec=10.998568244394912, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10852/20000 [19:07:13<23:59:04,  9.44s/it][2022-12-22 09:06:39,349] [INFO] [timer.py:197:stop] 0/4853, RunningAvgSamplesPerSec=10.950195049531764, CurrSamplesPerSec=10.781311979837271, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10853/20000 [19:07:23<24:37:01,  9.69s/it][2022-12-22 09:06:48,330] [INFO] [timer.py:197:stop] 0/4854, RunningAvgSamplesPerSec=10.950229797904415, CurrSamplesPerSec=11.121430099920143, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10854/20000 [19:07:32<24:04:31,  9.48s/it][2022-12-22 09:06:58,108] [INFO] [timer.py:197:stop] 0/4855, RunningAvgSamplesPerSec=10.950242757836735, CurrSamplesPerSec=11.013487606826772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10855/20000 [19:07:42<24:18:09,  9.57s/it][2022-12-22 09:07:07,419] [INFO] [timer.py:197:stop] 0/4856, RunningAvgSamplesPerSec=10.950209583695123, CurrSamplesPerSec=10.79154864801846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10856/20000 [19:07:51<24:06:17,  9.49s/it][2022-12-22 09:07:16,166] [INFO] [timer.py:197:stop] 0/4857, RunningAvgSamplesPerSec=10.95028096937083, CurrSamplesPerSec=11.308112440027317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10857/20000 [19:08:00<23:32:09,  9.27s/it][2022-12-22 09:07:25,613] [INFO] [timer.py:197:stop] 0/4858, RunningAvgSamplesPerSec=10.950301303807326, CurrSamplesPerSec=11.049923331729303, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10858/20000 [19:08:10<23:40:13,  9.32s/it][2022-12-22 09:07:35,797] [INFO] [timer.py:197:stop] 0/4859, RunningAvgSamplesPerSec=10.9502866176645, CurrSamplesPerSec=10.879432256190244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10859/20000 [19:08:20<24:19:30,  9.58s/it][2022-12-22 09:07:45,261] [INFO] [logging.py:68:log_dist] [Rank 0] step=10860, skipped=22, lr=[4.6989743589743596e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:07:45,262] [INFO] [timer.py:197:stop] 0/4860, RunningAvgSamplesPerSec=10.950298546848579, CurrSamplesPerSec=11.008546859929453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10860/20000 [19:08:29<24:14:05,  9.55s/it][2022-12-22 09:07:54,323] [INFO] [timer.py:197:stop] 0/4861, RunningAvgSamplesPerSec=10.950299911680379, CurrSamplesPerSec=10.956934282466008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10861/20000 [19:08:38<23:51:49,  9.40s/it][2022-12-22 09:08:03,703] [INFO] [timer.py:197:stop] 0/4862, RunningAvgSamplesPerSec=10.95030626332539, CurrSamplesPerSec=10.98125615440814, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10862/20000 [19:08:48<23:50:43,  9.39s/it][2022-12-22 09:08:13,029] [INFO] [timer.py:197:stop] 0/4863, RunningAvgSamplesPerSec=10.950320063417243, CurrSamplesPerSec=11.017801907207064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10863/20000 [19:08:57<23:47:26,  9.37s/it][2022-12-22 09:08:22,249] [INFO] [timer.py:197:stop] 0/4864, RunningAvgSamplesPerSec=10.950291612647867, CurrSamplesPerSec=10.813717669129847, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10864/20000 [19:09:06<23:40:16,  9.33s/it][2022-12-22 09:08:31,584] [INFO] [timer.py:197:stop] 0/4865, RunningAvgSamplesPerSec=10.950259363012957, CurrSamplesPerSec=10.795675591937307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10865/20000 [19:09:16<23:40:26,  9.33s/it][2022-12-22 09:08:40,505] [INFO] [timer.py:197:stop] 0/4866, RunningAvgSamplesPerSec=10.95032140745548, CurrSamplesPerSec=11.260594467432487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10866/20000 [19:09:24<23:21:36,  9.21s/it][2022-12-22 09:08:50,899] [INFO] [timer.py:197:stop] 0/4867, RunningAvgSamplesPerSec=10.950305268141726, CurrSamplesPerSec=10.872362524498062, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10867/20000 [19:09:35<24:15:42,  9.56s/it][2022-12-22 09:08:59,732] [INFO] [timer.py:197:stop] 0/4868, RunningAvgSamplesPerSec=10.950333192263512, CurrSamplesPerSec=11.087890949878323, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10868/20000 [19:09:44<23:42:11,  9.34s/it][2022-12-22 09:09:08,985] [INFO] [timer.py:197:stop] 0/4869, RunningAvgSamplesPerSec=10.950364334205977, CurrSamplesPerSec=11.104027938081462, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10869/20000 [19:09:53<23:37:53,  9.32s/it][2022-12-22 09:09:18,256] [INFO] [logging.py:68:log_dist] [Rank 0] step=10870, skipped=22, lr=[4.6938461538461544e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:09:18,257] [INFO] [timer.py:197:stop] 0/4870, RunningAvgSamplesPerSec=10.950407890685565, CurrSamplesPerSec=11.166583080884303, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10870/20000 [19:10:02<23:35:38,  9.30s/it][2022-12-22 09:09:27,855] [INFO] [timer.py:197:stop] 0/4871, RunningAvgSamplesPerSec=10.950402948894173, CurrSamplesPerSec=10.926399052736317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10871/20000 [19:10:12<23:48:57,  9.39s/it][2022-12-22 09:09:36,687] [INFO] [timer.py:197:stop] 0/4872, RunningAvgSamplesPerSec=10.950452289548195, CurrSamplesPerSec=11.196081855571352, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10872/20000 [19:10:21<23:23:14,  9.22s/it][2022-12-22 09:09:46,514] [INFO] [timer.py:197:stop] 0/4873, RunningAvgSamplesPerSec=10.950423948802499, CurrSamplesPerSec=10.814122813113414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10873/20000 [19:10:30<23:50:38,  9.40s/it][2022-12-22 09:09:55,323] [INFO] [timer.py:197:stop] 0/4874, RunningAvgSamplesPerSec=10.95044140873712, CurrSamplesPerSec=11.03615458409841, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10874/20000 [19:10:39<23:23:15,  9.23s/it][2022-12-22 09:10:04,151] [INFO] [timer.py:197:stop] 0/4875, RunningAvgSamplesPerSec=10.950463824956863, CurrSamplesPerSec=11.060776045820177, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10875/20000 [19:10:48<23:04:58,  9.11s/it]

                                                           
{'loss': 0.0583, 'learning_rate': 4.6912820512820515e-06, 'epoch': 0.54}


 54%|█████▍    | 10875/20000 [19:10:48<23:04:58,  9.11s/it][2022-12-22 09:10:13,658] [INFO] [timer.py:197:stop] 0/4876, RunningAvgSamplesPerSec=10.950467579751653, CurrSamplesPerSec=10.968795324837563, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10876/20000 [19:10:58<23:23:05,  9.23s/it][2022-12-22 09:10:22,938] [INFO] [timer.py:197:stop] 0/4877, RunningAvgSamplesPerSec=10.950467430184238, CurrSamplesPerSec=10.949738487150789, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10877/20000 [19:11:07<23:25:19,  9.24s/it][2022-12-22 09:10:32,225] [INFO] [timer.py:197:stop] 0/4878, RunningAvgSamplesPerSec=10.950510115967626, CurrSamplesPerSec=11.162635161698356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10878/20000 [19:11:16<23:27:12,  9.26s/it][2022-12-22 09:10:41,575] [INFO] [timer.py:197:stop] 0/4879, RunningAvgSamplesPerSec=10.95051374971871, CurrSamplesPerSec=10.96826064074947, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10879/20000 [19:11:26<23:31:22,  9.28s/it][2022-12-22 09:10:50,465] [INFO] [logging.py:68:log_dist] [Rank 0] step=10880, skipped=22, lr=[4.688717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:10:50,466] [INFO] [timer.py:197:stop] 0/4880, RunningAvgSamplesPerSec=10.95056243506164, CurrSamplesPerSec=11.193264379589351, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10880/20000 [19:11:34<23:13:16,  9.17s/it][2022-12-22 09:11:00,716] [INFO] [timer.py:197:stop] 0/4881, RunningAvgSamplesPerSec=10.950493567331206, CurrSamplesPerSec=10.62455781218429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10881/20000 [19:11:45<24:02:31,  9.49s/it][2022-12-22 09:11:10,149] [INFO] [timer.py:197:stop] 0/4882, RunningAvgSamplesPerSec=10.950436532001499, CurrSamplesPerSec=10.679058891805704, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10882/20000 [19:11:54<23:59:42,  9.47s/it][2022-12-22 09:11:19,119] [INFO] [timer.py:197:stop] 0/4883, RunningAvgSamplesPerSec=10.950472490290704, CurrSamplesPerSec=11.12880726261905, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10883/20000 [19:12:03<23:36:34,  9.32s/it][2022-12-22 09:11:28,278] [INFO] [timer.py:197:stop] 0/4884, RunningAvgSamplesPerSec=10.950461687066973, CurrSamplesPerSec=10.89798390380641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10884/20000 [19:12:12<23:28:58,  9.27s/it][2022-12-22 09:11:37,110] [INFO] [timer.py:197:stop] 0/4885, RunningAvgSamplesPerSec=10.95048577995891, CurrSamplesPerSec=11.069384658143871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10885/20000 [19:12:21<23:08:40,  9.14s/it][2022-12-22 09:11:46,707] [INFO] [timer.py:197:stop] 0/4886, RunningAvgSamplesPerSec=10.950503076419945, CurrSamplesPerSec=11.03561830355124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10886/20000 [19:12:31<23:29:19,  9.28s/it][2022-12-22 09:11:56,118] [INFO] [timer.py:197:stop] 0/4887, RunningAvgSamplesPerSec=10.950500059742241, CurrSamplesPerSec=10.935786406510806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10887/20000 [19:12:40<23:35:12,  9.32s/it][2022-12-22 09:12:05,152] [INFO] [timer.py:197:stop] 0/4888, RunningAvgSamplesPerSec=10.950500327261617, CurrSamplesPerSec=10.951807315428487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10888/20000 [19:12:49<23:22:09,  9.23s/it][2022-12-22 09:12:14,505] [INFO] [timer.py:197:stop] 0/4889, RunningAvgSamplesPerSec=10.950484559299008, CurrSamplesPerSec=10.873980648329335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10889/20000 [19:12:58<23:27:26,  9.27s/it][2022-12-22 09:12:24,135] [INFO] [logging.py:68:log_dist] [Rank 0] step=10890, skipped=22, lr=[4.683589743589743e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:12:24,136] [INFO] [timer.py:197:stop] 0/4890, RunningAvgSamplesPerSec=10.950447459710833, CurrSamplesPerSec=10.77209533842966, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10890/20000 [19:13:08<23:43:48,  9.38s/it][2022-12-22 09:12:33,119] [INFO] [timer.py:197:stop] 0/4891, RunningAvgSamplesPerSec=10.950426681361847, CurrSamplesPerSec=10.849795649426676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10891/20000 [19:13:17<23:25:41,  9.26s/it][2022-12-22 09:12:42,919] [INFO] [timer.py:197:stop] 0/4892, RunningAvgSamplesPerSec=10.950414782111823, CurrSamplesPerSec=10.892546842213692, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10892/20000 [19:13:27<23:50:08,  9.42s/it][2022-12-22 09:12:53,032] [INFO] [timer.py:197:stop] 0/4893, RunningAvgSamplesPerSec=10.950459019003873, CurrSamplesPerSec=11.171137659635342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10893/20000 [19:13:37<24:21:29,  9.63s/it][2022-12-22 09:13:02,260] [INFO] [timer.py:197:stop] 0/4894, RunningAvgSamplesPerSec=10.95045533857858, CurrSamplesPerSec=10.932483926911743, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10894/20000 [19:13:46<24:03:06,  9.51s/it][2022-12-22 09:13:11,668] [INFO] [timer.py:197:stop] 0/4895, RunningAvgSamplesPerSec=10.950490347416043, CurrSamplesPerSec=11.124475221225149, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10895/20000 [19:13:56<23:58:19,  9.48s/it][2022-12-22 09:13:21,320] [INFO] [timer.py:197:stop] 0/4896, RunningAvgSamplesPerSec=10.950447333270285, CurrSamplesPerSec=10.74394884186404, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10896/20000 [19:14:05<24:06:06,  9.53s/it][2022-12-22 09:13:30,661] [INFO] [timer.py:197:stop] 0/4897, RunningAvgSamplesPerSec=10.950363802690715, CurrSamplesPerSec=10.55628007444419, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10897/20000 [19:14:15<23:57:18,  9.47s/it][2022-12-22 09:13:39,873] [INFO] [timer.py:197:stop] 0/4898, RunningAvgSamplesPerSec=10.95036866550262, CurrSamplesPerSec=10.974223996108671, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10898/20000 [19:14:24<23:45:13,  9.40s/it][2022-12-22 09:13:49,388] [INFO] [timer.py:197:stop] 0/4899, RunningAvgSamplesPerSec=10.950299920046444, CurrSamplesPerSec=10.623760995367164, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 54%|█████▍    | 10899/20000 [19:14:33<23:50:32,  9.43s/it][2022-12-22 09:13:58,572] [INFO] [logging.py:68:log_dist] [Rank 0] step=10900, skipped=22, lr=[4.678461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:13:58,573] [INFO] [timer.py:197:stop] 0/4900, RunningAvgSamplesPerSec=10.95025068092322, CurrSamplesPerSec=10.71432287418532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10900/20000 [19:14:43<23:39:10,  9.36s/it]

                                                           
{'loss': 0.0598, 'learning_rate': 4.678461538461539e-06, 'epoch': 0.55}


 55%|█████▍    | 10900/20000 [19:14:43<23:39:10,  9.36s/it][2022-12-22 09:14:07,727] [INFO] [timer.py:197:stop] 0/4901, RunningAvgSamplesPerSec=10.950169797094254, CurrSamplesPerSec=10.567836172932944, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10901/20000 [19:14:52<23:29:46,  9.30s/it][2022-12-22 09:14:17,528] [INFO] [timer.py:197:stop] 0/4902, RunningAvgSamplesPerSec=10.950171060337631, CurrSamplesPerSec=10.956363189914816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10902/20000 [19:15:01<23:52:37,  9.45s/it][2022-12-22 09:14:26,857] [INFO] [timer.py:197:stop] 0/4903, RunningAvgSamplesPerSec=10.95022164673806, CurrSamplesPerSec=11.203837116222745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10903/20000 [19:15:11<23:47:02,  9.41s/it][2022-12-22 09:14:36,152] [INFO] [timer.py:197:stop] 0/4904, RunningAvgSamplesPerSec=10.950189158068802, CurrSamplesPerSec=10.793244787609641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10904/20000 [19:15:20<23:41:33,  9.38s/it][2022-12-22 09:14:45,395] [INFO] [timer.py:197:stop] 0/4905, RunningAvgSamplesPerSec=10.950235523619504, CurrSamplesPerSec=11.182337972182568, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10905/20000 [19:15:29<23:35:16,  9.34s/it][2022-12-22 09:14:55,129] [INFO] [timer.py:197:stop] 0/4906, RunningAvgSamplesPerSec=10.950201468763192, CurrSamplesPerSec=10.78573878116919, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10906/20000 [19:15:39<23:53:13,  9.46s/it][2022-12-22 09:15:04,390] [INFO] [timer.py:197:stop] 0/4907, RunningAvgSamplesPerSec=10.950160192345063, CurrSamplesPerSec=10.751415292541054, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10907/20000 [19:15:48<23:44:10,  9.40s/it][2022-12-22 09:15:13,454] [INFO] [timer.py:197:stop] 0/4908, RunningAvgSamplesPerSec=10.950103929199969, CurrSamplesPerSec=10.680918743268608, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10908/20000 [19:15:57<23:28:54,  9.30s/it][2022-12-22 09:15:22,830] [INFO] [timer.py:197:stop] 0/4909, RunningAvgSamplesPerSec=10.950151751109793, CurrSamplesPerSec=11.18990393794242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10909/20000 [19:16:07<23:32:17,  9.32s/it][2022-12-22 09:15:32,081] [INFO] [logging.py:68:log_dist] [Rank 0] step=10910, skipped=22, lr=[4.673333333333333e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:15:32,082] [INFO] [timer.py:197:stop] 0/4910, RunningAvgSamplesPerSec=10.950158500773423, CurrSamplesPerSec=10.983379603505723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10910/20000 [19:16:16<23:28:58,  9.30s/it][2022-12-22 09:15:41,718] [INFO] [timer.py:197:stop] 0/4911, RunningAvgSamplesPerSec=10.950087063711013, CurrSamplesPerSec=10.610354156011764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10911/20000 [19:16:26<23:44:04,  9.40s/it][2022-12-22 09:15:50,773] [INFO] [timer.py:197:stop] 0/4912, RunningAvgSamplesPerSec=10.95003403543436, CurrSamplesPerSec=10.695764227960064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10912/20000 [19:16:35<23:28:12,  9.30s/it][2022-12-22 09:16:00,163] [INFO] [timer.py:197:stop] 0/4913, RunningAvgSamplesPerSec=10.950110372749943, CurrSamplesPerSec=11.338213865716343, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10913/20000 [19:16:44<23:32:17,  9.33s/it][2022-12-22 09:16:09,851] [INFO] [timer.py:197:stop] 0/4914, RunningAvgSamplesPerSec=10.950167778460361, CurrSamplesPerSec=11.239538790924374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10914/20000 [19:16:54<23:48:35,  9.43s/it][2022-12-22 09:16:20,008] [INFO] [timer.py:197:stop] 0/4915, RunningAvgSamplesPerSec=10.95015245506664, CurrSamplesPerSec=10.875397893198333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10915/20000 [19:17:04<24:21:17,  9.65s/it][2022-12-22 09:16:29,386] [INFO] [timer.py:197:stop] 0/4916, RunningAvgSamplesPerSec=10.950198046682706, CurrSamplesPerSec=11.178868166663738, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10916/20000 [19:17:13<24:08:44,  9.57s/it][2022-12-22 09:16:38,539] [INFO] [timer.py:197:stop] 0/4917, RunningAvgSamplesPerSec=10.950245904387888, CurrSamplesPerSec=11.190581276411535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10917/20000 [19:17:23<23:49:40,  9.44s/it][2022-12-22 09:16:47,514] [INFO] [timer.py:197:stop] 0/4918, RunningAvgSamplesPerSec=10.9502561198802, CurrSamplesPerSec=11.000696591439326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10918/20000 [19:17:31<23:28:15,  9.30s/it][2022-12-22 09:16:57,076] [INFO] [timer.py:197:stop] 0/4919, RunningAvgSamplesPerSec=10.950200944151174, CurrSamplesPerSec=10.685514847599862, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10919/20000 [19:17:41<23:39:49,  9.38s/it][2022-12-22 09:17:06,164] [INFO] [logging.py:68:log_dist] [Rank 0] step=10920, skipped=22, lr=[4.668205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:17:06,165] [INFO] [timer.py:197:stop] 0/4920, RunningAvgSamplesPerSec=10.950246316928899, CurrSamplesPerSec=11.177985109509173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10920/20000 [19:17:50<23:26:22,  9.29s/it][2022-12-22 09:17:16,039] [INFO] [timer.py:197:stop] 0/4921, RunningAvgSamplesPerSec=10.950240567429145, CurrSamplesPerSec=10.922037369591662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10921/20000 [19:18:00<23:52:37,  9.47s/it][2022-12-22 09:17:25,188] [INFO] [timer.py:197:stop] 0/4922, RunningAvgSamplesPerSec=10.950249518053171, CurrSamplesPerSec=10.994455414238397, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10922/20000 [19:18:09<23:37:59,  9.37s/it][2022-12-22 09:17:34,435] [INFO] [timer.py:197:stop] 0/4923, RunningAvgSamplesPerSec=10.950221183450669, CurrSamplesPerSec=10.812567748364684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10923/20000 [19:18:18<23:32:10,  9.33s/it][2022-12-22 09:17:44,531] [INFO] [timer.py:197:stop] 0/4924, RunningAvgSamplesPerSec=10.95027901557843, CurrSamplesPerSec=11.242466249519044, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10924/20000 [19:18:28<24:06:32,  9.56s/it][2022-12-22 09:17:54,616] [INFO] [timer.py:197:stop] 0/4925, RunningAvgSamplesPerSec=10.950208415353613, CurrSamplesPerSec=10.61340443006034, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10925/20000 [19:18:39<24:30:05,  9.72s/it]

                                                           
{'loss': 0.0461, 'learning_rate': 4.665641025641026e-06, 'epoch': 0.55}


 55%|█████▍    | 10925/20000 [19:18:39<24:30:05,  9.72s/it][2022-12-22 09:18:03,574] [INFO] [timer.py:197:stop] 0/4926, RunningAvgSamplesPerSec=10.950203598296868, CurrSamplesPerSec=10.926540484506898, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10926/20000 [19:18:48<23:55:20,  9.49s/it][2022-12-22 09:18:12,880] [INFO] [timer.py:197:stop] 0/4927, RunningAvgSamplesPerSec=10.950247885343176, CurrSamplesPerSec=11.172749218354236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10927/20000 [19:18:57<23:46:47,  9.44s/it][2022-12-22 09:18:22,120] [INFO] [timer.py:197:stop] 0/4928, RunningAvgSamplesPerSec=10.950241854695347, CurrSamplesPerSec=10.920621271984254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10928/20000 [19:19:06<23:37:46,  9.38s/it][2022-12-22 09:18:31,270] [INFO] [timer.py:197:stop] 0/4929, RunningAvgSamplesPerSec=10.9501439717842, CurrSamplesPerSec=10.488312838957013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10929/20000 [19:19:15<23:27:20,  9.31s/it][2022-12-22 09:18:40,432] [INFO] [logging.py:68:log_dist] [Rank 0] step=10930, skipped=22, lr=[4.663076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:18:40,433] [INFO] [timer.py:197:stop] 0/4930, RunningAvgSamplesPerSec=10.950199720218617, CurrSamplesPerSec=11.231940826369181, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10930/20000 [19:19:24<23:20:33,  9.26s/it][2022-12-22 09:18:50,369] [INFO] [timer.py:197:stop] 0/4931, RunningAvgSamplesPerSec=10.95018463121359, CurrSamplesPerSec=10.876327651391835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10931/20000 [19:19:34<23:50:50,  9.47s/it][2022-12-22 09:19:00,273] [INFO] [timer.py:197:stop] 0/4932, RunningAvgSamplesPerSec=10.95023411536749, CurrSamplesPerSec=11.199699266879575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10932/20000 [19:19:44<24:10:33,  9.60s/it][2022-12-22 09:19:09,231] [INFO] [timer.py:197:stop] 0/4933, RunningAvgSamplesPerSec=10.950274893498863, CurrSamplesPerSec=11.15507171028171, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10933/20000 [19:19:53<23:41:25,  9.41s/it][2022-12-22 09:19:19,582] [INFO] [timer.py:197:stop] 0/4934, RunningAvgSamplesPerSec=10.950279713042196, CurrSamplesPerSec=10.974096580961598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10934/20000 [19:20:04<24:24:01,  9.69s/it][2022-12-22 09:19:28,425] [INFO] [timer.py:197:stop] 0/4935, RunningAvgSamplesPerSec=10.950308415776636, CurrSamplesPerSec=11.093724715413703, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10935/20000 [19:20:12<23:45:30,  9.44s/it][2022-12-22 09:19:38,768] [INFO] [timer.py:197:stop] 0/4936, RunningAvgSamplesPerSec=10.950289348815716, CurrSamplesPerSec=10.857033214897829, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10936/20000 [19:20:23<24:26:32,  9.71s/it][2022-12-22 09:19:48,163] [INFO] [timer.py:197:stop] 0/4937, RunningAvgSamplesPerSec=10.950288871865116, CurrSamplesPerSec=10.947936103330951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10937/20000 [19:20:32<24:12:09,  9.61s/it][2022-12-22 09:19:57,453] [INFO] [timer.py:197:stop] 0/4938, RunningAvgSamplesPerSec=10.950236661248603, CurrSamplesPerSec=10.698501797800393, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10938/20000 [19:20:41<23:57:20,  9.52s/it][2022-12-22 09:20:06,721] [INFO] [timer.py:197:stop] 0/4939, RunningAvgSamplesPerSec=10.950240084827076, CurrSamplesPerSec=10.967164992563209, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10939/20000 [19:20:51<23:45:55,  9.44s/it][2022-12-22 09:20:15,579] [INFO] [logging.py:68:log_dist] [Rank 0] step=10940, skipped=22, lr=[4.657948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:20:15,580] [INFO] [timer.py:197:stop] 0/4940, RunningAvgSamplesPerSec=10.950234000225942, CurrSamplesPerSec=10.920276523135662, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10940/20000 [19:21:00<23:19:20,  9.27s/it][2022-12-22 09:20:25,576] [INFO] [timer.py:197:stop] 0/4941, RunningAvgSamplesPerSec=10.950230383710238, CurrSamplesPerSec=10.932401112204523, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10941/20000 [19:21:10<23:52:11,  9.49s/it][2022-12-22 09:20:34,547] [INFO] [timer.py:197:stop] 0/4942, RunningAvgSamplesPerSec=10.950222997205262, CurrSamplesPerSec=10.913862213856936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10942/20000 [19:21:19<23:28:43,  9.33s/it][2022-12-22 09:20:43,601] [INFO] [timer.py:197:stop] 0/4943, RunningAvgSamplesPerSec=10.950239475237042, CurrSamplesPerSec=11.032250727800168, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10943/20000 [19:21:28<23:16:00,  9.25s/it][2022-12-22 09:20:52,822] [INFO] [timer.py:197:stop] 0/4944, RunningAvgSamplesPerSec=10.950234987212523, CurrSamplesPerSec=10.928104483631605, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10944/20000 [19:21:37<23:14:37,  9.24s/it][2022-12-22 09:21:02,107] [INFO] [timer.py:197:stop] 0/4945, RunningAvgSamplesPerSec=10.950235549524445, CurrSamplesPerSec=10.953015200605682, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10945/20000 [19:21:46<23:16:31,  9.25s/it][2022-12-22 09:21:11,517] [INFO] [timer.py:197:stop] 0/4946, RunningAvgSamplesPerSec=10.950188330710366, CurrSamplesPerSec=10.721657831853488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10946/20000 [19:21:55<23:23:27,  9.30s/it][2022-12-22 09:21:21,540] [INFO] [timer.py:197:stop] 0/4947, RunningAvgSamplesPerSec=10.950133412595285, CurrSamplesPerSec=10.685189035992071, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10947/20000 [19:22:06<23:55:59,  9.52s/it][2022-12-22 09:21:31,579] [INFO] [timer.py:197:stop] 0/4948, RunningAvgSamplesPerSec=10.950086533154492, CurrSamplesPerSec=10.723074626456667, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10948/20000 [19:22:16<24:19:27,  9.67s/it][2022-12-22 09:21:41,247] [INFO] [timer.py:197:stop] 0/4949, RunningAvgSamplesPerSec=10.95007309170828, CurrSamplesPerSec=10.883992973372406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10949/20000 [19:22:25<24:19:03,  9.67s/it][2022-12-22 09:21:50,984] [INFO] [logging.py:68:log_dist] [Rank 0] step=10950, skipped=22, lr=[4.652820512820514e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:21:50,985] [INFO] [timer.py:197:stop] 0/4950, RunningAvgSamplesPerSec=10.950001005469609, CurrSamplesPerSec=10.604640086589434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10950/20000 [19:22:35<24:21:48,  9.69s/it]

                                                           
{'loss': 0.0656, 'learning_rate': 4.652820512820514e-06, 'epoch': 0.55}


 55%|█████▍    | 10950/20000 [19:22:35<24:21:48,  9.69s/it][2022-12-22 09:22:00,164] [INFO] [timer.py:197:stop] 0/4951, RunningAvgSamplesPerSec=10.94994083095982, CurrSamplesPerSec=10.660080634208493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10951/20000 [19:22:44<23:58:27,  9.54s/it][2022-12-22 09:22:09,577] [INFO] [timer.py:197:stop] 0/4952, RunningAvgSamplesPerSec=10.949947589888293, CurrSamplesPerSec=10.983500043760438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10952/20000 [19:22:54<23:52:38,  9.50s/it][2022-12-22 09:22:18,986] [INFO] [timer.py:197:stop] 0/4953, RunningAvgSamplesPerSec=10.949899524132665, CurrSamplesPerSec=10.71703486836177, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10953/20000 [19:23:03<23:48:22,  9.47s/it][2022-12-22 09:22:28,448] [INFO] [timer.py:197:stop] 0/4954, RunningAvgSamplesPerSec=10.949795748431676, CurrSamplesPerSec=10.459034714966998, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10954/20000 [19:23:12<23:47:42,  9.47s/it][2022-12-22 09:22:37,622] [INFO] [timer.py:197:stop] 0/4955, RunningAvgSamplesPerSec=10.94978915626651, CurrSamplesPerSec=10.917241806764965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10955/20000 [19:23:22<23:34:13,  9.38s/it][2022-12-22 09:22:47,062] [INFO] [timer.py:197:stop] 0/4956, RunningAvgSamplesPerSec=10.949753498371582, CurrSamplesPerSec=10.775943963821696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10956/20000 [19:23:31<23:36:42,  9.40s/it][2022-12-22 09:22:56,484] [INFO] [timer.py:197:stop] 0/4957, RunningAvgSamplesPerSec=10.949808236972338, CurrSamplesPerSec=11.227870955263974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10957/20000 [19:23:40<23:37:35,  9.41s/it][2022-12-22 09:23:05,916] [INFO] [timer.py:197:stop] 0/4958, RunningAvgSamplesPerSec=10.949768453086936, CurrSamplesPerSec=10.756126155099041, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10958/20000 [19:23:50<23:38:37,  9.41s/it][2022-12-22 09:23:14,687] [INFO] [timer.py:197:stop] 0/4959, RunningAvgSamplesPerSec=10.949841131448093, CurrSamplesPerSec=11.322289204522328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10959/20000 [19:23:59<23:09:26,  9.22s/it][2022-12-22 09:23:23,494] [INFO] [logging.py:68:log_dist] [Rank 0] step=10960, skipped=22, lr=[4.647692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:23:23,495] [INFO] [timer.py:197:stop] 0/4960, RunningAvgSamplesPerSec=10.949889329191931, CurrSamplesPerSec=11.194135848250587, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10960/20000 [19:24:07<22:50:37,  9.10s/it][2022-12-22 09:23:33,656] [INFO] [timer.py:197:stop] 0/4961, RunningAvgSamplesPerSec=10.949896318199203, CurrSamplesPerSec=10.984657843026648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10961/20000 [19:24:18<23:38:31,  9.42s/it][2022-12-22 09:23:42,643] [INFO] [timer.py:197:stop] 0/4962, RunningAvgSamplesPerSec=10.949952759481075, CurrSamplesPerSec=11.237188607414401, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10962/20000 [19:24:27<23:18:59,  9.29s/it][2022-12-22 09:23:52,515] [INFO] [timer.py:197:stop] 0/4963, RunningAvgSamplesPerSec=10.949945162197743, CurrSamplesPerSec=10.91239189662728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10963/20000 [19:24:36<23:45:14,  9.46s/it][2022-12-22 09:24:01,791] [INFO] [timer.py:197:stop] 0/4964, RunningAvgSamplesPerSec=10.949943458371367, CurrSamplesPerSec=10.941497296943014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10964/20000 [19:24:46<23:36:39,  9.41s/it][2022-12-22 09:24:11,306] [INFO] [timer.py:197:stop] 0/4965, RunningAvgSamplesPerSec=10.949908660224205, CurrSamplesPerSec=10.779921313755876, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10965/20000 [19:24:55<23:41:23,  9.44s/it][2022-12-22 09:24:20,628] [INFO] [timer.py:197:stop] 0/4966, RunningAvgSamplesPerSec=10.949948626735964, CurrSamplesPerSec=11.151962560943408, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10966/20000 [19:25:05<23:35:55,  9.40s/it][2022-12-22 09:24:30,365] [INFO] [timer.py:197:stop] 0/4967, RunningAvgSamplesPerSec=10.949920627149865, CurrSamplesPerSec=10.812673147586423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10967/20000 [19:25:14<23:50:49,  9.50s/it][2022-12-22 09:24:39,408] [INFO] [timer.py:197:stop] 0/4968, RunningAvgSamplesPerSec=10.949866941178334, CurrSamplesPerSec=10.689651744970634, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10968/20000 [19:25:23<23:29:49,  9.37s/it][2022-12-22 09:24:50,099] [INFO] [timer.py:197:stop] 0/4969, RunningAvgSamplesPerSec=10.949914526215602, CurrSamplesPerSec=11.191435063604732, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10969/20000 [19:25:34<24:29:32,  9.76s/it][2022-12-22 09:24:59,050] [INFO] [logging.py:68:log_dist] [Rank 0] step=10970, skipped=22, lr=[4.642564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:24:59,051] [INFO] [timer.py:197:stop] 0/4970, RunningAvgSamplesPerSec=10.949950586311646, CurrSamplesPerSec=11.132040157967833, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10970/20000 [19:25:43<23:52:44,  9.52s/it][2022-12-22 09:25:08,098] [INFO] [timer.py:197:stop] 0/4971, RunningAvgSamplesPerSec=10.949907180456732, CurrSamplesPerSec=10.738432377553735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10971/20000 [19:25:52<23:31:13,  9.38s/it][2022-12-22 09:25:17,316] [INFO] [timer.py:197:stop] 0/4972, RunningAvgSamplesPerSec=10.94996181945454, CurrSamplesPerSec=11.228367375109277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10972/20000 [19:26:01<23:23:52,  9.33s/it][2022-12-22 09:25:26,687] [INFO] [timer.py:197:stop] 0/4973, RunningAvgSamplesPerSec=10.949888954746603, CurrSamplesPerSec=10.59934690744486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10973/20000 [19:26:11<23:25:32,  9.34s/it][2022-12-22 09:25:35,830] [INFO] [timer.py:197:stop] 0/4974, RunningAvgSamplesPerSec=10.949825879486172, CurrSamplesPerSec=10.645008917586432, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10974/20000 [19:26:20<23:16:22,  9.28s/it][2022-12-22 09:25:45,017] [INFO] [timer.py:197:stop] 0/4975, RunningAvgSamplesPerSec=10.949826626610331, CurrSamplesPerSec=10.953542588820008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10975/20000 [19:26:29<23:11:55,  9.25s/it]

                                                           
{'loss': 0.0441, 'learning_rate': 4.6400000000000005e-06, 'epoch': 0.55}


 55%|█████▍    | 10975/20000 [19:26:29<23:11:55,  9.25s/it][2022-12-22 09:25:54,338] [INFO] [timer.py:197:stop] 0/4976, RunningAvgSamplesPerSec=10.949830420206956, CurrSamplesPerSec=10.968728542500823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10976/20000 [19:26:38<23:14:49,  9.27s/it][2022-12-22 09:26:03,277] [INFO] [timer.py:197:stop] 0/4977, RunningAvgSamplesPerSec=10.94987840422779, CurrSamplesPerSec=11.19387023898008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10977/20000 [19:26:47<22:59:33,  9.17s/it][2022-12-22 09:26:12,702] [INFO] [timer.py:197:stop] 0/4978, RunningAvgSamplesPerSec=10.949919118970563, CurrSamplesPerSec=11.156293321554553, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10978/20000 [19:26:57<23:10:44,  9.25s/it][2022-12-22 09:26:23,080] [INFO] [timer.py:197:stop] 0/4979, RunningAvgSamplesPerSec=10.9499481265699, CurrSamplesPerSec=11.09621845849405, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10979/20000 [19:27:07<24:01:30,  9.59s/it][2022-12-22 09:26:34,260] [INFO] [logging.py:68:log_dist] [Rank 0] step=10980, skipped=22, lr=[4.637435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:26:34,261] [INFO] [timer.py:197:stop] 0/4980, RunningAvgSamplesPerSec=10.949938384298921, CurrSamplesPerSec=10.901664903773229, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10980/20000 [19:27:18<25:13:12, 10.07s/it][2022-12-22 09:26:44,500] [INFO] [timer.py:197:stop] 0/4981, RunningAvgSamplesPerSec=10.949914968528885, CurrSamplesPerSec=10.834579279916925, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10981/20000 [19:27:28<25:20:50, 10.12s/it][2022-12-22 09:26:53,413] [INFO] [timer.py:197:stop] 0/4982, RunningAvgSamplesPerSec=10.949914990313594, CurrSamplesPerSec=10.95002345744889, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10982/20000 [19:27:37<24:26:21,  9.76s/it][2022-12-22 09:27:03,072] [INFO] [timer.py:197:stop] 0/4983, RunningAvgSamplesPerSec=10.949903999811903, CurrSamplesPerSec=10.895443574516067, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10983/20000 [19:27:47<24:21:48,  9.73s/it][2022-12-22 09:27:12,312] [INFO] [timer.py:197:stop] 0/4984, RunningAvgSamplesPerSec=10.949900236114138, CurrSamplesPerSec=10.931185305215067, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10984/20000 [19:27:56<23:59:44,  9.58s/it][2022-12-22 09:27:22,275] [INFO] [timer.py:197:stop] 0/4985, RunningAvgSamplesPerSec=10.94991295782442, CurrSamplesPerSec=11.01366157806155, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10985/20000 [19:28:06<24:16:45,  9.70s/it][2022-12-22 09:27:31,277] [INFO] [timer.py:197:stop] 0/4986, RunningAvgSamplesPerSec=10.949916596688357, CurrSamplesPerSec=10.96807913788556, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10986/20000 [19:28:15<23:45:19,  9.49s/it][2022-12-22 09:27:40,648] [INFO] [timer.py:197:stop] 0/4987, RunningAvgSamplesPerSec=10.949916013581507, CurrSamplesPerSec=10.947010580331881, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10987/20000 [19:28:25<23:39:56,  9.45s/it][2022-12-22 09:27:49,602] [INFO] [timer.py:197:stop] 0/4988, RunningAvgSamplesPerSec=10.949950198193937, CurrSamplesPerSec=11.12305500183585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10988/20000 [19:28:34<23:17:18,  9.30s/it][2022-12-22 09:27:58,662] [INFO] [timer.py:197:stop] 0/4989, RunningAvgSamplesPerSec=10.950001403715314, CurrSamplesPerSec=11.211408331507126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10989/20000 [19:28:43<23:06:13,  9.23s/it][2022-12-22 09:28:07,452] [INFO] [logging.py:68:log_dist] [Rank 0] step=10990, skipped=22, lr=[4.632307692307692e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:28:07,453] [INFO] [timer.py:197:stop] 0/4990, RunningAvgSamplesPerSec=10.95004981456416, CurrSamplesPerSec=11.196918734663363, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10990/20000 [19:28:51<22:46:17,  9.10s/it][2022-12-22 09:28:17,484] [INFO] [timer.py:197:stop] 0/4991, RunningAvgSamplesPerSec=10.950099659642445, CurrSamplesPerSec=11.204504450656103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10991/20000 [19:29:01<23:28:07,  9.38s/it][2022-12-22 09:28:26,316] [INFO] [timer.py:197:stop] 0/4992, RunningAvgSamplesPerSec=10.950147326254756, CurrSamplesPerSec=11.19323637534821, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10992/20000 [19:29:10<23:03:23,  9.21s/it][2022-12-22 09:28:35,470] [INFO] [timer.py:197:stop] 0/4993, RunningAvgSamplesPerSec=10.95018975543024, CurrSamplesPerSec=11.166086535307773, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10993/20000 [19:29:19<23:00:31,  9.20s/it][2022-12-22 09:28:44,352] [INFO] [timer.py:197:stop] 0/4994, RunningAvgSamplesPerSec=10.950252607198642, CurrSamplesPerSec=11.273199123830318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10994/20000 [19:29:28<22:46:10,  9.10s/it][2022-12-22 09:28:53,698] [INFO] [timer.py:197:stop] 0/4995, RunningAvgSamplesPerSec=10.950277001586796, CurrSamplesPerSec=11.073423560464601, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10995/20000 [19:29:38<22:57:03,  9.18s/it][2022-12-22 09:29:03,068] [INFO] [timer.py:197:stop] 0/4996, RunningAvgSamplesPerSec=10.950319014921222, CurrSamplesPerSec=11.164189478351028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10996/20000 [19:29:47<23:05:38,  9.23s/it][2022-12-22 09:29:11,969] [INFO] [timer.py:197:stop] 0/4997, RunningAvgSamplesPerSec=10.95037868138275, CurrSamplesPerSec=11.256689790293846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10997/20000 [19:29:56<22:50:32,  9.13s/it][2022-12-22 09:29:21,075] [INFO] [timer.py:197:stop] 0/4998, RunningAvgSamplesPerSec=10.95037756916518, CurrSamplesPerSec=10.94482486006317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10998/20000 [19:30:05<22:49:06,  9.13s/it][2022-12-22 09:29:30,065] [INFO] [timer.py:197:stop] 0/4999, RunningAvgSamplesPerSec=10.950438930997178, CurrSamplesPerSec=11.265834075931009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▍    | 10999/20000 [19:30:14<22:42:53,  9.08s/it][2022-12-22 09:29:39,979] [INFO] [logging.py:68:log_dist] [Rank 0] step=11000, skipped=22, lr=[4.627179487179487e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:29:39,980] [INFO] [timer.py:197:stop] 0/5000, RunningAvgSamplesPerSec=10.950404698897126, CurrSamplesPerSec=10.78197843174184, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11000/20000 [19:30:24<23:20:04,  9.33s/it]

                                                           
{'loss': 0.0528, 'learning_rate': 4.627179487179487e-06, 'epoch': 0.55}


 55%|█████▌    | 11000/20000 [19:30:24<23:20:04,  9.33s/it][INFO|trainer.py:2955] 2022-12-22 09:29:39,985 >> ***** Running Evaluation *****
[INFO|trainer.py:2959] 2022-12-22 09:29:39,985 >>   Num examples: Unknown
[INFO|trainer.py:2960] 2022-12-22 09:29:39,986 >>   Batch size = 32
[INFO|trainer_utils.py:689] 2022-12-22 09:29:42,306 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: duration, age, input_length, gender, speaker_id. If duration, age, input_length, gender, speaker_id are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
[INFO|configuration_utils.py:523] 2022-12-22 09:29:42,318 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:29:47,509 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:29:53,150 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:29:58,747 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:04,243 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:09,648 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:15,559 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:21,134 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:26,778 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:31,984 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:36,733 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:42,511 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:47,716 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:53,321 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:30:58,124 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:04,266 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:11,205 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:18,662 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:23,949 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:29,214 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:34,718 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:40,502 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:46,467 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:52,759 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:31:57,600 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:02,791 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:08,517 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:13,937 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:19,214 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:24,297 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:30,019 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 09:32:33,973 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}



                                                           
{'eval_loss': 0.1502685546875, 'eval_wer': 10.040211108318672, 'eval_runtime': 211.4155, 'eval_samples_per_second': 4.73, 'eval_steps_per_second': 0.151, 'epoch': 0.55}


 55%|█████▌    | 11000/20000 [19:33:55<23:20:04,  9.33s/it][2022-12-22 09:33:24,453] [INFO] [timer.py:197:stop] 0/5001, RunningAvgSamplesPerSec=10.950375279603616, CurrSamplesPerSec=10.805286242891603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11001/20000 [19:34:08<184:40:06, 73.88s/it][2022-12-22 09:33:33,387] [INFO] [timer.py:197:stop] 0/5002, RunningAvgSamplesPerSec=10.95035993659827, CurrSamplesPerSec=10.874193850248425, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11002/20000 [19:34:17<135:57:08, 54.39s/it][2022-12-22 09:33:43,164] [INFO] [timer.py:197:stop] 0/5003, RunningAvgSamplesPerSec=10.950368482851681, CurrSamplesPerSec=10.993267185594464, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11003/20000 [19:34:27<102:29:10, 41.01s/it][2022-12-22 09:33:52,196] [INFO] [timer.py:197:stop] 0/5004, RunningAvgSamplesPerSec=10.950373553622855, CurrSamplesPerSec=10.975791354704787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11004/20000 [19:34:36<78:30:14, 31.42s/it] [2022-12-22 09:34:01,541] [INFO] [timer.py:197:stop] 0/5005, RunningAvgSamplesPerSec=10.950382457871621, CurrSamplesPerSec=10.995103442516045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11005/20000 [19:34:46<61:57:04, 24.79s/it][2022-12-22 09:34:11,193] [INFO] [timer.py:197:stop] 0/5006, RunningAvgSamplesPerSec=10.95037868502895, CurrSamplesPerSec=10.93153564001979, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11006/20000 [19:34:55<50:35:42, 20.25s/it][2022-12-22 09:34:20,645] [INFO] [timer.py:197:stop] 0/5007, RunningAvgSamplesPerSec=10.95042527953511, CurrSamplesPerSec=11.188657700139231, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11007/20000 [19:35:05<42:29:47, 17.01s/it][2022-12-22 09:34:30,434] [INFO] [timer.py:197:stop] 0/5008, RunningAvgSamplesPerSec=10.950460823092763, CurrSamplesPerSec=11.13129464862369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11008/20000 [19:35:14<37:04:45, 14.84s/it][2022-12-22 09:34:40,005] [INFO] [timer.py:197:stop] 0/5009, RunningAvgSamplesPerSec=10.950412295705355, CurrSamplesPerSec=10.712757472298769, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11009/20000 [19:35:24<33:07:24, 13.26s/it][2022-12-22 09:34:48,916] [INFO] [logging.py:68:log_dist] [Rank 0] step=11010, skipped=22, lr=[4.622051282051282e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:34:48,917] [INFO] [timer.py:197:stop] 0/5010, RunningAvgSamplesPerSec=10.950386110482977, CurrSamplesPerSec=10.820828213703123, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11010/20000 [19:35:33<29:51:36, 11.96s/it][2022-12-22 09:34:58,560] [INFO] [timer.py:197:stop] 0/5011, RunningAvgSamplesPerSec=10.950375777473639, CurrSamplesPerSec=10.898871506772162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11011/20000 [19:35:43<28:07:23, 11.26s/it][2022-12-22 09:35:08,123] [INFO] [timer.py:197:stop] 0/5012, RunningAvgSamplesPerSec=10.950418295783457, CurrSamplesPerSec=11.167617653970977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11012/20000 [19:35:52<26:50:50, 10.75s/it][2022-12-22 09:35:17,871] [INFO] [timer.py:197:stop] 0/5013, RunningAvgSamplesPerSec=10.950381251163611, CurrSamplesPerSec=10.76788143801867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11013/20000 [19:36:02<26:05:28, 10.45s/it][2022-12-22 09:35:27,394] [INFO] [timer.py:197:stop] 0/5014, RunningAvgSamplesPerSec=10.950375459629111, CurrSamplesPerSec=10.921430806515588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11014/20000 [19:36:11<25:23:34, 10.17s/it][2022-12-22 09:35:36,419] [INFO] [timer.py:197:stop] 0/5015, RunningAvgSamplesPerSec=10.95032169522465, CurrSamplesPerSec=10.68732759056921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11015/20000 [19:36:20<24:31:49,  9.83s/it][2022-12-22 09:35:46,942] [INFO] [timer.py:197:stop] 0/5016, RunningAvgSamplesPerSec=10.950331601906433, CurrSamplesPerSec=11.000220098279968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11016/20000 [19:36:31<25:02:51, 10.04s/it][2022-12-22 09:35:56,204] [INFO] [timer.py:197:stop] 0/5017, RunningAvgSamplesPerSec=10.950295354068366, CurrSamplesPerSec=10.771516552799541, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11017/20000 [19:36:40<24:27:52,  9.80s/it][2022-12-22 09:36:05,541] [INFO] [timer.py:197:stop] 0/5018, RunningAvgSamplesPerSec=10.950289147112073, CurrSamplesPerSec=10.919249513834192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11018/20000 [19:36:50<24:06:43,  9.66s/it][2022-12-22 09:36:14,764] [INFO] [timer.py:197:stop] 0/5019, RunningAvgSamplesPerSec=10.950272741678193, CurrSamplesPerSec=10.868596988727385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11019/20000 [19:36:59<23:46:46,  9.53s/it][2022-12-22 09:36:23,726] [INFO] [logging.py:68:log_dist] [Rank 0] step=11020, skipped=22, lr=[4.616923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:36:23,727] [INFO] [timer.py:197:stop] 0/5020, RunningAvgSamplesPerSec=10.95031934170778, CurrSamplesPerSec=11.18921315582627, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11020/20000 [19:37:08<23:21:03,  9.36s/it][2022-12-22 09:36:33,150] [INFO] [timer.py:197:stop] 0/5021, RunningAvgSamplesPerSec=10.950349737045702, CurrSamplesPerSec=11.105028440672728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11021/20000 [19:37:17<23:23:40,  9.38s/it][2022-12-22 09:36:42,972] [INFO] [timer.py:197:stop] 0/5022, RunningAvgSamplesPerSec=10.950324774444134, CurrSamplesPerSec=10.82645500596909, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11022/20000 [19:37:27<23:43:25,  9.51s/it][2022-12-22 09:36:52,413] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 65536.0
[2022-12-22 09:36:52,415] [INFO] [timer.py:197:stop] 0/5023, RunningAvgSamplesPerSec=10.950458316429204, CurrSamplesPerSec=11.664564990269152, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11023/20000 [19:37:36<23:40:05,  9.49s/it][2022-12-22 09:37:01,571] [INFO] [stage_1_and_2.py:1765:step] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0
[2022-12-22 09:37:01,572] [INFO] [timer.py:197:stop] 0/5024, RunningAvgSamplesPerSec=10.950554852635571, CurrSamplesPerSec=11.457716281927762, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11024/20000 [19:37:46<23:24:54,  9.39s/it][2022-12-22 09:37:10,747] [INFO] [timer.py:197:stop] 0/5025, RunningAvgSamplesPerSec=10.950530996723753, CurrSamplesPerSec=10.832023399245264, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11025/20000 [19:37:55<23:15:03,  9.33s/it]

                                                           
{'loss': 0.0608, 'learning_rate': 4.615384615384616e-06, 'epoch': 0.55}


 55%|█████▌    | 11025/20000 [19:37:55<23:15:03,  9.33s/it][2022-12-22 09:37:20,258] [INFO] [timer.py:197:stop] 0/5026, RunningAvgSamplesPerSec=10.950421685120489, CurrSamplesPerSec=10.427571300852216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11026/20000 [19:38:04<23:23:12,  9.38s/it][2022-12-22 09:37:31,990] [INFO] [timer.py:197:stop] 0/5027, RunningAvgSamplesPerSec=10.950380033030658, CurrSamplesPerSec=10.745044642885734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11027/20000 [19:38:16<25:08:29, 10.09s/it][2022-12-22 09:37:40,985] [INFO] [timer.py:197:stop] 0/5028, RunningAvgSamplesPerSec=10.950350087303962, CurrSamplesPerSec=10.801913005946343, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11028/20000 [19:38:25<24:19:21,  9.76s/it][2022-12-22 09:37:50,863] [INFO] [timer.py:197:stop] 0/5029, RunningAvgSamplesPerSec=10.95036976114315, CurrSamplesPerSec=11.050151676643146, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11029/20000 [19:38:35<24:24:30,  9.79s/it][2022-12-22 09:37:59,913] [INFO] [logging.py:68:log_dist] [Rank 0] step=11030, skipped=24, lr=[4.612820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:37:59,914] [INFO] [timer.py:197:stop] 0/5030, RunningAvgSamplesPerSec=10.950338899247743, CurrSamplesPerSec=10.797363908737642, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11030/20000 [19:38:44<23:50:58,  9.57s/it][2022-12-22 09:38:08,995] [INFO] [timer.py:197:stop] 0/5031, RunningAvgSamplesPerSec=10.950340847156973, CurrSamplesPerSec=10.960143704271992, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11031/20000 [19:38:53<23:28:47,  9.42s/it][2022-12-22 09:38:18,026] [INFO] [timer.py:197:stop] 0/5032, RunningAvgSamplesPerSec=10.950399320553785, CurrSamplesPerSec=11.252578382258957, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11032/20000 [19:39:02<23:10:59,  9.31s/it][2022-12-22 09:38:28,276] [INFO] [timer.py:197:stop] 0/5033, RunningAvgSamplesPerSec=10.950404884208773, CurrSamplesPerSec=10.9784617861144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11033/20000 [19:39:12<23:53:09,  9.59s/it][2022-12-22 09:38:37,345] [INFO] [timer.py:197:stop] 0/5034, RunningAvgSamplesPerSec=10.950373910060524, CurrSamplesPerSec=10.796729859548835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11034/20000 [19:39:21<23:29:39,  9.43s/it][2022-12-22 09:38:46,926] [INFO] [timer.py:197:stop] 0/5035, RunningAvgSamplesPerSec=10.95032886188896, CurrSamplesPerSec=10.728244732494138, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11035/20000 [19:39:31<23:36:06,  9.48s/it][2022-12-22 09:38:57,032] [INFO] [timer.py:197:stop] 0/5036, RunningAvgSamplesPerSec=10.95033812022249, CurrSamplesPerSec=10.997134485957195, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11036/20000 [19:39:41<24:04:06,  9.67s/it][2022-12-22 09:39:06,253] [INFO] [timer.py:197:stop] 0/5037, RunningAvgSamplesPerSec=10.950402580012568, CurrSamplesPerSec=11.284804377858507, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11037/20000 [19:39:50<23:43:59,  9.53s/it][2022-12-22 09:39:15,160] [INFO] [timer.py:197:stop] 0/5038, RunningAvgSamplesPerSec=10.95046104150842, CurrSamplesPerSec=11.252947262340136, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11038/20000 [19:39:59<23:15:49,  9.34s/it][2022-12-22 09:39:24,160] [INFO] [timer.py:197:stop] 0/5039, RunningAvgSamplesPerSec=10.950492858649076, CurrSamplesPerSec=11.113103827267217, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11039/20000 [19:40:08<23:00:12,  9.24s/it][2022-12-22 09:39:33,790] [INFO] [logging.py:68:log_dist] [Rank 0] step=11040, skipped=24, lr=[4.607692307692308e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:39:33,791] [INFO] [timer.py:197:stop] 0/5040, RunningAvgSamplesPerSec=10.950494491050591, CurrSamplesPerSec=10.958723077312479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11040/20000 [19:40:18<23:17:30,  9.36s/it][2022-12-22 09:39:42,721] [INFO] [timer.py:197:stop] 0/5041, RunningAvgSamplesPerSec=10.950486370500547, CurrSamplesPerSec=10.90972734648863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11041/20000 [19:40:27<22:58:09,  9.23s/it][2022-12-22 09:39:51,990] [INFO] [timer.py:197:stop] 0/5042, RunningAvgSamplesPerSec=10.950498485757603, CurrSamplesPerSec=11.011889587980411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11042/20000 [19:40:36<22:59:46,  9.24s/it][2022-12-22 09:40:00,801] [INFO] [timer.py:197:stop] 0/5043, RunningAvgSamplesPerSec=10.950556265835024, CurrSamplesPerSec=11.249725331739246, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11043/20000 [19:40:45<22:40:19,  9.11s/it][2022-12-22 09:40:11,036] [INFO] [timer.py:197:stop] 0/5044, RunningAvgSamplesPerSec=10.950539960531128, CurrSamplesPerSec=10.86895740583347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11044/20000 [19:40:55<23:30:28,  9.45s/it][2022-12-22 09:40:19,776] [INFO] [timer.py:197:stop] 0/5045, RunningAvgSamplesPerSec=10.950603813494142, CurrSamplesPerSec=11.282304349220382, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11045/20000 [19:41:04<22:58:31,  9.24s/it][2022-12-22 09:40:29,150] [INFO] [timer.py:197:stop] 0/5046, RunningAvgSamplesPerSec=10.950548409826666, CurrSamplesPerSec=10.678100537267436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11046/20000 [19:41:13<23:04:31,  9.28s/it][2022-12-22 09:40:38,747] [INFO] [timer.py:197:stop] 0/5047, RunningAvgSamplesPerSec=10.95060549842184, CurrSamplesPerSec=11.246338447115967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11047/20000 [19:41:23<23:18:40,  9.37s/it][2022-12-22 09:40:48,962] [INFO] [timer.py:197:stop] 0/5048, RunningAvgSamplesPerSec=10.950588124579422, CurrSamplesPerSec=10.86363323455505, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11048/20000 [19:41:33<23:56:12,  9.63s/it][2022-12-22 09:40:58,318] [INFO] [timer.py:197:stop] 0/5049, RunningAvgSamplesPerSec=10.950551222487409, CurrSamplesPerSec=10.76745729235421, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11049/20000 [19:41:42<23:43:57,  9.54s/it][2022-12-22 09:41:07,842] [INFO] [logging.py:68:log_dist] [Rank 0] step=11050, skipped=24, lr=[4.602564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:41:07,843] [INFO] [timer.py:197:stop] 0/5050, RunningAvgSamplesPerSec=10.950533493806368, CurrSamplesPerSec=10.861782170077088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11050/20000 [19:41:52<23:42:54,  9.54s/it]

                                                           
{'loss': 0.0585, 'learning_rate': 4.602564102564103e-06, 'epoch': 0.55}


 55%|█████▌    | 11050/20000 [19:41:52<23:42:54,  9.54s/it][2022-12-22 09:41:17,148] [INFO] [timer.py:197:stop] 0/5051, RunningAvgSamplesPerSec=10.950508579933706, CurrSamplesPerSec=10.826171628053649, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11051/20000 [19:42:01<23:32:16,  9.47s/it][2022-12-22 09:41:25,982] [INFO] [timer.py:197:stop] 0/5052, RunningAvgSamplesPerSec=10.950532408721815, CurrSamplesPerSec=11.072180753317008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11052/20000 [19:42:10<23:03:42,  9.28s/it][2022-12-22 09:41:34,765] [INFO] [timer.py:197:stop] 0/5053, RunningAvgSamplesPerSec=10.950575263697456, CurrSamplesPerSec=11.171357094412508, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11053/20000 [19:42:19<22:41:22,  9.13s/it][2022-12-22 09:41:44,654] [INFO] [timer.py:197:stop] 0/5054, RunningAvgSamplesPerSec=10.950485125857439, CurrSamplesPerSec=10.51337609278748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11054/20000 [19:42:29<23:15:13,  9.36s/it][2022-12-22 09:41:53,478] [INFO] [timer.py:197:stop] 0/5055, RunningAvgSamplesPerSec=10.950530988028612, CurrSamplesPerSec=11.187235966197171, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11055/20000 [19:42:37<22:51:11,  9.20s/it][2022-12-22 09:42:03,630] [INFO] [timer.py:197:stop] 0/5056, RunningAvgSamplesPerSec=10.95051599267601, CurrSamplesPerSec=10.875265272401972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11056/20000 [19:42:48<23:33:42,  9.48s/it][2022-12-22 09:42:12,916] [INFO] [timer.py:197:stop] 0/5057, RunningAvgSamplesPerSec=10.950557396025177, CurrSamplesPerSec=11.163887216213645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11057/20000 [19:42:57<23:24:43,  9.42s/it][2022-12-22 09:42:21,739] [INFO] [timer.py:197:stop] 0/5058, RunningAvgSamplesPerSec=10.950616303597672, CurrSamplesPerSec=11.25671952907838, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11058/20000 [19:43:06<22:57:39,  9.24s/it][2022-12-22 09:42:30,781] [INFO] [timer.py:197:stop] 0/5059, RunningAvgSamplesPerSec=10.950616042192022, CurrSamplesPerSec=10.949294534768045, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11059/20000 [19:43:15<22:48:29,  9.18s/it][2022-12-22 09:42:40,127] [INFO] [logging.py:68:log_dist] [Rank 0] step=11060, skipped=24, lr=[4.597435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:42:40,128] [INFO] [timer.py:197:stop] 0/5060, RunningAvgSamplesPerSec=10.95067118042135, CurrSamplesPerSec=11.236792066767533, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11060/20000 [19:43:24<22:55:37,  9.23s/it][2022-12-22 09:42:49,845] [INFO] [timer.py:197:stop] 0/5061, RunningAvgSamplesPerSec=10.950614512778628, CurrSamplesPerSec=10.671301841753014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11061/20000 [19:43:34<23:17:09,  9.38s/it][2022-12-22 09:43:00,152] [INFO] [timer.py:197:stop] 0/5062, RunningAvgSamplesPerSec=10.95061926929328, CurrSamplesPerSec=10.974735481052868, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11062/20000 [19:43:44<23:58:30,  9.66s/it][2022-12-22 09:43:10,193] [INFO] [timer.py:197:stop] 0/5063, RunningAvgSamplesPerSec=10.950659726897346, CurrSamplesPerSec=11.159275918515952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11063/20000 [19:43:54<24:15:30,  9.77s/it][2022-12-22 09:43:19,734] [INFO] [timer.py:197:stop] 0/5064, RunningAvgSamplesPerSec=10.950613121207946, CurrSamplesPerSec=10.71971612957227, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11064/20000 [19:44:04<24:05:03,  9.70s/it][2022-12-22 09:43:29,149] [INFO] [timer.py:197:stop] 0/5065, RunningAvgSamplesPerSec=10.950656335759192, CurrSamplesPerSec=11.173868190663118, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11065/20000 [19:44:13<23:52:03,  9.62s/it][2022-12-22 09:43:39,757] [INFO] [timer.py:197:stop] 0/5066, RunningAvgSamplesPerSec=10.95060877131037, CurrSamplesPerSec=10.71497294327734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11066/20000 [19:44:24<24:36:10,  9.91s/it][2022-12-22 09:43:48,796] [INFO] [timer.py:197:stop] 0/5067, RunningAvgSamplesPerSec=10.950632959022721, CurrSamplesPerSec=11.074505363185278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11067/20000 [19:44:33<23:56:57,  9.65s/it][2022-12-22 09:43:58,211] [INFO] [timer.py:197:stop] 0/5068, RunningAvgSamplesPerSec=10.95061826995458, CurrSamplesPerSec=10.876720312663595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11068/20000 [19:44:42<23:46:11,  9.58s/it][2022-12-22 09:44:07,734] [INFO] [timer.py:197:stop] 0/5069, RunningAvgSamplesPerSec=10.950605370962622, CurrSamplesPerSec=10.885646786007449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11069/20000 [19:44:52<23:43:29,  9.56s/it][2022-12-22 09:44:16,585] [INFO] [logging.py:68:log_dist] [Rank 0] step=11070, skipped=24, lr=[4.592307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:44:16,586] [INFO] [timer.py:197:stop] 0/5070, RunningAvgSamplesPerSec=10.950651301029561, CurrSamplesPerSec=11.188433388160808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11070/20000 [19:45:01<23:11:33,  9.35s/it][2022-12-22 09:44:26,973] [INFO] [timer.py:197:stop] 0/5071, RunningAvgSamplesPerSec=10.950600281623451, CurrSamplesPerSec=10.697999535073107, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11071/20000 [19:45:11<23:57:42,  9.66s/it][2022-12-22 09:44:37,325] [INFO] [timer.py:197:stop] 0/5072, RunningAvgSamplesPerSec=10.950573823994084, CurrSamplesPerSec=10.818083059975043, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11072/20000 [19:45:21<24:28:23,  9.87s/it][2022-12-22 09:44:47,005] [INFO] [timer.py:197:stop] 0/5073, RunningAvgSamplesPerSec=10.950548380475443, CurrSamplesPerSec=10.82305195878623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11073/20000 [19:45:31<24:19:51,  9.81s/it][2022-12-22 09:44:56,203] [INFO] [timer.py:197:stop] 0/5074, RunningAvgSamplesPerSec=10.950556707873073, CurrSamplesPerSec=10.992948447219748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11074/20000 [19:45:40<23:52:16,  9.63s/it][2022-12-22 09:45:05,164] [INFO] [timer.py:197:stop] 0/5075, RunningAvgSamplesPerSec=10.95055212105455, CurrSamplesPerSec=10.92733710729879, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11075/20000 [19:45:49<23:22:22,  9.43s/it]

                                                           
{'loss': 0.0528, 'learning_rate': 4.58974358974359e-06, 'epoch': 0.55}


 55%|█████▌    | 11075/20000 [19:45:49<23:22:22,  9.43s/it][2022-12-22 09:45:14,298] [INFO] [timer.py:197:stop] 0/5076, RunningAvgSamplesPerSec=10.950593712479758, CurrSamplesPerSec=11.165733081219646, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11076/20000 [19:45:58<23:09:05,  9.34s/it][2022-12-22 09:45:24,010] [INFO] [timer.py:197:stop] 0/5077, RunningAvgSamplesPerSec=10.950651025809767, CurrSamplesPerSec=11.249393905804638, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11077/20000 [19:46:08<23:25:34,  9.45s/it][2022-12-22 09:45:33,095] [INFO] [timer.py:197:stop] 0/5078, RunningAvgSamplesPerSec=10.950689029499394, CurrSamplesPerSec=11.147016243633617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11078/20000 [19:46:17<23:09:04,  9.34s/it][2022-12-22 09:45:42,032] [INFO] [timer.py:197:stop] 0/5079, RunningAvgSamplesPerSec=10.950700511307865, CurrSamplesPerSec=11.009294078380906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11079/20000 [19:46:26<22:50:51,  9.22s/it][2022-12-22 09:45:51,900] [INFO] [logging.py:68:log_dist] [Rank 0] step=11080, skipped=24, lr=[4.587179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:45:51,901] [INFO] [timer.py:197:stop] 0/5080, RunningAvgSamplesPerSec=10.950706792374731, CurrSamplesPerSec=10.982688920667018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11080/20000 [19:46:36<23:19:40,  9.41s/it][2022-12-22 09:46:00,943] [INFO] [timer.py:197:stop] 0/5081, RunningAvgSamplesPerSec=10.950738274193426, CurrSamplesPerSec=11.11297178663296, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11081/20000 [19:46:45<23:02:53,  9.30s/it][2022-12-22 09:46:11,193] [INFO] [timer.py:197:stop] 0/5082, RunningAvgSamplesPerSec=10.950696968431016, CurrSamplesPerSec=10.744849377829707, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11082/20000 [19:46:55<23:44:56,  9.59s/it][2022-12-22 09:46:20,705] [INFO] [timer.py:197:stop] 0/5083, RunningAvgSamplesPerSec=10.95073645847942, CurrSamplesPerSec=11.155090252665575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11083/20000 [19:47:05<23:41:28,  9.56s/it][2022-12-22 09:46:29,802] [INFO] [timer.py:197:stop] 0/5084, RunningAvgSamplesPerSec=10.95069333311643, CurrSamplesPerSec=10.735872703765565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11084/20000 [19:47:14<23:20:26,  9.42s/it][2022-12-22 09:46:40,089] [INFO] [timer.py:197:stop] 0/5085, RunningAvgSamplesPerSec=10.9506804034481, CurrSamplesPerSec=10.885363832332551, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11085/20000 [19:47:24<23:58:46,  9.68s/it][2022-12-22 09:46:48,989] [INFO] [timer.py:197:stop] 0/5086, RunningAvgSamplesPerSec=10.950678597589661, CurrSamplesPerSec=10.941507108472344, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11086/20000 [19:47:33<23:23:40,  9.45s/it][2022-12-22 09:46:58,720] [INFO] [timer.py:197:stop] 0/5087, RunningAvgSamplesPerSec=10.950685152960993, CurrSamplesPerSec=10.98411442004089, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11087/20000 [19:47:43<23:36:07,  9.53s/it][2022-12-22 09:47:07,574] [INFO] [timer.py:197:stop] 0/5088, RunningAvgSamplesPerSec=10.950691857277478, CurrSamplesPerSec=10.984889791789765, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11088/20000 [19:47:52<23:05:46,  9.33s/it][2022-12-22 09:47:17,294] [INFO] [timer.py:197:stop] 0/5089, RunningAvgSamplesPerSec=10.950649764686746, CurrSamplesPerSec=10.740672663817136, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11089/20000 [19:48:01<23:22:55,  9.45s/it][2022-12-22 09:47:26,977] [INFO] [logging.py:68:log_dist] [Rank 0] step=11090, skipped=24, lr=[4.5820512820512826e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:47:26,978] [INFO] [timer.py:197:stop] 0/5090, RunningAvgSamplesPerSec=10.950681160871993, CurrSamplesPerSec=11.112757859861214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11090/20000 [19:48:11<23:33:24,  9.52s/it][2022-12-22 09:47:36,702] [INFO] [timer.py:197:stop] 0/5091, RunningAvgSamplesPerSec=10.950687217951897, CurrSamplesPerSec=10.98159263443556, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11091/20000 [19:48:21<23:42:24,  9.58s/it][2022-12-22 09:47:46,624] [INFO] [timer.py:197:stop] 0/5092, RunningAvgSamplesPerSec=10.950568227057206, CurrSamplesPerSec=10.376760240517303, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11092/20000 [19:48:31<23:57:28,  9.68s/it][2022-12-22 09:47:56,172] [INFO] [timer.py:197:stop] 0/5093, RunningAvgSamplesPerSec=10.950614977547756, CurrSamplesPerSec=11.193861836783526, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11093/20000 [19:48:40<23:51:22,  9.64s/it][2022-12-22 09:48:05,122] [INFO] [timer.py:197:stop] 0/5094, RunningAvgSamplesPerSec=10.950628943218202, CurrSamplesPerSec=11.02219290658718, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11094/20000 [19:48:49<23:20:21,  9.43s/it][2022-12-22 09:48:14,792] [INFO] [timer.py:197:stop] 0/5095, RunningAvgSamplesPerSec=10.950586708682001, CurrSamplesPerSec=10.739671423064559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11095/20000 [19:48:59<23:30:41,  9.50s/it][2022-12-22 09:48:24,085] [INFO] [timer.py:197:stop] 0/5096, RunningAvgSamplesPerSec=10.950533711737558, CurrSamplesPerSec=10.68711441991006, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11096/20000 [19:49:08<23:21:06,  9.44s/it][2022-12-22 09:48:33,912] [INFO] [timer.py:197:stop] 0/5097, RunningAvgSamplesPerSec=10.950516701754553, CurrSamplesPerSec=10.8645482300775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11097/20000 [19:49:18<23:38:08,  9.56s/it][2022-12-22 09:48:44,152] [INFO] [timer.py:197:stop] 0/5098, RunningAvgSamplesPerSec=10.950503028594776, CurrSamplesPerSec=10.881278755929849, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11098/20000 [19:49:28<24:08:23,  9.76s/it][2022-12-22 09:48:53,635] [INFO] [timer.py:197:stop] 0/5099, RunningAvgSamplesPerSec=10.950532293514062, CurrSamplesPerSec=11.101725813252196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 55%|█████▌    | 11099/20000 [19:49:38<23:55:45,  9.68s/it][2022-12-22 09:49:03,867] [INFO] [logging.py:68:log_dist] [Rank 0] step=11100, skipped=24, lr=[4.5769230769230775e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:49:03,868] [INFO] [timer.py:197:stop] 0/5100, RunningAvgSamplesPerSec=10.950551766389085, CurrSamplesPerSec=11.050713026765129, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11100/20000 [19:49:48<24:20:17,  9.84s/it]

                                                           
{'loss': 0.0402, 'learning_rate': 4.5769230769230775e-06, 'epoch': 0.56}


 56%|█████▌    | 11100/20000 [19:49:48<24:20:17,  9.84s/it][2022-12-22 09:49:12,868] [INFO] [timer.py:197:stop] 0/5101, RunningAvgSamplesPerSec=10.950556302618724, CurrSamplesPerSec=10.973730951808628, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11101/20000 [19:49:57<23:42:33,  9.59s/it][2022-12-22 09:49:23,246] [INFO] [timer.py:197:stop] 0/5102, RunningAvgSamplesPerSec=10.950528115298342, CurrSamplesPerSec=10.808663328154262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11102/20000 [19:50:07<24:17:21,  9.83s/it][2022-12-22 09:49:32,540] [INFO] [timer.py:197:stop] 0/5103, RunningAvgSamplesPerSec=10.950576504692947, CurrSamplesPerSec=11.20305343881009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11103/20000 [19:50:17<23:53:30,  9.67s/it][2022-12-22 09:49:41,803] [INFO] [timer.py:197:stop] 0/5104, RunningAvgSamplesPerSec=10.950510302029132, CurrSamplesPerSec=10.622915112749487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11104/20000 [19:50:26<23:35:22,  9.55s/it][2022-12-22 09:49:50,892] [INFO] [timer.py:197:stop] 0/5105, RunningAvgSamplesPerSec=10.950520511499326, CurrSamplesPerSec=11.00285823386298, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11105/20000 [19:50:35<23:14:51,  9.41s/it][2022-12-22 09:49:59,741] [INFO] [timer.py:197:stop] 0/5106, RunningAvgSamplesPerSec=10.950558150726605, CurrSamplesPerSec=11.146060921454026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11106/20000 [19:50:44<22:49:48,  9.24s/it][2022-12-22 09:50:09,568] [INFO] [timer.py:197:stop] 0/5107, RunningAvgSamplesPerSec=10.950563143110527, CurrSamplesPerSec=10.97610371326026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11107/20000 [19:50:54<23:15:42,  9.42s/it][2022-12-22 09:50:19,041] [INFO] [timer.py:197:stop] 0/5108, RunningAvgSamplesPerSec=10.95045438227183, CurrSamplesPerSec=10.422028481613955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11108/20000 [19:51:03<23:18:04,  9.43s/it][2022-12-22 09:50:29,467] [INFO] [timer.py:197:stop] 0/5109, RunningAvgSamplesPerSec=10.950490564596645, CurrSamplesPerSec=11.138408520869081, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11109/20000 [19:51:13<24:02:00,  9.73s/it][2022-12-22 09:50:39,505] [INFO] [logging.py:68:log_dist] [Rank 0] step=11110, skipped=24, lr=[4.571794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:50:39,506] [INFO] [timer.py:197:stop] 0/5110, RunningAvgSamplesPerSec=10.950547366646548, CurrSamplesPerSec=11.248530781410663, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11110/20000 [19:51:23<24:15:32,  9.82s/it][2022-12-22 09:50:48,753] [INFO] [timer.py:197:stop] 0/5111, RunningAvgSamplesPerSec=10.950515524860863, CurrSamplesPerSec=10.79024859193595, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11111/20000 [19:51:33<23:49:44,  9.65s/it][2022-12-22 09:50:57,615] [INFO] [timer.py:197:stop] 0/5112, RunningAvgSamplesPerSec=10.950517159293183, CurrSamplesPerSec=10.958873847648418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11112/20000 [19:51:42<23:14:33,  9.41s/it][2022-12-22 09:51:07,117] [INFO] [timer.py:197:stop] 0/5113, RunningAvgSamplesPerSec=10.950569323300737, CurrSamplesPerSec=11.223779160253603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11113/20000 [19:51:51<23:18:15,  9.44s/it][2022-12-22 09:51:16,014] [INFO] [timer.py:197:stop] 0/5114, RunningAvgSamplesPerSec=10.950653945132046, CurrSamplesPerSec=11.400944063755308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11114/20000 [19:52:00<22:53:59,  9.28s/it][2022-12-22 09:51:24,925] [INFO] [timer.py:197:stop] 0/5115, RunningAvgSamplesPerSec=10.950664404916195, CurrSamplesPerSec=11.004397242016225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11115/20000 [19:52:09<22:37:32,  9.17s/it][2022-12-22 09:51:34,336] [INFO] [timer.py:197:stop] 0/5116, RunningAvgSamplesPerSec=10.950698575980065, CurrSamplesPerSec=11.12824856129176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11116/20000 [19:52:18<22:48:12,  9.24s/it][2022-12-22 09:51:43,940] [INFO] [timer.py:197:stop] 0/5117, RunningAvgSamplesPerSec=10.950718880087125, CurrSamplesPerSec=11.055548274940374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11117/20000 [19:52:28<23:04:11,  9.35s/it][2022-12-22 09:51:53,128] [INFO] [timer.py:197:stop] 0/5118, RunningAvgSamplesPerSec=10.950688090207198, CurrSamplesPerSec=10.795431159783693, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11118/20000 [19:52:37<22:56:52,  9.30s/it][2022-12-22 09:52:02,466] [INFO] [timer.py:197:stop] 0/5119, RunningAvgSamplesPerSec=10.95067227108497, CurrSamplesPerSec=10.870335484543972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11119/20000 [19:52:46<22:58:20,  9.31s/it][2022-12-22 09:52:11,423] [INFO] [logging.py:68:log_dist] [Rank 0] step=11120, skipped=24, lr=[4.566666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:52:11,424] [INFO] [timer.py:197:stop] 0/5120, RunningAvgSamplesPerSec=10.950703723716096, CurrSamplesPerSec=11.114047986223714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11120/20000 [19:52:55<22:42:29,  9.21s/it][2022-12-22 09:52:22,182] [INFO] [timer.py:197:stop] 0/5121, RunningAvgSamplesPerSec=10.95066510183071, CurrSamplesPerSec=10.756503719679902, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11121/20000 [19:53:06<23:51:13,  9.67s/it][2022-12-22 09:52:31,515] [INFO] [timer.py:197:stop] 0/5122, RunningAvgSamplesPerSec=10.950709535844325, CurrSamplesPerSec=11.18299296435192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11122/20000 [19:53:15<23:36:02,  9.57s/it][2022-12-22 09:52:41,214] [INFO] [timer.py:197:stop] 0/5123, RunningAvgSamplesPerSec=10.950723155146457, CurrSamplesPerSec=11.020900939826479, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11123/20000 [19:53:25<23:41:37,  9.61s/it][2022-12-22 09:52:50,075] [INFO] [timer.py:197:stop] 0/5124, RunningAvgSamplesPerSec=10.950761166510283, CurrSamplesPerSec=11.148940807774453, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11124/20000 [19:53:34<23:08:16,  9.38s/it][2022-12-22 09:53:02,146] [INFO] [timer.py:197:stop] 0/5125, RunningAvgSamplesPerSec=10.950724327500414, CurrSamplesPerSec=10.76523172328956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11125/20000 [19:53:46<25:07:20, 10.19s/it]

                                                           
{'loss': 0.0412, 'learning_rate': 4.564102564102564e-06, 'epoch': 0.56}


 56%|█████▌    | 11125/20000 [19:53:46<25:07:20, 10.19s/it][2022-12-22 09:53:11,755] [INFO] [timer.py:197:stop] 0/5126, RunningAvgSamplesPerSec=10.95076059563435, CurrSamplesPerSec=11.139769792453329, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11126/20000 [19:53:56<24:41:20, 10.02s/it][2022-12-22 09:53:21,021] [INFO] [timer.py:197:stop] 0/5127, RunningAvgSamplesPerSec=10.95077084801416, CurrSamplesPerSec=11.003557319608742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11127/20000 [19:54:05<24:07:54,  9.79s/it][2022-12-22 09:53:30,454] [INFO] [timer.py:197:stop] 0/5128, RunningAvgSamplesPerSec=10.950734288840774, CurrSamplesPerSec=10.766521007605238, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11128/20000 [19:54:14<23:51:52,  9.68s/it][2022-12-22 09:53:41,857] [INFO] [timer.py:197:stop] 0/5129, RunningAvgSamplesPerSec=10.95072844750147, CurrSamplesPerSec=10.920867407546664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11129/20000 [19:54:26<25:07:59, 10.20s/it][2022-12-22 09:53:51,063] [INFO] [logging.py:68:log_dist] [Rank 0] step=11130, skipped=24, lr=[4.561538461538461e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:53:51,064] [INFO] [timer.py:197:stop] 0/5130, RunningAvgSamplesPerSec=10.95074068216057, CurrSamplesPerSec=11.013829228269701, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11130/20000 [19:54:35<24:23:48,  9.90s/it][2022-12-22 09:54:00,229] [INFO] [timer.py:197:stop] 0/5131, RunningAvgSamplesPerSec=10.95074349515374, CurrSamplesPerSec=10.965187554489354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11131/20000 [19:54:44<23:50:57,  9.68s/it][2022-12-22 09:54:10,108] [INFO] [timer.py:197:stop] 0/5132, RunningAvgSamplesPerSec=10.95073483265648, CurrSamplesPerSec=10.906484454380513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11132/20000 [19:54:54<23:59:37,  9.74s/it][2022-12-22 09:54:19,165] [INFO] [timer.py:197:stop] 0/5133, RunningAvgSamplesPerSec=10.95074185738627, CurrSamplesPerSec=10.986897726679716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11133/20000 [19:55:03<23:29:09,  9.54s/it][2022-12-22 09:54:28,343] [INFO] [timer.py:197:stop] 0/5134, RunningAvgSamplesPerSec=10.950702032454704, CurrSamplesPerSec=10.750104222991467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11134/20000 [19:55:12<23:13:08,  9.43s/it][2022-12-22 09:54:37,470] [INFO] [timer.py:197:stop] 0/5135, RunningAvgSamplesPerSec=10.950719645674434, CurrSamplesPerSec=11.04186316619474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11135/20000 [19:55:21<22:59:38,  9.34s/it][2022-12-22 09:54:47,703] [INFO] [timer.py:197:stop] 0/5136, RunningAvgSamplesPerSec=10.950613451359251, CurrSamplesPerSec=10.431369778538706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11136/20000 [19:55:32<23:39:11,  9.61s/it][2022-12-22 09:54:56,722] [INFO] [timer.py:197:stop] 0/5137, RunningAvgSamplesPerSec=10.950605098602095, CurrSamplesPerSec=10.9078893526974, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11137/20000 [19:55:41<23:13:00,  9.43s/it][2022-12-22 09:55:06,098] [INFO] [timer.py:197:stop] 0/5138, RunningAvgSamplesPerSec=10.950553799156589, CurrSamplesPerSec=10.693320270403289, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11138/20000 [19:55:50<23:10:24,  9.41s/it][2022-12-22 09:55:15,750] [INFO] [timer.py:197:stop] 0/5139, RunningAvgSamplesPerSec=10.950551434327185, CurrSamplesPerSec=10.938419129631995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11139/20000 [19:56:00<23:20:48,  9.49s/it][2022-12-22 09:55:24,735] [INFO] [logging.py:68:log_dist] [Rank 0] step=11140, skipped=24, lr=[4.556410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:55:24,736] [INFO] [timer.py:197:stop] 0/5140, RunningAvgSamplesPerSec=10.950527891598469, CurrSamplesPerSec=10.830910223815566, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11140/20000 [19:56:09<22:58:32,  9.34s/it][2022-12-22 09:55:33,875] [INFO] [timer.py:197:stop] 0/5141, RunningAvgSamplesPerSec=10.950446028396192, CurrSamplesPerSec=10.545394204224891, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11141/20000 [19:56:18<22:49:41,  9.28s/it][2022-12-22 09:55:43,917] [INFO] [timer.py:197:stop] 0/5142, RunningAvgSamplesPerSec=10.95044557908067, CurrSamplesPerSec=10.948137033483457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11142/20000 [19:56:28<23:23:25,  9.51s/it][2022-12-22 09:55:53,904] [INFO] [timer.py:197:stop] 0/5143, RunningAvgSamplesPerSec=10.950430254177524, CurrSamplesPerSec=10.872222932135548, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11143/20000 [19:56:38<23:44:34,  9.65s/it][2022-12-22 09:56:03,783] [INFO] [timer.py:197:stop] 0/5144, RunningAvgSamplesPerSec=10.950400180725504, CurrSamplesPerSec=10.79794547548611, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11144/20000 [19:56:48<23:54:30,  9.72s/it][2022-12-22 09:56:12,773] [INFO] [timer.py:197:stop] 0/5145, RunningAvgSamplesPerSec=10.950392909919737, CurrSamplesPerSec=10.913133660749146, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11145/20000 [19:56:57<23:22:05,  9.50s/it][2022-12-22 09:56:22,202] [INFO] [timer.py:197:stop] 0/5146, RunningAvgSamplesPerSec=10.950391302508226, CurrSamplesPerSec=10.942130622652176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11146/20000 [19:57:06<23:18:44,  9.48s/it][2022-12-22 09:56:31,516] [INFO] [timer.py:197:stop] 0/5147, RunningAvgSamplesPerSec=10.950362699187481, CurrSamplesPerSec=10.805178378022852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11147/20000 [19:57:15<23:11:20,  9.43s/it][2022-12-22 09:56:40,502] [INFO] [timer.py:197:stop] 0/5148, RunningAvgSamplesPerSec=10.950375034573092, CurrSamplesPerSec=11.014210640209575, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11148/20000 [19:57:24<22:51:31,  9.30s/it][2022-12-22 09:56:50,215] [INFO] [timer.py:197:stop] 0/5149, RunningAvgSamplesPerSec=10.950371686947985, CurrSamplesPerSec=10.933171871768389, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11149/20000 [19:57:34<23:09:49,  9.42s/it][2022-12-22 09:56:59,229] [INFO] [logging.py:68:log_dist] [Rank 0] step=11150, skipped=24, lr=[4.551282051282052e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:56:59,230] [INFO] [timer.py:197:stop] 0/5150, RunningAvgSamplesPerSec=10.95038345171003, CurrSamplesPerSec=11.01127345580622, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11150/20000 [19:57:43<22:51:39,  9.30s/it]

                                                           
{'loss': 0.0428, 'learning_rate': 4.551282051282052e-06, 'epoch': 0.56}


 56%|█████▌    | 11150/20000 [19:57:43<22:51:39,  9.30s/it][2022-12-22 09:57:08,597] [INFO] [timer.py:197:stop] 0/5151, RunningAvgSamplesPerSec=10.950349838576265, CurrSamplesPerSec=10.780001834446503, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11151/20000 [19:57:53<22:54:30,  9.32s/it][2022-12-22 09:57:18,292] [INFO] [timer.py:197:stop] 0/5152, RunningAvgSamplesPerSec=10.950368507841038, CurrSamplesPerSec=11.047348054518128, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11152/20000 [19:58:02<23:10:56,  9.43s/it][2022-12-22 09:57:28,244] [INFO] [timer.py:197:stop] 0/5153, RunningAvgSamplesPerSec=10.950359593633491, CurrSamplesPerSec=10.904643123223254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11153/20000 [19:58:12<23:33:46,  9.59s/it][2022-12-22 09:57:38,282] [INFO] [timer.py:197:stop] 0/5154, RunningAvgSamplesPerSec=10.950315346616351, CurrSamplesPerSec=10.727046901973296, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11154/20000 [19:58:22<23:53:29,  9.72s/it][2022-12-22 09:57:47,617] [INFO] [timer.py:197:stop] 0/5155, RunningAvgSamplesPerSec=10.95035150742301, CurrSamplesPerSec=11.139877044285454, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11155/20000 [19:58:32<23:36:12,  9.61s/it][2022-12-22 09:57:57,017] [INFO] [timer.py:197:stop] 0/5156, RunningAvgSamplesPerSec=10.95038642257892, CurrSamplesPerSec=11.133310292692316, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11156/20000 [19:58:41<23:26:53,  9.54s/it][2022-12-22 09:58:07,404] [INFO] [timer.py:197:stop] 0/5157, RunningAvgSamplesPerSec=10.95037734436803, CurrSamplesPerSec=10.903787355162075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11157/20000 [19:58:51<24:03:58,  9.80s/it][2022-12-22 09:58:16,413] [INFO] [timer.py:197:stop] 0/5158, RunningAvgSamplesPerSec=10.95041329361188, CurrSamplesPerSec=11.138922483132093, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11158/20000 [19:59:00<23:28:58,  9.56s/it][2022-12-22 09:58:25,621] [INFO] [timer.py:197:stop] 0/5159, RunningAvgSamplesPerSec=10.95041157333984, CurrSamplesPerSec=10.94154903065952, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11159/20000 [19:59:10<23:13:11,  9.45s/it][2022-12-22 09:58:35,699] [INFO] [logging.py:68:log_dist] [Rank 0] step=11160, skipped=24, lr=[4.546153846153846e-06], mom=[[0.9, 0.999]]
[2022-12-22 09:58:35,700] [INFO] [timer.py:197:stop] 0/5160, RunningAvgSamplesPerSec=10.950415336051083, CurrSamplesPerSec=10.969854090379414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11160/20000 [19:59:20<23:40:37,  9.64s/it][2022-12-22 09:58:44,891] [INFO] [timer.py:197:stop] 0/5161, RunningAvgSamplesPerSec=10.950471064011495, CurrSamplesPerSec=11.245666120307288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11161/20000 [19:59:29<23:20:31,  9.51s/it][2022-12-22 09:58:54,253] [INFO] [timer.py:197:stop] 0/5162, RunningAvgSamplesPerSec=10.950501065257843, CurrSamplesPerSec=11.10749693425578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11162/20000 [19:59:38<23:13:56,  9.46s/it][2022-12-22 09:59:04,113] [INFO] [timer.py:197:stop] 0/5163, RunningAvgSamplesPerSec=10.950514152001524, CurrSamplesPerSec=11.018460831569648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11163/20000 [19:59:48<23:31:18,  9.58s/it][2022-12-22 09:59:13,218] [INFO] [timer.py:197:stop] 0/5164, RunningAvgSamplesPerSec=10.950552832452942, CurrSamplesPerSec=11.153890223984078, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11164/20000 [19:59:57<23:10:04,  9.44s/it][2022-12-22 09:59:23,667] [INFO] [timer.py:197:stop] 0/5165, RunningAvgSamplesPerSec=10.950517870462134, CurrSamplesPerSec=10.772970767207106, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11165/20000 [20:00:08<23:54:32,  9.74s/it][2022-12-22 09:59:33,471] [INFO] [timer.py:197:stop] 0/5166, RunningAvgSamplesPerSec=10.95052619074546, CurrSamplesPerSec=10.99365302781895, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11166/20000 [20:00:17<23:57:06,  9.76s/it][2022-12-22 09:59:43,327] [INFO] [timer.py:197:stop] 0/5167, RunningAvgSamplesPerSec=10.950500271118045, CurrSamplesPerSec=10.818267916175463, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11167/20000 [20:00:27<24:01:08,  9.79s/it][2022-12-22 09:59:52,802] [INFO] [timer.py:197:stop] 0/5168, RunningAvgSamplesPerSec=10.95048264663473, CurrSamplesPerSec=10.860202824315484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11168/20000 [20:00:37<23:47:05,  9.69s/it][2022-12-22 10:00:02,263] [INFO] [timer.py:197:stop] 0/5169, RunningAvgSamplesPerSec=10.950500445077328, CurrSamplesPerSec=11.043225927188596, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11169/20000 [20:00:46<23:36:36,  9.62s/it][2022-12-22 10:00:11,740] [INFO] [logging.py:68:log_dist] [Rank 0] step=11170, skipped=24, lr=[4.541025641025642e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:00:11,741] [INFO] [timer.py:197:stop] 0/5170, RunningAvgSamplesPerSec=10.95051387033977, CurrSamplesPerSec=11.020324517184488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11170/20000 [20:00:56<23:29:57,  9.58s/it][2022-12-22 10:00:21,380] [INFO] [timer.py:197:stop] 0/5171, RunningAvgSamplesPerSec=10.95053738340067, CurrSamplesPerSec=11.073416708502757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11171/20000 [20:01:05<23:32:24,  9.60s/it][2022-12-22 10:00:30,716] [INFO] [timer.py:197:stop] 0/5172, RunningAvgSamplesPerSec=10.950532673405178, CurrSamplesPerSec=10.926240724657614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11172/20000 [20:01:15<23:20:37,  9.52s/it][2022-12-22 10:00:39,778] [INFO] [timer.py:197:stop] 0/5173, RunningAvgSamplesPerSec=10.950545421432556, CurrSamplesPerSec=11.016851874310383, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11173/20000 [20:01:24<23:00:19,  9.38s/it][2022-12-22 10:00:49,052] [INFO] [timer.py:197:stop] 0/5174, RunningAvgSamplesPerSec=10.950544059302482, CurrSamplesPerSec=10.94350501318775, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11174/20000 [20:01:33<22:55:21,  9.35s/it][2022-12-22 10:00:58,345] [INFO] [timer.py:197:stop] 0/5175, RunningAvgSamplesPerSec=10.950595501707319, CurrSamplesPerSec=11.223282207527035, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11175/20000 [20:01:42<22:52:42,  9.33s/it]

                                                           
{'loss': 0.0398, 'learning_rate': 4.538461538461539e-06, 'epoch': 0.56}


 56%|█████▌    | 11175/20000 [20:01:42<22:52:42,  9.33s/it][2022-12-22 10:01:08,333] [INFO] [timer.py:197:stop] 0/5176, RunningAvgSamplesPerSec=10.950612631337826, CurrSamplesPerSec=11.039947238983535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11176/20000 [20:01:52<23:21:25,  9.53s/it][2022-12-22 10:01:17,517] [INFO] [timer.py:197:stop] 0/5177, RunningAvgSamplesPerSec=10.950648344756967, CurrSamplesPerSec=11.138601713350427, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11177/20000 [20:02:01<23:06:04,  9.43s/it][2022-12-22 10:01:26,410] [INFO] [timer.py:197:stop] 0/5178, RunningAvgSamplesPerSec=10.95066427635211, CurrSamplesPerSec=11.033735836120519, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11178/20000 [20:02:10<22:42:23,  9.27s/it][2022-12-22 10:01:36,006] [INFO] [timer.py:197:stop] 0/5179, RunningAvgSamplesPerSec=10.950683719654192, CurrSamplesPerSec=11.052255896087603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11179/20000 [20:02:20<22:56:46,  9.36s/it][2022-12-22 10:01:45,747] [INFO] [logging.py:68:log_dist] [Rank 0] step=11180, skipped=24, lr=[4.535897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:01:45,747] [INFO] [timer.py:197:stop] 0/5180, RunningAvgSamplesPerSec=10.950715333682009, CurrSamplesPerSec=11.116864851894588, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11180/20000 [20:02:30<23:13:14,  9.48s/it][2022-12-22 10:01:55,083] [INFO] [timer.py:197:stop] 0/5181, RunningAvgSamplesPerSec=10.95068275295186, CurrSamplesPerSec=10.784539776718804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11181/20000 [20:02:39<23:06:49,  9.44s/it][2022-12-22 10:02:03,993] [INFO] [timer.py:197:stop] 0/5182, RunningAvgSamplesPerSec=10.950731573745802, CurrSamplesPerSec=11.209551548127328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11182/20000 [20:02:48<22:43:30,  9.28s/it][2022-12-22 10:02:13,029] [INFO] [timer.py:197:stop] 0/5183, RunningAvgSamplesPerSec=10.950741238601362, CurrSamplesPerSec=11.001035165590226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11183/20000 [20:02:57<22:32:40,  9.21s/it][2022-12-22 10:02:22,118] [INFO] [timer.py:197:stop] 0/5184, RunningAvgSamplesPerSec=10.95075325651459, CurrSamplesPerSec=11.013374189578728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11184/20000 [20:03:06<22:27:25,  9.17s/it][2022-12-22 10:02:31,396] [INFO] [timer.py:197:stop] 0/5185, RunningAvgSamplesPerSec=10.950745444531318, CurrSamplesPerSec=10.910412873692234, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11185/20000 [20:03:15<22:32:01,  9.20s/it][2022-12-22 10:02:40,690] [INFO] [timer.py:197:stop] 0/5186, RunningAvgSamplesPerSec=10.950698657672753, CurrSamplesPerSec=10.713456950722293, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11186/20000 [20:03:25<22:35:54,  9.23s/it][2022-12-22 10:02:49,728] [INFO] [timer.py:197:stop] 0/5187, RunningAvgSamplesPerSec=10.950666071607023, CurrSamplesPerSec=10.784306679955376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11187/20000 [20:03:34<22:27:16,  9.17s/it][2022-12-22 10:02:59,220] [INFO] [timer.py:197:stop] 0/5188, RunningAvgSamplesPerSec=10.95068993509649, CurrSamplesPerSec=11.075836434969373, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11188/20000 [20:03:43<22:41:12,  9.27s/it][2022-12-22 10:03:08,708] [INFO] [timer.py:197:stop] 0/5189, RunningAvgSamplesPerSec=10.950687281255997, CurrSamplesPerSec=10.936941743176101, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11189/20000 [20:03:53<22:50:43,  9.33s/it][2022-12-22 10:03:17,986] [INFO] [logging.py:68:log_dist] [Rank 0] step=11190, skipped=24, lr=[4.5307692307692316e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:03:17,987] [INFO] [timer.py:197:stop] 0/5190, RunningAvgSamplesPerSec=10.950613486948665, CurrSamplesPerSec=10.58077244336142, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11190/20000 [20:04:02<22:48:07,  9.32s/it][2022-12-22 10:03:26,937] [INFO] [timer.py:197:stop] 0/5191, RunningAvgSamplesPerSec=10.950607566544976, CurrSamplesPerSec=10.919978439552438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11191/20000 [20:04:11<22:31:48,  9.21s/it][2022-12-22 10:03:36,412] [INFO] [timer.py:197:stop] 0/5192, RunningAvgSamplesPerSec=10.95058861840214, CurrSamplesPerSec=10.853141818202108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11192/20000 [20:04:20<22:43:27,  9.29s/it][2022-12-22 10:03:46,366] [INFO] [timer.py:197:stop] 0/5193, RunningAvgSamplesPerSec=10.95060156182427, CurrSamplesPerSec=11.018192639391074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11193/20000 [20:04:30<23:12:35,  9.49s/it][2022-12-22 10:03:55,441] [INFO] [timer.py:197:stop] 0/5194, RunningAvgSamplesPerSec=10.950557402544842, CurrSamplesPerSec=10.726027627700487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11194/20000 [20:04:39<22:54:16,  9.36s/it][2022-12-22 10:04:08,071] [INFO] [timer.py:197:stop] 0/5195, RunningAvgSamplesPerSec=10.950516872273552, CurrSamplesPerSec=10.744052047496206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11195/20000 [20:04:52<25:17:55, 10.34s/it][2022-12-22 10:04:18,092] [INFO] [timer.py:197:stop] 0/5196, RunningAvgSamplesPerSec=10.950537386090934, CurrSamplesPerSec=11.05811234447979, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11196/20000 [20:05:02<25:03:31, 10.25s/it][2022-12-22 10:04:27,445] [INFO] [timer.py:197:stop] 0/5197, RunningAvgSamplesPerSec=10.950516210828775, CurrSamplesPerSec=10.841625778659317, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11197/20000 [20:05:11<24:24:01,  9.98s/it][2022-12-22 10:04:36,361] [INFO] [timer.py:197:stop] 0/5198, RunningAvgSamplesPerSec=10.950577711936402, CurrSamplesPerSec=11.279679823784585, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11198/20000 [20:05:20<23:37:05,  9.66s/it][2022-12-22 10:04:45,458] [INFO] [timer.py:197:stop] 0/5199, RunningAvgSamplesPerSec=10.950630727249274, CurrSamplesPerSec=11.233208007265302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11199/20000 [20:05:29<23:12:11,  9.49s/it][2022-12-22 10:04:54,311] [INFO] [logging.py:68:log_dist] [Rank 0] step=11200, skipped=24, lr=[4.525641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:04:54,312] [INFO] [timer.py:197:stop] 0/5200, RunningAvgSamplesPerSec=10.950672171287811, CurrSamplesPerSec=11.170379002427989, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11200/20000 [20:05:38<22:43:59,  9.30s/it]

                                                           
{'loss': 0.04, 'learning_rate': 4.525641025641026e-06, 'epoch': 0.56}


 56%|█████▌    | 11200/20000 [20:05:38<22:43:59,  9.30s/it][2022-12-22 10:05:06,209] [INFO] [timer.py:197:stop] 0/5201, RunningAvgSamplesPerSec=10.95067838600171, CurrSamplesPerSec=10.983078065050348, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11201/20000 [20:05:50<24:38:05, 10.08s/it][2022-12-22 10:05:15,543] [INFO] [timer.py:197:stop] 0/5202, RunningAvgSamplesPerSec=10.95063730521715, CurrSamplesPerSec=10.74114498766492, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11202/20000 [20:06:00<24:05:08,  9.86s/it][2022-12-22 10:05:24,565] [INFO] [timer.py:197:stop] 0/5203, RunningAvgSamplesPerSec=10.950665179674612, CurrSamplesPerSec=11.097557049164035, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11203/20000 [20:06:09<23:28:19,  9.61s/it][2022-12-22 10:05:33,656] [INFO] [timer.py:197:stop] 0/5204, RunningAvgSamplesPerSec=10.950701805344364, CurrSamplesPerSec=11.144564856827449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11204/20000 [20:06:18<23:05:33,  9.45s/it][2022-12-22 10:05:42,930] [INFO] [timer.py:197:stop] 0/5205, RunningAvgSamplesPerSec=10.950709773182396, CurrSamplesPerSec=10.992315977350302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11205/20000 [20:06:27<22:57:34,  9.40s/it][2022-12-22 10:05:52,820] [INFO] [timer.py:197:stop] 0/5206, RunningAvgSamplesPerSec=10.95067790341483, CurrSamplesPerSec=10.78733338905785, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11206/20000 [20:06:37<23:19:04,  9.55s/it][2022-12-22 10:06:03,449] [INFO] [timer.py:197:stop] 0/5207, RunningAvgSamplesPerSec=10.950603680898235, CurrSamplesPerSec=10.577512066681223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11207/20000 [20:06:47<24:06:32,  9.87s/it][2022-12-22 10:06:12,681] [INFO] [timer.py:197:stop] 0/5208, RunningAvgSamplesPerSec=10.95060436016809, CurrSamplesPerSec=10.954141101878584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11208/20000 [20:06:57<23:38:18,  9.68s/it][2022-12-22 10:06:21,676] [INFO] [timer.py:197:stop] 0/5209, RunningAvgSamplesPerSec=10.950603955361947, CurrSamplesPerSec=10.948496940148386, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11209/20000 [20:07:06<23:08:03,  9.47s/it][2022-12-22 10:06:34,279] [INFO] [logging.py:68:log_dist] [Rank 0] step=11210, skipped=24, lr=[4.5205128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:06:34,280] [INFO] [timer.py:197:stop] 0/5210, RunningAvgSamplesPerSec=10.950554907159963, CurrSamplesPerSec=10.700982678098994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11210/20000 [20:07:18<25:25:29, 10.41s/it][2022-12-22 10:06:44,640] [INFO] [timer.py:197:stop] 0/5211, RunningAvgSamplesPerSec=10.95054889944823, CurrSamplesPerSec=10.919349896363267, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11211/20000 [20:07:29<25:22:59, 10.40s/it][2022-12-22 10:06:53,881] [INFO] [timer.py:197:stop] 0/5212, RunningAvgSamplesPerSec=10.950520782513705, CurrSamplesPerSec=10.805993072035134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11212/20000 [20:07:38<24:32:02, 10.05s/it][2022-12-22 10:07:03,370] [INFO] [timer.py:197:stop] 0/5213, RunningAvgSamplesPerSec=10.950555057590636, CurrSamplesPerSec=11.132089092723527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11213/20000 [20:07:47<24:07:10,  9.88s/it][2022-12-22 10:07:12,784] [INFO] [timer.py:197:stop] 0/5214, RunningAvgSamplesPerSec=10.950550968309146, CurrSamplesPerSec=10.92928311662635, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11214/20000 [20:07:57<23:46:29,  9.74s/it][2022-12-22 10:07:22,201] [INFO] [timer.py:197:stop] 0/5215, RunningAvgSamplesPerSec=10.95055995955488, CurrSamplesPerSec=10.997623778212308, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11215/20000 [20:08:06<23:32:04,  9.64s/it][2022-12-22 10:07:31,880] [INFO] [timer.py:197:stop] 0/5216, RunningAvgSamplesPerSec=10.950573287233086, CurrSamplesPerSec=11.020494180067347, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11216/20000 [20:08:16<23:33:24,  9.65s/it][2022-12-22 10:07:40,822] [INFO] [timer.py:197:stop] 0/5217, RunningAvgSamplesPerSec=10.950584597839104, CurrSamplesPerSec=11.009877475921124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11217/20000 [20:08:25<23:01:57,  9.44s/it][2022-12-22 10:07:51,510] [INFO] [timer.py:197:stop] 0/5218, RunningAvgSamplesPerSec=10.950596121582256, CurrSamplesPerSec=11.011024131590446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11218/20000 [20:08:35<23:56:34,  9.81s/it][2022-12-22 10:08:00,511] [INFO] [timer.py:197:stop] 0/5219, RunningAvgSamplesPerSec=10.950620306438601, CurrSamplesPerSec=11.078238931333813, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11219/20000 [20:08:44<23:20:39,  9.57s/it][2022-12-22 10:08:09,776] [INFO] [logging.py:68:log_dist] [Rank 0] step=11220, skipped=24, lr=[4.515384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:08:09,777] [INFO] [timer.py:197:stop] 0/5220, RunningAvgSamplesPerSec=10.950630903119979, CurrSamplesPerSec=11.006194348721287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11220/20000 [20:08:54<23:07:07,  9.48s/it][2022-12-22 10:08:19,755] [INFO] [timer.py:197:stop] 0/5221, RunningAvgSamplesPerSec=10.950636266294262, CurrSamplesPerSec=10.978693024264778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11221/20000 [20:09:04<23:28:52,  9.63s/it][2022-12-22 10:08:29,245] [INFO] [timer.py:197:stop] 0/5222, RunningAvgSamplesPerSec=10.9506034125419, CurrSamplesPerSec=10.78178355424033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11222/20000 [20:09:13<23:22:36,  9.59s/it][2022-12-22 10:08:38,185] [INFO] [timer.py:197:stop] 0/5223, RunningAvgSamplesPerSec=10.950615952114207, CurrSamplesPerSec=11.016466210427424, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11223/20000 [20:09:22<22:54:03,  9.39s/it][2022-12-22 10:08:47,389] [INFO] [timer.py:197:stop] 0/5224, RunningAvgSamplesPerSec=10.95066253984427, CurrSamplesPerSec=11.199423581226922, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11224/20000 [20:09:31<22:45:35,  9.34s/it][2022-12-22 10:08:57,291] [INFO] [timer.py:197:stop] 0/5225, RunningAvgSamplesPerSec=10.950602445292166, CurrSamplesPerSec=10.64553281389149, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11225/20000 [20:09:41<23:10:16,  9.51s/it]

                                                           
{'loss': 0.0443, 'learning_rate': 4.512820512820513e-06, 'epoch': 0.56}


 56%|█████▌    | 11225/20000 [20:09:41<23:10:16,  9.51s/it][2022-12-22 10:09:06,234] [INFO] [timer.py:197:stop] 0/5226, RunningAvgSamplesPerSec=10.950600363119438, CurrSamplesPerSec=10.939735966608707, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11226/20000 [20:09:50<22:45:23,  9.34s/it][2022-12-22 10:09:15,636] [INFO] [timer.py:197:stop] 0/5227, RunningAvgSamplesPerSec=10.950552805793436, CurrSamplesPerSec=10.707625770361577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11227/20000 [20:10:00<22:48:06,  9.36s/it][2022-12-22 10:09:25,996] [INFO] [timer.py:197:stop] 0/5228, RunningAvgSamplesPerSec=10.950509317586208, CurrSamplesPerSec=10.727903447874011, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11228/20000 [20:10:10<23:31:57,  9.66s/it][2022-12-22 10:09:35,144] [INFO] [timer.py:197:stop] 0/5229, RunningAvgSamplesPerSec=10.95045704413183, CurrSamplesPerSec=10.683926384733969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11229/20000 [20:10:19<23:09:25,  9.50s/it][2022-12-22 10:09:45,402] [INFO] [logging.py:68:log_dist] [Rank 0] step=11230, skipped=24, lr=[4.51025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:09:45,403] [INFO] [timer.py:197:stop] 0/5230, RunningAvgSamplesPerSec=10.950454246847592, CurrSamplesPerSec=10.93585234279874, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11230/20000 [20:10:29<23:42:22,  9.73s/it][2022-12-22 10:09:56,127] [INFO] [timer.py:197:stop] 0/5231, RunningAvgSamplesPerSec=10.95044171378305, CurrSamplesPerSec=10.885308655872764, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11231/20000 [20:10:40<24:25:42, 10.03s/it][2022-12-22 10:10:04,980] [INFO] [timer.py:197:stop] 0/5232, RunningAvgSamplesPerSec=10.950473521054054, CurrSamplesPerSec=11.119359337764749, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11232/20000 [20:10:49<23:33:59,  9.68s/it][2022-12-22 10:10:14,554] [INFO] [timer.py:197:stop] 0/5233, RunningAvgSamplesPerSec=10.950485631898346, CurrSamplesPerSec=11.014193918990307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11233/20000 [20:10:59<23:29:23,  9.65s/it][2022-12-22 10:10:23,854] [INFO] [timer.py:197:stop] 0/5234, RunningAvgSamplesPerSec=10.950460785634801, CurrSamplesPerSec=10.822014795416958, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11234/20000 [20:11:08<23:14:03,  9.54s/it][2022-12-22 10:10:33,055] [INFO] [timer.py:197:stop] 0/5235, RunningAvgSamplesPerSec=10.95047077056893, CurrSamplesPerSec=11.00296241455744, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11235/20000 [20:11:17<22:58:57,  9.44s/it][2022-12-22 10:10:41,970] [INFO] [timer.py:197:stop] 0/5236, RunningAvgSamplesPerSec=10.950486521396767, CurrSamplesPerSec=11.033535833354124, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11236/20000 [20:11:26<22:35:48,  9.28s/it][2022-12-22 10:10:51,579] [INFO] [timer.py:197:stop] 0/5237, RunningAvgSamplesPerSec=10.950429210414352, CurrSamplesPerSec=10.658462904832101, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11237/20000 [20:11:36<22:50:01,  9.38s/it][2022-12-22 10:11:00,582] [INFO] [timer.py:197:stop] 0/5238, RunningAvgSamplesPerSec=10.950428117164417, CurrSamplesPerSec=10.94470794394, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11238/20000 [20:11:45<22:33:16,  9.27s/it][2022-12-22 10:11:11,157] [INFO] [timer.py:197:stop] 0/5239, RunningAvgSamplesPerSec=10.950438155156196, CurrSamplesPerSec=11.003250612989483, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11239/20000 [20:11:55<23:30:25,  9.66s/it][2022-12-22 10:11:20,408] [INFO] [logging.py:68:log_dist] [Rank 0] step=11240, skipped=24, lr=[4.505128205128205e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:11:20,409] [INFO] [timer.py:197:stop] 0/5240, RunningAvgSamplesPerSec=10.950436496900048, CurrSamplesPerSec=10.941759092413736, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11240/20000 [20:12:04<23:12:25,  9.54s/it][2022-12-22 10:11:31,242] [INFO] [timer.py:197:stop] 0/5241, RunningAvgSamplesPerSec=10.950381170739599, CurrSamplesPerSec=10.668055821217145, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11241/20000 [20:12:15<24:09:02,  9.93s/it][2022-12-22 10:11:40,220] [INFO] [timer.py:197:stop] 0/5242, RunningAvgSamplesPerSec=10.95038684379782, CurrSamplesPerSec=10.980188898932735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11242/20000 [20:12:24<23:27:24,  9.64s/it][2022-12-22 10:11:50,337] [INFO] [timer.py:197:stop] 0/5243, RunningAvgSamplesPerSec=10.950368555632059, CurrSamplesPerSec=10.855370086066376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11243/20000 [20:12:34<23:48:00,  9.78s/it][2022-12-22 10:12:00,350] [INFO] [timer.py:197:stop] 0/5244, RunningAvgSamplesPerSec=10.95037847233573, CurrSamplesPerSec=11.002599820136993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11244/20000 [20:12:44<23:57:50,  9.85s/it][2022-12-22 10:12:09,815] [INFO] [timer.py:197:stop] 0/5245, RunningAvgSamplesPerSec=10.950410643549537, CurrSamplesPerSec=11.121690439385471, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11245/20000 [20:12:54<23:40:41,  9.74s/it][2022-12-22 10:12:19,531] [INFO] [timer.py:197:stop] 0/5246, RunningAvgSamplesPerSec=10.950441485388922, CurrSamplesPerSec=11.114569366910136, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11246/20000 [20:13:03<23:39:39,  9.73s/it][2022-12-22 10:12:28,368] [INFO] [timer.py:197:stop] 0/5247, RunningAvgSamplesPerSec=10.9504478703026, CurrSamplesPerSec=10.984033068538801, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11247/20000 [20:13:12<23:00:26,  9.46s/it][2022-12-22 10:12:38,349] [INFO] [timer.py:197:stop] 0/5248, RunningAvgSamplesPerSec=10.950488680206112, CurrSamplesPerSec=11.168804838599218, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11248/20000 [20:13:22<23:22:55,  9.62s/it][2022-12-22 10:12:47,275] [INFO] [timer.py:197:stop] 0/5249, RunningAvgSamplesPerSec=10.950487710374592, CurrSamplesPerSec=10.945402337399166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▌    | 11249/20000 [20:13:31<22:52:29,  9.41s/it][2022-12-22 10:12:58,854] [INFO] [logging.py:68:log_dist] [Rank 0] step=11250, skipped=24, lr=[4.5e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:12:58,855] [INFO] [timer.py:197:stop] 0/5250, RunningAvgSamplesPerSec=10.950463774057198, CurrSamplesPerSec=10.82629432144717, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11250/20000 [20:13:43<24:27:14, 10.06s/it]

                                                           
{'loss': 0.0425, 'learning_rate': 4.5e-06, 'epoch': 0.56}


 56%|█████▋    | 11250/20000 [20:13:43<24:27:14, 10.06s/it][2022-12-22 10:13:08,702] [INFO] [timer.py:197:stop] 0/5251, RunningAvgSamplesPerSec=10.950409039552142, CurrSamplesPerSec=10.670506057435277, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11251/20000 [20:13:53<24:17:43, 10.00s/it][2022-12-22 10:13:18,345] [INFO] [timer.py:197:stop] 0/5252, RunningAvgSamplesPerSec=10.950439768670462, CurrSamplesPerSec=11.114148761201077, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11252/20000 [20:14:02<24:02:05,  9.89s/it][2022-12-22 10:13:27,237] [INFO] [timer.py:197:stop] 0/5253, RunningAvgSamplesPerSec=10.95045920043943, CurrSamplesPerSec=11.053435519361113, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11253/20000 [20:14:11<23:18:13,  9.59s/it][2022-12-22 10:13:37,278] [INFO] [timer.py:197:stop] 0/5254, RunningAvgSamplesPerSec=10.950456159850917, CurrSamplesPerSec=10.93451327923881, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11254/20000 [20:14:21<23:37:43,  9.73s/it][2022-12-22 10:13:46,173] [INFO] [timer.py:197:stop] 0/5255, RunningAvgSamplesPerSec=10.950481154284958, CurrSamplesPerSec=11.083344952655306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11255/20000 [20:14:30<23:01:13,  9.48s/it][2022-12-22 10:13:56,327] [INFO] [timer.py:197:stop] 0/5256, RunningAvgSamplesPerSec=10.950424434656883, CurrSamplesPerSec=10.6603697778087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11256/20000 [20:14:40<23:30:42,  9.68s/it][2022-12-22 10:14:06,924] [INFO] [timer.py:197:stop] 0/5257, RunningAvgSamplesPerSec=10.950367838273989, CurrSamplesPerSec=10.660873170634842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11257/20000 [20:14:51<24:10:36,  9.95s/it][2022-12-22 10:14:16,103] [INFO] [timer.py:197:stop] 0/5258, RunningAvgSamplesPerSec=10.95034228600041, CurrSamplesPerSec=10.817692005294488, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11258/20000 [20:15:00<23:36:32,  9.72s/it][2022-12-22 10:14:26,109] [INFO] [timer.py:197:stop] 0/5259, RunningAvgSamplesPerSec=10.95033528218058, CurrSamplesPerSec=10.913646566200656, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11259/20000 [20:15:10<23:48:46,  9.81s/it][2022-12-22 10:14:35,614] [INFO] [logging.py:68:log_dist] [Rank 0] step=11260, skipped=24, lr=[4.494871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:14:35,616] [INFO] [timer.py:197:stop] 0/5260, RunningAvgSamplesPerSec=10.950336744777163, CurrSamplesPerSec=10.95803101864346, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11260/20000 [20:15:20<23:35:27,  9.72s/it][2022-12-22 10:14:45,795] [INFO] [timer.py:197:stop] 0/5261, RunningAvgSamplesPerSec=10.950338693693743, CurrSamplesPerSec=10.960595697472801, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11261/20000 [20:15:30<23:55:29,  9.86s/it][2022-12-22 10:14:55,010] [INFO] [timer.py:197:stop] 0/5262, RunningAvgSamplesPerSec=10.950315860469447, CurrSamplesPerSec=10.831538678717946, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11262/20000 [20:15:39<23:27:22,  9.66s/it][2022-12-22 10:15:04,861] [INFO] [timer.py:197:stop] 0/5263, RunningAvgSamplesPerSec=10.950334476888113, CurrSamplesPerSec=11.049140571493583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11263/20000 [20:15:49<23:35:21,  9.72s/it][2022-12-22 10:15:15,296] [INFO] [timer.py:197:stop] 0/5264, RunningAvgSamplesPerSec=10.95033298549108, CurrSamplesPerSec=10.942492364808261, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11264/20000 [20:15:59<24:06:25,  9.93s/it][2022-12-22 10:15:24,278] [INFO] [timer.py:197:stop] 0/5265, RunningAvgSamplesPerSec=10.950372278579454, CurrSamplesPerSec=11.16111236978118, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11265/20000 [20:16:08<23:24:39,  9.65s/it][2022-12-22 10:15:33,773] [INFO] [timer.py:197:stop] 0/5266, RunningAvgSamplesPerSec=10.950347021059383, CurrSamplesPerSec=10.819011328596194, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11266/20000 [20:16:18<23:17:47,  9.60s/it][2022-12-22 10:15:43,215] [INFO] [timer.py:197:stop] 0/5267, RunningAvgSamplesPerSec=10.95032175127595, CurrSamplesPerSec=10.81889839308991, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11267/20000 [20:16:27<23:10:39,  9.55s/it][2022-12-22 10:15:53,085] [INFO] [timer.py:197:stop] 0/5268, RunningAvgSamplesPerSec=10.950254630217886, CurrSamplesPerSec=10.607912599816402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11268/20000 [20:16:37<23:24:14,  9.65s/it][2022-12-22 10:16:02,264] [INFO] [timer.py:197:stop] 0/5269, RunningAvgSamplesPerSec=10.950241788820412, CurrSamplesPerSec=10.883034106994312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11269/20000 [20:16:46<23:03:34,  9.51s/it][2022-12-22 10:16:12,549] [INFO] [logging.py:68:log_dist] [Rank 0] step=11270, skipped=24, lr=[4.489743589743591e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:16:12,550] [INFO] [timer.py:197:stop] 0/5270, RunningAvgSamplesPerSec=10.950217804075821, CurrSamplesPerSec=10.825331187587647, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11270/20000 [20:16:57<23:37:22,  9.74s/it][2022-12-22 10:16:22,135] [INFO] [timer.py:197:stop] 0/5271, RunningAvgSamplesPerSec=10.950197870940178, CurrSamplesPerSec=10.846187715033938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11271/20000 [20:17:06<23:30:23,  9.69s/it][2022-12-22 10:16:31,528] [INFO] [timer.py:197:stop] 0/5272, RunningAvgSamplesPerSec=10.950182184469478, CurrSamplesPerSec=10.86814947108375, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11272/20000 [20:17:15<23:17:05,  9.60s/it][2022-12-22 10:16:40,953] [INFO] [timer.py:197:stop] 0/5273, RunningAvgSamplesPerSec=10.950182852139255, CurrSamplesPerSec=10.9537026030827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11273/20000 [20:17:25<23:09:07,  9.55s/it][2022-12-22 10:16:52,183] [INFO] [timer.py:197:stop] 0/5274, RunningAvgSamplesPerSec=10.950216228601224, CurrSamplesPerSec=11.12901673240584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11274/20000 [20:17:36<24:22:13, 10.05s/it][2022-12-22 10:17:01,398] [INFO] [timer.py:197:stop] 0/5275, RunningAvgSamplesPerSec=10.950186094096214, CurrSamplesPerSec=10.793589374334763, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11275/20000 [20:17:45<23:45:26,  9.80s/it]

                                                           
{'loss': 0.0555, 'learning_rate': 4.487179487179488e-06, 'epoch': 0.56}


 56%|█████▋    | 11275/20000 [20:17:45<23:45:26,  9.80s/it][2022-12-22 10:17:10,780] [INFO] [timer.py:197:stop] 0/5276, RunningAvgSamplesPerSec=10.950192294432616, CurrSamplesPerSec=10.982984595984703, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11276/20000 [20:17:55<23:26:56,  9.68s/it][2022-12-22 10:17:20,217] [INFO] [timer.py:197:stop] 0/5277, RunningAvgSamplesPerSec=10.950251526677173, CurrSamplesPerSec=11.27181782848474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11277/20000 [20:18:04<23:16:18,  9.60s/it][2022-12-22 10:17:29,176] [INFO] [timer.py:197:stop] 0/5278, RunningAvgSamplesPerSec=10.950303341467912, CurrSamplesPerSec=11.230624595877474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11278/20000 [20:18:13<22:48:01,  9.41s/it][2022-12-22 10:17:38,381] [INFO] [timer.py:197:stop] 0/5279, RunningAvgSamplesPerSec=10.950314463721005, CurrSamplesPerSec=11.009311687773195, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11279/20000 [20:18:22<22:38:53,  9.35s/it][2022-12-22 10:17:47,666] [INFO] [logging.py:68:log_dist] [Rank 0] step=11280, skipped=24, lr=[4.484615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:17:47,667] [INFO] [timer.py:197:stop] 0/5280, RunningAvgSamplesPerSec=10.9503179560113, CurrSamplesPerSec=10.968777844818504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11280/20000 [20:18:32<22:35:58,  9.33s/it][2022-12-22 10:17:56,918] [INFO] [timer.py:197:stop] 0/5281, RunningAvgSamplesPerSec=10.950368227419922, CurrSamplesPerSec=11.222290779894267, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11281/20000 [20:18:41<22:32:23,  9.31s/it][2022-12-22 10:18:07,564] [INFO] [timer.py:197:stop] 0/5282, RunningAvgSamplesPerSec=10.950382079009879, CurrSamplesPerSec=11.023996283547701, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11282/20000 [20:18:52<23:30:38,  9.71s/it][2022-12-22 10:18:16,908] [INFO] [timer.py:197:stop] 0/5283, RunningAvgSamplesPerSec=10.950345320860901, CurrSamplesPerSec=10.759642928046455, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11283/20000 [20:19:01<23:14:35,  9.60s/it][2022-12-22 10:18:26,317] [INFO] [timer.py:197:stop] 0/5284, RunningAvgSamplesPerSec=10.950338830985071, CurrSamplesPerSec=10.91617275204936, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11284/20000 [20:19:10<23:06:07,  9.54s/it][2022-12-22 10:18:35,197] [INFO] [timer.py:197:stop] 0/5285, RunningAvgSamplesPerSec=10.950353396289739, CurrSamplesPerSec=11.027831778760959, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11285/20000 [20:19:19<22:37:06,  9.34s/it][2022-12-22 10:18:44,940] [INFO] [timer.py:197:stop] 0/5286, RunningAvgSamplesPerSec=10.950313108720719, CurrSamplesPerSec=10.741532676676474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11286/20000 [20:19:29<22:54:23,  9.46s/it][2022-12-22 10:18:54,354] [INFO] [timer.py:197:stop] 0/5287, RunningAvgSamplesPerSec=10.950261787434087, CurrSamplesPerSec=10.68563479891368, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11287/20000 [20:19:38<22:52:03,  9.45s/it][2022-12-22 10:19:03,808] [INFO] [timer.py:197:stop] 0/5288, RunningAvgSamplesPerSec=10.950206674995952, CurrSamplesPerSec=10.666485683544998, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11288/20000 [20:19:48<22:52:09,  9.45s/it][2022-12-22 10:19:12,867] [INFO] [timer.py:197:stop] 0/5289, RunningAvgSamplesPerSec=10.950234420768092, CurrSamplesPerSec=11.098889997115249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11289/20000 [20:19:57<22:34:57,  9.33s/it][2022-12-22 10:19:21,980] [INFO] [logging.py:68:log_dist] [Rank 0] step=11290, skipped=24, lr=[4.47948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:19:21,981] [INFO] [timer.py:197:stop] 0/5290, RunningAvgSamplesPerSec=10.950209097373362, CurrSamplesPerSec=10.817941806193236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11290/20000 [20:20:06<22:25:16,  9.27s/it][2022-12-22 10:19:31,485] [INFO] [timer.py:197:stop] 0/5291, RunningAvgSamplesPerSec=10.950201857069139, CurrSamplesPerSec=10.912048554316085, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11291/20000 [20:20:15<22:35:28,  9.34s/it][2022-12-22 10:19:40,774] [INFO] [timer.py:197:stop] 0/5292, RunningAvgSamplesPerSec=10.950165266986627, CurrSamplesPerSec=10.760001762098362, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11292/20000 [20:20:25<22:33:08,  9.32s/it][2022-12-22 10:19:49,989] [INFO] [timer.py:197:stop] 0/5293, RunningAvgSamplesPerSec=10.950199217652337, CurrSamplesPerSec=11.132793616227644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11293/20000 [20:20:34<22:28:17,  9.29s/it][2022-12-22 10:19:59,450] [INFO] [timer.py:197:stop] 0/5294, RunningAvgSamplesPerSec=10.950205451409627, CurrSamplesPerSec=10.983287926873402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11294/20000 [20:20:43<22:35:29,  9.34s/it][2022-12-22 10:20:08,670] [INFO] [timer.py:197:stop] 0/5295, RunningAvgSamplesPerSec=10.95016044143725, CurrSamplesPerSec=10.717039574907522, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11295/20000 [20:20:53<22:30:03,  9.31s/it][2022-12-22 10:20:18,845] [INFO] [timer.py:197:stop] 0/5296, RunningAvgSamplesPerSec=10.950129577612877, CurrSamplesPerSec=10.789169137116327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11296/20000 [20:21:03<23:07:45,  9.57s/it][2022-12-22 10:20:28,219] [INFO] [timer.py:197:stop] 0/5297, RunningAvgSamplesPerSec=10.95011198599085, CurrSamplesPerSec=10.85776747190135, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11297/20000 [20:21:12<22:59:13,  9.51s/it][2022-12-22 10:20:37,289] [INFO] [timer.py:197:stop] 0/5298, RunningAvgSamplesPerSec=10.950150044639859, CurrSamplesPerSec=11.15544952352076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11298/20000 [20:21:21<22:39:57,  9.38s/it][2022-12-22 10:20:46,744] [INFO] [timer.py:197:stop] 0/5299, RunningAvgSamplesPerSec=10.95016733653591, CurrSamplesPerSec=11.042517703746004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11299/20000 [20:21:31<22:43:14,  9.40s/it][2022-12-22 10:20:56,029] [INFO] [logging.py:68:log_dist] [Rank 0] step=11300, skipped=24, lr=[4.474358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:20:56,030] [INFO] [timer.py:197:stop] 0/5300, RunningAvgSamplesPerSec=10.95017242956752, CurrSamplesPerSec=10.97721685956318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 56%|█████▋    | 11300/20000 [20:21:40<22:38:05,  9.37s/it]

                                                           
{'loss': 0.0677, 'learning_rate': 4.474358974358975e-06, 'epoch': 0.56}


 56%|█████▋    | 11300/20000 [20:21:40<22:38:05,  9.37s/it][2022-12-22 10:21:05,503] [INFO] [timer.py:197:stop] 0/5301, RunningAvgSamplesPerSec=10.950164312647198, CurrSamplesPerSec=10.907329122728546, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11301/20000 [20:21:49<22:42:33,  9.40s/it][2022-12-22 10:21:14,565] [INFO] [timer.py:197:stop] 0/5302, RunningAvgSamplesPerSec=10.950113784094594, CurrSamplesPerSec=10.688754904222254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11302/20000 [20:21:59<22:27:48,  9.30s/it][2022-12-22 10:21:25,006] [INFO] [timer.py:197:stop] 0/5303, RunningAvgSamplesPerSec=10.950125424082206, CurrSamplesPerSec=11.012166960306176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11303/20000 [20:22:09<23:17:22,  9.64s/it][2022-12-22 10:21:34,407] [INFO] [timer.py:197:stop] 0/5304, RunningAvgSamplesPerSec=10.950094965192744, CurrSamplesPerSec=10.790979048688584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11304/20000 [20:22:18<23:06:49,  9.57s/it][2022-12-22 10:21:43,502] [INFO] [timer.py:197:stop] 0/5305, RunningAvgSamplesPerSec=10.950096549579055, CurrSamplesPerSec=10.958503416384742, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11305/20000 [20:22:27<22:46:04,  9.43s/it][2022-12-22 10:21:52,404] [INFO] [timer.py:197:stop] 0/5306, RunningAvgSamplesPerSec=10.950143489392026, CurrSamplesPerSec=11.204856622032509, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11306/20000 [20:22:36<22:23:04,  9.27s/it][2022-12-22 10:22:01,668] [INFO] [timer.py:197:stop] 0/5307, RunningAvgSamplesPerSec=10.950128002282344, CurrSamplesPerSec=10.868596108617188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11307/20000 [20:22:46<22:22:43,  9.27s/it][2022-12-22 10:22:11,463] [INFO] [timer.py:197:stop] 0/5308, RunningAvgSamplesPerSec=10.950139777910927, CurrSamplesPerSec=11.012967985214704, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11308/20000 [20:22:55<22:45:30,  9.43s/it][2022-12-22 10:22:21,908] [INFO] [timer.py:197:stop] 0/5309, RunningAvgSamplesPerSec=10.950085935371632, CurrSamplesPerSec=10.671662868337423, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11309/20000 [20:23:06<23:29:37,  9.73s/it][2022-12-22 10:22:31,322] [INFO] [logging.py:68:log_dist] [Rank 0] step=11310, skipped=24, lr=[4.4692307692307695e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:22:31,323] [INFO] [timer.py:197:stop] 0/5310, RunningAvgSamplesPerSec=10.950031540158871, CurrSamplesPerSec=10.668772371306748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11310/20000 [20:23:15<23:15:41,  9.64s/it][2022-12-22 10:22:41,064] [INFO] [timer.py:197:stop] 0/5311, RunningAvgSamplesPerSec=10.949939848272974, CurrSamplesPerSec=10.483955203492899, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11311/20000 [20:23:25<23:20:04,  9.67s/it][2022-12-22 10:22:51,572] [INFO] [timer.py:197:stop] 0/5312, RunningAvgSamplesPerSec=10.949939663565212, CurrSamplesPerSec=10.948959137877644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11312/20000 [20:23:36<23:56:24,  9.92s/it][2022-12-22 10:23:01,005] [INFO] [timer.py:197:stop] 0/5313, RunningAvgSamplesPerSec=10.949943457550328, CurrSamplesPerSec=10.970126659211726, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11313/20000 [20:23:45<23:35:05,  9.77s/it][2022-12-22 10:23:10,044] [INFO] [timer.py:197:stop] 0/5314, RunningAvgSamplesPerSec=10.949956856576543, CurrSamplesPerSec=11.021584671542676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11314/20000 [20:23:54<23:03:00,  9.55s/it][2022-12-22 10:23:19,070] [INFO] [timer.py:197:stop] 0/5315, RunningAvgSamplesPerSec=10.950005010190903, CurrSamplesPerSec=11.211916408911577, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11315/20000 [20:24:03<22:39:57,  9.40s/it][2022-12-22 10:23:28,281] [INFO] [timer.py:197:stop] 0/5316, RunningAvgSamplesPerSec=10.949969927409501, CurrSamplesPerSec=10.766695468987088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11316/20000 [20:24:12<22:31:47,  9.34s/it][2022-12-22 10:23:37,528] [INFO] [timer.py:197:stop] 0/5317, RunningAvgSamplesPerSec=10.949983181006678, CurrSamplesPerSec=11.020868814215076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11317/20000 [20:24:21<22:27:37,  9.31s/it][2022-12-22 10:23:46,822] [INFO] [timer.py:197:stop] 0/5318, RunningAvgSamplesPerSec=10.949993240185352, CurrSamplesPerSec=11.00372015168863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11318/20000 [20:24:31<22:26:40,  9.31s/it][2022-12-22 10:23:55,667] [INFO] [timer.py:197:stop] 0/5319, RunningAvgSamplesPerSec=10.950022497147081, CurrSamplesPerSec=11.107793852341967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11319/20000 [20:24:40<22:06:28,  9.17s/it][2022-12-22 10:24:06,022] [INFO] [logging.py:68:log_dist] [Rank 0] step=11320, skipped=24, lr=[4.464102564102564e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:24:06,023] [INFO] [timer.py:197:stop] 0/5320, RunningAvgSamplesPerSec=10.949970252489289, CurrSamplesPerSec=10.679059316646391, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11320/20000 [20:24:50<22:57:51,  9.52s/it][2022-12-22 10:24:15,259] [INFO] [timer.py:197:stop] 0/5321, RunningAvgSamplesPerSec=10.949996154082859, CurrSamplesPerSec=11.08949598659951, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11321/20000 [20:24:59<22:45:12,  9.44s/it][2022-12-22 10:24:25,490] [INFO] [timer.py:197:stop] 0/5322, RunningAvgSamplesPerSec=10.94992428036628, CurrSamplesPerSec=10.580527219836641, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11322/20000 [20:25:09<23:19:26,  9.68s/it][2022-12-22 10:24:34,843] [INFO] [timer.py:197:stop] 0/5323, RunningAvgSamplesPerSec=10.949940768653217, CurrSamplesPerSec=11.038366951974602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11323/20000 [20:25:19<23:05:17,  9.58s/it][2022-12-22 10:24:44,570] [INFO] [timer.py:197:stop] 0/5324, RunningAvgSamplesPerSec=10.949938438476734, CurrSamplesPerSec=10.937553595694009, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11324/20000 [20:25:29<23:11:32,  9.62s/it][2022-12-22 10:24:53,509] [INFO] [timer.py:197:stop] 0/5325, RunningAvgSamplesPerSec=10.94993550500656, CurrSamplesPerSec=10.934345808002119, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11325/20000 [20:25:37<22:41:41,  9.42s/it]

                                                           
{'loss': 0.0718, 'learning_rate': 4.461538461538462e-06, 'epoch': 0.57}


 57%|█████▋    | 11325/20000 [20:25:37<22:41:41,  9.42s/it][2022-12-22 10:25:03,759] [INFO] [timer.py:197:stop] 0/5326, RunningAvgSamplesPerSec=10.94994349541605, CurrSamplesPerSec=10.992642331717976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11326/20000 [20:25:48<23:17:37,  9.67s/it][2022-12-22 10:25:13,371] [INFO] [timer.py:197:stop] 0/5327, RunningAvgSamplesPerSec=10.949943155866764, CurrSamplesPerSec=10.948135693924685, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11327/20000 [20:25:57<23:15:01,  9.65s/it][2022-12-22 10:25:23,181] [INFO] [timer.py:197:stop] 0/5328, RunningAvgSamplesPerSec=10.949945715755442, CurrSamplesPerSec=10.963594116823721, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11328/20000 [20:26:07<23:21:47,  9.70s/it][2022-12-22 10:25:32,881] [INFO] [timer.py:197:stop] 0/5329, RunningAvgSamplesPerSec=10.949938008470864, CurrSamplesPerSec=10.909042348762592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11329/20000 [20:26:17<23:21:40,  9.70s/it][2022-12-22 10:25:42,316] [INFO] [logging.py:68:log_dist] [Rank 0] step=11330, skipped=24, lr=[4.458974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:25:42,316] [INFO] [timer.py:197:stop] 0/5330, RunningAvgSamplesPerSec=10.949966527073588, CurrSamplesPerSec=11.104022885495622, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11330/20000 [20:26:26<23:10:04,  9.62s/it][2022-12-22 10:25:51,791] [INFO] [timer.py:197:stop] 0/5331, RunningAvgSamplesPerSec=10.949891862670592, CurrSamplesPerSec=10.566028384145321, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11331/20000 [20:26:36<23:03:36,  9.58s/it][2022-12-22 10:26:00,968] [INFO] [timer.py:197:stop] 0/5332, RunningAvgSamplesPerSec=10.94981202438222, CurrSamplesPerSec=10.540269663330768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11332/20000 [20:26:45<22:46:09,  9.46s/it][2022-12-22 10:26:10,358] [INFO] [timer.py:197:stop] 0/5333, RunningAvgSamplesPerSec=10.949816782212897, CurrSamplesPerSec=10.975234897880014, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11333/20000 [20:26:54<22:43:07,  9.44s/it][2022-12-22 10:26:19,503] [INFO] [timer.py:197:stop] 0/5334, RunningAvgSamplesPerSec=10.949825532042105, CurrSamplesPerSec=10.996670464468487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11334/20000 [20:27:03<22:30:18,  9.35s/it][2022-12-22 10:26:29,747] [INFO] [timer.py:197:stop] 0/5335, RunningAvgSamplesPerSec=10.949839309854172, CurrSamplesPerSec=11.023798897272915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11335/20000 [20:27:14<23:08:56,  9.62s/it][2022-12-22 10:26:39,399] [INFO] [timer.py:197:stop] 0/5336, RunningAvgSamplesPerSec=10.949646724397487, CurrSamplesPerSec=10.010678610866917, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11336/20000 [20:27:23<23:10:17,  9.63s/it][2022-12-22 10:26:49,263] [INFO] [timer.py:197:stop] 0/5337, RunningAvgSamplesPerSec=10.949638329566096, CurrSamplesPerSec=10.905042704827867, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11337/20000 [20:27:33<23:20:20,  9.70s/it][2022-12-22 10:26:58,616] [INFO] [timer.py:197:stop] 0/5338, RunningAvgSamplesPerSec=10.949622976452758, CurrSamplesPerSec=10.868322401261336, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11338/20000 [20:27:43<23:05:15,  9.60s/it][2022-12-22 10:27:07,884] [INFO] [timer.py:197:stop] 0/5339, RunningAvgSamplesPerSec=10.949618303473127, CurrSamplesPerSec=10.924739949020273, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11339/20000 [20:27:52<22:50:50,  9.50s/it][2022-12-22 10:27:16,950] [INFO] [logging.py:68:log_dist] [Rank 0] step=11340, skipped=24, lr=[4.453846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:27:16,951] [INFO] [timer.py:197:stop] 0/5340, RunningAvgSamplesPerSec=10.94966120004389, CurrSamplesPerSec=11.18349008287938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11340/20000 [20:28:01<22:32:05,  9.37s/it][2022-12-22 10:27:26,274] [INFO] [timer.py:197:stop] 0/5341, RunningAvgSamplesPerSec=10.949690655539715, CurrSamplesPerSec=11.109215234301056, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11341/20000 [20:28:10<22:30:00,  9.35s/it][2022-12-22 10:27:35,550] [INFO] [timer.py:197:stop] 0/5342, RunningAvgSamplesPerSec=10.949683472323871, CurrSamplesPerSec=10.911466163862478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11342/20000 [20:28:20<22:26:25,  9.33s/it][2022-12-22 10:27:45,023] [INFO] [timer.py:197:stop] 0/5343, RunningAvgSamplesPerSec=10.949691405512663, CurrSamplesPerSec=10.992219200125206, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11343/20000 [20:28:29<22:32:25,  9.37s/it][2022-12-22 10:27:56,000] [INFO] [timer.py:197:stop] 0/5344, RunningAvgSamplesPerSec=10.949641855272935, CurrSamplesPerSec=10.691240633455976, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11344/20000 [20:28:40<23:41:41,  9.85s/it][2022-12-22 10:28:08,021] [INFO] [timer.py:197:stop] 0/5345, RunningAvgSamplesPerSec=10.949626908392398, CurrSamplesPerSec=10.870358814978008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11345/20000 [20:28:52<25:15:17, 10.50s/it][2022-12-22 10:28:17,518] [INFO] [timer.py:197:stop] 0/5346, RunningAvgSamplesPerSec=10.949627368892088, CurrSamplesPerSec=10.952088371842342, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11346/20000 [20:29:01<24:31:28, 10.20s/it][2022-12-22 10:28:26,581] [INFO] [timer.py:197:stop] 0/5347, RunningAvgSamplesPerSec=10.949616330621625, CurrSamplesPerSec=10.890943956210881, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11347/20000 [20:29:11<23:42:02,  9.86s/it][2022-12-22 10:28:37,292] [INFO] [timer.py:197:stop] 0/5348, RunningAvgSamplesPerSec=10.949656744492723, CurrSamplesPerSec=11.170016910103977, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11348/20000 [20:29:21<24:18:42, 10.12s/it][2022-12-22 10:28:46,726] [INFO] [timer.py:197:stop] 0/5349, RunningAvgSamplesPerSec=10.949653286870298, CurrSamplesPerSec=10.931199994787598, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11349/20000 [20:29:31<23:49:02,  9.91s/it][2022-12-22 10:28:55,540] [INFO] [logging.py:68:log_dist] [Rank 0] step=11350, skipped=24, lr=[4.448717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:28:55,541] [INFO] [timer.py:197:stop] 0/5350, RunningAvgSamplesPerSec=10.949681242551357, CurrSamplesPerSec=11.101229509688224, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11350/20000 [20:29:40<23:01:27,  9.58s/it]

                                                           
{'loss': 0.0592, 'learning_rate': 4.448717948717949e-06, 'epoch': 0.57}


 57%|█████▋    | 11350/20000 [20:29:40<23:01:27,  9.58s/it][2022-12-22 10:29:04,871] [INFO] [timer.py:197:stop] 0/5351, RunningAvgSamplesPerSec=10.94969320022235, CurrSamplesPerSec=11.014018575208118, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11351/20000 [20:29:49<22:50:23,  9.51s/it][2022-12-22 10:29:13,936] [INFO] [timer.py:197:stop] 0/5352, RunningAvgSamplesPerSec=10.949697360915813, CurrSamplesPerSec=10.971998245856625, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11352/20000 [20:29:58<22:31:06,  9.37s/it][2022-12-22 10:29:23,862] [INFO] [timer.py:197:stop] 0/5353, RunningAvgSamplesPerSec=10.94972020314999, CurrSamplesPerSec=11.073305707902255, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11353/20000 [20:30:08<22:54:48,  9.54s/it][2022-12-22 10:29:34,827] [INFO] [timer.py:197:stop] 0/5354, RunningAvgSamplesPerSec=10.9497312861715, CurrSamplesPerSec=11.009359549483015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11354/20000 [20:30:19<23:56:17,  9.97s/it][2022-12-22 10:29:44,114] [INFO] [timer.py:197:stop] 0/5355, RunningAvgSamplesPerSec=10.949732340685603, CurrSamplesPerSec=10.955379011148075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11355/20000 [20:30:28<23:26:42,  9.76s/it][2022-12-22 10:29:53,158] [INFO] [timer.py:197:stop] 0/5356, RunningAvgSamplesPerSec=10.949739764033504, CurrSamplesPerSec=10.989621706041147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11356/20000 [20:30:37<22:55:27,  9.55s/it][2022-12-22 10:30:02,823] [INFO] [timer.py:197:stop] 0/5357, RunningAvgSamplesPerSec=10.949773621333778, CurrSamplesPerSec=11.134097635461549, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11357/20000 [20:30:47<23:00:25,  9.58s/it][2022-12-22 10:30:11,869] [INFO] [timer.py:197:stop] 0/5358, RunningAvgSamplesPerSec=10.9497401432429, CurrSamplesPerSec=10.773353406689216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11358/20000 [20:30:56<22:37:01,  9.42s/it][2022-12-22 10:30:21,758] [INFO] [timer.py:197:stop] 0/5359, RunningAvgSamplesPerSec=10.949726006053494, CurrSamplesPerSec=10.874527325386119, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11359/20000 [20:31:06<22:57:04,  9.56s/it][2022-12-22 10:30:30,775] [INFO] [logging.py:68:log_dist] [Rank 0] step=11360, skipped=24, lr=[4.443589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:30:30,776] [INFO] [timer.py:197:stop] 0/5360, RunningAvgSamplesPerSec=10.949697053199518, CurrSamplesPerSec=10.796763297269239, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11360/20000 [20:31:15<22:33:24,  9.40s/it][2022-12-22 10:30:40,458] [INFO] [timer.py:197:stop] 0/5361, RunningAvgSamplesPerSec=10.949670852013504, CurrSamplesPerSec=10.81106233171868, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11361/20000 [20:31:24<22:45:29,  9.48s/it][2022-12-22 10:30:50,854] [INFO] [timer.py:197:stop] 0/5362, RunningAvgSamplesPerSec=10.949675396994918, CurrSamplesPerSec=10.974086262258774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11362/20000 [20:31:35<23:24:42,  9.76s/it][2022-12-22 10:31:00,159] [INFO] [timer.py:197:stop] 0/5363, RunningAvgSamplesPerSec=10.949680725517547, CurrSamplesPerSec=10.97831631312419, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11363/20000 [20:31:44<23:05:03,  9.62s/it][2022-12-22 10:31:09,954] [INFO] [timer.py:197:stop] 0/5364, RunningAvgSamplesPerSec=10.949604959169523, CurrSamplesPerSec=10.557952889824417, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11364/20000 [20:31:54<23:12:21,  9.67s/it][2022-12-22 10:31:19,276] [INFO] [timer.py:197:stop] 0/5365, RunningAvgSamplesPerSec=10.94951924729755, CurrSamplesPerSec=10.508448808241326, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11365/20000 [20:32:03<22:57:01,  9.57s/it][2022-12-22 10:31:28,419] [INFO] [timer.py:197:stop] 0/5366, RunningAvgSamplesPerSec=10.949532045933882, CurrSamplesPerSec=11.018604204413263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11366/20000 [20:32:12<22:38:33,  9.44s/it][2022-12-22 10:31:38,762] [INFO] [timer.py:197:stop] 0/5367, RunningAvgSamplesPerSec=10.949566885135576, CurrSamplesPerSec=11.139689817215777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11367/20000 [20:32:23<23:17:18,  9.71s/it][2022-12-22 10:31:48,287] [INFO] [timer.py:197:stop] 0/5368, RunningAvgSamplesPerSec=10.949517732325821, CurrSamplesPerSec=10.692015664681497, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11368/20000 [20:32:32<23:09:05,  9.66s/it][2022-12-22 10:31:57,214] [INFO] [timer.py:197:stop] 0/5369, RunningAvgSamplesPerSec=10.94950646735563, CurrSamplesPerSec=10.889390574862785, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11369/20000 [20:32:41<22:37:29,  9.44s/it][2022-12-22 10:32:06,677] [INFO] [logging.py:68:log_dist] [Rank 0] step=11370, skipped=24, lr=[4.438461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:32:06,678] [INFO] [timer.py:197:stop] 0/5370, RunningAvgSamplesPerSec=10.949465653279168, CurrSamplesPerSec=10.734713521581103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11370/20000 [20:32:51<22:38:30,  9.44s/it][2022-12-22 10:32:19,143] [INFO] [timer.py:197:stop] 0/5371, RunningAvgSamplesPerSec=10.94945516171983, CurrSamplesPerSec=10.893424718339292, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11371/20000 [20:33:03<24:48:38, 10.35s/it][2022-12-22 10:32:28,181] [INFO] [timer.py:197:stop] 0/5372, RunningAvgSamplesPerSec=10.94941671543527, CurrSamplesPerSec=10.746818697250859, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11372/20000 [20:33:12<23:51:48,  9.96s/it][2022-12-22 10:32:37,056] [INFO] [timer.py:197:stop] 0/5373, RunningAvgSamplesPerSec=10.949449098761477, CurrSamplesPerSec=11.12615450728381, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11373/20000 [20:33:21<23:04:58,  9.63s/it][2022-12-22 10:32:46,936] [INFO] [timer.py:197:stop] 0/5374, RunningAvgSamplesPerSec=10.949423028772605, CurrSamplesPerSec=10.811169443261262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11374/20000 [20:33:31<23:15:30,  9.71s/it][2022-12-22 10:32:57,106] [INFO] [timer.py:197:stop] 0/5375, RunningAvgSamplesPerSec=10.949433738570157, CurrSamplesPerSec=11.00727072800444, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11375/20000 [20:33:41<23:35:18,  9.85s/it]

                                                           
{'loss': 0.0585, 'learning_rate': 4.435897435897436e-06, 'epoch': 0.57}


 57%|█████▋    | 11375/20000 [20:33:41<23:35:18,  9.85s/it][2022-12-22 10:33:06,008] [INFO] [timer.py:197:stop] 0/5376, RunningAvgSamplesPerSec=10.949424121614344, CurrSamplesPerSec=10.897994964768278, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11376/20000 [20:33:50<22:54:27,  9.56s/it][2022-12-22 10:33:15,705] [INFO] [timer.py:197:stop] 0/5377, RunningAvgSamplesPerSec=10.949419714851775, CurrSamplesPerSec=10.925788892227787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11377/20000 [20:34:00<23:00:07,  9.60s/it][2022-12-22 10:33:24,885] [INFO] [timer.py:197:stop] 0/5378, RunningAvgSamplesPerSec=10.949383419996545, CurrSamplesPerSec=10.757714173868989, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11378/20000 [20:34:09<22:41:44,  9.48s/it][2022-12-22 10:33:34,261] [INFO] [timer.py:197:stop] 0/5379, RunningAvgSamplesPerSec=10.949373825660489, CurrSamplesPerSec=10.898036554185826, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11379/20000 [20:34:18<22:37:13,  9.45s/it][2022-12-22 10:33:43,457] [INFO] [logging.py:68:log_dist] [Rank 0] step=11380, skipped=24, lr=[4.433333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:33:43,458] [INFO] [timer.py:197:stop] 0/5380, RunningAvgSamplesPerSec=10.949380992476744, CurrSamplesPerSec=10.98805309394003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11380/20000 [20:34:27<22:26:18,  9.37s/it][2022-12-22 10:33:52,826] [INFO] [timer.py:197:stop] 0/5381, RunningAvgSamplesPerSec=10.949332919218781, CurrSamplesPerSec=10.69675985578815, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11381/20000 [20:34:37<22:26:03,  9.37s/it][2022-12-22 10:34:01,953] [INFO] [timer.py:197:stop] 0/5382, RunningAvgSamplesPerSec=10.949345220137388, CurrSamplesPerSec=11.015914210987383, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11382/20000 [20:34:46<22:15:25,  9.30s/it][2022-12-22 10:34:10,726] [INFO] [timer.py:197:stop] 0/5383, RunningAvgSamplesPerSec=10.949390215758458, CurrSamplesPerSec=11.196940685742888, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11383/20000 [20:34:55<21:52:39,  9.14s/it][2022-12-22 10:34:21,206] [INFO] [timer.py:197:stop] 0/5384, RunningAvgSamplesPerSec=10.94938377258744, CurrSamplesPerSec=10.914822526226473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11384/20000 [20:35:05<22:50:18,  9.54s/it][2022-12-22 10:34:31,177] [INFO] [timer.py:197:stop] 0/5385, RunningAvgSamplesPerSec=10.949294306026646, CurrSamplesPerSec=10.488071882407517, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11385/20000 [20:35:15<23:08:30,  9.67s/it][2022-12-22 10:34:40,999] [INFO] [timer.py:197:stop] 0/5386, RunningAvgSamplesPerSec=10.949280973859672, CurrSamplesPerSec=10.877981339269777, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11386/20000 [20:35:25<23:14:54,  9.72s/it][2022-12-22 10:34:50,322] [INFO] [timer.py:197:stop] 0/5387, RunningAvgSamplesPerSec=10.949281626019454, CurrSamplesPerSec=10.952793980839223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11387/20000 [20:35:34<22:57:48,  9.60s/it][2022-12-22 10:35:00,055] [INFO] [timer.py:197:stop] 0/5388, RunningAvgSamplesPerSec=10.949325583572188, CurrSamplesPerSec=11.191268494891073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11388/20000 [20:35:44<23:03:27,  9.64s/it][2022-12-22 10:35:09,469] [INFO] [timer.py:197:stop] 0/5389, RunningAvgSamplesPerSec=10.949280573681504, CurrSamplesPerSec=10.712109381889972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11389/20000 [20:35:53<22:53:37,  9.57s/it][2022-12-22 10:35:18,649] [INFO] [logging.py:68:log_dist] [Rank 0] step=11390, skipped=24, lr=[4.428205128205129e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:35:18,650] [INFO] [timer.py:197:stop] 0/5390, RunningAvgSamplesPerSec=10.949314713422288, CurrSamplesPerSec=11.13636793018569, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11390/20000 [20:36:03<22:36:39,  9.45s/it][2022-12-22 10:35:28,075] [INFO] [timer.py:197:stop] 0/5391, RunningAvgSamplesPerSec=10.949280134901912, CurrSamplesPerSec=10.766088765024811, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11391/20000 [20:36:12<22:35:15,  9.45s/it][2022-12-22 10:35:36,928] [INFO] [timer.py:197:stop] 0/5392, RunningAvgSamplesPerSec=10.949328624950796, CurrSamplesPerSec=11.217031589908679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11392/20000 [20:36:21<22:09:34,  9.27s/it][2022-12-22 10:35:47,093] [INFO] [timer.py:197:stop] 0/5393, RunningAvgSamplesPerSec=10.949338839129066, CurrSamplesPerSec=11.004671530165544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11393/20000 [20:36:31<22:48:03,  9.54s/it][2022-12-22 10:35:58,274] [INFO] [timer.py:197:stop] 0/5394, RunningAvgSamplesPerSec=10.949323125763279, CurrSamplesPerSec=10.865262833999457, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11394/20000 [20:36:42<23:58:39, 10.03s/it][2022-12-22 10:36:07,389] [INFO] [timer.py:197:stop] 0/5395, RunningAvgSamplesPerSec=10.94926972940028, CurrSamplesPerSec=10.668734633427535, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11395/20000 [20:36:51<23:19:06,  9.76s/it][2022-12-22 10:36:16,616] [INFO] [timer.py:197:stop] 0/5396, RunningAvgSamplesPerSec=10.9492674104411, CurrSamplesPerSec=10.936775534323738, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11396/20000 [20:37:01<22:56:11,  9.60s/it][2022-12-22 10:36:26,371] [INFO] [timer.py:197:stop] 0/5397, RunningAvgSamplesPerSec=10.949236413491732, CurrSamplesPerSec=10.784554074803664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11397/20000 [20:37:10<23:02:50,  9.64s/it][2022-12-22 10:36:35,899] [INFO] [timer.py:197:stop] 0/5398, RunningAvgSamplesPerSec=10.949259428581549, CurrSamplesPerSec=11.074850323611912, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11398/20000 [20:37:20<22:57:41,  9.61s/it][2022-12-22 10:36:44,872] [INFO] [timer.py:197:stop] 0/5399, RunningAvgSamplesPerSec=10.949258412191979, CurrSamplesPerSec=10.943776720345243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11399/20000 [20:37:29<22:30:09,  9.42s/it][2022-12-22 10:36:54,136] [INFO] [logging.py:68:log_dist] [Rank 0] step=11400, skipped=24, lr=[4.423076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:36:54,137] [INFO] [timer.py:197:stop] 0/5400, RunningAvgSamplesPerSec=10.949263156786156, CurrSamplesPerSec=10.974929768091606, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11400/20000 [20:37:38<22:23:23,  9.37s/it]

                                                           
{'loss': 0.0687, 'learning_rate': 4.423076923076924e-06, 'epoch': 0.57}


 57%|█████▋    | 11400/20000 [20:37:38<22:23:23,  9.37s/it][2022-12-22 10:37:04,377] [INFO] [timer.py:197:stop] 0/5401, RunningAvgSamplesPerSec=10.949215784510432, CurrSamplesPerSec=10.699337159183036, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11401/20000 [20:37:48<23:00:30,  9.63s/it][2022-12-22 10:37:13,358] [INFO] [timer.py:197:stop] 0/5402, RunningAvgSamplesPerSec=10.94925585208892, CurrSamplesPerSec=11.169941612723196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11402/20000 [20:37:57<22:32:21,  9.44s/it][2022-12-22 10:37:22,533] [INFO] [timer.py:197:stop] 0/5403, RunningAvgSamplesPerSec=10.949274627691263, CurrSamplesPerSec=11.051610668599592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11403/20000 [20:38:06<22:20:55,  9.36s/it][2022-12-22 10:37:31,822] [INFO] [timer.py:197:stop] 0/5404, RunningAvgSamplesPerSec=10.949255626652686, CurrSamplesPerSec=10.847584134957804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11404/20000 [20:38:16<22:17:46,  9.34s/it][2022-12-22 10:37:41,397] [INFO] [timer.py:197:stop] 0/5405, RunningAvgSamplesPerSec=10.949204305748378, CurrSamplesPerSec=10.678816313293863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11405/20000 [20:38:25<22:27:49,  9.41s/it][2022-12-22 10:37:50,413] [INFO] [timer.py:197:stop] 0/5406, RunningAvgSamplesPerSec=10.949176308193527, CurrSamplesPerSec=10.79996733079302, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11406/20000 [20:38:34<22:10:46,  9.29s/it][2022-12-22 10:38:00,034] [INFO] [timer.py:197:stop] 0/5407, RunningAvgSamplesPerSec=10.949158851790607, CurrSamplesPerSec=10.855630410239696, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11407/20000 [20:38:44<22:24:47,  9.39s/it][2022-12-22 10:38:09,337] [INFO] [timer.py:197:stop] 0/5408, RunningAvgSamplesPerSec=10.949180649778503, CurrSamplesPerSec=11.068280580467007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11408/20000 [20:38:53<22:20:56,  9.36s/it][2022-12-22 10:38:18,770] [INFO] [timer.py:197:stop] 0/5409, RunningAvgSamplesPerSec=10.949104721793683, CurrSamplesPerSec=10.55347248107162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11409/20000 [20:39:03<22:23:43,  9.38s/it][2022-12-22 10:38:27,623] [INFO] [logging.py:68:log_dist] [Rank 0] step=11410, skipped=24, lr=[4.4179487179487185e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:38:27,624] [INFO] [timer.py:197:stop] 0/5410, RunningAvgSamplesPerSec=10.949150024238742, CurrSamplesPerSec=11.19970674328969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11410/20000 [20:39:12<22:00:46,  9.23s/it][2022-12-22 10:38:37,524] [INFO] [timer.py:197:stop] 0/5411, RunningAvgSamplesPerSec=10.949188562177365, CurrSamplesPerSec=11.161646529568968, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11411/20000 [20:39:21<22:29:35,  9.43s/it][2022-12-22 10:38:47,048] [INFO] [timer.py:197:stop] 0/5412, RunningAvgSamplesPerSec=10.94919716080646, CurrSamplesPerSec=10.995905590253441, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11412/20000 [20:39:31<22:33:33,  9.46s/it][2022-12-22 10:38:56,642] [INFO] [timer.py:197:stop] 0/5413, RunningAvgSamplesPerSec=10.949191060276599, CurrSamplesPerSec=10.916286395760551, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11413/20000 [20:39:41<22:39:18,  9.50s/it][2022-12-22 10:39:06,671] [INFO] [timer.py:197:stop] 0/5414, RunningAvgSamplesPerSec=10.94918492049978, CurrSamplesPerSec=10.91606310586772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11414/20000 [20:39:51<23:01:57,  9.66s/it][2022-12-22 10:39:16,649] [INFO] [timer.py:197:stop] 0/5415, RunningAvgSamplesPerSec=10.949188198336218, CurrSamplesPerSec=10.966956642528114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11415/20000 [20:40:01<23:15:31,  9.75s/it][2022-12-22 10:39:25,601] [INFO] [timer.py:197:stop] 0/5416, RunningAvgSamplesPerSec=10.949169245364764, CurrSamplesPerSec=10.847529340832926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11416/20000 [20:40:10<22:40:59,  9.51s/it][2022-12-22 10:39:34,587] [INFO] [timer.py:197:stop] 0/5417, RunningAvgSamplesPerSec=10.949140534176502, CurrSamplesPerSec=10.795874445442248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11417/20000 [20:40:19<22:18:13,  9.35s/it][2022-12-22 10:39:44,667] [INFO] [timer.py:197:stop] 0/5418, RunningAvgSamplesPerSec=10.94914454491864, CurrSamplesPerSec=10.970905886270192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11418/20000 [20:40:29<22:49:11,  9.57s/it][2022-12-22 10:39:54,397] [INFO] [timer.py:197:stop] 0/5419, RunningAvgSamplesPerSec=10.949183080917516, CurrSamplesPerSec=11.16195052690629, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11419/20000 [20:40:38<22:55:48,  9.62s/it][2022-12-22 10:40:03,435] [INFO] [logging.py:68:log_dist] [Rank 0] step=11420, skipped=24, lr=[4.412820512820513e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:40:03,436] [INFO] [timer.py:197:stop] 0/5420, RunningAvgSamplesPerSec=10.949147566503546, CurrSamplesPerSec=10.760088455164416, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11420/20000 [20:40:47<22:30:41,  9.45s/it][2022-12-22 10:40:13,397] [INFO] [timer.py:197:stop] 0/5421, RunningAvgSamplesPerSec=10.949151590215573, CurrSamplesPerSec=10.970995562769408, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11421/20000 [20:40:57<22:52:38,  9.60s/it][2022-12-22 10:40:22,814] [INFO] [timer.py:197:stop] 0/5422, RunningAvgSamplesPerSec=10.949147981394681, CurrSamplesPerSec=10.92962665434328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11422/20000 [20:41:07<22:44:38,  9.55s/it][2022-12-22 10:40:31,935] [INFO] [timer.py:197:stop] 0/5423, RunningAvgSamplesPerSec=10.949180439615256, CurrSamplesPerSec=11.127977304577861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11423/20000 [20:41:16<22:26:17,  9.42s/it][2022-12-22 10:40:41,747] [INFO] [timer.py:197:stop] 0/5424, RunningAvgSamplesPerSec=10.949218189253202, CurrSamplesPerSec=11.157757289398859, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11424/20000 [20:41:26<22:43:01,  9.54s/it][2022-12-22 10:40:50,540] [INFO] [timer.py:197:stop] 0/5425, RunningAvgSamplesPerSec=10.94924679750785, CurrSamplesPerSec=11.10659019137098, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11425/20000 [20:41:35<22:11:01,  9.31s/it]

                                                           
{'loss': 0.073, 'learning_rate': 4.4102564102564104e-06, 'epoch': 0.57}


 57%|█████▋    | 11425/20000 [20:41:35<22:11:01,  9.31s/it][2022-12-22 10:41:01,134] [INFO] [timer.py:197:stop] 0/5426, RunningAvgSamplesPerSec=10.949240818162336, CurrSamplesPerSec=10.916910590517906, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11426/20000 [20:41:45<23:05:47,  9.70s/it][2022-12-22 10:41:10,748] [INFO] [timer.py:197:stop] 0/5427, RunningAvgSamplesPerSec=10.949203905627964, CurrSamplesPerSec=10.752586268293506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11427/20000 [20:41:55<23:02:01,  9.67s/it][2022-12-22 10:41:19,759] [INFO] [timer.py:197:stop] 0/5428, RunningAvgSamplesPerSec=10.949210552295465, CurrSamplesPerSec=10.985387885413312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11428/20000 [20:42:04<22:33:31,  9.47s/it][2022-12-22 10:41:29,531] [INFO] [timer.py:197:stop] 0/5429, RunningAvgSamplesPerSec=10.949144187050072, CurrSamplesPerSec=10.600514293975593, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11429/20000 [20:42:13<22:46:07,  9.56s/it][2022-12-22 10:41:38,901] [INFO] [logging.py:68:log_dist] [Rank 0] step=11430, skipped=24, lr=[4.4076923076923075e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:41:38,902] [INFO] [timer.py:197:stop] 0/5430, RunningAvgSamplesPerSec=10.949183790327533, CurrSamplesPerSec=11.168414968142809, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11430/20000 [20:42:23<22:37:43,  9.51s/it][2022-12-22 10:41:48,235] [INFO] [timer.py:197:stop] 0/5431, RunningAvgSamplesPerSec=10.949149710246799, CurrSamplesPerSec=10.767237026220414, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11431/20000 [20:42:32<22:30:08,  9.45s/it][2022-12-22 10:41:57,474] [INFO] [timer.py:197:stop] 0/5432, RunningAvgSamplesPerSec=10.949152568442454, CurrSamplesPerSec=10.964691738836587, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11432/20000 [20:42:41<22:20:47,  9.39s/it][2022-12-22 10:42:06,496] [INFO] [timer.py:197:stop] 0/5433, RunningAvgSamplesPerSec=10.949150197928335, CurrSamplesPerSec=10.936293423552083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11433/20000 [20:42:50<22:04:55,  9.28s/it][2022-12-22 10:42:15,373] [INFO] [timer.py:197:stop] 0/5434, RunningAvgSamplesPerSec=10.949185012643227, CurrSamplesPerSec=11.141586880364294, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11434/20000 [20:42:59<21:47:31,  9.16s/it][2022-12-22 10:42:24,289] [INFO] [timer.py:197:stop] 0/5435, RunningAvgSamplesPerSec=10.949181838996404, CurrSamplesPerSec=10.931969694587915, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11435/20000 [20:43:08<21:36:59,  9.09s/it][2022-12-22 10:42:33,787] [INFO] [timer.py:197:stop] 0/5436, RunningAvgSamplesPerSec=10.94920060229618, CurrSamplesPerSec=11.052099815111758, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11436/20000 [20:43:18<21:54:30,  9.21s/it][2022-12-22 10:42:43,032] [INFO] [timer.py:197:stop] 0/5437, RunningAvgSamplesPerSec=10.949211856569177, CurrSamplesPerSec=11.01071113728248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11437/20000 [20:43:27<21:55:52,  9.22s/it][2022-12-22 10:42:52,083] [INFO] [timer.py:197:stop] 0/5438, RunningAvgSamplesPerSec=10.949211096213169, CurrSamplesPerSec=10.945080120737156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11438/20000 [20:43:36<21:48:27,  9.17s/it][2022-12-22 10:43:02,503] [INFO] [timer.py:197:stop] 0/5439, RunningAvgSamplesPerSec=10.94920083319502, CurrSamplesPerSec=10.89369394435259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11439/20000 [20:43:46<22:41:51,  9.54s/it][2022-12-22 10:43:12,118] [INFO] [logging.py:68:log_dist] [Rank 0] step=11440, skipped=24, lr=[4.402564102564103e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:43:12,119] [INFO] [timer.py:197:stop] 0/5440, RunningAvgSamplesPerSec=10.949123913031306, CurrSamplesPerSec=10.546298223592064, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11440/20000 [20:43:56<22:44:45,  9.57s/it][2022-12-22 10:43:21,474] [INFO] [timer.py:197:stop] 0/5441, RunningAvgSamplesPerSec=10.949062151185368, CurrSamplesPerSec=10.623198880421572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11441/20000 [20:44:05<22:35:33,  9.50s/it][2022-12-22 10:43:30,973] [INFO] [timer.py:197:stop] 0/5442, RunningAvgSamplesPerSec=10.94903285522663, CurrSamplesPerSec=10.791978164810013, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11442/20000 [20:44:15<22:35:14,  9.50s/it][2022-12-22 10:43:41,949] [INFO] [timer.py:197:stop] 0/5443, RunningAvgSamplesPerSec=10.949035154751392, CurrSamplesPerSec=10.961558880603516, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11443/20000 [20:44:26<23:38:10,  9.94s/it][2022-12-22 10:43:51,415] [INFO] [timer.py:197:stop] 0/5444, RunningAvgSamplesPerSec=10.949025966350776, CurrSamplesPerSec=10.89925915940619, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11444/20000 [20:44:35<23:17:33,  9.80s/it][2022-12-22 10:44:02,387] [INFO] [timer.py:197:stop] 0/5445, RunningAvgSamplesPerSec=10.949019741497818, CurrSamplesPerSec=10.91524859692115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11445/20000 [20:44:46<24:07:29, 10.15s/it][2022-12-22 10:44:11,232] [INFO] [timer.py:197:stop] 0/5446, RunningAvgSamplesPerSec=10.949080490218547, CurrSamplesPerSec=11.29003425635398, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11446/20000 [20:44:55<23:11:25,  9.76s/it][2022-12-22 10:44:21,372] [INFO] [timer.py:197:stop] 0/5447, RunningAvgSamplesPerSec=10.949049278927266, CurrSamplesPerSec=10.78173202114547, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11447/20000 [20:45:05<23:27:31,  9.87s/it][2022-12-22 10:44:30,626] [INFO] [timer.py:197:stop] 0/5448, RunningAvgSamplesPerSec=10.949049242284348, CurrSamplesPerSec=10.94884972522792, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11448/20000 [20:45:15<23:00:51,  9.69s/it][2022-12-22 10:44:40,423] [INFO] [timer.py:197:stop] 0/5449, RunningAvgSamplesPerSec=10.94900336170047, CurrSamplesPerSec=10.704713627114984, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11449/20000 [20:45:24<23:05:23,  9.72s/it][2022-12-22 10:44:49,493] [INFO] [logging.py:68:log_dist] [Rank 0] step=11450, skipped=24, lr=[4.397435897435898e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:44:49,494] [INFO] [timer.py:197:stop] 0/5450, RunningAvgSamplesPerSec=10.948962947473426, CurrSamplesPerSec=10.733166188882612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11450/20000 [20:45:33<22:37:24,  9.53s/it]

                                                           
{'loss': 0.0585, 'learning_rate': 4.397435897435898e-06, 'epoch': 0.57}


 57%|█████▋    | 11450/20000 [20:45:33<22:37:24,  9.53s/it][2022-12-22 10:44:59,455] [INFO] [timer.py:197:stop] 0/5451, RunningAvgSamplesPerSec=10.948995353073135, CurrSamplesPerSec=11.128434942616948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11451/20000 [20:45:43<22:55:52,  9.66s/it][2022-12-22 10:45:09,415] [INFO] [timer.py:197:stop] 0/5452, RunningAvgSamplesPerSec=10.948982881018669, CurrSamplesPerSec=10.881441958965114, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11452/20000 [20:45:53<23:08:41,  9.75s/it][2022-12-22 10:45:20,135] [INFO] [timer.py:197:stop] 0/5453, RunningAvgSamplesPerSec=10.948968083628683, CurrSamplesPerSec=10.868912077337562, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11453/20000 [20:46:04<23:50:05, 10.04s/it][2022-12-22 10:45:30,053] [INFO] [timer.py:197:stop] 0/5454, RunningAvgSamplesPerSec=10.94894978929901, CurrSamplesPerSec=10.85012762979792, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11454/20000 [20:46:14<23:44:45, 10.00s/it][2022-12-22 10:45:39,273] [INFO] [timer.py:197:stop] 0/5455, RunningAvgSamplesPerSec=10.948983517323816, CurrSamplesPerSec=11.136010349313818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11455/20000 [20:46:23<23:11:06,  9.77s/it][2022-12-22 10:45:48,445] [INFO] [timer.py:197:stop] 0/5456, RunningAvgSamplesPerSec=10.948896569095783, CurrSamplesPerSec=10.494450717000015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11456/20000 [20:46:32<22:45:31,  9.59s/it][2022-12-22 10:45:57,592] [INFO] [timer.py:197:stop] 0/5457, RunningAvgSamplesPerSec=10.948917859012926, CurrSamplesPerSec=11.066277919491341, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11457/20000 [20:46:42<22:26:27,  9.46s/it][2022-12-22 10:46:07,321] [INFO] [timer.py:197:stop] 0/5458, RunningAvgSamplesPerSec=10.948887993296006, CurrSamplesPerSec=10.788359579330448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11458/20000 [20:46:51<22:37:55,  9.54s/it][2022-12-22 10:46:16,631] [INFO] [timer.py:197:stop] 0/5459, RunningAvgSamplesPerSec=10.948833595749328, CurrSamplesPerSec=10.659874898825972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11459/20000 [20:47:01<22:28:01,  9.47s/it][2022-12-22 10:46:25,533] [INFO] [logging.py:68:log_dist] [Rank 0] step=11460, skipped=24, lr=[4.392307692307693e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:46:25,534] [INFO] [timer.py:197:stop] 0/5460, RunningAvgSamplesPerSec=10.948866712555962, CurrSamplesPerSec=11.132618631227922, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11460/20000 [20:47:09<22:03:40,  9.30s/it][2022-12-22 10:46:35,510] [INFO] [timer.py:197:stop] 0/5461, RunningAvgSamplesPerSec=10.948855933472474, CurrSamplesPerSec=10.890338190807684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11461/20000 [20:47:19<22:32:20,  9.50s/it][2022-12-22 10:46:44,413] [INFO] [timer.py:197:stop] 0/5462, RunningAvgSamplesPerSec=10.94887746513958, CurrSamplesPerSec=11.06769462788411, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11462/20000 [20:47:28<22:06:38,  9.32s/it][2022-12-22 10:46:53,646] [INFO] [timer.py:197:stop] 0/5463, RunningAvgSamplesPerSec=10.94886952940597, CurrSamplesPerSec=10.905711249953228, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11463/20000 [20:47:38<22:02:37,  9.30s/it][2022-12-22 10:47:02,684] [INFO] [timer.py:197:stop] 0/5464, RunningAvgSamplesPerSec=10.948862896508437, CurrSamplesPerSec=10.912760104251065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11464/20000 [20:47:47<21:51:29,  9.22s/it][2022-12-22 10:47:11,820] [INFO] [timer.py:197:stop] 0/5465, RunningAvgSamplesPerSec=10.948881626735048, CurrSamplesPerSec=11.052151234888004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11465/20000 [20:47:56<21:47:48,  9.19s/it][2022-12-22 10:47:22,171] [INFO] [timer.py:197:stop] 0/5466, RunningAvgSamplesPerSec=10.948831714540251, CurrSamplesPerSec=10.682788170541956, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11466/20000 [20:48:06<22:37:02,  9.54s/it][2022-12-22 10:47:31,141] [INFO] [timer.py:197:stop] 0/5467, RunningAvgSamplesPerSec=10.94879425891418, CurrSamplesPerSec=10.747892706315866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11467/20000 [20:48:15<22:12:31,  9.37s/it][2022-12-22 10:47:41,720] [INFO] [timer.py:197:stop] 0/5468, RunningAvgSamplesPerSec=10.948813479261828, CurrSamplesPerSec=11.05487033884509, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11468/20000 [20:48:26<23:03:56,  9.73s/it][2022-12-22 10:47:50,480] [INFO] [timer.py:197:stop] 0/5469, RunningAvgSamplesPerSec=10.948858106225801, CurrSamplesPerSec=11.19834853685201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11469/20000 [20:48:34<22:22:18,  9.44s/it][2022-12-22 10:47:59,968] [INFO] [logging.py:68:log_dist] [Rank 0] step=11470, skipped=24, lr=[4.387179487179488e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:47:59,969] [INFO] [timer.py:197:stop] 0/5470, RunningAvgSamplesPerSec=10.948883076636985, CurrSamplesPerSec=11.087120202707245, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11470/20000 [20:48:44<22:24:13,  9.46s/it][2022-12-22 10:48:10,423] [INFO] [timer.py:197:stop] 0/5471, RunningAvgSamplesPerSec=10.948872651235146, CurrSamplesPerSec=10.892161876723181, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11471/20000 [20:48:54<23:06:39,  9.75s/it][2022-12-22 10:48:19,342] [INFO] [timer.py:197:stop] 0/5472, RunningAvgSamplesPerSec=10.948852082865203, CurrSamplesPerSec=10.837507826784108, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11472/20000 [20:49:03<22:30:51,  9.50s/it][2022-12-22 10:48:28,349] [INFO] [timer.py:197:stop] 0/5473, RunningAvgSamplesPerSec=10.948789317651645, CurrSamplesPerSec=10.615903932589847, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11473/20000 [20:49:12<22:09:30,  9.36s/it][2022-12-22 10:48:37,863] [INFO] [timer.py:197:stop] 0/5474, RunningAvgSamplesPerSec=10.94876361751514, CurrSamplesPerSec=10.809941271193132, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11474/20000 [20:49:22<22:16:06,  9.40s/it][2022-12-22 10:48:47,431] [INFO] [timer.py:197:stop] 0/5475, RunningAvgSamplesPerSec=10.94881447556103, CurrSamplesPerSec=11.234369214059623, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11475/20000 [20:49:31<22:23:00,  9.45s/it]

                                                           
{'loss': 0.0584, 'learning_rate': 4.384615384615385e-06, 'epoch': 0.57}


 57%|█████▋    | 11475/20000 [20:49:31<22:23:00,  9.45s/it][2022-12-22 10:48:56,290] [INFO] [timer.py:197:stop] 0/5476, RunningAvgSamplesPerSec=10.948821235042825, CurrSamplesPerSec=10.98594132579687, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11476/20000 [20:49:40<21:57:34,  9.27s/it][2022-12-22 10:49:05,697] [INFO] [timer.py:197:stop] 0/5477, RunningAvgSamplesPerSec=10.948820385758074, CurrSamplesPerSec=10.944173374557465, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11477/20000 [20:49:50<22:03:03,  9.31s/it][2022-12-22 10:49:15,434] [INFO] [timer.py:197:stop] 0/5478, RunningAvgSamplesPerSec=10.948787555119768, CurrSamplesPerSec=10.771943611909403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11478/20000 [20:49:59<22:20:56,  9.44s/it][2022-12-22 10:49:24,302] [INFO] [timer.py:197:stop] 0/5479, RunningAvgSamplesPerSec=10.948846750924494, CurrSamplesPerSec=11.282894751221493, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11479/20000 [20:50:08<21:56:20,  9.27s/it][2022-12-22 10:49:34,730] [INFO] [logging.py:68:log_dist] [Rank 0] step=11480, skipped=24, lr=[4.382051282051282e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:49:34,732] [INFO] [timer.py:197:stop] 0/5480, RunningAvgSamplesPerSec=10.948846866902606, CurrSamplesPerSec=10.949482115889854, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11480/20000 [20:50:19<22:45:38,  9.62s/it][2022-12-22 10:49:43,862] [INFO] [timer.py:197:stop] 0/5481, RunningAvgSamplesPerSec=10.948880214699678, CurrSamplesPerSec=11.134659695454188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11481/20000 [20:50:28<22:24:44,  9.47s/it][2022-12-22 10:49:53,030] [INFO] [timer.py:197:stop] 0/5482, RunningAvgSamplesPerSec=10.948839328613676, CurrSamplesPerSec=10.729316747510289, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11482/20000 [20:50:37<22:11:42,  9.38s/it][2022-12-22 10:50:01,942] [INFO] [timer.py:197:stop] 0/5483, RunningAvgSamplesPerSec=10.948838034940557, CurrSamplesPerSec=10.941753294422686, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11483/20000 [20:50:46<21:51:34,  9.24s/it][2022-12-22 10:50:11,171] [INFO] [timer.py:197:stop] 0/5484, RunningAvgSamplesPerSec=10.9488488419294, CurrSamplesPerSec=11.008404200143918, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11484/20000 [20:50:55<21:50:59,  9.24s/it][2022-12-22 10:50:20,205] [INFO] [timer.py:197:stop] 0/5485, RunningAvgSamplesPerSec=10.948853675606063, CurrSamplesPerSec=10.975416188906612, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11485/20000 [20:51:04<21:42:12,  9.18s/it][2022-12-22 10:50:29,547] [INFO] [timer.py:197:stop] 0/5486, RunningAvgSamplesPerSec=10.94883371481899, CurrSamplesPerSec=10.840472104009557, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11486/20000 [20:51:14<21:49:05,  9.23s/it][2022-12-22 10:50:38,730] [INFO] [timer.py:197:stop] 0/5487, RunningAvgSamplesPerSec=10.948839237051425, CurrSamplesPerSec=10.979207171174766, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11487/20000 [20:51:23<21:47:08,  9.21s/it][2022-12-22 10:50:47,949] [INFO] [timer.py:197:stop] 0/5488, RunningAvgSamplesPerSec=10.948835307850372, CurrSamplesPerSec=10.927325986694928, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11488/20000 [20:51:32<21:47:14,  9.21s/it][2022-12-22 10:50:57,182] [INFO] [timer.py:197:stop] 0/5489, RunningAvgSamplesPerSec=10.948826578841997, CurrSamplesPerSec=10.901147811532354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11489/20000 [20:51:41<21:47:53,  9.22s/it][2022-12-22 10:51:06,968] [INFO] [logging.py:68:log_dist] [Rank 0] step=11490, skipped=24, lr=[4.376923076923078e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:51:06,969] [INFO] [timer.py:197:stop] 0/5490, RunningAvgSamplesPerSec=10.94881540215496, CurrSamplesPerSec=10.887830570742244, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11490/20000 [20:51:51<22:11:49,  9.39s/it][2022-12-22 10:51:16,587] [INFO] [timer.py:197:stop] 0/5491, RunningAvgSamplesPerSec=10.948817776175268, CurrSamplesPerSec=10.96186192442819, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11491/20000 [20:52:01<22:21:23,  9.46s/it][2022-12-22 10:51:25,705] [INFO] [timer.py:197:stop] 0/5492, RunningAvgSamplesPerSec=10.948832290745226, CurrSamplesPerSec=11.029086853474885, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11492/20000 [20:52:10<22:06:43,  9.36s/it][2022-12-22 10:51:35,635] [INFO] [timer.py:197:stop] 0/5493, RunningAvgSamplesPerSec=10.948787618086403, CurrSamplesPerSec=10.70890898250677, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11493/20000 [20:52:20<22:30:59,  9.53s/it][2022-12-22 10:51:44,821] [INFO] [timer.py:197:stop] 0/5494, RunningAvgSamplesPerSec=10.94879595848662, CurrSamplesPerSec=10.994785498318908, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11494/20000 [20:52:29<22:16:15,  9.43s/it][2022-12-22 10:51:53,974] [INFO] [timer.py:197:stop] 0/5495, RunningAvgSamplesPerSec=10.948749510367605, CurrSamplesPerSec=10.699465523872341, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11495/20000 [20:52:38<22:04:30,  9.34s/it][2022-12-22 10:52:03,332] [INFO] [timer.py:197:stop] 0/5496, RunningAvgSamplesPerSec=10.948683848643297, CurrSamplesPerSec=10.599508877949706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11496/20000 [20:52:47<22:04:57,  9.35s/it][2022-12-22 10:52:12,841] [INFO] [timer.py:197:stop] 0/5497, RunningAvgSamplesPerSec=10.94868537675021, CurrSamplesPerSec=10.957087239834674, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11497/20000 [20:52:57<22:11:36,  9.40s/it][2022-12-22 10:52:21,971] [INFO] [timer.py:197:stop] 0/5498, RunningAvgSamplesPerSec=10.948693252573769, CurrSamplesPerSec=10.992142679804774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11498/20000 [20:53:06<22:00:09,  9.32s/it][2022-12-22 10:52:30,924] [INFO] [timer.py:197:stop] 0/5499, RunningAvgSamplesPerSec=10.948705076314294, CurrSamplesPerSec=11.01407641996247, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▋    | 11499/20000 [20:53:15<21:44:32,  9.21s/it][2022-12-22 10:52:40,164] [INFO] [logging.py:68:log_dist] [Rank 0] step=11500, skipped=24, lr=[4.371794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:52:40,165] [INFO] [timer.py:197:stop] 0/5500, RunningAvgSamplesPerSec=10.948665926385853, CurrSamplesPerSec=10.73760808091087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 57%|█████▊    | 11500/20000 [20:53:24<21:45:47,  9.22s/it]

                                                           
{'loss': 0.0609, 'learning_rate': 4.371794871794872e-06, 'epoch': 0.57}


 57%|█████▊    | 11500/20000 [20:53:24<21:45:47,  9.22s/it][2022-12-22 10:52:49,151] [INFO] [timer.py:197:stop] 0/5501, RunningAvgSamplesPerSec=10.948682966496268, CurrSamplesPerSec=11.043178224873259, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11501/20000 [20:53:33<21:35:49,  9.15s/it][2022-12-22 10:52:58,286] [INFO] [timer.py:197:stop] 0/5502, RunningAvgSamplesPerSec=10.948692049084963, CurrSamplesPerSec=10.998866127348162, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11502/20000 [20:53:42<21:35:07,  9.14s/it][2022-12-22 10:53:07,552] [INFO] [timer.py:197:stop] 0/5503, RunningAvgSamplesPerSec=10.948584779176926, CurrSamplesPerSec=10.388772288645724, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11503/20000 [20:53:52<21:40:08,  9.18s/it][2022-12-22 10:53:17,061] [INFO] [timer.py:197:stop] 0/5504, RunningAvgSamplesPerSec=10.948595756117662, CurrSamplesPerSec=11.009314848439312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11504/20000 [20:54:01<21:53:56,  9.28s/it][2022-12-22 10:53:26,125] [INFO] [timer.py:197:stop] 0/5505, RunningAvgSamplesPerSec=10.94860787693086, CurrSamplesPerSec=11.015705360759583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11505/20000 [20:54:10<21:44:36,  9.21s/it][2022-12-22 10:53:35,046] [INFO] [timer.py:197:stop] 0/5506, RunningAvgSamplesPerSec=10.948620169913115, CurrSamplesPerSec=11.016689105486256, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11506/20000 [20:54:19<21:32:00,  9.13s/it][2022-12-22 10:53:44,954] [INFO] [timer.py:197:stop] 0/5507, RunningAvgSamplesPerSec=10.948654643491896, CurrSamplesPerSec=11.14174411176001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11507/20000 [20:54:29<22:05:02,  9.36s/it][2022-12-22 10:53:54,594] [INFO] [timer.py:197:stop] 0/5508, RunningAvgSamplesPerSec=10.948665772986757, CurrSamplesPerSec=11.010278484696872, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11508/20000 [20:54:39<22:16:45,  9.44s/it][2022-12-22 10:54:03,917] [INFO] [timer.py:197:stop] 0/5509, RunningAvgSamplesPerSec=10.948663403206035, CurrSamplesPerSec=10.935630924763712, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11509/20000 [20:54:48<22:11:24,  9.41s/it][2022-12-22 10:54:12,768] [INFO] [logging.py:68:log_dist] [Rank 0] step=11510, skipped=24, lr=[4.366666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:54:12,769] [INFO] [timer.py:197:stop] 0/5510, RunningAvgSamplesPerSec=10.948667344538073, CurrSamplesPerSec=10.970415381760285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11510/20000 [20:54:57<21:47:39,  9.24s/it][2022-12-22 10:54:23,241] [INFO] [timer.py:197:stop] 0/5511, RunningAvgSamplesPerSec=10.948660081463798, CurrSamplesPerSec=10.908800735783512, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11511/20000 [20:55:07<22:39:42,  9.61s/it][2022-12-22 10:54:32,757] [INFO] [timer.py:197:stop] 0/5512, RunningAvgSamplesPerSec=10.948625993358906, CurrSamplesPerSec=10.764001880163402, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11512/20000 [20:55:17<22:35:32,  9.58s/it][2022-12-22 10:54:42,424] [INFO] [timer.py:197:stop] 0/5513, RunningAvgSamplesPerSec=10.948596677950995, CurrSamplesPerSec=10.789417622443011, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11513/20000 [20:55:26<22:39:02,  9.61s/it][2022-12-22 10:54:52,913] [INFO] [timer.py:197:stop] 0/5514, RunningAvgSamplesPerSec=10.948559811157846, CurrSamplesPerSec=10.749089171058369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11514/20000 [20:55:37<23:16:12,  9.87s/it][2022-12-22 10:55:02,072] [INFO] [timer.py:197:stop] 0/5515, RunningAvgSamplesPerSec=10.948526642582106, CurrSamplesPerSec=10.768704773352116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11515/20000 [20:55:46<22:45:50,  9.66s/it][2022-12-22 10:55:12,570] [INFO] [timer.py:197:stop] 0/5516, RunningAvgSamplesPerSec=10.948463597033545, CurrSamplesPerSec=10.61158982799201, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11516/20000 [20:55:57<23:21:17,  9.91s/it][2022-12-22 10:55:22,179] [INFO] [timer.py:197:stop] 0/5517, RunningAvgSamplesPerSec=10.948495375000427, CurrSamplesPerSec=11.126569565490238, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11517/20000 [20:56:06<23:08:21,  9.82s/it][2022-12-22 10:55:31,718] [INFO] [timer.py:197:stop] 0/5518, RunningAvgSamplesPerSec=10.948508967193158, CurrSamplesPerSec=11.023986776248583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11518/20000 [20:56:16<22:56:17,  9.74s/it][2022-12-22 10:55:41,231] [INFO] [timer.py:197:stop] 0/5519, RunningAvgSamplesPerSec=10.948463102166555, CurrSamplesPerSec=10.701186590489385, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11519/20000 [20:56:25<22:46:39,  9.67s/it][2022-12-22 10:55:50,480] [INFO] [logging.py:68:log_dist] [Rank 0] step=11520, skipped=24, lr=[4.361538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:55:50,481] [INFO] [timer.py:197:stop] 0/5520, RunningAvgSamplesPerSec=10.948483029735709, CurrSamplesPerSec=11.05953880975446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11520/20000 [20:56:34<22:28:45,  9.54s/it][2022-12-22 10:55:59,658] [INFO] [timer.py:197:stop] 0/5521, RunningAvgSamplesPerSec=10.948516679607959, CurrSamplesPerSec=11.137400608509676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11521/20000 [20:56:44<22:13:03,  9.43s/it][2022-12-22 10:56:08,714] [INFO] [timer.py:197:stop] 0/5522, RunningAvgSamplesPerSec=10.94855415777428, CurrSamplesPerSec=11.159379834945305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11522/20000 [20:56:53<21:56:57,  9.32s/it][2022-12-22 10:56:18,419] [INFO] [timer.py:197:stop] 0/5523, RunningAvgSamplesPerSec=10.948551098455251, CurrSamplesPerSec=10.931689669797846, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11523/20000 [20:57:02<22:13:05,  9.44s/it][2022-12-22 10:56:28,592] [INFO] [timer.py:197:stop] 0/5524, RunningAvgSamplesPerSec=10.94851408969482, CurrSamplesPerSec=10.747932727628784, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11524/20000 [20:57:13<22:44:11,  9.66s/it][2022-12-22 10:56:37,852] [INFO] [timer.py:197:stop] 0/5525, RunningAvgSamplesPerSec=10.948549926277906, CurrSamplesPerSec=11.15008280459818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11525/20000 [20:57:22<22:27:13,  9.54s/it]

                                                           
{'loss': 0.0647, 'learning_rate': 4.358974358974359e-06, 'epoch': 0.58}


 58%|█████▊    | 11525/20000 [20:57:22<22:27:13,  9.54s/it][2022-12-22 10:56:47,309] [INFO] [timer.py:197:stop] 0/5526, RunningAvgSamplesPerSec=10.948569045110649, CurrSamplesPerSec=11.05519085703272, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11526/20000 [20:57:31<22:23:36,  9.51s/it][2022-12-22 10:56:56,794] [INFO] [timer.py:197:stop] 0/5527, RunningAvgSamplesPerSec=10.948600812392293, CurrSamplesPerSec=11.126942221906088, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11527/20000 [20:57:41<22:22:14,  9.50s/it][2022-12-22 10:57:05,647] [INFO] [timer.py:197:stop] 0/5528, RunningAvgSamplesPerSec=10.948622919649539, CurrSamplesPerSec=11.072143761128684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11528/20000 [20:57:50<21:54:28,  9.31s/it][2022-12-22 10:57:15,384] [INFO] [timer.py:197:stop] 0/5529, RunningAvgSamplesPerSec=10.948601256104347, CurrSamplesPerSec=10.830183527191144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11529/20000 [20:57:59<22:12:26,  9.44s/it][2022-12-22 10:57:24,916] [INFO] [logging.py:68:log_dist] [Rank 0] step=11530, skipped=24, lr=[4.3564102564102564e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:57:24,917] [INFO] [timer.py:197:stop] 0/5530, RunningAvgSamplesPerSec=10.948578459212888, CurrSamplesPerSec=10.824013814198004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11530/20000 [20:58:09<22:16:18,  9.47s/it][2022-12-22 10:57:33,812] [INFO] [timer.py:197:stop] 0/5531, RunningAvgSamplesPerSec=10.948596306724076, CurrSamplesPerSec=11.048154660649757, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11531/20000 [20:58:18<21:51:58,  9.29s/it][2022-12-22 10:57:42,982] [INFO] [timer.py:197:stop] 0/5532, RunningAvgSamplesPerSec=10.948619543043952, CurrSamplesPerSec=11.078618873500329, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11532/20000 [20:58:27<21:46:31,  9.26s/it][2022-12-22 10:57:55,429] [INFO] [timer.py:197:stop] 0/5533, RunningAvgSamplesPerSec=10.948632730594472, CurrSamplesPerSec=11.022048987768374, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11533/20000 [20:58:39<24:01:25, 10.21s/it][2022-12-22 10:58:04,960] [INFO] [timer.py:197:stop] 0/5534, RunningAvgSamplesPerSec=10.948594925355108, CurrSamplesPerSec=10.743413494466452, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11534/20000 [20:58:49<23:32:17, 10.01s/it][2022-12-22 10:58:14,382] [INFO] [timer.py:197:stop] 0/5535, RunningAvgSamplesPerSec=10.948551692672735, CurrSamplesPerSec=10.714502062987682, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11535/20000 [20:58:58<23:07:18,  9.83s/it][2022-12-22 10:58:23,569] [INFO] [timer.py:197:stop] 0/5536, RunningAvgSamplesPerSec=10.948512622400536, CurrSamplesPerSec=10.736523243422429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11536/20000 [20:59:08<22:39:48,  9.64s/it][2022-12-22 10:58:33,281] [INFO] [timer.py:197:stop] 0/5537, RunningAvgSamplesPerSec=10.948466165707284, CurrSamplesPerSec=10.69727436454668, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11537/20000 [20:59:17<22:42:42,  9.66s/it][2022-12-22 10:58:42,491] [INFO] [timer.py:197:stop] 0/5538, RunningAvgSamplesPerSec=10.948445243714474, CurrSamplesPerSec=10.83385427710808, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11538/20000 [20:59:26<22:23:25,  9.53s/it][2022-12-22 10:58:51,808] [INFO] [timer.py:197:stop] 0/5539, RunningAvgSamplesPerSec=10.948459938563346, CurrSamplesPerSec=11.030419720245675, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11539/20000 [20:59:36<22:14:30,  9.46s/it][2022-12-22 10:59:01,127] [INFO] [logging.py:68:log_dist] [Rank 0] step=11540, skipped=24, lr=[4.351282051282051e-06], mom=[[0.9, 0.999]]
[2022-12-22 10:59:01,128] [INFO] [timer.py:197:stop] 0/5540, RunningAvgSamplesPerSec=10.948464039874581, CurrSamplesPerSec=10.971220208835994, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11540/20000 [20:59:45<22:08:16,  9.42s/it][2022-12-22 10:59:11,711] [INFO] [timer.py:197:stop] 0/5541, RunningAvgSamplesPerSec=10.948500482631884, CurrSamplesPerSec=11.154111299089111, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11541/20000 [20:59:56<22:57:16,  9.77s/it][2022-12-22 10:59:20,933] [INFO] [timer.py:197:stop] 0/5542, RunningAvgSamplesPerSec=10.948479599968744, CurrSamplesPerSec=10.834019995974506, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11542/20000 [21:00:05<22:33:57,  9.60s/it][2022-12-22 10:59:30,093] [INFO] [timer.py:197:stop] 0/5543, RunningAvgSamplesPerSec=10.948477613419156, CurrSamplesPerSec=10.937483182377429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11543/20000 [21:00:14<22:14:58,  9.47s/it][2022-12-22 10:59:42,915] [INFO] [timer.py:197:stop] 0/5544, RunningAvgSamplesPerSec=10.948456580469871, CurrSamplesPerSec=10.83314073821412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11544/20000 [21:00:27<24:36:30, 10.48s/it][2022-12-22 10:59:53,343] [INFO] [timer.py:197:stop] 0/5545, RunningAvgSamplesPerSec=10.948487849504193, CurrSamplesPerSec=11.12456834792059, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11545/20000 [21:00:37<24:34:16, 10.46s/it][2022-12-22 11:00:03,454] [INFO] [timer.py:197:stop] 0/5546, RunningAvgSamplesPerSec=10.94849245178503, CurrSamplesPerSec=10.974062484452228, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11546/20000 [21:00:47<24:19:15, 10.36s/it][2022-12-22 11:00:12,238] [INFO] [timer.py:197:stop] 0/5547, RunningAvgSamplesPerSec=10.948550181289287, CurrSamplesPerSec=11.278241972803112, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11547/20000 [21:00:56<23:12:37,  9.88s/it][2022-12-22 11:00:21,714] [INFO] [timer.py:197:stop] 0/5548, RunningAvgSamplesPerSec=10.94855589685082, CurrSamplesPerSec=10.980340709656003, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11548/20000 [21:01:06<22:55:08,  9.76s/it][2022-12-22 11:00:30,756] [INFO] [timer.py:197:stop] 0/5549, RunningAvgSamplesPerSec=10.94857445506728, CurrSamplesPerSec=11.05247523598797, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11549/20000 [21:01:15<22:24:34,  9.55s/it][2022-12-22 11:00:39,960] [INFO] [logging.py:68:log_dist] [Rank 0] step=11550, skipped=24, lr=[4.346153846153846e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:00:39,961] [INFO] [timer.py:197:stop] 0/5550, RunningAvgSamplesPerSec=10.94860454502778, CurrSamplesPerSec=11.118097909920428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11550/20000 [21:01:24<22:09:59,  9.44s/it]

                                                           
{'loss': 0.0612, 'learning_rate': 4.346153846153846e-06, 'epoch': 0.58}


 58%|█████▊    | 11550/20000 [21:01:24<22:09:59,  9.44s/it][2022-12-22 11:00:49,365] [INFO] [timer.py:197:stop] 0/5551, RunningAvgSamplesPerSec=10.948606530760294, CurrSamplesPerSec=10.959634473427071, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11551/20000 [21:01:33<22:08:10,  9.43s/it][2022-12-22 11:01:00,665] [INFO] [timer.py:197:stop] 0/5552, RunningAvgSamplesPerSec=10.948597236536457, CurrSamplesPerSec=10.897265431822616, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11552/20000 [21:01:45<23:26:54,  9.99s/it][2022-12-22 11:01:11,145] [INFO] [timer.py:197:stop] 0/5553, RunningAvgSamplesPerSec=10.9485587828286, CurrSamplesPerSec=10.739221999727075, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11553/20000 [21:01:55<23:47:19, 10.14s/it][2022-12-22 11:01:20,385] [INFO] [timer.py:197:stop] 0/5554, RunningAvgSamplesPerSec=10.948601197544956, CurrSamplesPerSec=11.189220618242832, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11554/20000 [21:02:04<23:09:14,  9.87s/it][2022-12-22 11:01:29,391] [INFO] [timer.py:197:stop] 0/5555, RunningAvgSamplesPerSec=10.948566010448635, CurrSamplesPerSec=10.756632597676578, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11555/20000 [21:02:13<22:32:38,  9.61s/it][2022-12-22 11:01:39,051] [INFO] [timer.py:197:stop] 0/5556, RunningAvgSamplesPerSec=10.948566919825407, CurrSamplesPerSec=10.953619019630422, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11556/20000 [21:02:23<22:34:32,  9.62s/it][2022-12-22 11:01:47,892] [INFO] [timer.py:197:stop] 0/5557, RunningAvgSamplesPerSec=10.948585605321322, CurrSamplesPerSec=11.05335814437806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11557/20000 [21:02:32<22:01:19,  9.39s/it][2022-12-22 11:01:57,419] [INFO] [timer.py:197:stop] 0/5558, RunningAvgSamplesPerSec=10.948529863672048, CurrSamplesPerSec=10.647402965846144, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11558/20000 [21:02:41<22:06:57,  9.43s/it][2022-12-22 11:02:07,594] [INFO] [timer.py:197:stop] 0/5559, RunningAvgSamplesPerSec=10.948544149027182, CurrSamplesPerSec=11.028493262681964, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11559/20000 [21:02:52<22:38:09,  9.65s/it][2022-12-22 11:02:16,703] [INFO] [logging.py:68:log_dist] [Rank 0] step=11560, skipped=24, lr=[4.341025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:02:16,704] [INFO] [timer.py:197:stop] 0/5560, RunningAvgSamplesPerSec=10.948557024698978, CurrSamplesPerSec=11.020577882347222, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11560/20000 [21:03:01<22:15:02,  9.49s/it][2022-12-22 11:02:26,459] [INFO] [timer.py:197:stop] 0/5561, RunningAvgSamplesPerSec=10.948549871683493, CurrSamplesPerSec=10.908937279051065, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11561/20000 [21:03:10<22:26:02,  9.57s/it][2022-12-22 11:02:35,668] [INFO] [timer.py:197:stop] 0/5562, RunningAvgSamplesPerSec=10.948539142324112, CurrSamplesPerSec=10.889217857045645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11562/20000 [21:03:20<22:10:40,  9.46s/it][2022-12-22 11:02:44,822] [INFO] [timer.py:197:stop] 0/5563, RunningAvgSamplesPerSec=10.948535188677623, CurrSamplesPerSec=10.926596969287456, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11563/20000 [21:03:29<21:57:31,  9.37s/it][2022-12-22 11:02:53,582] [INFO] [timer.py:197:stop] 0/5564, RunningAvgSamplesPerSec=10.94857728816687, CurrSamplesPerSec=11.187808999478527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11564/20000 [21:03:38<21:31:38,  9.19s/it][2022-12-22 11:03:02,962] [INFO] [timer.py:197:stop] 0/5565, RunningAvgSamplesPerSec=10.948599129141625, CurrSamplesPerSec=11.07144186978058, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11565/20000 [21:03:47<21:39:37,  9.24s/it][2022-12-22 11:03:12,327] [INFO] [timer.py:197:stop] 0/5566, RunningAvgSamplesPerSec=10.948596109114705, CurrSamplesPerSec=10.931821444382603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11566/20000 [21:03:56<21:44:33,  9.28s/it][2022-12-22 11:03:21,320] [INFO] [timer.py:197:stop] 0/5567, RunningAvgSamplesPerSec=10.948561663174987, CurrSamplesPerSec=10.760202322806403, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11567/20000 [21:04:05<21:32:16,  9.19s/it][2022-12-22 11:03:30,548] [INFO] [timer.py:197:stop] 0/5568, RunningAvgSamplesPerSec=10.948570446250136, CurrSamplesPerSec=10.99766748322985, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11568/20000 [21:04:15<21:33:32,  9.20s/it][2022-12-22 11:03:40,509] [INFO] [timer.py:197:stop] 0/5569, RunningAvgSamplesPerSec=10.948532913169776, CurrSamplesPerSec=10.74353603916214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11569/20000 [21:04:24<22:05:17,  9.43s/it][2022-12-22 11:03:50,603] [INFO] [logging.py:68:log_dist] [Rank 0] step=11570, skipped=24, lr=[4.335897435897437e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:03:50,604] [INFO] [timer.py:197:stop] 0/5570, RunningAvgSamplesPerSec=10.948535248139862, CurrSamplesPerSec=10.961549480693725, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11570/20000 [21:04:35<22:33:04,  9.63s/it][2022-12-22 11:03:59,801] [INFO] [timer.py:197:stop] 0/5571, RunningAvgSamplesPerSec=10.948524215067003, CurrSamplesPerSec=10.88743489898087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11571/20000 [21:04:44<22:14:40,  9.50s/it][2022-12-22 11:04:08,946] [INFO] [timer.py:197:stop] 0/5572, RunningAvgSamplesPerSec=10.948541212013302, CurrSamplesPerSec=11.044022843954787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11572/20000 [21:04:53<21:59:30,  9.39s/it][2022-12-22 11:04:18,029] [INFO] [timer.py:197:stop] 0/5573, RunningAvgSamplesPerSec=10.948509880866832, CurrSamplesPerSec=10.776733920689459, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11573/20000 [21:05:02<21:46:15,  9.30s/it][2022-12-22 11:04:27,403] [INFO] [timer.py:197:stop] 0/5574, RunningAvgSamplesPerSec=10.948543725492517, CurrSamplesPerSec=11.140396690162163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11574/20000 [21:05:11<21:49:13,  9.32s/it][2022-12-22 11:04:36,408] [INFO] [timer.py:197:stop] 0/5575, RunningAvgSamplesPerSec=10.948504794304357, CurrSamplesPerSec=10.735795417164741, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11575/20000 [21:05:20<21:35:40,  9.23s/it]

                                                           
{'loss': 0.0523, 'learning_rate': 4.333333333333334e-06, 'epoch': 0.58}


 58%|█████▊    | 11575/20000 [21:05:20<21:35:40,  9.23s/it][2022-12-22 11:04:45,752] [INFO] [timer.py:197:stop] 0/5576, RunningAvgSamplesPerSec=10.948476971977854, CurrSamplesPerSec=10.795588758643525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11576/20000 [21:05:30<21:40:24,  9.26s/it][2022-12-22 11:04:56,225] [INFO] [timer.py:197:stop] 0/5577, RunningAvgSamplesPerSec=10.948518979528684, CurrSamplesPerSec=11.187787084188857, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11577/20000 [21:05:40<22:31:14,  9.63s/it][2022-12-22 11:05:05,347] [INFO] [timer.py:197:stop] 0/5578, RunningAvgSamplesPerSec=10.948508047825852, CurrSamplesPerSec=10.88790122944024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11578/20000 [21:05:49<22:09:53,  9.47s/it][2022-12-22 11:05:14,781] [INFO] [timer.py:197:stop] 0/5579, RunningAvgSamplesPerSec=10.948507577665392, CurrSamplesPerSec=10.94588659063787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11579/20000 [21:05:59<22:08:03,  9.46s/it][2022-12-22 11:05:24,171] [INFO] [logging.py:68:log_dist] [Rank 0] step=11580, skipped=24, lr=[4.330769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:05:24,172] [INFO] [timer.py:197:stop] 0/5580, RunningAvgSamplesPerSec=10.948521524415373, CurrSamplesPerSec=11.026859179070861, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11580/20000 [21:06:08<22:04:51,  9.44s/it][2022-12-22 11:05:34,778] [INFO] [timer.py:197:stop] 0/5581, RunningAvgSamplesPerSec=10.94856815313138, CurrSamplesPerSec=11.21499348517504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11581/20000 [21:06:19<22:53:46,  9.79s/it][2022-12-22 11:05:43,872] [INFO] [timer.py:197:stop] 0/5582, RunningAvgSamplesPerSec=10.94857059914207, CurrSamplesPerSec=10.962233925797031, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11582/20000 [21:06:28<22:24:16,  9.58s/it][2022-12-22 11:05:53,140] [INFO] [timer.py:197:stop] 0/5583, RunningAvgSamplesPerSec=10.948609060221743, CurrSamplesPerSec=11.16751358406415, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11583/20000 [21:06:37<22:10:57,  9.49s/it][2022-12-22 11:06:02,374] [INFO] [timer.py:197:stop] 0/5584, RunningAvgSamplesPerSec=10.94855062996948, CurrSamplesPerSec=10.631884874905502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11584/20000 [21:06:46<22:00:07,  9.41s/it][2022-12-22 11:06:11,241] [INFO] [timer.py:197:stop] 0/5585, RunningAvgSamplesPerSec=10.948574351321112, CurrSamplesPerSec=11.08260823881435, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11585/20000 [21:06:55<21:37:02,  9.25s/it][2022-12-22 11:06:20,852] [INFO] [timer.py:197:stop] 0/5586, RunningAvgSamplesPerSec=10.948558581451262, CurrSamplesPerSec=10.86121787695121, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11586/20000 [21:07:05<21:52:08,  9.36s/it][2022-12-22 11:06:29,849] [INFO] [timer.py:197:stop] 0/5587, RunningAvgSamplesPerSec=10.948522644880612, CurrSamplesPerSec=10.751465244371076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11587/20000 [21:07:14<21:36:51,  9.25s/it][2022-12-22 11:06:39,309] [INFO] [timer.py:197:stop] 0/5588, RunningAvgSamplesPerSec=10.948501050223406, CurrSamplesPerSec=10.829209216327806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11588/20000 [21:07:23<21:45:35,  9.31s/it][2022-12-22 11:06:48,749] [INFO] [timer.py:197:stop] 0/5589, RunningAvgSamplesPerSec=10.948484746344972, CurrSamplesPerSec=10.858162747053273, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11589/20000 [21:07:33<21:50:48,  9.35s/it][2022-12-22 11:06:58,271] [INFO] [logging.py:68:log_dist] [Rank 0] step=11590, skipped=24, lr=[4.325641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:06:58,272] [INFO] [timer.py:197:stop] 0/5590, RunningAvgSamplesPerSec=10.948472795070092, CurrSamplesPerSec=10.882105848797138, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11590/20000 [21:07:42<21:57:54,  9.40s/it][2022-12-22 11:07:07,710] [INFO] [timer.py:197:stop] 0/5591, RunningAvgSamplesPerSec=10.948476624163945, CurrSamplesPerSec=10.96991550684532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11591/20000 [21:07:52<21:59:16,  9.41s/it][2022-12-22 11:07:17,583] [INFO] [timer.py:197:stop] 0/5592, RunningAvgSamplesPerSec=10.94844843970943, CurrSamplesPerSec=10.793160163252729, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11592/20000 [21:08:02<22:18:24,  9.55s/it][2022-12-22 11:07:26,791] [INFO] [timer.py:197:stop] 0/5593, RunningAvgSamplesPerSec=10.948419353787331, CurrSamplesPerSec=10.788208695007748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11593/20000 [21:08:11<22:03:49,  9.45s/it][2022-12-22 11:07:36,360] [INFO] [timer.py:197:stop] 0/5594, RunningAvgSamplesPerSec=10.948409314312054, CurrSamplesPerSec=10.892564964107166, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11594/20000 [21:08:20<22:08:44,  9.48s/it][2022-12-22 11:07:45,612] [INFO] [timer.py:197:stop] 0/5595, RunningAvgSamplesPerSec=10.948410851558794, CurrSamplesPerSec=10.957013891323799, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11595/20000 [21:08:30<21:58:51,  9.41s/it][2022-12-22 11:07:55,063] [INFO] [timer.py:197:stop] 0/5596, RunningAvgSamplesPerSec=10.948409054996969, CurrSamplesPerSec=10.938370099847935, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11596/20000 [21:08:39<22:00:12,  9.43s/it][2022-12-22 11:08:04,338] [INFO] [timer.py:197:stop] 0/5597, RunningAvgSamplesPerSec=10.948423075056658, CurrSamplesPerSec=11.027417259079266, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11597/20000 [21:08:48<21:53:44,  9.38s/it][2022-12-22 11:08:13,683] [INFO] [timer.py:197:stop] 0/5598, RunningAvgSamplesPerSec=10.94842938486692, CurrSamplesPerSec=10.983846998362583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11598/20000 [21:08:58<21:52:03,  9.37s/it][2022-12-22 11:08:22,868] [INFO] [timer.py:197:stop] 0/5599, RunningAvgSamplesPerSec=10.948431937376492, CurrSamplesPerSec=10.96273444400896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11599/20000 [21:09:07<21:44:08,  9.31s/it][2022-12-22 11:08:31,978] [INFO] [logging.py:68:log_dist] [Rank 0] step=11600, skipped=24, lr=[4.320512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:08:31,979] [INFO] [timer.py:197:stop] 0/5600, RunningAvgSamplesPerSec=10.94843364534402, CurrSamplesPerSec=10.958001495136926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11600/20000 [21:09:16<21:35:27,  9.25s/it]

                                                           
{'loss': 0.0542, 'learning_rate': 4.320512820512821e-06, 'epoch': 0.58}


 58%|█████▊    | 11600/20000 [21:09:16<21:35:27,  9.25s/it][2022-12-22 11:08:41,328] [INFO] [timer.py:197:stop] 0/5601, RunningAvgSamplesPerSec=10.948409643186157, CurrSamplesPerSec=10.815674838983972, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11601/20000 [21:09:25<21:39:19,  9.28s/it][2022-12-22 11:08:50,501] [INFO] [timer.py:197:stop] 0/5602, RunningAvgSamplesPerSec=10.948408584044255, CurrSamplesPerSec=10.94248165939486, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11602/20000 [21:09:34<21:34:35,  9.25s/it][2022-12-22 11:09:00,862] [INFO] [timer.py:197:stop] 0/5603, RunningAvgSamplesPerSec=10.948386031766068, CurrSamplesPerSec=10.823533737949926, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11603/20000 [21:09:45<22:21:07,  9.58s/it][2022-12-22 11:09:10,801] [INFO] [timer.py:197:stop] 0/5604, RunningAvgSamplesPerSec=10.948378646514337, CurrSamplesPerSec=10.907169574089028, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11604/20000 [21:09:55<22:35:55,  9.69s/it][2022-12-22 11:09:19,966] [INFO] [timer.py:197:stop] 0/5605, RunningAvgSamplesPerSec=10.94837887515629, CurrSamplesPerSec=10.949659877264978, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11605/20000 [21:10:04<22:13:44,  9.53s/it][2022-12-22 11:09:28,934] [INFO] [timer.py:197:stop] 0/5606, RunningAvgSamplesPerSec=10.94836908192849, CurrSamplesPerSec=10.89377131061097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11606/20000 [21:10:13<21:49:54,  9.36s/it][2022-12-22 11:09:39,157] [INFO] [timer.py:197:stop] 0/5607, RunningAvgSamplesPerSec=10.948367769027847, CurrSamplesPerSec=10.941015215743688, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11607/20000 [21:10:23<22:25:49,  9.62s/it][2022-12-22 11:09:49,336] [INFO] [timer.py:197:stop] 0/5608, RunningAvgSamplesPerSec=10.94827747120911, CurrSamplesPerSec=10.464525189276074, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11608/20000 [21:10:33<22:49:02,  9.79s/it][2022-12-22 11:09:58,523] [INFO] [timer.py:197:stop] 0/5609, RunningAvgSamplesPerSec=10.948271711820055, CurrSamplesPerSec=10.916079530459118, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11609/20000 [21:10:42<22:23:39,  9.61s/it][2022-12-22 11:10:07,519] [INFO] [logging.py:68:log_dist] [Rank 0] step=11610, skipped=24, lr=[4.315384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:10:07,520] [INFO] [timer.py:197:stop] 0/5610, RunningAvgSamplesPerSec=10.948276413721599, CurrSamplesPerSec=10.974703624019357, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11610/20000 [21:10:51<21:57:52,  9.42s/it][2022-12-22 11:10:16,792] [INFO] [timer.py:197:stop] 0/5611, RunningAvgSamplesPerSec=10.948226949538125, CurrSamplesPerSec=10.677687682213207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11611/20000 [21:11:01<21:51:18,  9.38s/it][2022-12-22 11:10:26,590] [INFO] [timer.py:197:stop] 0/5612, RunningAvgSamplesPerSec=10.948236063442392, CurrSamplesPerSec=10.999595805954076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11612/20000 [21:11:11<22:08:44,  9.50s/it][2022-12-22 11:10:38,477] [INFO] [timer.py:197:stop] 0/5613, RunningAvgSamplesPerSec=10.948237712214635, CurrSamplesPerSec=10.95749514703004, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11613/20000 [21:11:22<23:48:30, 10.22s/it][2022-12-22 11:10:47,764] [INFO] [timer.py:197:stop] 0/5614, RunningAvgSamplesPerSec=10.948210225241956, CurrSamplesPerSec=10.796123673934332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11614/20000 [21:11:32<23:09:12,  9.94s/it][2022-12-22 11:10:56,625] [INFO] [timer.py:197:stop] 0/5615, RunningAvgSamplesPerSec=10.948222264270326, CurrSamplesPerSec=11.01620489667188, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11615/20000 [21:11:41<22:23:50,  9.62s/it][2022-12-22 11:11:06,083] [INFO] [timer.py:197:stop] 0/5616, RunningAvgSamplesPerSec=10.94817540901473, CurrSamplesPerSec=10.691347512951092, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11616/20000 [21:11:50<22:17:03,  9.57s/it][2022-12-22 11:11:15,972] [INFO] [timer.py:197:stop] 0/5617, RunningAvgSamplesPerSec=10.948137218214562, CurrSamplesPerSec=10.737852908285728, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11617/20000 [21:12:00<22:30:20,  9.66s/it][2022-12-22 11:11:24,816] [INFO] [timer.py:197:stop] 0/5618, RunningAvgSamplesPerSec=10.94816670597101, CurrSamplesPerSec=11.116283411221243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11618/20000 [21:12:09<21:55:46,  9.42s/it][2022-12-22 11:11:33,653] [INFO] [timer.py:197:stop] 0/5619, RunningAvgSamplesPerSec=10.948182196226327, CurrSamplesPerSec=11.035872372440275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11619/20000 [21:12:18<21:31:14,  9.24s/it][2022-12-22 11:11:42,912] [INFO] [logging.py:68:log_dist] [Rank 0] step=11620, skipped=24, lr=[4.3102564102564105e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:11:42,913] [INFO] [timer.py:197:stop] 0/5620, RunningAvgSamplesPerSec=10.9481925662482, CurrSamplesPerSec=11.006752595470967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11620/20000 [21:12:27<21:31:43,  9.25s/it][2022-12-22 11:11:51,947] [INFO] [timer.py:197:stop] 0/5621, RunningAvgSamplesPerSec=10.948230633908068, CurrSamplesPerSec=11.166356401653534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11621/20000 [21:12:36<21:22:36,  9.18s/it][2022-12-22 11:12:00,973] [INFO] [timer.py:197:stop] 0/5622, RunningAvgSamplesPerSec=10.948181467135578, CurrSamplesPerSec=10.678714357138787, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11622/20000 [21:12:45<21:15:48,  9.14s/it][2022-12-22 11:12:11,114] [INFO] [timer.py:197:stop] 0/5623, RunningAvgSamplesPerSec=10.94817445610427, CurrSamplesPerSec=10.908913782725822, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11623/20000 [21:12:55<21:57:42,  9.44s/it][2022-12-22 11:12:20,954] [INFO] [timer.py:197:stop] 0/5624, RunningAvgSamplesPerSec=10.948169714895496, CurrSamplesPerSec=10.921584107304469, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11624/20000 [21:13:05<22:14:23,  9.56s/it][2022-12-22 11:12:33,321] [INFO] [timer.py:197:stop] 0/5625, RunningAvgSamplesPerSec=10.948163453248245, CurrSamplesPerSec=10.913073322100804, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11625/20000 [21:13:17<24:11:50, 10.40s/it]

                                                           
{'loss': 0.0536, 'learning_rate': 4.307692307692308e-06, 'epoch': 0.58}


 58%|█████▊    | 11625/20000 [21:13:17<24:11:50, 10.40s/it][2022-12-22 11:12:43,368] [INFO] [timer.py:197:stop] 0/5626, RunningAvgSamplesPerSec=10.948099776055534, CurrSamplesPerSec=10.601384245746173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11626/20000 [21:13:27<23:56:50, 10.30s/it][2022-12-22 11:12:52,766] [INFO] [timer.py:197:stop] 0/5627, RunningAvgSamplesPerSec=10.948049779715497, CurrSamplesPerSec=10.673912304397266, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11627/20000 [21:13:37<23:19:05, 10.03s/it][2022-12-22 11:13:01,664] [INFO] [timer.py:197:stop] 0/5628, RunningAvgSamplesPerSec=10.948065677791744, CurrSamplesPerSec=11.038228965051472, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11628/20000 [21:13:46<22:31:43,  9.69s/it][2022-12-22 11:13:11,134] [INFO] [timer.py:197:stop] 0/5629, RunningAvgSamplesPerSec=10.948104244105476, CurrSamplesPerSec=11.169466147152592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11629/20000 [21:13:55<22:22:29,  9.62s/it][2022-12-22 11:13:20,060] [INFO] [logging.py:68:log_dist] [Rank 0] step=11630, skipped=24, lr=[4.3051282051282054e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:13:20,061] [INFO] [timer.py:197:stop] 0/5630, RunningAvgSamplesPerSec=10.948099119749124, CurrSamplesPerSec=10.91934012453156, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11630/20000 [21:14:04<21:53:12,  9.41s/it][2022-12-22 11:13:29,354] [INFO] [timer.py:197:stop] 0/5631, RunningAvgSamplesPerSec=10.948088012525089, CurrSamplesPerSec=10.885931520232445, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11631/20000 [21:14:13<21:47:58,  9.38s/it][2022-12-22 11:13:38,425] [INFO] [timer.py:197:stop] 0/5632, RunningAvgSamplesPerSec=10.94808926782784, CurrSamplesPerSec=10.955159931350746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11632/20000 [21:14:22<21:35:00,  9.29s/it][2022-12-22 11:13:48,206] [INFO] [timer.py:197:stop] 0/5633, RunningAvgSamplesPerSec=10.948016235749849, CurrSamplesPerSec=10.551731403182334, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11633/20000 [21:14:32<21:55:36,  9.43s/it][2022-12-22 11:13:59,131] [INFO] [timer.py:197:stop] 0/5634, RunningAvgSamplesPerSec=10.948064749391204, CurrSamplesPerSec=11.228237277868482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11634/20000 [21:14:43<22:57:48,  9.88s/it][2022-12-22 11:14:08,034] [INFO] [timer.py:197:stop] 0/5635, RunningAvgSamplesPerSec=10.94810264872512, CurrSamplesPerSec=11.165796710593115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11635/20000 [21:14:52<22:16:43,  9.59s/it][2022-12-22 11:14:17,222] [INFO] [timer.py:197:stop] 0/5636, RunningAvgSamplesPerSec=10.948074625863308, CurrSamplesPerSec=10.792465859665175, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11636/20000 [21:15:01<21:59:50,  9.47s/it][2022-12-22 11:14:26,331] [INFO] [timer.py:197:stop] 0/5637, RunningAvgSamplesPerSec=10.948097019764205, CurrSamplesPerSec=11.075735439590648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11637/20000 [21:15:10<21:44:39,  9.36s/it][2022-12-22 11:14:35,260] [INFO] [timer.py:197:stop] 0/5638, RunningAvgSamplesPerSec=10.94809246362044, CurrSamplesPerSec=10.922478669902452, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11638/20000 [21:15:19<21:26:28,  9.23s/it][2022-12-22 11:14:44,826] [INFO] [timer.py:197:stop] 0/5639, RunningAvgSamplesPerSec=10.948096321530935, CurrSamplesPerSec=10.969882781197603, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11639/20000 [21:15:29<21:40:18,  9.33s/it][2022-12-22 11:14:54,038] [INFO] [logging.py:68:log_dist] [Rank 0] step=11640, skipped=24, lr=[4.3e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:14:54,039] [INFO] [timer.py:197:stop] 0/5640, RunningAvgSamplesPerSec=10.948055811940852, CurrSamplesPerSec=10.724369684916967, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11640/20000 [21:15:38<21:35:12,  9.30s/it][2022-12-22 11:15:03,125] [INFO] [timer.py:197:stop] 0/5641, RunningAvgSamplesPerSec=10.948109538188815, CurrSamplesPerSec=11.259638943020624, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11641/20000 [21:15:47<21:26:17,  9.23s/it][2022-12-22 11:15:12,020] [INFO] [timer.py:197:stop] 0/5642, RunningAvgSamplesPerSec=10.948087372807185, CurrSamplesPerSec=10.824507900766406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11642/20000 [21:15:56<21:12:01,  9.13s/it][2022-12-22 11:15:21,625] [INFO] [timer.py:197:stop] 0/5643, RunningAvgSamplesPerSec=10.94813933771845, CurrSamplesPerSec=11.249284534817406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11643/20000 [21:16:06<21:31:38,  9.27s/it][2022-12-22 11:15:31,698] [INFO] [timer.py:197:stop] 0/5644, RunningAvgSamplesPerSec=10.948112890373032, CurrSamplesPerSec=10.80092943321602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11644/20000 [21:16:16<22:04:55,  9.51s/it][2022-12-22 11:15:41,554] [INFO] [timer.py:197:stop] 0/5645, RunningAvgSamplesPerSec=10.94813253149431, CurrSamplesPerSec=11.060081063311879, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11645/20000 [21:16:26<22:19:02,  9.62s/it][2022-12-22 11:15:50,693] [INFO] [timer.py:197:stop] 0/5646, RunningAvgSamplesPerSec=10.948110261753165, CurrSamplesPerSec=10.823868477530032, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11646/20000 [21:16:35<21:58:59,  9.47s/it][2022-12-22 11:15:59,832] [INFO] [timer.py:197:stop] 0/5647, RunningAvgSamplesPerSec=10.948139531146436, CurrSamplesPerSec=11.115867278836504, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11647/20000 [21:16:44<21:44:51,  9.37s/it][2022-12-22 11:16:08,881] [INFO] [timer.py:197:stop] 0/5648, RunningAvgSamplesPerSec=10.948168765257527, CurrSamplesPerSec=11.115721363685735, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11648/20000 [21:16:53<21:31:10,  9.28s/it][2022-12-22 11:16:17,725] [INFO] [timer.py:197:stop] 0/5649, RunningAvgSamplesPerSec=10.948168412510157, CurrSamplesPerSec=10.946177163149285, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11649/20000 [21:17:02<21:12:59,  9.15s/it][2022-12-22 11:16:27,159] [INFO] [logging.py:68:log_dist] [Rank 0] step=11650, skipped=24, lr=[4.294871794871795e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:16:27,160] [INFO] [timer.py:197:stop] 0/5650, RunningAvgSamplesPerSec=10.948151410596887, CurrSamplesPerSec=10.85297639142534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11650/20000 [21:17:11<21:24:52,  9.23s/it]

                                                           
{'loss': 0.0529, 'learning_rate': 4.294871794871795e-06, 'epoch': 0.58}


 58%|█████▊    | 11650/20000 [21:17:11<21:24:52,  9.23s/it][2022-12-22 11:16:37,334] [INFO] [timer.py:197:stop] 0/5651, RunningAvgSamplesPerSec=10.948072978405882, CurrSamplesPerSec=10.522318067808794, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11651/20000 [21:17:21<22:04:03,  9.52s/it][2022-12-22 11:16:46,738] [INFO] [timer.py:197:stop] 0/5652, RunningAvgSamplesPerSec=10.948103660390805, CurrSamplesPerSec=11.124214751371207, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11652/20000 [21:17:31<21:59:15,  9.48s/it][2022-12-22 11:16:55,912] [INFO] [timer.py:197:stop] 0/5653, RunningAvgSamplesPerSec=10.94814612009861, CurrSamplesPerSec=11.19341887217182, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11653/20000 [21:17:40<21:46:13,  9.39s/it][2022-12-22 11:17:04,905] [INFO] [timer.py:197:stop] 0/5654, RunningAvgSamplesPerSec=10.948120059680106, CurrSamplesPerSec=10.802807634612309, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11654/20000 [21:17:49<21:29:31,  9.27s/it][2022-12-22 11:17:14,740] [INFO] [timer.py:197:stop] 0/5655, RunningAvgSamplesPerSec=10.948137818862042, CurrSamplesPerSec=11.049441654984442, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11655/20000 [21:17:59<21:52:55,  9.44s/it][2022-12-22 11:17:24,727] [INFO] [timer.py:197:stop] 0/5656, RunningAvgSamplesPerSec=10.94813939141411, CurrSamplesPerSec=10.957036253570617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11656/20000 [21:18:09<22:15:36,  9.60s/it][2022-12-22 11:17:35,502] [INFO] [timer.py:197:stop] 0/5657, RunningAvgSamplesPerSec=10.94814208622471, CurrSamplesPerSec=10.963399783154298, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11657/20000 [21:18:19<23:04:16,  9.96s/it][2022-12-22 11:17:44,606] [INFO] [timer.py:197:stop] 0/5658, RunningAvgSamplesPerSec=10.948148738531629, CurrSamplesPerSec=10.98589726432449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11658/20000 [21:18:29<22:28:37,  9.70s/it][2022-12-22 11:17:53,828] [INFO] [timer.py:197:stop] 0/5659, RunningAvgSamplesPerSec=10.948159637906361, CurrSamplesPerSec=11.010155650076532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11659/20000 [21:18:38<22:08:30,  9.56s/it][2022-12-22 11:18:02,761] [INFO] [logging.py:68:log_dist] [Rank 0] step=11660, skipped=24, lr=[4.28974358974359e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:18:02,762] [INFO] [timer.py:197:stop] 0/5660, RunningAvgSamplesPerSec=10.94818346825107, CurrSamplesPerSec=11.084672657600624, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11660/20000 [21:18:47<21:42:23,  9.37s/it][2022-12-22 11:18:13,579] [INFO] [timer.py:197:stop] 0/5661, RunningAvgSamplesPerSec=10.948181638918316, CurrSamplesPerSec=10.937841051866185, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11661/20000 [21:18:58<22:42:36,  9.80s/it][2022-12-22 11:18:23,016] [INFO] [timer.py:197:stop] 0/5662, RunningAvgSamplesPerSec=10.94822264877256, CurrSamplesPerSec=11.185324259472248, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11662/20000 [21:19:07<22:27:06,  9.69s/it][2022-12-22 11:18:32,395] [INFO] [timer.py:197:stop] 0/5663, RunningAvgSamplesPerSec=10.948256255132545, CurrSamplesPerSec=11.141831978296386, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11663/20000 [21:19:16<22:13:51,  9.60s/it][2022-12-22 11:18:41,182] [INFO] [timer.py:197:stop] 0/5664, RunningAvgSamplesPerSec=10.94829140835294, CurrSamplesPerSec=11.150978597601544, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11664/20000 [21:19:25<21:39:48,  9.36s/it][2022-12-22 11:18:51,804] [INFO] [timer.py:197:stop] 0/5665, RunningAvgSamplesPerSec=10.948236205346236, CurrSamplesPerSec=10.644353803150748, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11665/20000 [21:19:36<22:32:25,  9.74s/it][2022-12-22 11:19:03,644] [INFO] [timer.py:197:stop] 0/5666, RunningAvgSamplesPerSec=10.948212652627937, CurrSamplesPerSec=10.816439251251513, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11666/20000 [21:19:48<23:59:58, 10.37s/it][2022-12-22 11:19:12,696] [INFO] [timer.py:197:stop] 0/5667, RunningAvgSamplesPerSec=10.948219832960744, CurrSamplesPerSec=10.989040902980076, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11667/20000 [21:19:57<23:05:00,  9.97s/it][2022-12-22 11:19:22,668] [INFO] [timer.py:197:stop] 0/5668, RunningAvgSamplesPerSec=10.948268749536993, CurrSamplesPerSec=11.232578611283476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11668/20000 [21:20:07<23:04:48,  9.97s/it][2022-12-22 11:19:32,887] [INFO] [timer.py:197:stop] 0/5669, RunningAvgSamplesPerSec=10.94827346620003, CurrSamplesPerSec=10.97506348464573, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11669/20000 [21:20:17<23:14:56, 10.05s/it][2022-12-22 11:19:42,231] [INFO] [logging.py:68:log_dist] [Rank 0] step=11670, skipped=24, lr=[4.284615384615385e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:19:42,232] [INFO] [timer.py:197:stop] 0/5670, RunningAvgSamplesPerSec=10.94828750692104, CurrSamplesPerSec=11.028438891147376, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11670/20000 [21:20:26<22:45:32,  9.84s/it][2022-12-22 11:19:51,544] [INFO] [timer.py:197:stop] 0/5671, RunningAvgSamplesPerSec=10.948253731994628, CurrSamplesPerSec=10.76010786425119, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11671/20000 [21:20:36<22:23:34,  9.68s/it][2022-12-22 11:20:02,025] [INFO] [timer.py:197:stop] 0/5672, RunningAvgSamplesPerSec=10.948251966405323, CurrSamplesPerSec=10.938251984445774, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11672/20000 [21:20:46<22:56:49,  9.92s/it][2022-12-22 11:20:11,083] [INFO] [timer.py:197:stop] 0/5673, RunningAvgSamplesPerSec=10.948295887022033, CurrSamplesPerSec=11.20312310497534, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11673/20000 [21:20:55<22:20:46,  9.66s/it][2022-12-22 11:20:20,552] [INFO] [timer.py:197:stop] 0/5674, RunningAvgSamplesPerSec=10.948281803884118, CurrSamplesPerSec=10.868994813129405, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11674/20000 [21:21:05<22:12:37,  9.60s/it][2022-12-22 11:20:29,469] [INFO] [timer.py:197:stop] 0/5675, RunningAvgSamplesPerSec=10.948277972812825, CurrSamplesPerSec=10.926591187353955, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11675/20000 [21:21:13<21:43:53,  9.40s/it]

                                                           
{'loss': 0.0471, 'learning_rate': 4.282051282051282e-06, 'epoch': 0.58}


 58%|█████▊    | 11675/20000 [21:21:13<21:43:53,  9.40s/it][2022-12-22 11:20:39,903] [INFO] [timer.py:197:stop] 0/5676, RunningAvgSamplesPerSec=10.948198921031125, CurrSamplesPerSec=10.51738816907015, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11676/20000 [21:21:24<22:26:51,  9.71s/it][2022-12-22 11:20:49,862] [INFO] [timer.py:197:stop] 0/5677, RunningAvgSamplesPerSec=10.948162089626772, CurrSamplesPerSec=10.743095751242617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11677/20000 [21:21:34<22:37:08,  9.78s/it][2022-12-22 11:20:59,598] [INFO] [timer.py:197:stop] 0/5678, RunningAvgSamplesPerSec=10.948116882236867, CurrSamplesPerSec=10.697440194403084, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11678/20000 [21:21:44<22:35:01,  9.77s/it][2022-12-22 11:21:10,227] [INFO] [timer.py:197:stop] 0/5679, RunningAvgSamplesPerSec=10.94808744108278, CurrSamplesPerSec=10.783492220199713, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11679/20000 [21:21:54<23:10:37, 10.03s/it][2022-12-22 11:21:20,404] [INFO] [logging.py:68:log_dist] [Rank 0] step=11680, skipped=24, lr=[4.27948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:21:20,405] [INFO] [timer.py:197:stop] 0/5680, RunningAvgSamplesPerSec=10.948040488813467, CurrSamplesPerSec=10.68782885169391, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11680/20000 [21:22:04<23:16:41, 10.07s/it][2022-12-22 11:21:29,822] [INFO] [timer.py:197:stop] 0/5681, RunningAvgSamplesPerSec=10.947995413263822, CurrSamplesPerSec=10.697904033744798, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11681/20000 [21:22:14<22:49:17,  9.88s/it][2022-12-22 11:21:39,593] [INFO] [timer.py:197:stop] 0/5682, RunningAvgSamplesPerSec=10.94802327639633, CurrSamplesPerSec=11.108578969205409, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11682/20000 [21:22:24<22:44:44,  9.84s/it][2022-12-22 11:21:48,998] [INFO] [timer.py:197:stop] 0/5683, RunningAvgSamplesPerSec=10.947963035536697, CurrSamplesPerSec=10.616166753046752, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11683/20000 [21:22:33<22:26:19,  9.71s/it][2022-12-22 11:21:58,119] [INFO] [timer.py:197:stop] 0/5684, RunningAvgSamplesPerSec=10.947999305987992, CurrSamplesPerSec=11.158004954514066, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11684/20000 [21:22:42<22:01:33,  9.54s/it][2022-12-22 11:22:06,986] [INFO] [timer.py:197:stop] 0/5685, RunningAvgSamplesPerSec=10.948055230014313, CurrSamplesPerSec=11.275315746948127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11685/20000 [21:22:51<21:33:39,  9.33s/it][2022-12-22 11:22:16,333] [INFO] [timer.py:197:stop] 0/5686, RunningAvgSamplesPerSec=10.948119377760662, CurrSamplesPerSec=11.325230309738732, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11686/20000 [21:23:00<21:33:58,  9.34s/it][2022-12-22 11:22:25,581] [INFO] [timer.py:197:stop] 0/5687, RunningAvgSamplesPerSec=10.948046398286044, CurrSamplesPerSec=10.548376978748141, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11687/20000 [21:23:10<21:30:03,  9.31s/it][2022-12-22 11:22:35,108] [INFO] [timer.py:197:stop] 0/5688, RunningAvgSamplesPerSec=10.948096964028316, CurrSamplesPerSec=11.24331619945354, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11688/20000 [21:23:19<21:38:53,  9.38s/it][2022-12-22 11:22:45,524] [INFO] [timer.py:197:stop] 0/5689, RunningAvgSamplesPerSec=10.94808623113699, CurrSamplesPerSec=10.887397364648772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11689/20000 [21:23:29<22:21:56,  9.69s/it][2022-12-22 11:22:54,768] [INFO] [logging.py:68:log_dist] [Rank 0] step=11690, skipped=24, lr=[4.274358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:22:54,769] [INFO] [timer.py:197:stop] 0/5690, RunningAvgSamplesPerSec=10.948047505064219, CurrSamplesPerSec=10.732156049245933, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11690/20000 [21:23:39<22:03:22,  9.56s/it][2022-12-22 11:23:03,803] [INFO] [timer.py:197:stop] 0/5691, RunningAvgSamplesPerSec=10.948046688603974, CurrSamplesPerSec=10.943404632183025, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11691/20000 [21:23:48<21:41:33,  9.40s/it][2022-12-22 11:23:12,897] [INFO] [timer.py:197:stop] 0/5692, RunningAvgSamplesPerSec=10.948081282376048, CurrSamplesPerSec=11.148488426851634, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11692/20000 [21:23:57<21:28:45,  9.31s/it][2022-12-22 11:23:22,069] [INFO] [timer.py:197:stop] 0/5693, RunningAvgSamplesPerSec=10.948035113792953, CurrSamplesPerSec=10.691492719194844, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11693/20000 [21:24:06<21:22:57,  9.27s/it][2022-12-22 11:23:31,195] [INFO] [timer.py:197:stop] 0/5694, RunningAvgSamplesPerSec=10.947960577678728, CurrSamplesPerSec=10.53960047861684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11694/20000 [21:24:15<21:16:58,  9.22s/it][2022-12-22 11:23:40,529] [INFO] [timer.py:197:stop] 0/5695, RunningAvgSamplesPerSec=10.948027650361633, CurrSamplesPerSec=11.3436021913418, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11695/20000 [21:24:24<21:21:21,  9.26s/it][2022-12-22 11:23:49,422] [INFO] [timer.py:197:stop] 0/5696, RunningAvgSamplesPerSec=10.9480662912388, CurrSamplesPerSec=11.172560419689827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11696/20000 [21:24:33<21:06:32,  9.15s/it][2022-12-22 11:23:58,775] [INFO] [timer.py:197:stop] 0/5697, RunningAvgSamplesPerSec=10.948071351739399, CurrSamplesPerSec=10.976961893218572, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11697/20000 [21:24:43<21:14:19,  9.21s/it][2022-12-22 11:24:07,768] [INFO] [timer.py:197:stop] 0/5698, RunningAvgSamplesPerSec=10.948039264584429, CurrSamplesPerSec=10.76830345724393, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11698/20000 [21:24:52<21:05:13,  9.14s/it][2022-12-22 11:24:17,535] [INFO] [timer.py:197:stop] 0/5699, RunningAvgSamplesPerSec=10.948015752974692, CurrSamplesPerSec=10.815712316199987, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11699/20000 [21:25:01<21:30:54,  9.33s/it][2022-12-22 11:24:27,435] [INFO] [logging.py:68:log_dist] [Rank 0] step=11700, skipped=24, lr=[4.26923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:24:27,436] [INFO] [timer.py:197:stop] 0/5700, RunningAvgSamplesPerSec=10.948045215144719, CurrSamplesPerSec=11.118504998835071, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 58%|█████▊    | 11700/20000 [21:25:11<21:54:24,  9.50s/it]

                                                           
{'loss': 0.0567, 'learning_rate': 4.26923076923077e-06, 'epoch': 0.58}


 58%|█████▊    | 11700/20000 [21:25:11<21:54:24,  9.50s/it][2022-12-22 11:24:36,495] [INFO] [timer.py:197:stop] 0/5701, RunningAvgSamplesPerSec=10.948093664680615, CurrSamplesPerSec=11.2313017041291, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11701/20000 [21:25:20<21:35:54,  9.37s/it][2022-12-22 11:24:45,816] [INFO] [timer.py:197:stop] 0/5702, RunningAvgSamplesPerSec=10.948136222541171, CurrSamplesPerSec=11.196169180300082, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11702/20000 [21:25:30<21:33:43,  9.35s/it][2022-12-22 11:24:55,035] [INFO] [timer.py:197:stop] 0/5703, RunningAvgSamplesPerSec=10.948165051194321, CurrSamplesPerSec=11.11499276585733, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11703/20000 [21:25:39<21:27:59,  9.31s/it][2022-12-22 11:25:04,249] [INFO] [timer.py:197:stop] 0/5704, RunningAvgSamplesPerSec=10.948140053404245, CurrSamplesPerSec=10.80745922172415, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11704/20000 [21:25:48<21:23:39,  9.28s/it][2022-12-22 11:25:13,675] [INFO] [timer.py:197:stop] 0/5705, RunningAvgSamplesPerSec=10.948134230267822, CurrSamplesPerSec=10.915031119181275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11705/20000 [21:25:58<21:29:24,  9.33s/it][2022-12-22 11:25:22,835] [INFO] [timer.py:197:stop] 0/5706, RunningAvgSamplesPerSec=10.948156703632883, CurrSamplesPerSec=11.07784072870679, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11706/20000 [21:26:07<21:22:18,  9.28s/it][2022-12-22 11:25:31,762] [INFO] [timer.py:197:stop] 0/5707, RunningAvgSamplesPerSec=10.948162048893854, CurrSamplesPerSec=10.978736578948304, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11707/20000 [21:26:16<21:07:42,  9.17s/it][2022-12-22 11:25:41,304] [INFO] [timer.py:197:stop] 0/5708, RunningAvgSamplesPerSec=10.948112379409872, CurrSamplesPerSec=10.671898333618715, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11708/20000 [21:26:25<21:22:52,  9.28s/it][2022-12-22 11:25:50,731] [INFO] [timer.py:197:stop] 0/5709, RunningAvgSamplesPerSec=10.94807047053885, CurrSamplesPerSec=10.71405089499801, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11709/20000 [21:26:35<21:28:42,  9.33s/it][2022-12-22 11:25:59,779] [INFO] [logging.py:68:log_dist] [Rank 0] step=11710, skipped=24, lr=[4.264102564102565e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:25:59,780] [INFO] [timer.py:197:stop] 0/5710, RunningAvgSamplesPerSec=10.948078197326636, CurrSamplesPerSec=10.992353338316367, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11710/20000 [21:26:44<21:17:04,  9.24s/it][2022-12-22 11:26:09,994] [INFO] [timer.py:197:stop] 0/5711, RunningAvgSamplesPerSec=10.948037527222972, CurrSamplesPerSec=10.72071365281473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11711/20000 [21:26:54<21:57:09,  9.53s/it][2022-12-22 11:26:19,082] [INFO] [timer.py:197:stop] 0/5712, RunningAvgSamplesPerSec=10.948044589683214, CurrSamplesPerSec=10.988513239716525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11712/20000 [21:27:03<21:38:30,  9.40s/it][2022-12-22 11:26:27,824] [INFO] [timer.py:197:stop] 0/5713, RunningAvgSamplesPerSec=10.94809204073518, CurrSamplesPerSec=11.22591435206676, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11713/20000 [21:27:12<21:11:04,  9.20s/it][2022-12-22 11:26:37,038] [INFO] [timer.py:197:stop] 0/5714, RunningAvgSamplesPerSec=10.948136193444986, CurrSamplesPerSec=11.206237927437087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11714/20000 [21:27:21<21:11:23,  9.21s/it][2022-12-22 11:26:46,283] [INFO] [timer.py:197:stop] 0/5715, RunningAvgSamplesPerSec=10.948169749644952, CurrSamplesPerSec=11.143258847332321, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11715/20000 [21:27:30<21:12:50,  9.22s/it][2022-12-22 11:26:57,468] [INFO] [timer.py:197:stop] 0/5716, RunningAvgSamplesPerSec=10.94813249084735, CurrSamplesPerSec=10.739333277910116, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11716/20000 [21:27:41<22:34:08,  9.81s/it][2022-12-22 11:27:06,473] [INFO] [timer.py:197:stop] 0/5717, RunningAvgSamplesPerSec=10.948096970231138, CurrSamplesPerSec=10.74882704502559, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11717/20000 [21:27:50<22:00:44,  9.57s/it][2022-12-22 11:27:15,473] [INFO] [timer.py:197:stop] 0/5718, RunningAvgSamplesPerSec=10.94811071818172, CurrSamplesPerSec=11.02724828895856, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11718/20000 [21:27:59<21:37:06,  9.40s/it][2022-12-22 11:27:25,760] [INFO] [timer.py:197:stop] 0/5719, RunningAvgSamplesPerSec=10.948139362540418, CurrSamplesPerSec=11.114356759170287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11719/20000 [21:28:10<22:13:46,  9.66s/it][2022-12-22 11:27:35,889] [INFO] [logging.py:68:log_dist] [Rank 0] step=11720, skipped=24, lr=[4.2589743589743595e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:27:35,890] [INFO] [timer.py:197:stop] 0/5720, RunningAvgSamplesPerSec=10.948118388625922, CurrSamplesPerSec=10.829509792190438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11720/20000 [21:28:20<22:32:53,  9.80s/it][2022-12-22 11:27:44,804] [INFO] [timer.py:197:stop] 0/5721, RunningAvgSamplesPerSec=10.948112301316662, CurrSamplesPerSec=10.913415397827842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11721/20000 [21:28:29<21:55:56,  9.54s/it][2022-12-22 11:27:55,425] [INFO] [timer.py:197:stop] 0/5722, RunningAvgSamplesPerSec=10.948127333711454, CurrSamplesPerSec=11.034778144751247, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11722/20000 [21:28:39<22:40:37,  9.86s/it][2022-12-22 11:28:04,656] [INFO] [timer.py:197:stop] 0/5723, RunningAvgSamplesPerSec=10.948115004288708, CurrSamplesPerSec=10.878042172132654, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11723/20000 [21:28:49<22:14:22,  9.67s/it][2022-12-22 11:28:13,516] [INFO] [timer.py:197:stop] 0/5724, RunningAvgSamplesPerSec=10.948156007167682, CurrSamplesPerSec=11.18787054926189, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11724/20000 [21:28:57<21:40:34,  9.43s/it][2022-12-22 11:28:24,233] [INFO] [timer.py:197:stop] 0/5725, RunningAvgSamplesPerSec=10.948124714532918, CurrSamplesPerSec=10.771950095861305, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11725/20000 [21:29:08<22:33:42,  9.82s/it]

                                                           
{'loss': 0.0753, 'learning_rate': 4.2564102564102566e-06, 'epoch': 0.59}


 59%|█████▊    | 11725/20000 [21:29:08<22:33:42,  9.82s/it][2022-12-22 11:28:33,007] [INFO] [timer.py:197:stop] 0/5726, RunningAvgSamplesPerSec=10.948165546224098, CurrSamplesPerSec=11.186942711498434, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11726/20000 [21:29:17<21:50:26,  9.50s/it][2022-12-22 11:28:43,406] [INFO] [timer.py:197:stop] 0/5727, RunningAvgSamplesPerSec=10.948191978761967, CurrSamplesPerSec=11.10161240787892, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11727/20000 [21:29:27<22:27:21,  9.77s/it][2022-12-22 11:28:52,396] [INFO] [timer.py:197:stop] 0/5728, RunningAvgSamplesPerSec=10.948183610686964, CurrSamplesPerSec=10.900485137462383, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11728/20000 [21:29:36<21:54:51,  9.54s/it][2022-12-22 11:29:01,760] [INFO] [timer.py:197:stop] 0/5729, RunningAvgSamplesPerSec=10.948181856302229, CurrSamplesPerSec=10.938145459912306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11729/20000 [21:29:46<21:47:33,  9.49s/it][2022-12-22 11:29:13,033] [INFO] [logging.py:68:log_dist] [Rank 0] step=11730, skipped=24, lr=[4.253846153846154e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:29:13,034] [INFO] [timer.py:197:stop] 0/5730, RunningAvgSamplesPerSec=10.948175183840146, CurrSamplesPerSec=10.910094930894044, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11730/20000 [21:29:57<23:01:19, 10.02s/it][2022-12-22 11:29:23,213] [INFO] [timer.py:197:stop] 0/5731, RunningAvgSamplesPerSec=10.948204737160768, CurrSamplesPerSec=11.120145169150527, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11731/20000 [21:30:07<23:07:41, 10.07s/it][2022-12-22 11:29:32,311] [INFO] [timer.py:197:stop] 0/5732, RunningAvgSamplesPerSec=10.948205762639468, CurrSamplesPerSec=10.954083884957484, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11732/20000 [21:30:16<22:27:21,  9.78s/it][2022-12-22 11:29:42,348] [INFO] [timer.py:197:stop] 0/5733, RunningAvgSamplesPerSec=10.948216575408237, CurrSamplesPerSec=11.010526420275921, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11733/20000 [21:30:26<22:37:56,  9.86s/it][2022-12-22 11:29:51,672] [INFO] [timer.py:197:stop] 0/5734, RunningAvgSamplesPerSec=10.948206036315996, CurrSamplesPerSec=10.888137942760945, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11734/20000 [21:30:36<22:15:48,  9.70s/it][2022-12-22 11:30:01,908] [INFO] [timer.py:197:stop] 0/5735, RunningAvgSamplesPerSec=10.948240191475334, CurrSamplesPerSec=11.147582849258947, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11735/20000 [21:30:46<22:37:57,  9.86s/it][2022-12-22 11:30:10,903] [INFO] [timer.py:197:stop] 0/5736, RunningAvgSamplesPerSec=10.948280961101105, CurrSamplesPerSec=11.187112881271691, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11736/20000 [21:30:55<22:02:05,  9.60s/it][2022-12-22 11:30:20,564] [INFO] [timer.py:197:stop] 0/5737, RunningAvgSamplesPerSec=10.948254268529997, CurrSamplesPerSec=10.797309620789363, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11737/20000 [21:31:05<22:04:29,  9.62s/it][2022-12-22 11:30:29,634] [INFO] [timer.py:197:stop] 0/5738, RunningAvgSamplesPerSec=10.948227540478626, CurrSamplesPerSec=10.797059034695852, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11738/20000 [21:31:14<21:41:44,  9.45s/it][2022-12-22 11:30:38,944] [INFO] [timer.py:197:stop] 0/5739, RunningAvgSamplesPerSec=10.948256766035264, CurrSamplesPerSec=11.118501775163223, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11739/20000 [21:31:23<21:35:38,  9.41s/it][2022-12-22 11:30:48,301] [INFO] [logging.py:68:log_dist] [Rank 0] step=11740, skipped=24, lr=[4.248717948717949e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:30:48,302] [INFO] [timer.py:197:stop] 0/5740, RunningAvgSamplesPerSec=10.948284692082098, CurrSamplesPerSec=11.110876119250147, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11740/20000 [21:31:32<21:33:20,  9.39s/it][2022-12-22 11:30:57,282] [INFO] [timer.py:197:stop] 0/5741, RunningAvgSamplesPerSec=10.94825752042131, CurrSamplesPerSec=10.79453601609412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11741/20000 [21:31:41<21:16:02,  9.27s/it][2022-12-22 11:31:06,805] [INFO] [timer.py:197:stop] 0/5742, RunningAvgSamplesPerSec=10.948263838907806, CurrSamplesPerSec=10.984646155945086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11742/20000 [21:31:51<21:26:21,  9.35s/it][2022-12-22 11:31:16,980] [INFO] [timer.py:197:stop] 0/5743, RunningAvgSamplesPerSec=10.948288272888632, CurrSamplesPerSec=11.090359618971695, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11743/20000 [21:32:01<22:00:23,  9.59s/it][2022-12-22 11:31:26,209] [INFO] [timer.py:197:stop] 0/5744, RunningAvgSamplesPerSec=10.948267718636867, CurrSamplesPerSec=10.831524255778081, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11744/20000 [21:32:10<21:45:07,  9.48s/it][2022-12-22 11:31:35,571] [INFO] [timer.py:197:stop] 0/5745, RunningAvgSamplesPerSec=10.948299655585767, CurrSamplesPerSec=11.1348061082356, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11745/20000 [21:32:20<21:39:54,  9.45s/it][2022-12-22 11:31:44,542] [INFO] [timer.py:197:stop] 0/5746, RunningAvgSamplesPerSec=10.94827773717665, CurrSamplesPerSec=10.823831380207022, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11746/20000 [21:32:29<21:20:04,  9.31s/it][2022-12-22 11:31:54,076] [INFO] [timer.py:197:stop] 0/5747, RunningAvgSamplesPerSec=10.948251790856855, CurrSamplesPerSec=10.801218010446666, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11747/20000 [21:32:38<21:29:20,  9.37s/it][2022-12-22 11:32:03,083] [INFO] [timer.py:197:stop] 0/5748, RunningAvgSamplesPerSec=10.948217823906317, CurrSamplesPerSec=10.756495530212565, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11748/20000 [21:32:47<21:14:04,  9.26s/it][2022-12-22 11:32:12,858] [INFO] [timer.py:197:stop] 0/5749, RunningAvgSamplesPerSec=10.948183617715769, CurrSamplesPerSec=10.755101778343953, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▊    | 11749/20000 [21:32:57<21:35:01,  9.42s/it][2022-12-22 11:32:21,957] [INFO] [logging.py:68:log_dist] [Rank 0] step=11750, skipped=24, lr=[4.243589743589744e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:32:21,958] [INFO] [timer.py:197:stop] 0/5750, RunningAvgSamplesPerSec=10.948212246148243, CurrSamplesPerSec=11.115250502749584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11750/20000 [21:33:06<21:21:44,  9.32s/it]

                                                           
{'loss': 0.0535, 'learning_rate': 4.243589743589744e-06, 'epoch': 0.59}


 59%|█████▉    | 11750/20000 [21:33:06<21:21:44,  9.32s/it][2022-12-22 11:32:31,903] [INFO] [timer.py:197:stop] 0/5751, RunningAvgSamplesPerSec=10.948193528024527, CurrSamplesPerSec=10.841648986019674, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11751/20000 [21:33:16<21:47:18,  9.51s/it][2022-12-22 11:32:41,292] [INFO] [timer.py:197:stop] 0/5752, RunningAvgSamplesPerSec=10.948102446569301, CurrSamplesPerSec=10.448380103898607, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11752/20000 [21:33:25<21:42:12,  9.47s/it][2022-12-22 11:32:50,713] [INFO] [timer.py:197:stop] 0/5753, RunningAvgSamplesPerSec=10.948095673000944, CurrSamplesPerSec=10.909285745869, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11753/20000 [21:33:35<21:39:56,  9.46s/it][2022-12-22 11:33:00,383] [INFO] [timer.py:197:stop] 0/5754, RunningAvgSamplesPerSec=10.948084768111704, CurrSamplesPerSec=10.885728010996539, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11754/20000 [21:33:44<21:48:30,  9.52s/it][2022-12-22 11:33:09,388] [INFO] [timer.py:197:stop] 0/5755, RunningAvgSamplesPerSec=10.948053324457753, CurrSamplesPerSec=10.770129276639008, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11755/20000 [21:33:53<21:27:05,  9.37s/it][2022-12-22 11:33:18,759] [INFO] [timer.py:197:stop] 0/5756, RunningAvgSamplesPerSec=10.948075539522053, CurrSamplesPerSec=11.077388613701018, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11756/20000 [21:34:03<21:27:09,  9.37s/it][2022-12-22 11:33:28,538] [INFO] [timer.py:197:stop] 0/5757, RunningAvgSamplesPerSec=10.948092739379412, CurrSamplesPerSec=11.047963683505467, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11757/20000 [21:34:12<21:43:53,  9.49s/it][2022-12-22 11:33:39,012] [INFO] [timer.py:197:stop] 0/5758, RunningAvgSamplesPerSec=10.94805227336965, CurrSamplesPerSec=10.720021788641393, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11758/20000 [21:34:23<22:24:16,  9.79s/it][2022-12-22 11:33:48,503] [INFO] [timer.py:197:stop] 0/5759, RunningAvgSamplesPerSec=10.948013907599625, CurrSamplesPerSec=10.731547654171262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11759/20000 [21:34:32<22:11:57,  9.70s/it][2022-12-22 11:33:57,670] [INFO] [logging.py:68:log_dist] [Rank 0] step=11760, skipped=24, lr=[4.238461538461539e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:33:57,671] [INFO] [timer.py:197:stop] 0/5760, RunningAvgSamplesPerSec=10.947978050138397, CurrSamplesPerSec=10.745367662997085, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11760/20000 [21:34:42<21:49:58,  9.54s/it][2022-12-22 11:34:06,985] [INFO] [timer.py:197:stop] 0/5761, RunningAvgSamplesPerSec=10.94802213748546, CurrSamplesPerSec=11.207904086039948, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11761/20000 [21:34:51<21:40:33,  9.47s/it][2022-12-22 11:34:16,182] [INFO] [timer.py:197:stop] 0/5762, RunningAvgSamplesPerSec=10.94803617872576, CurrSamplesPerSec=11.029501498688262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11762/20000 [21:35:00<21:29:07,  9.39s/it][2022-12-22 11:34:25,309] [INFO] [timer.py:197:stop] 0/5763, RunningAvgSamplesPerSec=10.948012153260915, CurrSamplesPerSec=10.811353192395645, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11763/20000 [21:35:09<21:18:09,  9.31s/it][2022-12-22 11:34:34,655] [INFO] [timer.py:197:stop] 0/5764, RunningAvgSamplesPerSec=10.94802543950445, CurrSamplesPerSec=11.025106486654236, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11764/20000 [21:35:19<21:19:26,  9.32s/it][2022-12-22 11:34:43,765] [INFO] [timer.py:197:stop] 0/5765, RunningAvgSamplesPerSec=10.948053452276334, CurrSamplesPerSec=11.111878776308265, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11765/20000 [21:35:28<21:10:36,  9.26s/it][2022-12-22 11:34:53,096] [INFO] [timer.py:197:stop] 0/5766, RunningAvgSamplesPerSec=10.948112023947386, CurrSamplesPerSec=11.296400749419716, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11766/20000 [21:35:37<21:13:29,  9.28s/it][2022-12-22 11:35:03,299] [INFO] [timer.py:197:stop] 0/5767, RunningAvgSamplesPerSec=10.948079177623049, CurrSamplesPerSec=10.761971894115863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11767/20000 [21:35:47<21:51:21,  9.56s/it][2022-12-22 11:35:12,664] [INFO] [timer.py:197:stop] 0/5768, RunningAvgSamplesPerSec=10.94808381395934, CurrSamplesPerSec=10.974877718233438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11768/20000 [21:35:57<21:43:17,  9.50s/it][2022-12-22 11:35:24,911] [INFO] [timer.py:197:stop] 0/5769, RunningAvgSamplesPerSec=10.9480601724836, CurrSamplesPerSec=10.813420147236448, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11769/20000 [21:36:09<23:36:13, 10.32s/it][2022-12-22 11:35:36,907] [INFO] [logging.py:68:log_dist] [Rank 0] step=11770, skipped=24, lr=[4.233333333333334e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:35:36,908] [INFO] [timer.py:197:stop] 0/5770, RunningAvgSamplesPerSec=10.948095914272386, CurrSamplesPerSec=11.158174708864768, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11770/20000 [21:36:21<24:44:52, 10.83s/it][2022-12-22 11:35:45,936] [INFO] [timer.py:197:stop] 0/5771, RunningAvgSamplesPerSec=10.948059076693097, CurrSamplesPerSec=10.739625877495378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11771/20000 [21:36:30<23:30:45, 10.29s/it][2022-12-22 11:35:56,801] [INFO] [timer.py:197:stop] 0/5772, RunningAvgSamplesPerSec=10.948012467063478, CurrSamplesPerSec=10.685568442534919, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11772/20000 [21:36:41<23:54:25, 10.46s/it][2022-12-22 11:36:05,585] [INFO] [timer.py:197:stop] 0/5773, RunningAvgSamplesPerSec=10.948055321849395, CurrSamplesPerSec=11.201042377201528, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11773/20000 [21:36:50<22:45:17,  9.96s/it][2022-12-22 11:36:16,445] [INFO] [timer.py:197:stop] 0/5774, RunningAvgSamplesPerSec=10.947953878629647, CurrSamplesPerSec=10.392246023671369, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11774/20000 [21:37:00<23:22:15, 10.23s/it][2022-12-22 11:36:29,716] [INFO] [timer.py:197:stop] 0/5775, RunningAvgSamplesPerSec=10.947998056646282, CurrSamplesPerSec=11.20907551288318, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11775/20000 [21:37:14<25:27:13, 11.14s/it]

                                                           
{'loss': 0.0549, 'learning_rate': 4.230769230769231e-06, 'epoch': 0.59}


 59%|█████▉    | 11775/20000 [21:37:14<25:27:13, 11.14s/it][2022-12-22 11:36:39,964] [INFO] [timer.py:197:stop] 0/5776, RunningAvgSamplesPerSec=10.947944850826982, CurrSamplesPerSec=10.649171537238932, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11776/20000 [21:37:24<24:50:19, 10.87s/it][2022-12-22 11:36:48,947] [INFO] [timer.py:197:stop] 0/5777, RunningAvgSamplesPerSec=10.947941229963886, CurrSamplesPerSec=10.927074222280496, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11777/20000 [21:37:33<23:32:27, 10.31s/it][2022-12-22 11:36:59,549] [INFO] [timer.py:197:stop] 0/5778, RunningAvgSamplesPerSec=10.947943133365335, CurrSamplesPerSec=10.95894632625969, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11778/20000 [21:37:44<23:44:25, 10.39s/it][2022-12-22 11:37:08,683] [INFO] [timer.py:197:stop] 0/5779, RunningAvgSamplesPerSec=10.947983508857162, CurrSamplesPerSec=11.186269076497515, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11779/20000 [21:37:53<22:52:24, 10.02s/it][2022-12-22 11:37:17,520] [INFO] [logging.py:68:log_dist] [Rank 0] step=11780, skipped=24, lr=[4.228205128205128e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:37:17,520] [INFO] [timer.py:197:stop] 0/5780, RunningAvgSamplesPerSec=10.948024051887199, CurrSamplesPerSec=11.187362317555262, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11780/20000 [21:38:01<22:03:48,  9.66s/it][2022-12-22 11:37:28,382] [INFO] [timer.py:197:stop] 0/5781, RunningAvgSamplesPerSec=10.947985072803606, CurrSamplesPerSec=10.72730453728225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11781/20000 [21:38:12<22:52:54, 10.02s/it][2022-12-22 11:37:39,953] [INFO] [timer.py:197:stop] 0/5782, RunningAvgSamplesPerSec=10.94802703887743, CurrSamplesPerSec=11.19604403084428, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11782/20000 [21:38:24<23:56:21, 10.49s/it][2022-12-22 11:37:49,974] [INFO] [timer.py:197:stop] 0/5783, RunningAvgSamplesPerSec=10.947957635318895, CurrSamplesPerSec=10.560986816680016, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11783/20000 [21:38:34<23:37:03, 10.35s/it][2022-12-22 11:37:58,970] [INFO] [timer.py:197:stop] 0/5784, RunningAvgSamplesPerSec=10.947972249981548, CurrSamplesPerSec=11.033116803449243, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11784/20000 [21:38:43<22:41:23,  9.94s/it][2022-12-22 11:38:08,333] [INFO] [timer.py:197:stop] 0/5785, RunningAvgSamplesPerSec=10.947975346266707, CurrSamplesPerSec=10.965907395584772, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11785/20000 [21:38:52<22:17:24,  9.77s/it][2022-12-22 11:38:17,860] [INFO] [timer.py:197:stop] 0/5786, RunningAvgSamplesPerSec=10.947905260958457, CurrSamplesPerSec=10.5570734434965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11786/20000 [21:39:02<22:07:21,  9.70s/it][2022-12-22 11:38:27,566] [INFO] [timer.py:197:stop] 0/5787, RunningAvgSamplesPerSec=10.947947514993544, CurrSamplesPerSec=11.197926237772657, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11787/20000 [21:39:12<22:07:37,  9.70s/it][2022-12-22 11:38:36,361] [INFO] [timer.py:197:stop] 0/5788, RunningAvgSamplesPerSec=10.947985211732536, CurrSamplesPerSec=11.170493817091096, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11788/20000 [21:39:20<21:30:20,  9.43s/it][2022-12-22 11:38:45,664] [INFO] [timer.py:197:stop] 0/5789, RunningAvgSamplesPerSec=10.948041671930634, CurrSamplesPerSec=11.28476974648481, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11789/20000 [21:39:30<21:25:02,  9.39s/it][2022-12-22 11:38:55,066] [INFO] [logging.py:68:log_dist] [Rank 0] step=11790, skipped=24, lr=[4.223076923076924e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:38:55,067] [INFO] [timer.py:197:stop] 0/5790, RunningAvgSamplesPerSec=10.948009174369515, CurrSamplesPerSec=10.763122298147543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11790/20000 [21:39:39<21:25:26,  9.39s/it][2022-12-22 11:39:04,464] [INFO] [timer.py:197:stop] 0/5791, RunningAvgSamplesPerSec=10.948010903511191, CurrSamplesPerSec=10.958028334681746, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11791/20000 [21:39:48<21:25:23,  9.40s/it][2022-12-22 11:39:14,989] [INFO] [timer.py:197:stop] 0/5792, RunningAvgSamplesPerSec=10.948028318597325, CurrSamplesPerSec=11.049781416936584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11792/20000 [21:39:59<22:11:36,  9.73s/it][2022-12-22 11:39:24,438] [INFO] [timer.py:197:stop] 0/5793, RunningAvgSamplesPerSec=10.947999314940478, CurrSamplesPerSec=10.78260555204328, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11793/20000 [21:40:08<21:59:44,  9.65s/it][2022-12-22 11:39:33,527] [INFO] [timer.py:197:stop] 0/5794, RunningAvgSamplesPerSec=10.947957814826063, CurrSamplesPerSec=10.712793812143406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11794/20000 [21:40:17<21:36:39,  9.48s/it][2022-12-22 11:39:42,921] [INFO] [timer.py:197:stop] 0/5795, RunningAvgSamplesPerSec=10.94796400056779, CurrSamplesPerSec=10.983909470496549, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11795/20000 [21:40:27<21:32:54,  9.45s/it][2022-12-22 11:39:52,004] [INFO] [timer.py:197:stop] 0/5796, RunningAvgSamplesPerSec=10.947981035275104, CurrSamplesPerSec=11.047560834326378, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11796/20000 [21:40:36<21:17:30,  9.34s/it][2022-12-22 11:40:01,438] [INFO] [timer.py:197:stop] 0/5797, RunningAvgSamplesPerSec=10.947998349397677, CurrSamplesPerSec=11.04924426607001, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11797/20000 [21:40:45<21:21:05,  9.37s/it][2022-12-22 11:40:11,338] [INFO] [timer.py:197:stop] 0/5798, RunningAvgSamplesPerSec=10.948008976752577, CurrSamplesPerSec=11.009942953962247, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11798/20000 [21:40:55<21:42:38,  9.53s/it][2022-12-22 11:40:20,390] [INFO] [timer.py:197:stop] 0/5799, RunningAvgSamplesPerSec=10.947974559589076, CurrSamplesPerSec=10.75206297986109, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11799/20000 [21:41:04<21:22:54,  9.39s/it][2022-12-22 11:40:30,357] [INFO] [logging.py:68:log_dist] [Rank 0] step=11800, skipped=24, lr=[4.217948717948718e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:40:30,358] [INFO] [timer.py:197:stop] 0/5800, RunningAvgSamplesPerSec=10.947980641634274, CurrSamplesPerSec=10.983352190234683, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11800/20000 [21:41:14<21:46:38,  9.56s/it]

                                                           
{'loss': 0.0526, 'learning_rate': 4.217948717948718e-06, 'epoch': 0.59}


 59%|█████▉    | 11800/20000 [21:41:14<21:46:38,  9.56s/it][2022-12-22 11:40:39,960] [INFO] [timer.py:197:stop] 0/5801, RunningAvgSamplesPerSec=10.947972944400785, CurrSamplesPerSec=10.90352560200816, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11801/20000 [21:41:24<21:48:11,  9.57s/it][2022-12-22 11:40:49,358] [INFO] [timer.py:197:stop] 0/5802, RunningAvgSamplesPerSec=10.948011133405348, CurrSamplesPerSec=11.174042149130532, MemAllocated=1.52GB, MaxMemAllocated=26.06GB

Added parsing of ordinal numbers written out (i.e. spoken by user) in queries/util. The value of the spoken ordinal is collected, similar to handling of other numbers previously supported. Also fixed some grammar issues with the support of other numbers.INFO] [timer.py:197:stop] 0/5813, RunningAvgSamplesPerSec=10.947825844492654, CurrSamplesPerSec=11.15078034352163, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11813/20000 [21:43:19<22:00:16,  9.68s/it][2022-12-22 11:42:44,848] [INFO] [timer.py:197:stop] 0/5814, RunningAvgSamplesPerSec=10.947771109958257, CurrSamplesPerSec=10.638689920891338, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11814/20000 [21:43:29<21:55:36,  9.64s/it][2022-12-22 11:42:54,815] [INFO] [timer.py:197:stop] 0/5815, RunningAvgSamplesPerSec=10.947763785896678, CurrSamplesPerSec=10.905361239299664, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11815/20000 [21:43:39<22:08:41,  9.74s/it][2022-12-22 11:43:06,298] [INFO] [timer.py:197:stop] 0/5816, RunningAvgSamplesPerSec=10.947735187388382, CurrSamplesPerSec=10.783979148371007, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11816/20000 [21:43:50<23:19:51, 10.26s/it][2022-12-22 11:43:15,225] [INFO] [timer.py:197:stop] 0/5817, RunningAvgSamplesPerSec=10.947722280208044, CurrSamplesPerSec=10.873190904975152, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11817/20000 [21:43:59<22:25:00,  9.86s/it][2022-12-22 11:43:24,634] [INFO] [timer.py:197:stop] 0/5818, RunningAvgSamplesPerSec=10.947715648630506, CurrSamplesPerSec=10.909288406006663, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11818/20000 [21:44:09<22:06:21,  9.73s/it][2022-12-22 11:43:34,499] [INFO] [timer.py:197:stop] 0/5819, RunningAvgSamplesPerSec=10.94773059472017, CurrSamplesPerSec=11.035352904794216, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11819/20000 [21:44:18<22:11:51,  9.77s/it][2022-12-22 11:43:44,411] [INFO] [logging.py:68:log_dist] [Rank 0] step=11820, skipped=24, lr=[4.2076923076923085e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:43:44,411] [INFO] [timer.py:197:stop] 0/5820, RunningAvgSamplesPerSec=10.947747275081184, CurrSamplesPerSec=11.045644747551474, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11820/20000 [21:44:28<22:17:35,  9.81s/it][2022-12-22 11:43:53,883] [INFO] [timer.py:197:stop] 0/5821, RunningAvgSamplesPerSec=10.9477199403261, CurrSamplesPerSec=10.790963865980103, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11821/20000 [21:44:38<22:03:32,  9.71s/it][2022-12-22 11:44:03,742] [INFO] [timer.py:197:stop] 0/5822, RunningAvgSamplesPerSec=10.947720908335688, CurrSamplesPerSec=10.953356656331312, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11822/20000 [21:44:48<22:09:30,  9.75s/it][2022-12-22 11:44:13,281] [INFO] [timer.py:197:stop] 0/5823, RunningAvgSamplesPerSec=10.947695813531668, CurrSamplesPerSec=10.803567185448438, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11823/20000 [21:44:57<22:00:31,  9.69s/it][2022-12-22 11:44:22,658] [INFO] [timer.py:197:stop] 0/5824, RunningAvgSamplesPerSec=10.94768813827986, CurrSamplesPerSec=10.903192117464672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11824/20000 [21:45:07<21:47:36,  9.60s/it][2022-12-22 11:44:31,858] [INFO] [timer.py:197:stop] 0/5825, RunningAvgSamplesPerSec=10.947694405865562, CurrSamplesPerSec=10.984306342447644, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11825/20000 [21:45:16<21:31:15,  9.48s/it]

                                                           
{'loss': 0.0497, 'learning_rate': 4.2051282051282055e-06, 'epoch': 0.59}


 59%|█████▉    | 11825/20000 [21:45:16<21:31:15,  9.48s/it][2022-12-22 11:44:41,269] [INFO] [timer.py:197:stop] 0/5826, RunningAvgSamplesPerSec=10.947600366025789, CurrSamplesPerSec=10.426096256900502, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11826/20000 [21:45:25<21:28:24,  9.46s/it][2022-12-22 11:44:50,442] [INFO] [timer.py:197:stop] 0/5827, RunningAvgSamplesPerSec=10.94760883588646, CurrSamplesPerSec=10.997160616487237, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11827/20000 [21:45:34<21:16:37,  9.37s/it][2022-12-22 11:44:59,515] [INFO] [timer.py:197:stop] 0/5828, RunningAvgSamplesPerSec=10.947618042000128, CurrSamplesPerSec=11.001507671410993, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11828/20000 [21:45:43<21:04:14,  9.28s/it][2022-12-22 11:45:10,318] [INFO] [timer.py:197:stop] 0/5829, RunningAvgSamplesPerSec=10.947656439670853, CurrSamplesPerSec=11.176028636497678, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11829/20000 [21:45:54<22:06:12,  9.74s/it][2022-12-22 11:45:19,180] [INFO] [logging.py:68:log_dist] [Rank 0] step=11830, skipped=24, lr=[4.2025641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:45:19,181] [INFO] [timer.py:197:stop] 0/5830, RunningAvgSamplesPerSec=10.947662437922695, CurrSamplesPerSec=10.982726216220252, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11830/20000 [21:46:03<21:30:17,  9.48s/it][2022-12-22 11:45:28,581] [INFO] [timer.py:197:stop] 0/5831, RunningAvgSamplesPerSec=10.947645425480118, CurrSamplesPerSec=10.849386951164362, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11831/20000 [21:46:13<21:27:01,  9.45s/it][2022-12-22 11:45:38,161] [INFO] [timer.py:197:stop] 0/5832, RunningAvgSamplesPerSec=10.947618010328238, CurrSamplesPerSec=10.79011456993205, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11832/20000 [21:46:22<21:32:04,  9.49s/it][2022-12-22 11:45:47,008] [INFO] [timer.py:197:stop] 0/5833, RunningAvgSamplesPerSec=10.947641397521974, CurrSamplesPerSec=11.085708589021536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11833/20000 [21:46:31<21:05:37,  9.30s/it][2022-12-22 11:45:57,169] [INFO] [timer.py:197:stop] 0/5834, RunningAvgSamplesPerSec=10.947615438327073, CurrSamplesPerSec=10.798312081489938, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11834/20000 [21:46:41<21:40:41,  9.56s/it][2022-12-22 11:46:06,697] [INFO] [timer.py:197:stop] 0/5835, RunningAvgSamplesPerSec=10.947562791344058, CurrSamplesPerSec=10.648903278084171, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11835/20000 [21:46:51<21:39:21,  9.55s/it][2022-12-22 11:46:16,576] [INFO] [timer.py:197:stop] 0/5836, RunningAvgSamplesPerSec=10.947610746063006, CurrSamplesPerSec=11.234666371132965, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11836/20000 [21:47:01<21:52:42,  9.65s/it][2022-12-22 11:46:26,174] [INFO] [timer.py:197:stop] 0/5837, RunningAvgSamplesPerSec=10.947583708823563, CurrSamplesPerSec=10.792089237342097, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11837/20000 [21:47:10<21:50:30,  9.63s/it][2022-12-22 11:46:35,733] [INFO] [timer.py:197:stop] 0/5838, RunningAvgSamplesPerSec=10.947558948842731, CurrSamplesPerSec=10.804966569002778, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11838/20000 [21:47:20<21:47:21,  9.61s/it][2022-12-22 11:46:44,881] [INFO] [timer.py:197:stop] 0/5839, RunningAvgSamplesPerSec=10.947517153127759, CurrSamplesPerSec=10.70891453635687, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11839/20000 [21:47:29<21:28:18,  9.47s/it][2022-12-22 11:46:55,145] [INFO] [logging.py:68:log_dist] [Rank 0] step=11840, skipped=24, lr=[4.1974358974358975e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:46:55,146] [INFO] [timer.py:197:stop] 0/5840, RunningAvgSamplesPerSec=10.947470123825063, CurrSamplesPerSec=10.67967622098249, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11840/20000 [21:47:39<22:00:30,  9.71s/it][2022-12-22 11:47:04,313] [INFO] [timer.py:197:stop] 0/5841, RunningAvgSamplesPerSec=10.947462583978382, CurrSamplesPerSec=10.903621266678275, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11841/20000 [21:47:48<21:38:12,  9.55s/it][2022-12-22 11:47:13,536] [INFO] [timer.py:197:stop] 0/5842, RunningAvgSamplesPerSec=10.947461101054856, CurrSamplesPerSec=10.938809154932533, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11842/20000 [21:47:57<21:24:49,  9.45s/it][2022-12-22 11:47:23,976] [INFO] [timer.py:197:stop] 0/5843, RunningAvgSamplesPerSec=10.947431484499527, CurrSamplesPerSec=10.77716139361446, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11843/20000 [21:48:08<22:05:04,  9.75s/it][2022-12-22 11:47:32,868] [INFO] [timer.py:197:stop] 0/5844, RunningAvgSamplesPerSec=10.947448556635162, CurrSamplesPerSec=11.048083725511137, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11844/20000 [21:48:17<21:30:03,  9.49s/it][2022-12-22 11:47:42,420] [INFO] [timer.py:197:stop] 0/5845, RunningAvgSamplesPerSec=10.947488101612501, CurrSamplesPerSec=11.183491014726929, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11845/20000 [21:48:26<21:32:23,  9.51s/it][2022-12-22 11:47:51,557] [INFO] [timer.py:197:stop] 0/5846, RunningAvgSamplesPerSec=10.947502745296951, CurrSamplesPerSec=11.033739917885127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11846/20000 [21:48:36<21:17:05,  9.40s/it][2022-12-22 11:48:01,088] [INFO] [timer.py:197:stop] 0/5847, RunningAvgSamplesPerSec=10.947457598037099, CurrSamplesPerSec=10.689827129618937, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11847/20000 [21:48:45<21:22:22,  9.44s/it][2022-12-22 11:48:10,031] [INFO] [timer.py:197:stop] 0/5848, RunningAvgSamplesPerSec=10.947461806053349, CurrSamplesPerSec=10.97211305489783, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11848/20000 [21:48:54<21:02:05,  9.29s/it][2022-12-22 11:48:18,980] [INFO] [timer.py:197:stop] 0/5849, RunningAvgSamplesPerSec=10.947447362542299, CurrSamplesPerSec=10.863656975883723, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11849/20000 [21:49:03<20:48:04,  9.19s/it][2022-12-22 11:48:28,893] [INFO] [logging.py:68:log_dist] [Rank 0] step=11850, skipped=24, lr=[4.192307692307692e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:48:28,894] [INFO] [timer.py:197:stop] 0/5850, RunningAvgSamplesPerSec=10.947402725443192, CurrSamplesPerSec=10.692487977817692, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11850/20000 [21:49:13<21:17:32,  9.41s/it]

                                                           
{'loss': 0.0537, 'learning_rate': 4.192307692307692e-06, 'epoch': 0.59}


 59%|█████▉    | 11850/20000 [21:49:13<21:17:32,  9.41s/it][2022-12-22 11:48:39,488] [INFO] [timer.py:197:stop] 0/5851, RunningAvgSamplesPerSec=10.947391948792097, CurrSamplesPerSec=10.884730881583648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11851/20000 [21:49:23<22:05:49,  9.76s/it][2022-12-22 11:48:48,969] [INFO] [timer.py:197:stop] 0/5852, RunningAvgSamplesPerSec=10.947348812774761, CurrSamplesPerSec=10.700730997788702, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11852/20000 [21:49:33<21:54:13,  9.68s/it][2022-12-22 11:48:58,086] [INFO] [timer.py:197:stop] 0/5853, RunningAvgSamplesPerSec=10.94731748418063, CurrSamplesPerSec=10.76706341103086, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11853/20000 [21:49:42<21:31:11,  9.51s/it][2022-12-22 11:49:08,549] [INFO] [timer.py:197:stop] 0/5854, RunningAvgSamplesPerSec=10.947355646304809, CurrSamplesPerSec=11.175292111610602, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11854/20000 [21:49:53<22:09:52,  9.80s/it][2022-12-22 11:49:17,813] [INFO] [timer.py:197:stop] 0/5855, RunningAvgSamplesPerSec=10.94732341096156, CurrSamplesPerSec=10.761878267401281, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11855/20000 [21:50:02<21:48:04,  9.64s/it][2022-12-22 11:49:26,762] [INFO] [timer.py:197:stop] 0/5856, RunningAvgSamplesPerSec=10.94735633338863, CurrSamplesPerSec=11.143504481430126, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11856/20000 [21:50:11<21:19:57,  9.43s/it][2022-12-22 11:49:36,594] [INFO] [timer.py:197:stop] 0/5857, RunningAvgSamplesPerSec=10.947387361635172, CurrSamplesPerSec=11.132091862628226, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11857/20000 [21:50:21<21:36:09,  9.55s/it][2022-12-22 11:49:45,683] [INFO] [timer.py:197:stop] 0/5858, RunningAvgSamplesPerSec=10.94740706699141, CurrSamplesPerSec=11.064011028257395, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11858/20000 [21:50:30<21:17:12,  9.41s/it][2022-12-22 11:49:54,611] [INFO] [timer.py:197:stop] 0/5859, RunningAvgSamplesPerSec=10.947415108378785, CurrSamplesPerSec=10.9947089422648, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11859/20000 [21:50:39<20:57:22,  9.27s/it][2022-12-22 11:50:04,206] [INFO] [logging.py:68:log_dist] [Rank 0] step=11860, skipped=24, lr=[4.187179487179487e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:50:04,207] [INFO] [timer.py:197:stop] 0/5860, RunningAvgSamplesPerSec=10.947408978569657, CurrSamplesPerSec=10.911624064042286, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11860/20000 [21:50:48<21:10:34,  9.37s/it][2022-12-22 11:50:13,005] [INFO] [timer.py:197:stop] 0/5861, RunningAvgSamplesPerSec=10.947450497597188, CurrSamplesPerSec=11.196196265252073, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11861/20000 [21:50:57<20:47:20,  9.20s/it][2022-12-22 11:50:21,951] [INFO] [timer.py:197:stop] 0/5862, RunningAvgSamplesPerSec=10.94743380693908, CurrSamplesPerSec=10.85050919111569, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11862/20000 [21:51:06<20:37:03,  9.12s/it][2022-12-22 11:50:33,219] [INFO] [timer.py:197:stop] 0/5863, RunningAvgSamplesPerSec=10.94746243552297, CurrSamplesPerSec=11.117837278146332, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11863/20000 [21:51:17<22:04:19,  9.77s/it][2022-12-22 11:50:46,378] [INFO] [timer.py:197:stop] 0/5864, RunningAvgSamplesPerSec=10.947443450366483, CurrSamplesPerSec=10.837291248210306, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11864/20000 [21:51:30<24:22:10, 10.78s/it][2022-12-22 11:50:58,824] [INFO] [timer.py:197:stop] 0/5865, RunningAvgSamplesPerSec=10.947444256665882, CurrSamplesPerSec=10.952172825634165, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11865/20000 [21:51:43<25:29:37, 11.28s/it][2022-12-22 11:51:08,314] [INFO] [timer.py:197:stop] 0/5866, RunningAvgSamplesPerSec=10.947424001072969, CurrSamplesPerSec=10.82994015150473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11866/20000 [21:51:52<24:16:34, 10.74s/it][2022-12-22 11:51:17,537] [INFO] [timer.py:197:stop] 0/5867, RunningAvgSamplesPerSec=10.94746372989274, CurrSamplesPerSec=11.185499973102509, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11867/20000 [21:52:01<23:14:30, 10.29s/it][2022-12-22 11:51:28,071] [INFO] [timer.py:197:stop] 0/5868, RunningAvgSamplesPerSec=10.947512042824506, CurrSamplesPerSec=11.238397688176745, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11868/20000 [21:52:12<23:24:22, 10.36s/it][2022-12-22 11:51:37,457] [INFO] [timer.py:197:stop] 0/5869, RunningAvgSamplesPerSec=10.947532578425864, CurrSamplesPerSec=11.06933490372868, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11869/20000 [21:52:21<22:44:31, 10.07s/it][2022-12-22 11:51:46,364] [INFO] [logging.py:68:log_dist] [Rank 0] step=11870, skipped=24, lr=[4.182051282051283e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:51:46,365] [INFO] [timer.py:197:stop] 0/5870, RunningAvgSamplesPerSec=10.94757174894123, CurrSamplesPerSec=11.18231374919242, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11870/20000 [21:52:30<21:57:09,  9.72s/it][2022-12-22 11:51:55,390] [INFO] [timer.py:197:stop] 0/5871, RunningAvgSamplesPerSec=10.94757887677868, CurrSamplesPerSec=10.989565467583958, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11871/20000 [21:52:39<21:28:44,  9.51s/it][2022-12-22 11:52:04,765] [INFO] [timer.py:197:stop] 0/5872, RunningAvgSamplesPerSec=10.947522173116164, CurrSamplesPerSec=10.624548140340133, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11872/20000 [21:52:49<21:22:59,  9.47s/it][2022-12-22 11:52:14,078] [INFO] [timer.py:197:stop] 0/5873, RunningAvgSamplesPerSec=10.94752602168938, CurrSamplesPerSec=10.970163869494524, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11873/20000 [21:52:58<21:16:25,  9.42s/it][2022-12-22 11:52:23,593] [INFO] [timer.py:197:stop] 0/5874, RunningAvgSamplesPerSec=10.94749925070931, CurrSamplesPerSec=10.792551774890995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11874/20000 [21:53:08<21:19:58,  9.45s/it][2022-12-22 11:52:33,801] [INFO] [timer.py:197:stop] 0/5875, RunningAvgSamplesPerSec=10.947501669482227, CurrSamplesPerSec=10.961723157820288, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11875/20000 [21:53:18<21:50:33,  9.68s/it]

                                                           
{'loss': 0.0691, 'learning_rate': 4.17948717948718e-06, 'epoch': 0.59}


 59%|█████▉    | 11875/20000 [21:53:18<21:50:33,  9.68s/it][2022-12-22 11:52:43,166] [INFO] [timer.py:197:stop] 0/5876, RunningAvgSamplesPerSec=10.947509366687685, CurrSamplesPerSec=10.992902528807614, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11876/20000 [21:53:27<21:37:41,  9.58s/it][2022-12-22 11:52:52,524] [INFO] [timer.py:197:stop] 0/5877, RunningAvgSamplesPerSec=10.947514020659089, CurrSamplesPerSec=10.974919896528842, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11877/20000 [21:53:36<21:28:21,  9.52s/it][2022-12-22 11:53:01,650] [INFO] [timer.py:197:stop] 0/5878, RunningAvgSamplesPerSec=10.94751878428778, CurrSamplesPerSec=10.975576842890813, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11878/20000 [21:53:46<21:12:19,  9.40s/it][2022-12-22 11:53:10,986] [INFO] [timer.py:197:stop] 0/5879, RunningAvgSamplesPerSec=10.947527048697795, CurrSamplesPerSec=10.996305131413273, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11879/20000 [21:53:55<21:09:37,  9.38s/it][2022-12-22 11:53:19,994] [INFO] [logging.py:68:log_dist] [Rank 0] step=11880, skipped=24, lr=[4.176923076923077e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:53:19,995] [INFO] [timer.py:197:stop] 0/5880, RunningAvgSamplesPerSec=10.947528567604323, CurrSamplesPerSec=10.956462467195157, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11880/20000 [21:54:04<20:54:23,  9.27s/it][2022-12-22 11:53:28,882] [INFO] [timer.py:197:stop] 0/5881, RunningAvgSamplesPerSec=10.947536956049557, CurrSamplesPerSec=10.997067358095835, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11881/20000 [21:54:13<20:38:43,  9.15s/it][2022-12-22 11:53:38,685] [INFO] [timer.py:197:stop] 0/5882, RunningAvgSamplesPerSec=10.947562052390015, CurrSamplesPerSec=11.09711937980753, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11882/20000 [21:54:23<21:04:55,  9.35s/it][2022-12-22 11:53:48,570] [INFO] [timer.py:197:stop] 0/5883, RunningAvgSamplesPerSec=10.947598487584486, CurrSamplesPerSec=11.1661144038617, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11883/20000 [21:54:33<21:26:31,  9.51s/it][2022-12-22 11:53:58,178] [INFO] [timer.py:197:stop] 0/5884, RunningAvgSamplesPerSec=10.94756555650577, CurrSamplesPerSec=10.757264963567183, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11884/20000 [21:54:42<21:30:19,  9.54s/it][2022-12-22 11:54:07,560] [INFO] [timer.py:197:stop] 0/5885, RunningAvgSamplesPerSec=10.947583696023514, CurrSamplesPerSec=11.055330634278002, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11885/20000 [21:54:52<21:23:48,  9.49s/it][2022-12-22 11:54:16,962] [INFO] [timer.py:197:stop] 0/5886, RunningAvgSamplesPerSec=10.947576290294641, CurrSamplesPerSec=10.904181115811033, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11886/20000 [21:55:01<21:19:57,  9.46s/it][2022-12-22 11:54:25,701] [INFO] [timer.py:197:stop] 0/5887, RunningAvgSamplesPerSec=10.947624471518116, CurrSamplesPerSec=11.238660709456026, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11887/20000 [21:55:10<20:50:21,  9.25s/it][2022-12-22 11:54:35,044] [INFO] [timer.py:197:stop] 0/5888, RunningAvgSamplesPerSec=10.947681563250681, CurrSamplesPerSec=11.29430614112837, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11888/20000 [21:55:19<20:54:06,  9.28s/it][2022-12-22 11:54:44,443] [INFO] [timer.py:197:stop] 0/5889, RunningAvgSamplesPerSec=10.947680423502241, CurrSamplesPerSec=10.940975973260592, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11889/20000 [21:55:28<20:58:57,  9.31s/it][2022-12-22 11:54:53,224] [INFO] [logging.py:68:log_dist] [Rank 0] step=11890, skipped=24, lr=[4.171794871794872e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:54:53,224] [INFO] [timer.py:197:stop] 0/5890, RunningAvgSamplesPerSec=10.947722326251256, CurrSamplesPerSec=11.200091324597192, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11890/20000 [21:55:37<20:37:13,  9.15s/it][2022-12-22 11:55:03,833] [INFO] [timer.py:197:stop] 0/5891, RunningAvgSamplesPerSec=10.947680266053004, CurrSamplesPerSec=10.705508971738478, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11891/20000 [21:55:48<21:36:04,  9.59s/it][2022-12-22 11:55:14,018] [INFO] [timer.py:197:stop] 0/5892, RunningAvgSamplesPerSec=10.947628529524977, CurrSamplesPerSec=10.651203141293117, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11892/20000 [21:55:58<22:00:03,  9.77s/it][2022-12-22 11:55:23,816] [INFO] [timer.py:197:stop] 0/5893, RunningAvgSamplesPerSec=10.947622522791649, CurrSamplesPerSec=10.912356851654518, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11893/20000 [21:56:08<22:01:05,  9.78s/it][2022-12-22 11:55:33,777] [INFO] [timer.py:197:stop] 0/5894, RunningAvgSamplesPerSec=10.947629305537646, CurrSamplesPerSec=10.987732858822024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11894/20000 [21:56:18<22:08:21,  9.83s/it][2022-12-22 11:55:43,179] [INFO] [timer.py:197:stop] 0/5895, RunningAvgSamplesPerSec=10.947651063998636, CurrSamplesPerSec=11.077371242980995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11895/20000 [21:56:27<21:50:45,  9.70s/it][2022-12-22 11:55:52,222] [INFO] [timer.py:197:stop] 0/5896, RunningAvgSamplesPerSec=10.94769808355974, CurrSamplesPerSec=11.23198077392436, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11896/20000 [21:56:36<21:23:49,  9.51s/it][2022-12-22 11:56:01,581] [INFO] [timer.py:197:stop] 0/5897, RunningAvgSamplesPerSec=10.94773910933649, CurrSamplesPerSec=11.195007452621429, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11897/20000 [21:56:46<21:17:46,  9.46s/it][2022-12-22 11:56:10,807] [INFO] [timer.py:197:stop] 0/5898, RunningAvgSamplesPerSec=10.947777484741863, CurrSamplesPerSec=11.178774594168091, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11898/20000 [21:56:55<21:08:03,  9.39s/it][2022-12-22 11:56:20,034] [INFO] [timer.py:197:stop] 0/5899, RunningAvgSamplesPerSec=10.947812392434649, CurrSamplesPerSec=11.1575722434274, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 59%|█████▉    | 11899/20000 [21:57:04<21:01:14,  9.34s/it][2022-12-22 11:56:29,231] [INFO] [logging.py:68:log_dist] [Rank 0] step=11900, skipped=24, lr=[4.166666666666667e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:56:29,232] [INFO] [timer.py:197:stop] 0/5900, RunningAvgSamplesPerSec=10.947786270608132, CurrSamplesPerSec=10.795883563355021, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11900/20000 [21:57:13<20:55:18,  9.30s/it]

                                                           
{'loss': 0.0696, 'learning_rate': 4.166666666666667e-06, 'epoch': 0.59}


 60%|█████▉    | 11900/20000 [21:57:13<20:55:18,  9.30s/it][2022-12-22 11:56:39,348] [INFO] [timer.py:197:stop] 0/5901, RunningAvgSamplesPerSec=10.947788213292839, CurrSamplesPerSec=10.95925817418379, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11901/20000 [21:57:23<21:28:15,  9.54s/it][2022-12-22 11:56:48,729] [INFO] [timer.py:197:stop] 0/5902, RunningAvgSamplesPerSec=10.94780121159185, CurrSamplesPerSec=11.025019093065525, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11902/20000 [21:57:33<21:21:30,  9.49s/it][2022-12-22 11:56:58,000] [INFO] [timer.py:197:stop] 0/5903, RunningAvgSamplesPerSec=10.947792455788983, CurrSamplesPerSec=10.8963758788863, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11903/20000 [21:57:42<21:12:17,  9.43s/it][2022-12-22 11:57:07,399] [INFO] [timer.py:197:stop] 0/5904, RunningAvgSamplesPerSec=10.947792499494083, CurrSamplesPerSec=10.948050409357732, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11904/20000 [21:57:51<21:10:57,  9.42s/it][2022-12-22 11:57:17,047] [INFO] [timer.py:197:stop] 0/5905, RunningAvgSamplesPerSec=10.947706762037106, CurrSamplesPerSec=10.464043839020333, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11905/20000 [21:58:01<21:20:02,  9.49s/it][2022-12-22 11:57:26,757] [INFO] [timer.py:197:stop] 0/5906, RunningAvgSamplesPerSec=10.947674257442104, CurrSamplesPerSec=10.75910515307495, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11906/20000 [21:58:11<21:28:54,  9.55s/it][2022-12-22 11:57:35,617] [INFO] [timer.py:197:stop] 0/5907, RunningAvgSamplesPerSec=10.94768316716012, CurrSamplesPerSec=11.000540160089173, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11907/20000 [21:58:20<21:00:37,  9.35s/it][2022-12-22 11:57:45,905] [INFO] [timer.py:197:stop] 0/5908, RunningAvgSamplesPerSec=10.947706126174502, CurrSamplesPerSec=11.084979342706253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11908/20000 [21:58:30<21:38:34,  9.63s/it][2022-12-22 11:57:56,110] [INFO] [timer.py:197:stop] 0/5909, RunningAvgSamplesPerSec=10.947705267829363, CurrSamplesPerSec=10.942638228152896, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11909/20000 [21:58:40<22:01:43,  9.80s/it][2022-12-22 11:58:06,010] [INFO] [logging.py:68:log_dist] [Rank 0] step=11910, skipped=24, lr=[4.161538461538462e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:58:06,011] [INFO] [timer.py:197:stop] 0/5910, RunningAvgSamplesPerSec=10.947719022257067, CurrSamplesPerSec=11.029574008157685, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11910/20000 [21:58:50<22:05:35,  9.83s/it][2022-12-22 11:58:16,096] [INFO] [timer.py:197:stop] 0/5911, RunningAvgSamplesPerSec=10.947738342156063, CurrSamplesPerSec=11.063083102329934, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11911/20000 [21:59:00<22:15:41,  9.91s/it][2022-12-22 11:58:25,007] [INFO] [timer.py:197:stop] 0/5912, RunningAvgSamplesPerSec=10.947750388703108, CurrSamplesPerSec=11.019399380844098, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11912/20000 [21:59:09<21:35:13,  9.61s/it][2022-12-22 11:58:34,053] [INFO] [timer.py:197:stop] 0/5913, RunningAvgSamplesPerSec=10.947785067436072, CurrSamplesPerSec=11.156647105629393, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11913/20000 [21:59:18<21:12:19,  9.44s/it][2022-12-22 11:58:44,612] [INFO] [timer.py:197:stop] 0/5914, RunningAvgSamplesPerSec=10.94777192378193, CurrSamplesPerSec=10.870627342277361, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11914/20000 [21:59:29<21:57:26,  9.78s/it][2022-12-22 11:58:54,282] [INFO] [timer.py:197:stop] 0/5915, RunningAvgSamplesPerSec=10.94777006999274, CurrSamplesPerSec=10.936821430633307, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11915/20000 [21:59:38<21:52:58,  9.74s/it][2022-12-22 11:59:03,117] [INFO] [timer.py:197:stop] 0/5916, RunningAvgSamplesPerSec=10.947787400891924, CurrSamplesPerSec=11.05123348657827, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11916/20000 [21:59:47<21:16:06,  9.47s/it][2022-12-22 11:59:12,595] [INFO] [timer.py:197:stop] 0/5917, RunningAvgSamplesPerSec=10.94775457585668, CurrSamplesPerSec=10.757010197813482, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11917/20000 [21:59:57<21:16:12,  9.47s/it][2022-12-22 11:59:22,125] [INFO] [timer.py:197:stop] 0/5918, RunningAvgSamplesPerSec=10.947753678695745, CurrSamplesPerSec=10.942449543280334, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11918/20000 [22:00:06<21:18:20,  9.49s/it][2022-12-22 11:59:31,458] [INFO] [timer.py:197:stop] 0/5919, RunningAvgSamplesPerSec=10.947729981327072, CurrSamplesPerSec=10.809309226173806, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11919/20000 [22:00:15<21:11:49,  9.44s/it][2022-12-22 11:59:42,261] [INFO] [logging.py:68:log_dist] [Rank 0] step=11920, skipped=24, lr=[4.156410256410257e-06], mom=[[0.9, 0.999]]
[2022-12-22 11:59:42,262] [INFO] [timer.py:197:stop] 0/5920, RunningAvgSamplesPerSec=10.947727830047834, CurrSamplesPerSec=10.93501349648087, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11920/20000 [22:00:26<22:06:36,  9.85s/it][2022-12-22 11:59:51,107] [INFO] [timer.py:197:stop] 0/5921, RunningAvgSamplesPerSec=10.947734263592322, CurrSamplesPerSec=10.985940876188225, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11921/20000 [22:00:35<21:25:49,  9.55s/it][2022-12-22 12:00:00,657] [INFO] [timer.py:197:stop] 0/5922, RunningAvgSamplesPerSec=10.947725945749859, CurrSamplesPerSec=10.89871309045947, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11922/20000 [22:00:45<21:25:41,  9.55s/it][2022-12-22 12:00:10,266] [INFO] [timer.py:197:stop] 0/5923, RunningAvgSamplesPerSec=10.947688634589948, CurrSamplesPerSec=10.731175700471521, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11923/20000 [22:00:54<21:27:56,  9.57s/it][2022-12-22 12:00:19,465] [INFO] [timer.py:197:stop] 0/5924, RunningAvgSamplesPerSec=10.947721603434116, CurrSamplesPerSec=11.146474689155543, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11924/20000 [22:01:03<21:12:54,  9.46s/it][2022-12-22 12:00:28,956] [INFO] [timer.py:197:stop] 0/5925, RunningAvgSamplesPerSec=10.947735114217563, CurrSamplesPerSec=11.028335133623253, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11925/20000 [22:01:13<21:14:07,  9.47s/it]

                                                           
{'loss': 0.0623, 'learning_rate': 4.1538461538461545e-06, 'epoch': 0.6}


 60%|█████▉    | 11925/20000 [22:01:13<21:14:07,  9.47s/it][2022-12-22 12:00:38,152] [INFO] [timer.py:197:stop] 0/5926, RunningAvgSamplesPerSec=10.947752282444254, CurrSamplesPerSec=11.050393223068214, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11926/20000 [22:01:22<21:03:02,  9.39s/it][2022-12-22 12:00:47,504] [INFO] [timer.py:197:stop] 0/5927, RunningAvgSamplesPerSec=10.947767919706044, CurrSamplesPerSec=11.041193719509364, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11927/20000 [22:01:31<21:01:29,  9.38s/it][2022-12-22 12:00:56,903] [INFO] [timer.py:197:stop] 0/5928, RunningAvgSamplesPerSec=10.947742375280558, CurrSamplesPerSec=10.798455863863134, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11928/20000 [22:01:41<21:02:17,  9.38s/it][2022-12-22 12:01:06,192] [INFO] [timer.py:197:stop] 0/5929, RunningAvgSamplesPerSec=10.947742321259565, CurrSamplesPerSec=10.947422202208068, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11929/20000 [22:01:50<20:58:20,  9.35s/it][2022-12-22 12:01:15,541] [INFO] [logging.py:68:log_dist] [Rank 0] step=11930, skipped=24, lr=[4.1512820512820516e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:01:15,542] [INFO] [timer.py:197:stop] 0/5930, RunningAvgSamplesPerSec=10.947760054628453, CurrSamplesPerSec=11.053884770812902, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11930/20000 [22:02:00<20:58:00,  9.35s/it][2022-12-22 12:01:24,856] [INFO] [timer.py:197:stop] 0/5931, RunningAvgSamplesPerSec=10.947792329514119, CurrSamplesPerSec=11.142521547491818, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11931/20000 [22:02:09<20:56:15,  9.34s/it][2022-12-22 12:01:34,113] [INFO] [timer.py:197:stop] 0/5932, RunningAvgSamplesPerSec=10.947738357613527, CurrSamplesPerSec=10.63682830753444, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11932/20000 [22:02:18<20:52:41,  9.32s/it][2022-12-22 12:01:42,957] [INFO] [timer.py:197:stop] 0/5933, RunningAvgSamplesPerSec=10.94776829942501, CurrSamplesPerSec=11.128250867953176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11933/20000 [22:02:27<20:33:31,  9.17s/it][2022-12-22 12:01:52,758] [INFO] [timer.py:197:stop] 0/5934, RunningAvgSamplesPerSec=10.947800455711956, CurrSamplesPerSec=11.141901347593526, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11934/20000 [22:02:37<20:58:37,  9.36s/it][2022-12-22 12:02:02,010] [INFO] [timer.py:197:stop] 0/5935, RunningAvgSamplesPerSec=10.947807956816275, CurrSamplesPerSec=10.9924861293476, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11935/20000 [22:02:46<20:53:59,  9.33s/it][2022-12-22 12:02:10,915] [INFO] [timer.py:197:stop] 0/5936, RunningAvgSamplesPerSec=10.947808743032185, CurrSamplesPerSec=10.952475350699146, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11936/20000 [22:02:55<20:36:46,  9.20s/it][2022-12-22 12:02:21,582] [INFO] [timer.py:197:stop] 0/5937, RunningAvgSamplesPerSec=10.947790753592765, CurrSamplesPerSec=10.842072428321618, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11937/20000 [22:03:06<21:35:39,  9.64s/it][2022-12-22 12:02:30,842] [INFO] [timer.py:197:stop] 0/5938, RunningAvgSamplesPerSec=10.947827542662065, CurrSamplesPerSec=11.170614677181083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11938/20000 [22:03:15<21:20:08,  9.53s/it][2022-12-22 12:02:41,670] [INFO] [timer.py:197:stop] 0/5939, RunningAvgSamplesPerSec=10.947848926464351, CurrSamplesPerSec=11.07627242710803, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11939/20000 [22:03:26<22:12:23,  9.92s/it][2022-12-22 12:02:50,959] [INFO] [logging.py:68:log_dist] [Rank 0] step=11940, skipped=24, lr=[4.1461538461538465e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:02:50,960] [INFO] [timer.py:197:stop] 0/5940, RunningAvgSamplesPerSec=10.947871505940128, CurrSamplesPerSec=11.083587952426473, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11940/20000 [22:03:35<21:46:55,  9.73s/it][2022-12-22 12:03:00,299] [INFO] [timer.py:197:stop] 0/5941, RunningAvgSamplesPerSec=10.94784093746632, CurrSamplesPerSec=10.769286281191851, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11941/20000 [22:03:44<21:31:04,  9.61s/it][2022-12-22 12:03:10,723] [INFO] [timer.py:197:stop] 0/5942, RunningAvgSamplesPerSec=10.94788091994105, CurrSamplesPerSec=11.190602269616287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11942/20000 [22:03:55<22:03:35,  9.86s/it][2022-12-22 12:03:20,065] [INFO] [timer.py:197:stop] 0/5943, RunningAvgSamplesPerSec=10.947834969511725, CurrSamplesPerSec=10.681529911933584, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11943/20000 [22:04:04<21:42:44,  9.70s/it][2022-12-22 12:03:29,164] [INFO] [timer.py:197:stop] 0/5944, RunningAvgSamplesPerSec=10.947819705483104, CurrSamplesPerSec=10.857881220356873, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11944/20000 [22:04:13<21:18:19,  9.52s/it][2022-12-22 12:03:39,098] [INFO] [timer.py:197:stop] 0/5945, RunningAvgSamplesPerSec=10.947823121818097, CurrSamplesPerSec=10.968160701392327, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11945/20000 [22:04:23<21:34:48,  9.64s/it][2022-12-22 12:03:48,191] [INFO] [timer.py:197:stop] 0/5946, RunningAvgSamplesPerSec=10.947837728219962, CurrSamplesPerSec=11.035337480301708, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11946/20000 [22:04:32<21:12:25,  9.48s/it][2022-12-22 12:03:56,966] [INFO] [timer.py:197:stop] 0/5947, RunningAvgSamplesPerSec=10.947847049826027, CurrSamplesPerSec=11.003536571268823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11947/20000 [22:04:41<20:43:55,  9.27s/it][2022-12-22 12:04:06,789] [INFO] [timer.py:197:stop] 0/5948, RunningAvgSamplesPerSec=10.94784284929969, CurrSamplesPerSec=10.92292756178706, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11948/20000 [22:04:51<21:06:07,  9.43s/it][2022-12-22 12:04:16,379] [INFO] [timer.py:197:stop] 0/5949, RunningAvgSamplesPerSec=10.947822298289708, CurrSamplesPerSec=10.826975080151989, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11949/20000 [22:05:00<21:12:12,  9.48s/it][2022-12-22 12:04:25,380] [INFO] [logging.py:68:log_dist] [Rank 0] step=11950, skipped=24, lr=[4.141025641025641e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:04:25,381] [INFO] [timer.py:197:stop] 0/5950, RunningAvgSamplesPerSec=10.947842035932391, CurrSamplesPerSec=11.066494166493449, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11950/20000 [22:05:09<20:52:44,  9.34s/it]

                                                           
{'loss': 0.0538, 'learning_rate': 4.141025641025641e-06, 'epoch': 0.6}


 60%|█████▉    | 11950/20000 [22:05:09<20:52:44,  9.34s/it][2022-12-22 12:04:34,928] [INFO] [timer.py:197:stop] 0/5951, RunningAvgSamplesPerSec=10.947873537241614, CurrSamplesPerSec=11.138506502821127, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11951/20000 [22:05:19<21:01:01,  9.40s/it][2022-12-22 12:04:43,842] [INFO] [timer.py:197:stop] 0/5952, RunningAvgSamplesPerSec=10.94791863502584, CurrSamplesPerSec=11.222946237983335, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11952/20000 [22:05:28<20:41:20,  9.25s/it][2022-12-22 12:04:53,023] [INFO] [timer.py:197:stop] 0/5953, RunningAvgSamplesPerSec=10.947879185228626, CurrSamplesPerSec=10.718080678839238, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11953/20000 [22:05:37<20:38:13,  9.23s/it][2022-12-22 12:05:02,815] [INFO] [timer.py:197:stop] 0/5954, RunningAvgSamplesPerSec=10.947915301209914, CurrSamplesPerSec=11.167146102723176, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11954/20000 [22:05:47<21:00:33,  9.40s/it][2022-12-22 12:05:12,426] [INFO] [timer.py:197:stop] 0/5955, RunningAvgSamplesPerSec=10.947883847998577, CurrSamplesPerSec=10.763822326720337, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11955/20000 [22:05:56<21:08:54,  9.46s/it][2022-12-22 12:05:21,560] [INFO] [timer.py:197:stop] 0/5956, RunningAvgSamplesPerSec=10.94791844398321, CurrSamplesPerSec=11.15781758139195, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11956/20000 [22:06:06<20:55:28,  9.36s/it][2022-12-22 12:05:30,674] [INFO] [timer.py:197:stop] 0/5957, RunningAvgSamplesPerSec=10.947913849518983, CurrSamplesPerSec=10.920626603322923, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11957/20000 [22:06:15<20:45:14,  9.29s/it][2022-12-22 12:05:39,916] [INFO] [timer.py:197:stop] 0/5958, RunningAvgSamplesPerSec=10.947906207185902, CurrSamplesPerSec=10.902584546011196, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11958/20000 [22:06:24<20:43:12,  9.28s/it][2022-12-22 12:05:49,396] [INFO] [timer.py:197:stop] 0/5959, RunningAvgSamplesPerSec=10.947919390852801, CurrSamplesPerSec=11.02700865924849, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11959/20000 [22:06:33<20:51:15,  9.34s/it][2022-12-22 12:05:58,588] [INFO] [logging.py:68:log_dist] [Rank 0] step=11960, skipped=24, lr=[4.135897435897436e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:05:58,589] [INFO] [timer.py:197:stop] 0/5960, RunningAvgSamplesPerSec=10.947936186216584, CurrSamplesPerSec=11.048909084922125, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11960/20000 [22:06:43<20:45:19,  9.29s/it][2022-12-22 12:06:07,752] [INFO] [timer.py:197:stop] 0/5961, RunningAvgSamplesPerSec=10.947866357404237, CurrSamplesPerSec=10.547060255796866, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11961/20000 [22:06:52<20:39:56,  9.25s/it][2022-12-22 12:06:17,593] [INFO] [timer.py:197:stop] 0/5962, RunningAvgSamplesPerSec=10.94790240884563, CurrSamplesPerSec=11.167033679634828, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11962/20000 [22:07:02<21:03:20,  9.43s/it][2022-12-22 12:06:26,661] [INFO] [timer.py:197:stop] 0/5963, RunningAvgSamplesPerSec=10.947909467203242, CurrSamplesPerSec=10.990139576807776, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11963/20000 [22:07:11<20:48:37,  9.32s/it][2022-12-22 12:06:35,909] [INFO] [timer.py:197:stop] 0/5964, RunningAvgSamplesPerSec=10.947887501944477, CurrSamplesPerSec=10.818500303333412, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11964/20000 [22:07:20<20:45:30,  9.30s/it][2022-12-22 12:06:45,130] [INFO] [timer.py:197:stop] 0/5965, RunningAvgSamplesPerSec=10.947845543141193, CurrSamplesPerSec=10.703276500487684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11965/20000 [22:07:29<20:42:13,  9.28s/it][2022-12-22 12:06:54,400] [INFO] [timer.py:197:stop] 0/5966, RunningAvgSamplesPerSec=10.947902441775643, CurrSamplesPerSec=11.298041997322583, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11966/20000 [22:07:38<20:41:49,  9.27s/it][2022-12-22 12:07:03,494] [INFO] [timer.py:197:stop] 0/5967, RunningAvgSamplesPerSec=10.947866013996677, CurrSamplesPerSec=10.734838872915615, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11967/20000 [22:07:47<20:34:26,  9.22s/it][2022-12-22 12:07:13,140] [INFO] [timer.py:197:stop] 0/5968, RunningAvgSamplesPerSec=10.947791280725923, CurrSamplesPerSec=10.519451831820101, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11968/20000 [22:07:57<20:51:22,  9.35s/it][2022-12-22 12:07:24,723] [INFO] [timer.py:197:stop] 0/5969, RunningAvgSamplesPerSec=10.947826849781418, CurrSamplesPerSec=11.16422708814902, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11969/20000 [22:08:09<22:20:58, 10.02s/it][2022-12-22 12:07:33,668] [INFO] [logging.py:68:log_dist] [Rank 0] step=11970, skipped=24, lr=[4.130769230769231e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:07:33,669] [INFO] [timer.py:197:stop] 0/5970, RunningAvgSamplesPerSec=10.94783038759856, CurrSamplesPerSec=10.968981333619263, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11970/20000 [22:08:18<21:37:43,  9.70s/it][2022-12-22 12:07:42,683] [INFO] [timer.py:197:stop] 0/5971, RunningAvgSamplesPerSec=10.947828271350994, CurrSamplesPerSec=10.935213061633254, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11971/20000 [22:08:27<21:10:09,  9.49s/it][2022-12-22 12:07:52,146] [INFO] [timer.py:197:stop] 0/5972, RunningAvgSamplesPerSec=10.94787009185006, CurrSamplesPerSec=11.203322289529734, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11972/20000 [22:08:36<21:08:51,  9.48s/it][2022-12-22 12:08:01,474] [INFO] [timer.py:197:stop] 0/5973, RunningAvgSamplesPerSec=10.947873337791231, CurrSamplesPerSec=10.967285973635823, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11973/20000 [22:08:45<21:02:27,  9.44s/it][2022-12-22 12:08:10,470] [INFO] [timer.py:197:stop] 0/5974, RunningAvgSamplesPerSec=10.947909442172117, CurrSamplesPerSec=11.16781975955415, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11974/20000 [22:08:54<20:44:38,  9.30s/it][2022-12-22 12:08:19,897] [INFO] [timer.py:197:stop] 0/5975, RunningAvgSamplesPerSec=10.947864419582743, CurrSamplesPerSec=10.68543573224975, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11975/20000 [22:09:04<20:49:22,  9.34s/it]

                                                           
{'loss': 0.0582, 'learning_rate': 4.128205128205128e-06, 'epoch': 0.6}


 60%|█████▉    | 11975/20000 [22:09:04<20:49:22,  9.34s/it][2022-12-22 12:08:29,173] [INFO] [timer.py:197:stop] 0/5976, RunningAvgSamplesPerSec=10.947893383061743, CurrSamplesPerSec=11.123670339617487, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11976/20000 [22:09:13<20:46:37,  9.32s/it][2022-12-22 12:08:38,783] [INFO] [timer.py:197:stop] 0/5977, RunningAvgSamplesPerSec=10.947911183573945, CurrSamplesPerSec=11.05529466520287, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11977/20000 [22:09:23<20:58:01,  9.41s/it][2022-12-22 12:08:47,661] [INFO] [timer.py:197:stop] 0/5978, RunningAvgSamplesPerSec=10.947906558060161, CurrSamplesPerSec=10.920338718483636, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11978/20000 [22:09:32<20:36:36,  9.25s/it][2022-12-22 12:08:59,194] [INFO] [timer.py:197:stop] 0/5979, RunningAvgSamplesPerSec=10.94791580454024, CurrSamplesPerSec=11.003453127648406, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11979/20000 [22:09:43<22:08:02,  9.93s/it][2022-12-22 12:09:08,343] [INFO] [logging.py:68:log_dist] [Rank 0] step=11980, skipped=24, lr=[4.125641025641026e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:09:08,344] [INFO] [timer.py:197:stop] 0/5980, RunningAvgSamplesPerSec=10.947945108692068, CurrSamplesPerSec=11.125944222945083, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11980/20000 [22:09:52<21:36:25,  9.70s/it][2022-12-22 12:09:17,784] [INFO] [timer.py:197:stop] 0/5981, RunningAvgSamplesPerSec=10.947911804168426, CurrSamplesPerSec=10.752373931949426, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11981/20000 [22:10:02<21:25:53,  9.62s/it][2022-12-22 12:09:26,878] [INFO] [timer.py:197:stop] 0/5982, RunningAvgSamplesPerSec=10.947905442680412, CurrSamplesPerSec=10.910001813080836, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11982/20000 [22:10:11<21:04:34,  9.46s/it][2022-12-22 12:09:36,073] [INFO] [timer.py:197:stop] 0/5983, RunningAvgSamplesPerSec=10.947917770076847, CurrSamplesPerSec=11.022135429123871, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11983/20000 [22:10:20<20:53:41,  9.38s/it][2022-12-22 12:09:45,518] [INFO] [timer.py:197:stop] 0/5984, RunningAvgSamplesPerSec=10.947896478810943, CurrSamplesPerSec=10.822017849455621, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11984/20000 [22:10:29<20:56:00,  9.40s/it][2022-12-22 12:09:54,559] [INFO] [timer.py:197:stop] 0/5985, RunningAvgSamplesPerSec=10.94784529847157, CurrSamplesPerSec=10.650014846159351, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11985/20000 [22:10:39<20:41:24,  9.29s/it][2022-12-22 12:10:04,188] [INFO] [timer.py:197:stop] 0/5986, RunningAvgSamplesPerSec=10.947833483831884, CurrSamplesPerSec=10.87760004732995, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11986/20000 [22:10:48<20:54:44,  9.39s/it][2022-12-22 12:10:13,565] [INFO] [timer.py:197:stop] 0/5987, RunningAvgSamplesPerSec=10.947766942609887, CurrSamplesPerSec=10.563560623995729, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11987/20000 [22:10:58<20:53:53,  9.39s/it][2022-12-22 12:10:22,767] [INFO] [timer.py:197:stop] 0/5988, RunningAvgSamplesPerSec=10.947765704124837, CurrSamplesPerSec=10.940358387167269, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11988/20000 [22:11:07<20:46:14,  9.33s/it][2022-12-22 12:10:32,092] [INFO] [timer.py:197:stop] 0/5989, RunningAvgSamplesPerSec=10.947771193674797, CurrSamplesPerSec=10.980730586012536, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11989/20000 [22:11:16<20:45:46,  9.33s/it][2022-12-22 12:10:41,208] [INFO] [logging.py:68:log_dist] [Rank 0] step=11990, skipped=24, lr=[4.120512820512821e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:10:41,208] [INFO] [timer.py:197:stop] 0/5990, RunningAvgSamplesPerSec=10.947780635088733, CurrSamplesPerSec=11.004599798885115, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11990/20000 [22:11:25<20:37:02,  9.27s/it][2022-12-22 12:10:50,136] [INFO] [timer.py:197:stop] 0/5991, RunningAvgSamplesPerSec=10.947772062625196, CurrSamplesPerSec=10.896679752591984, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11991/20000 [22:11:34<20:23:18,  9.16s/it][2022-12-22 12:11:00,680] [INFO] [timer.py:197:stop] 0/5992, RunningAvgSamplesPerSec=10.947744919417293, CurrSamplesPerSec=10.787563148539672, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11992/20000 [22:11:45<21:18:24,  9.58s/it][2022-12-22 12:11:09,890] [INFO] [timer.py:197:stop] 0/5993, RunningAvgSamplesPerSec=10.947753886976734, CurrSamplesPerSec=11.001734470586461, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11993/20000 [22:11:54<21:03:30,  9.47s/it][2022-12-22 12:11:19,144] [INFO] [timer.py:197:stop] 0/5994, RunningAvgSamplesPerSec=10.947784465191, CurrSamplesPerSec=11.13409671182708, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11994/20000 [22:12:03<20:54:46,  9.40s/it][2022-12-22 12:11:28,726] [INFO] [timer.py:197:stop] 0/5995, RunningAvgSamplesPerSec=10.947780846896311, CurrSamplesPerSec=10.92614288375684, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11995/20000 [22:12:13<21:01:44,  9.46s/it][2022-12-22 12:11:38,187] [INFO] [timer.py:197:stop] 0/5996, RunningAvgSamplesPerSec=10.947768224554894, CurrSamplesPerSec=10.872641719977024, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11996/20000 [22:12:22<21:01:44,  9.46s/it][2022-12-22 12:11:47,044] [INFO] [timer.py:197:stop] 0/5997, RunningAvgSamplesPerSec=10.947783685403621, CurrSamplesPerSec=11.041247308588714, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11997/20000 [22:12:31<20:37:30,  9.28s/it][2022-12-22 12:11:56,734] [INFO] [timer.py:197:stop] 0/5998, RunningAvgSamplesPerSec=10.94782648356033, CurrSamplesPerSec=11.21055992148633, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11998/20000 [22:12:41<20:53:52,  9.40s/it][2022-12-22 12:12:05,656] [INFO] [timer.py:197:stop] 0/5999, RunningAvgSamplesPerSec=10.94784841829893, CurrSamplesPerSec=11.08096860136812, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|█████▉    | 11999/20000 [22:12:50<20:34:31,  9.26s/it][2022-12-22 12:12:15,336] [INFO] [logging.py:68:log_dist] [Rank 0] step=12000, skipped=24, lr=[4.115384615384616e-06], mom=[[0.9, 0.999]]
[2022-12-22 12:12:15,337] [INFO] [timer.py:197:stop] 0/6000, RunningAvgSamplesPerSec=10.947788480313054, CurrSamplesPerSec=10.59976879445372, MemAllocated=1.52GB, MaxMemAllocated=26.06GB


 60%|██████    | 12000/20000 [22:12:59<20:51:17,  9.38s/it]

                                                           
{'loss': 0.0733, 'learning_rate': 4.115384615384616e-06, 'epoch': 0.6}


 60%|██████    | 12000/20000 [22:12:59<20:51:17,  9.38s/it][INFO|trainer.py:2955] 2022-12-22 12:12:15,343 >> ***** Running Evaluation *****
[INFO|trainer.py:2959] 2022-12-22 12:12:15,343 >>   Num examples: Unknown
[INFO|trainer.py:2960] 2022-12-22 12:12:15,343 >>   Batch size = 32
[INFO|trainer_utils.py:689] 2022-12-22 12:12:18,068 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: duration, age, input_length, gender, speaker_id. If duration, age, input_length, gender, speaker_id are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
[INFO|configuration_utils.py:523] 2022-12-22 12:12:18,079 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:12:23,298 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:12:30,590 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:12:36,520 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:12:44,186 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:12:50,112 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:12:55,874 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:01,017 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:06,614 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:11,708 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:16,520 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:22,129 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:27,180 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:32,644 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:37,316 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:42,897 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:49,526 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:13:55,081 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:00,277 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:05,934 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:11,459 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:16,899 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:22,514 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:28,574 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:33,415 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:38,617 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:44,145 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:49,506 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:54,813 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:14:59,828 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:15:05,697 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}

[INFO|configuration_utils.py:523] 2022-12-22 12:15:09,614 >> Generate config GenerationConfig {
  "begin_suppress_tokens": [
    220,
    50257
  ],
  "bos_token_id": 50257,
  "decoder_start_token_id": 50258,
  "eos_token_id": 50257,
  "max_length": 448,
  "pad_token_id": 50257,
  "transformers_version": "4.26.0.dev0",
  "use_cache": false
}



                                                           
{'eval_loss': 0.1458740234375, 'eval_wer': 9.788891681326966, 'eval_runtime': 211.5744, 'eval_samples_per_second': 4.726, 'eval_steps_per_second': 0.151, 'epoch': 0.6}


 60%|██████    | 12000/20000 [22:16:31<20:51:17,  9.38s/it][INFO|trainer.py:2700] 2022-12-22 12:15:46,920 >> Saving model checkpoint to ./checkpoint-12000
[INFO|configuration_utils.py:447] 2022-12-22 12:15:46,921 >> Configuration saved in ./checkpoint-12000/config.json
[INFO|modeling_utils.py:1693] 2022-12-22 12:15:48,765 >> Model weights saved in ./checkpoint-12000/pytorch_model.bin
[INFO|feature_extraction_utils.py:368] 2022-12-22 12:15:48,784 >> Feature extractor saved in ./checkpoint-12000/preprocessor_config.json
[2022-12-22 12:15:48,786] [INFO] [logging.py:68:log_dist] [Rank 0] [Torch] Checkpoint global_step12000 is begin to save!
/home/ubuntu/whisper-medium-is/.venv/lib/python3.9/site-packages/torch/nn/modules/module.py:1432: UserWarning: Positional args are being deprecated, use kwargs instead. Refer to https://pytorch.org/docs/master/generated/torch.nn.Module.html#torch.nn.Module.state_dict for details.
  warnings.warn(
[2022-12-22 12:15:48,798] [INFO] [logging.py:68:log_dist] [Rank 0] Saving model checkpoint: ./checkpoint-12000/global_step12000/mp_rank_00_model_states.pt
[2022-12-22 12:15:48,799] [INFO] [torch_checkpoint_engine.py:15:save] [Torch] Saving ./checkpoint-12000/global_step12000/mp_rank_00_model_states.pt...
[2022-12-22 12:15:50,597] [INFO] [torch_checkpoint_engine.py:17:save] [Torch] Saved ./checkpoint-12000/global_step12000/mp_rank_00_model_states.pt.
[2022-12-22 12:15:50,598] [INFO] [torch_checkpoint_engine.py:15:save] [Torch] Saving ./checkpoint-12000/global_step12000/zero_pp_rank_0_mp_rank_00_optim_states.pt...
[2022-12-22 12:15:57,742] [INFO] [torch_checkpoint_engine.py:17:save] [Torch] Saved ./checkpoint-12000/global_step12000/zero_pp_rank_0_mp_rank_00_optim_states.pt.
[2022-12-22 12:15:57,742] [INFO] [engine.py:3269:_save_zero_checkpoint] zero checkpoint saved ./checkpoint-12000/global_step12000/zero_pp_rank_0_mp_rank_00_optim_states.pt
[2022-12-22 12:15:57,742] [INFO] [torch_checkpoint_engine.py:27:commit] [Torch] Checkpoint global_step12000 is ready now!
[INFO|feature_extraction_utils.py:368] 2022-12-22 12:15:59,176 >> Feature extractor saved in ./preprocessor_config.json