/workspace/thumbs_up/train_dreambooth_lora_sdxl.py:122: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
  def resize_image(image, size, interpolation=Image.BILINEAR):
10/13/2023 09:11:50 - INFO - __main__ - Current working directory: /workspace/thumbs_up
10/13/2023 09:11:50 - INFO - __main__ - Distributed environment: NO
Num processes: 1
Process index: 0
Local process index: 0
Device: cuda

Mixed precision type: fp16

You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
{'variance_type', 'dynamic_thresholding_ratio', 'thresholding', 'clip_sample_range'} was not found in config. Values will be initialized to default values.
{'dropout', 'attention_type'} was not found in config. Values will be initialized to default values.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["id2label"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["bos_token_id"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["eos_token_id"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["id2label"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["bos_token_id"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["eos_token_id"]` will be overriden.
Some weights of ViTModel were not initialized from the model checkpoint at facebook/dino-vits16 and are newly initialized: ['pooler.dense.weight', 'pooler.dense.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
wandb: Currently logged in as: berglund. Use `wandb login --relogin` to force relogin
wandb: - Waiting for wandb.init()...
wandb: \ Waiting for wandb.init()...
wandb: Tracking run with wandb version 0.15.12
wandb: Run data is saved locally in /workspace/thumbs_up/wandb/run-20231013_091209-wfyqbtqx
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run devoted-dawn-47
wandb: ⭐️ View project at https://wandb.ai/berglund/dreambooth-lora-sd-xl
wandb: 🚀 View run at https://wandb.ai/berglund/dreambooth-lora-sd-xl/runs/wfyqbtqx
10/13/2023 09:12:11 - INFO - __main__ - ***** Running training *****
10/13/2023 09:12:11 - INFO - __main__ -   Num examples = 21
10/13/2023 09:12:11 - INFO - __main__ -   Num batches each epoch = 11
10/13/2023 09:12:11 - INFO - __main__ -   Num Epochs = 55
10/13/2023 09:12:11 - INFO - __main__ -   Instantaneous batch size per device = 2
10/13/2023 09:12:11 - INFO - __main__ -   Total train batch size (w. parallel, distributed & accumulation) = 2
10/13/2023 09:12:11 - INFO - __main__ -   Gradient Accumulation steps = 1
10/13/2023 09:12:11 - INFO - __main__ -   Total optimization steps = 600

Steps:   0%|          | 0/600 [00:00<?, ?it/s]/usr/local/lib/python3.10/dist-packages/diffusers/models/attention_processor.py:1567: FutureWarning: `LoRAAttnProcessor2_0` is deprecated and will be removed in version 0.26.0. Make sure use AttnProcessor2_0 instead by settingLoRA layers to `self.{to_q,to_k,to_v,to_out[0]}.lora_layer` respectively. This will be done automatically when using `LoraLoaderMixin.load_lora_weights`
  deprecate(

Steps:   0%|          | 1/600 [00:02<25:33,  2.56s/it]
Steps:   0%|          | 1/600 [00:02<25:33,  2.56s/it, loss=0.0509, lr=0.0001]
Steps:   0%|          | 2/600 [00:04<20:50,  2.09s/it, loss=0.0509, lr=0.0001]
Steps:   0%|          | 2/600 [00:04<20:50,  2.09s/it, loss=0.0944, lr=0.0001]
Steps:   0%|          | 3/600 [00:06<20:31,  2.06s/it, loss=0.0944, lr=0.0001]
Steps:   0%|          | 3/600 [00:06<20:31,  2.06s/it, loss=0.235, lr=0.0001] 
Steps:   1%|          | 4/600 [00:08<19:22,  1.95s/it, loss=0.235, lr=0.0001]
Steps:   1%|          | 4/600 [00:08<19:22,  1.95s/it, loss=0.0463, lr=0.0001]
Steps:   1%|          | 5/600 [00:09<18:19,  1.85s/it, loss=0.0463, lr=0.0001]
Steps:   1%|          | 5/600 [00:09<18:19,  1.85s/it, loss=0.0609, lr=0.0001]
Steps:   1%|          | 6/600 [00:11<18:07,  1.83s/it, loss=0.0609, lr=0.0001]
Steps:   1%|          | 6/600 [00:11<18:07,  1.83s/it, loss=0.00998, lr=0.0001]
Steps:   1%|          | 7/600 [00:13<16:58,  1.72s/it, loss=0.00998, lr=0.0001]
Steps:   1%|          | 7/600 [00:13<16:58,  1.72s/it, loss=0.132, lr=0.0001]  
Steps:   1%|▏         | 8/600 [00:14<16:13,  1.64s/it, loss=0.132, lr=0.0001]
Steps:   1%|▏         | 8/600 [00:14<16:13,  1.64s/it, loss=0.134, lr=0.0001]
Steps:   2%|▏         | 9/600 [00:16<16:46,  1.70s/it, loss=0.134, lr=0.0001]
Steps:   2%|▏         | 9/600 [00:16<16:46,  1.70s/it, loss=0.0904, lr=0.0001]
Steps:   2%|▏         | 10/600 [00:17<15:40,  1.59s/it, loss=0.0904, lr=0.0001]
Steps:   2%|▏         | 10/600 [00:17<15:40,  1.59s/it, loss=0.0585, lr=0.0001]
Steps:   2%|▏         | 11/600 [00:18<13:34,  1.38s/it, loss=0.0585, lr=0.0001]
Steps:   2%|▏         | 11/600 [00:18<13:34,  1.38s/it, loss=0.291, lr=0.0001] 10/13/2023 09:12:30 - INFO - __main__ - Running validation... 
 Generating 4 images with prompts: "a photo of Brad Pitt in a suit and sunglasses showing <thumbs_up> thumbs up", "a photo of Barack Obama wearing a vest showing <thumbs_up> thumbs up", "a photo of a black man at the beach showing <thumbs_up> thumbs up".


Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]Loaded scheduler as EulerDiscreteScheduler from `scheduler` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer_2 as CLIPTokenizer from `tokenizer_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.

Loading pipeline components...: 100%|██████████| 7/7 [00:00<00:00, 70.63it/s]
{'variance_type', 'lambda_min_clipped', 'thresholding', 'solver_order', 'algorithm_type', 'lower_order_final', 'dynamic_thresholding_ratio', 'solver_type'} was not found in config. Values will be initialized to default values.
10/13/2023 09:13:27 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/13/2023 09:14:17 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/13/2023 09:15:07 - INFO - __main__ - Image features shape: torch.Size([5, 75648])

Steps:   2%|▏         | 12/600 [03:05<8:26:53, 51.72s/it, loss=0.291, lr=0.0001]
Steps:   2%|▏         | 12/600 [03:05<8:26:53, 51.72s/it, loss=0.143, lr=0.0001]
Steps:   2%|▏         | 13/600 [03:07<5:58:26, 36.64s/it, loss=0.143, lr=0.0001]
Steps:   2%|▏         | 13/600 [03:07<5:58:26, 36.64s/it, loss=0.103, lr=0.0001]
Steps:   2%|▏         | 14/600 [03:08<4:14:12, 26.03s/it, loss=0.103, lr=0.0001]
Steps:   2%|▏         | 14/600 [03:08<4:14:12, 26.03s/it, loss=0.185, lr=0.0001]
Steps:   2%|▎         | 15/600 [03:10<3:01:31, 18.62s/it, loss=0.185, lr=0.0001]
Steps:   2%|▎         | 15/600 [03:10<3:01:31, 18.62s/it, loss=0.136, lr=0.0001]
Steps:   3%|▎         | 16/600 [03:11<2:11:14, 13.48s/it, loss=0.136, lr=0.0001]
Steps:   3%|▎         | 16/600 [03:11<2:11:14, 13.48s/it, loss=0.0198, lr=0.0001]
Steps:   3%|▎         | 17/600 [03:13<1:36:56,  9.98s/it, loss=0.0198, lr=0.0001]
Steps:   3%|▎         | 17/600 [03:13<1:36:56,  9.98s/it, loss=0.15, lr=0.0001]  
Steps:   3%|▎         | 18/600 [03:15<1:13:04,  7.53s/it, loss=0.15, lr=0.0001]
Steps:   3%|▎         | 18/600 [03:15<1:13:04,  7.53s/it, loss=0.112, lr=0.0001]
Steps:   3%|▎         | 19/600 [03:17<55:32,  5.74s/it, loss=0.112, lr=0.0001]  
Steps:   3%|▎         | 19/600 [03:17<55:32,  5.74s/it, loss=0.184, lr=0.0001]
Steps:   3%|▎         | 20/600 [03:18<43:31,  4.50s/it, loss=0.184, lr=0.0001]
Steps:   3%|▎         | 20/600 [03:18<43:31,  4.50s/it, loss=0.143, lr=0.0001]
Steps:   4%|▎         | 21/600 [03:20<34:16,  3.55s/it, loss=0.143, lr=0.0001]
Steps:   4%|▎         | 21/600 [03:20<34:16,  3.55s/it, loss=0.102, lr=0.0001]
Steps:   4%|▎         | 22/600 [03:20<26:09,  2.71s/it, loss=0.102, lr=0.0001]
Steps:   4%|▎         | 22/600 [03:20<26:09,  2.71s/it, loss=0.319, lr=0.0001]
Steps:   4%|▍         | 23/600 [03:23<24:43,  2.57s/it, loss=0.319, lr=0.0001]
Steps:   4%|▍         | 23/600 [03:23<24:43,  2.57s/it, loss=0.0733, lr=0.0001]
Steps:   4%|▍         | 24/600 [03:24<21:25,  2.23s/it, loss=0.0733, lr=0.0001]
Steps:   4%|▍         | 24/600 [03:24<21:25,  2.23s/it, loss=0.0966, lr=0.0001]
Steps:   4%|▍         | 25/600 [03:26<19:52,  2.07s/it, loss=0.0966, lr=0.0001]
Steps:   4%|▍         | 25/600 [03:26<19:52,  2.07s/it, loss=0.0827, lr=0.0001]
Steps:   4%|▍         | 26/600 [03:27<18:49,  1.97s/it, loss=0.0827, lr=0.0001]
Steps:   4%|▍         | 26/600 [03:27<18:49,  1.97s/it, loss=0.0604, lr=0.0001]
Steps:   4%|▍         | 27/600 [03:29<18:11,  1.90s/it, loss=0.0604, lr=0.0001]
Steps:   4%|▍         | 27/600 [03:29<18:11,  1.90s/it, loss=0.197, lr=0.0001] 
Steps:   5%|▍         | 28/600 [03:31<16:22,  1.72s/it, loss=0.197, lr=0.0001]
Steps:   5%|▍         | 28/600 [03:31<16:22,  1.72s/it, loss=0.0577, lr=0.0001]
Steps:   5%|▍         | 29/600 [03:32<16:44,  1.76s/it, loss=0.0577, lr=0.0001]
Steps:   5%|▍         | 29/600 [03:32<16:44,  1.76s/it, loss=0.00538, lr=0.0001]
Steps:   5%|▌         | 30/600 [03:34<16:59,  1.79s/it, loss=0.00538, lr=0.0001]
Steps:   5%|▌         | 30/600 [03:34<16:59,  1.79s/it, loss=0.15, lr=0.0001]   
Steps:   5%|▌         | 31/600 [03:36<16:21,  1.73s/it, loss=0.15, lr=0.0001]
Steps:   5%|▌         | 31/600 [03:36<16:21,  1.73s/it, loss=0.0863, lr=0.0001]
Steps:   5%|▌         | 32/600 [03:37<14:41,  1.55s/it, loss=0.0863, lr=0.0001]
Steps:   5%|▌         | 32/600 [03:37<14:41,  1.55s/it, loss=0.141, lr=0.0001] 
Steps:   6%|▌         | 33/600 [03:38<12:25,  1.32s/it, loss=0.141, lr=0.0001]
Steps:   6%|▌         | 33/600 [03:38<12:25,  1.32s/it, loss=0.0124, lr=0.0001]
Steps:   6%|▌         | 34/600 [03:40<15:56,  1.69s/it, loss=0.0124, lr=0.0001]
Steps:   6%|▌         | 34/600 [03:40<15:56,  1.69s/it, loss=0.0871, lr=0.0001]
Steps:   6%|▌         | 35/600 [03:42<14:59,  1.59s/it, loss=0.0871, lr=0.0001]
Steps:   6%|▌         | 35/600 [03:42<14:59,  1.59s/it, loss=0.136, lr=0.0001] 
Steps:   6%|▌         | 36/600 [03:43<14:37,  1.56s/it, loss=0.136, lr=0.0001]
Steps:   6%|▌         | 36/600 [03:43<14:37,  1.56s/it, loss=0.0604, lr=0.0001]
Steps:   6%|▌         | 37/600 [03:45<14:22,  1.53s/it, loss=0.0604, lr=0.0001]
Steps:   6%|▌         | 37/600 [03:45<14:22,  1.53s/it, loss=0.196, lr=0.0001] 
Steps:   6%|▋         | 38/600 [03:46<14:47,  1.58s/it, loss=0.196, lr=0.0001]
Steps:   6%|▋         | 38/600 [03:46<14:47,  1.58s/it, loss=0.183, lr=0.0001]
Steps:   6%|▋         | 39/600 [03:48<14:36,  1.56s/it, loss=0.183, lr=0.0001]
Steps:   6%|▋         | 39/600 [03:48<14:36,  1.56s/it, loss=0.175, lr=0.0001]
Steps:   7%|▋         | 40/600 [03:49<14:37,  1.57s/it, loss=0.175, lr=0.0001]
Steps:   7%|▋         | 40/600 [03:49<14:37,  1.57s/it, loss=0.0722, lr=0.0001]
Steps:   7%|▋         | 41/600 [03:51<15:26,  1.66s/it, loss=0.0722, lr=0.0001]
Steps:   7%|▋         | 41/600 [03:51<15:26,  1.66s/it, loss=0.0251, lr=0.0001]
Steps:   7%|▋         | 42/600 [03:53<15:14,  1.64s/it, loss=0.0251, lr=0.0001]
Steps:   7%|▋         | 42/600 [03:53<15:14,  1.64s/it, loss=0.173, lr=0.0001] 
Steps:   7%|▋         | 43/600 [03:54<14:42,  1.58s/it, loss=0.173, lr=0.0001]
Steps:   7%|▋         | 43/600 [03:54<14:42,  1.58s/it, loss=0.246, lr=0.0001]
Steps:   7%|▋         | 44/600 [03:55<12:23,  1.34s/it, loss=0.246, lr=0.0001]
Steps:   7%|▋         | 44/600 [03:55<12:23,  1.34s/it, loss=0.0921, lr=0.0001]
Steps:   8%|▊         | 45/600 [03:57<13:36,  1.47s/it, loss=0.0921, lr=0.0001]
Steps:   8%|▊         | 45/600 [03:57<13:36,  1.47s/it, loss=0.0782, lr=0.0001]
Steps:   8%|▊         | 46/600 [03:58<13:53,  1.51s/it, loss=0.0782, lr=0.0001]
Steps:   8%|▊         | 46/600 [03:58<13:53,  1.51s/it, loss=0.24, lr=0.0001]  
Steps:   8%|▊         | 47/600 [04:00<14:38,  1.59s/it, loss=0.24, lr=0.0001]
Steps:   8%|▊         | 47/600 [04:00<14:38,  1.59s/it, loss=0.149, lr=0.0001]
Steps:   8%|▊         | 48/600 [04:02<15:28,  1.68s/it, loss=0.149, lr=0.0001]
Steps:   8%|▊         | 48/600 [04:02<15:28,  1.68s/it, loss=0.0201, lr=0.0001]
Steps:   8%|▊         | 49/600 [04:04<15:21,  1.67s/it, loss=0.0201, lr=0.0001]
Steps:   8%|▊         | 49/600 [04:04<15:21,  1.67s/it, loss=0.263, lr=0.0001] 
Steps:   8%|▊         | 50/600 [04:05<15:16,  1.67s/it, loss=0.263, lr=0.0001]
Steps:   8%|▊         | 50/600 [04:05<15:16,  1.67s/it, loss=0.168, lr=0.0001]
Steps:   8%|▊         | 51/600 [04:07<15:17,  1.67s/it, loss=0.168, lr=0.0001]
Steps:   8%|▊         | 51/600 [04:07<15:17,  1.67s/it, loss=0.172, lr=0.0001]
Steps:   9%|▊         | 52/600 [04:09<15:27,  1.69s/it, loss=0.172, lr=0.0001]
Steps:   9%|▊         | 52/600 [04:09<15:27,  1.69s/it, loss=0.137, lr=0.0001]
Steps:   9%|▉         | 53/600 [04:10<14:30,  1.59s/it, loss=0.137, lr=0.0001]
Steps:   9%|▉         | 53/600 [04:10<14:30,  1.59s/it, loss=0.15, lr=0.0001] 
Steps:   9%|▉         | 54/600 [04:12<14:03,  1.55s/it, loss=0.15, lr=0.0001]
Steps:   9%|▉         | 54/600 [04:12<14:03,  1.55s/it, loss=0.0249, lr=0.0001]
Steps:   9%|▉         | 55/600 [04:12<11:54,  1.31s/it, loss=0.0249, lr=0.0001]
Steps:   9%|▉         | 55/600 [04:12<11:54,  1.31s/it, loss=0.0709, lr=0.0001]
Steps:   9%|▉         | 56/600 [04:15<15:05,  1.66s/it, loss=0.0709, lr=0.0001]
Steps:   9%|▉         | 56/600 [04:15<15:05,  1.66s/it, loss=0.16, lr=0.0001]  
Steps:  10%|▉         | 57/600 [04:17<15:18,  1.69s/it, loss=0.16, lr=0.0001]
Steps:  10%|▉         | 57/600 [04:17<15:18,  1.69s/it, loss=0.0126, lr=0.0001]
Steps:  10%|▉         | 58/600 [04:18<14:25,  1.60s/it, loss=0.0126, lr=0.0001]
Steps:  10%|▉         | 58/600 [04:18<14:25,  1.60s/it, loss=0.169, lr=0.0001] 
Steps:  10%|▉         | 59/600 [04:20<14:18,  1.59s/it, loss=0.169, lr=0.0001]
Steps:  10%|▉         | 59/600 [04:20<14:18,  1.59s/it, loss=0.154, lr=0.0001]
Steps:  10%|█         | 60/600 [04:21<14:06,  1.57s/it, loss=0.154, lr=0.0001]
Steps:  10%|█         | 60/600 [04:21<14:06,  1.57s/it, loss=0.07, lr=0.0001] 
Steps:  10%|█         | 61/600 [04:23<14:15,  1.59s/it, loss=0.07, lr=0.0001]
Steps:  10%|█         | 61/600 [04:23<14:15,  1.59s/it, loss=0.104, lr=0.0001]
Steps:  10%|█         | 62/600 [04:24<13:45,  1.54s/it, loss=0.104, lr=0.0001]
Steps:  10%|█         | 62/600 [04:24<13:45,  1.54s/it, loss=0.0639, lr=0.0001]
Steps:  10%|█         | 63/600 [04:26<14:36,  1.63s/it, loss=0.0639, lr=0.0001]
Steps:  10%|█         | 63/600 [04:26<14:36,  1.63s/it, loss=0.135, lr=0.0001] 
Steps:  11%|█         | 64/600 [04:28<14:49,  1.66s/it, loss=0.135, lr=0.0001]
Steps:  11%|█         | 64/600 [04:28<14:49,  1.66s/it, loss=0.169, lr=0.0001]
Steps:  11%|█         | 65/600 [04:29<13:34,  1.52s/it, loss=0.169, lr=0.0001]
Steps:  11%|█         | 65/600 [04:29<13:34,  1.52s/it, loss=0.0589, lr=0.0001]
Steps:  11%|█         | 66/600 [04:30<11:30,  1.29s/it, loss=0.0589, lr=0.0001]
Steps:  11%|█         | 66/600 [04:30<11:30,  1.29s/it, loss=0.00226, lr=0.0001]
Steps:  11%|█         | 67/600 [04:32<14:02,  1.58s/it, loss=0.00226, lr=0.0001]
Steps:  11%|█         | 67/600 [04:32<14:02,  1.58s/it, loss=0.0975, lr=0.0001] 
Steps:  11%|█▏        | 68/600 [04:33<13:46,  1.55s/it, loss=0.0975, lr=0.0001]
Steps:  11%|█▏        | 68/600 [04:33<13:46,  1.55s/it, loss=0.0995, lr=0.0001]
Steps:  12%|█▏        | 69/600 [04:35<14:10,  1.60s/it, loss=0.0995, lr=0.0001]
Steps:  12%|█▏        | 69/600 [04:35<14:10,  1.60s/it, loss=0.2, lr=0.0001]   
Steps:  12%|█▏        | 70/600 [04:37<14:50,  1.68s/it, loss=0.2, lr=0.0001]
Steps:  12%|█▏        | 70/600 [04:37<14:50,  1.68s/it, loss=0.144, lr=0.0001]
Steps:  12%|█▏        | 71/600 [04:39<14:41,  1.67s/it, loss=0.144, lr=0.0001]
Steps:  12%|█▏        | 71/600 [04:39<14:41,  1.67s/it, loss=0.0461, lr=0.0001]
Steps:  12%|█▏        | 72/600 [04:40<14:23,  1.64s/it, loss=0.0461, lr=0.0001]
Steps:  12%|█▏        | 72/600 [04:40<14:23,  1.64s/it, loss=0.0286, lr=0.0001]
Steps:  12%|█▏        | 73/600 [04:42<13:58,  1.59s/it, loss=0.0286, lr=0.0001]
Steps:  12%|█▏        | 73/600 [04:42<13:58,  1.59s/it, loss=0.0159, lr=0.0001]
Steps:  12%|█▏        | 74/600 [04:43<14:14,  1.62s/it, loss=0.0159, lr=0.0001]
Steps:  12%|█▏        | 74/600 [04:43<14:14,  1.62s/it, loss=0.114, lr=0.0001] 
Steps:  12%|█▎        | 75/600 [04:45<14:30,  1.66s/it, loss=0.114, lr=0.0001]
Steps:  12%|█▎        | 75/600 [04:45<14:30,  1.66s/it, loss=0.0512, lr=0.0001]
Steps:  13%|█▎        | 76/600 [04:46<13:27,  1.54s/it, loss=0.0512, lr=0.0001]
Steps:  13%|█▎        | 76/600 [04:46<13:27,  1.54s/it, loss=0.14, lr=0.0001]  
Steps:  13%|█▎        | 77/600 [04:47<11:23,  1.31s/it, loss=0.14, lr=0.0001]
Steps:  13%|█▎        | 77/600 [04:47<11:23,  1.31s/it, loss=0.0021, lr=0.0001]
Steps:  13%|█▎        | 78/600 [04:49<13:49,  1.59s/it, loss=0.0021, lr=0.0001]
Steps:  13%|█▎        | 78/600 [04:49<13:49,  1.59s/it, loss=0.058, lr=0.0001] 
Steps:  13%|█▎        | 79/600 [04:51<14:08,  1.63s/it, loss=0.058, lr=0.0001]
Steps:  13%|█▎        | 79/600 [04:51<14:08,  1.63s/it, loss=0.209, lr=0.0001]
Steps:  13%|█▎        | 80/600 [04:53<13:48,  1.59s/it, loss=0.209, lr=0.0001]
Steps:  13%|█▎        | 80/600 [04:53<13:48,  1.59s/it, loss=0.0339, lr=0.0001]
Steps:  14%|█▎        | 81/600 [04:54<14:13,  1.64s/it, loss=0.0339, lr=0.0001]
Steps:  14%|█▎        | 81/600 [04:54<14:13,  1.64s/it, loss=0.111, lr=0.0001] 
Steps:  14%|█▎        | 82/600 [04:56<14:19,  1.66s/it, loss=0.111, lr=0.0001]
Steps:  14%|█▎        | 82/600 [04:56<14:19,  1.66s/it, loss=0.0383, lr=0.0001]
Steps:  14%|█▍        | 83/600 [04:57<13:12,  1.53s/it, loss=0.0383, lr=0.0001]
Steps:  14%|█▍        | 83/600 [04:57<13:12,  1.53s/it, loss=0.0317, lr=0.0001]
Steps:  14%|█▍        | 84/600 [04:59<14:06,  1.64s/it, loss=0.0317, lr=0.0001]
Steps:  14%|█▍        | 84/600 [04:59<14:06,  1.64s/it, loss=0.0762, lr=0.0001]
Steps:  14%|█▍        | 85/600 [05:01<14:00,  1.63s/it, loss=0.0762, lr=0.0001]
Steps:  14%|█▍        | 85/600 [05:01<14:00,  1.63s/it, loss=0.201, lr=0.0001] 
Steps:  14%|█▍        | 86/600 [05:03<14:02,  1.64s/it, loss=0.201, lr=0.0001]
Steps:  14%|█▍        | 86/600 [05:03<14:02,  1.64s/it, loss=0.0298, lr=0.0001]
Steps:  14%|█▍        | 87/600 [05:04<13:01,  1.52s/it, loss=0.0298, lr=0.0001]
Steps:  14%|█▍        | 87/600 [05:04<13:01,  1.52s/it, loss=0.193, lr=0.0001] 
Steps:  15%|█▍        | 88/600 [05:05<11:02,  1.29s/it, loss=0.193, lr=0.0001]
Steps:  15%|█▍        | 88/600 [05:05<11:02,  1.29s/it, loss=0.397, lr=0.0001]
Steps:  15%|█▍        | 89/600 [05:07<13:17,  1.56s/it, loss=0.397, lr=0.0001]
Steps:  15%|█▍        | 89/600 [05:07<13:17,  1.56s/it, loss=0.0848, lr=0.0001]
Steps:  15%|█▌        | 90/600 [05:08<12:57,  1.52s/it, loss=0.0848, lr=0.0001]
Steps:  15%|█▌        | 90/600 [05:08<12:57,  1.52s/it, loss=0.156, lr=0.0001] 
Steps:  15%|█▌        | 91/600 [05:10<13:26,  1.59s/it, loss=0.156, lr=0.0001]
Steps:  15%|█▌        | 91/600 [05:10<13:26,  1.59s/it, loss=0.0624, lr=0.0001]
Steps:  15%|█▌        | 92/600 [05:12<13:33,  1.60s/it, loss=0.0624, lr=0.0001]
Steps:  15%|█▌        | 92/600 [05:12<13:33,  1.60s/it, loss=0.142, lr=0.0001] 
Steps:  16%|█▌        | 93/600 [05:13<13:53,  1.64s/it, loss=0.142, lr=0.0001]
Steps:  16%|█▌        | 93/600 [05:13<13:53,  1.64s/it, loss=0.00491, lr=0.0001]
Steps:  16%|█▌        | 94/600 [05:15<13:53,  1.65s/it, loss=0.00491, lr=0.0001]
Steps:  16%|█▌        | 94/600 [05:15<13:53,  1.65s/it, loss=0.111, lr=0.0001]  
Steps:  16%|█▌        | 95/600 [05:17<13:53,  1.65s/it, loss=0.111, lr=0.0001]
Steps:  16%|█▌        | 95/600 [05:17<13:53,  1.65s/it, loss=0.0723, lr=0.0001]
Steps:  16%|█▌        | 96/600 [05:18<13:11,  1.57s/it, loss=0.0723, lr=0.0001]
Steps:  16%|█▌        | 96/600 [05:18<13:11,  1.57s/it, loss=0.0142, lr=0.0001]
Steps:  16%|█▌        | 97/600 [05:20<13:28,  1.61s/it, loss=0.0142, lr=0.0001]
Steps:  16%|█▌        | 97/600 [05:20<13:28,  1.61s/it, loss=0.00479, lr=0.0001]
Steps:  16%|█▋        | 98/600 [05:21<12:54,  1.54s/it, loss=0.00479, lr=0.0001]
Steps:  16%|█▋        | 98/600 [05:21<12:54,  1.54s/it, loss=0.13, lr=0.0001]   
Steps:  16%|█▋        | 99/600 [05:22<10:55,  1.31s/it, loss=0.13, lr=0.0001]
Steps:  16%|█▋        | 99/600 [05:22<10:55,  1.31s/it, loss=0.25, lr=0.0001]
Steps:  17%|█▋        | 100/600 [05:24<12:22,  1.49s/it, loss=0.25, lr=0.0001]
Steps:  17%|█▋        | 100/600 [05:24<12:22,  1.49s/it, loss=0.226, lr=0.0001]
Steps:  17%|█▋        | 101/600 [05:26<13:09,  1.58s/it, loss=0.226, lr=0.0001]
Steps:  17%|█▋        | 101/600 [05:26<13:09,  1.58s/it, loss=0.0418, lr=0.0001]
Steps:  17%|█▋        | 102/600 [05:27<13:04,  1.57s/it, loss=0.0418, lr=0.0001]
Steps:  17%|█▋        | 102/600 [05:27<13:04,  1.57s/it, loss=0.00838, lr=0.0001]
Steps:  17%|█▋        | 103/600 [05:29<12:56,  1.56s/it, loss=0.00838, lr=0.0001]
Steps:  17%|█▋        | 103/600 [05:29<12:56,  1.56s/it, loss=0.109, lr=0.0001]  
Steps:  17%|█▋        | 104/600 [05:30<13:28,  1.63s/it, loss=0.109, lr=0.0001]
Steps:  17%|█▋        | 104/600 [05:30<13:28,  1.63s/it, loss=0.0142, lr=0.0001]
Steps:  18%|█▊        | 105/600 [05:32<13:57,  1.69s/it, loss=0.0142, lr=0.0001]
Steps:  18%|█▊        | 105/600 [05:32<13:57,  1.69s/it, loss=0.186, lr=0.0001] 
Steps:  18%|█▊        | 106/600 [05:34<13:54,  1.69s/it, loss=0.186, lr=0.0001]
Steps:  18%|█▊        | 106/600 [05:34<13:54,  1.69s/it, loss=0.0971, lr=0.0001]
Steps:  18%|█▊        | 107/600 [05:36<13:50,  1.69s/it, loss=0.0971, lr=0.0001]
Steps:  18%|█▊        | 107/600 [05:36<13:50,  1.69s/it, loss=0.205, lr=0.0001] 
Steps:  18%|█▊        | 108/600 [05:37<13:37,  1.66s/it, loss=0.205, lr=0.0001]
Steps:  18%|█▊        | 108/600 [05:37<13:37,  1.66s/it, loss=0.0545, lr=0.0001]
Steps:  18%|█▊        | 109/600 [05:38<12:27,  1.52s/it, loss=0.0545, lr=0.0001]
Steps:  18%|█▊        | 109/600 [05:38<12:27,  1.52s/it, loss=0.0294, lr=0.0001]
Steps:  18%|█▊        | 110/600 [05:39<10:34,  1.29s/it, loss=0.0294, lr=0.0001]
Steps:  18%|█▊        | 110/600 [05:39<10:34,  1.29s/it, loss=0.321, lr=0.0001] 
Steps:  18%|█▊        | 111/600 [05:41<12:48,  1.57s/it, loss=0.321, lr=0.0001]
Steps:  18%|█▊        | 111/600 [05:41<12:48,  1.57s/it, loss=0.119, lr=0.0001]
Steps:  19%|█▊        | 112/600 [05:43<12:37,  1.55s/it, loss=0.119, lr=0.0001]
Steps:  19%|█▊        | 112/600 [05:43<12:37,  1.55s/it, loss=0.159, lr=0.0001]
Steps:  19%|█▉        | 113/600 [05:44<12:41,  1.56s/it, loss=0.159, lr=0.0001]
Steps:  19%|█▉        | 113/600 [05:44<12:41,  1.56s/it, loss=0.197, lr=0.0001]
Steps:  19%|█▉        | 114/600 [05:46<13:17,  1.64s/it, loss=0.197, lr=0.0001]
Steps:  19%|█▉        | 114/600 [05:46<13:17,  1.64s/it, loss=0.0343, lr=0.0001]
Steps:  19%|█▉        | 115/600 [05:48<13:24,  1.66s/it, loss=0.0343, lr=0.0001]
Steps:  19%|█▉        | 115/600 [05:48<13:24,  1.66s/it, loss=0.264, lr=0.0001] 
Steps:  19%|█▉        | 116/600 [05:49<12:37,  1.57s/it, loss=0.264, lr=0.0001]
Steps:  19%|█▉        | 116/600 [05:49<12:37,  1.57s/it, loss=0.00298, lr=0.0001]
Steps:  20%|█▉        | 117/600 [05:51<13:16,  1.65s/it, loss=0.00298, lr=0.0001]
Steps:  20%|█▉        | 117/600 [05:51<13:16,  1.65s/it, loss=0.0194, lr=0.0001] 
Steps:  20%|█▉        | 118/600 [05:53<12:35,  1.57s/it, loss=0.0194, lr=0.0001]
Steps:  20%|█▉        | 118/600 [05:53<12:35,  1.57s/it, loss=0.0501, lr=0.0001]
Steps:  20%|█▉        | 119/600 [05:54<12:38,  1.58s/it, loss=0.0501, lr=0.0001]
Steps:  20%|█▉        | 119/600 [05:54<12:38,  1.58s/it, loss=0.017, lr=0.0001] 
Steps:  20%|██        | 120/600 [05:56<12:07,  1.52s/it, loss=0.017, lr=0.0001]
Steps:  20%|██        | 120/600 [05:56<12:07,  1.52s/it, loss=0.199, lr=0.0001]
Steps:  20%|██        | 121/600 [05:56<10:15,  1.29s/it, loss=0.199, lr=0.0001]
Steps:  20%|██        | 121/600 [05:56<10:15,  1.29s/it, loss=0.357, lr=0.0001]
Steps:  20%|██        | 122/600 [05:59<13:13,  1.66s/it, loss=0.357, lr=0.0001]
Steps:  20%|██        | 122/600 [05:59<13:13,  1.66s/it, loss=0.0326, lr=0.0001]
Steps:  20%|██        | 123/600 [06:00<13:02,  1.64s/it, loss=0.0326, lr=0.0001]
Steps:  20%|██        | 123/600 [06:00<13:02,  1.64s/it, loss=0.0202, lr=0.0001]
Steps:  21%|██        | 124/600 [06:02<12:47,  1.61s/it, loss=0.0202, lr=0.0001]
Steps:  21%|██        | 124/600 [06:02<12:47,  1.61s/it, loss=0.0847, lr=0.0001]
Steps:  21%|██        | 125/600 [06:04<12:47,  1.62s/it, loss=0.0847, lr=0.0001]
Steps:  21%|██        | 125/600 [06:04<12:47,  1.62s/it, loss=0.0871, lr=0.0001]
Steps:  21%|██        | 126/600 [06:05<12:43,  1.61s/it, loss=0.0871, lr=0.0001]
Steps:  21%|██        | 126/600 [06:05<12:43,  1.61s/it, loss=0.131, lr=0.0001] 
Steps:  21%|██        | 127/600 [06:07<12:20,  1.57s/it, loss=0.131, lr=0.0001]
Steps:  21%|██        | 127/600 [06:07<12:20,  1.57s/it, loss=0.0999, lr=0.0001]
Steps:  21%|██▏       | 128/600 [06:08<12:08,  1.54s/it, loss=0.0999, lr=0.0001]
Steps:  21%|██▏       | 128/600 [06:08<12:08,  1.54s/it, loss=0.0346, lr=0.0001]
Steps:  22%|██▏       | 129/600 [06:10<12:21,  1.58s/it, loss=0.0346, lr=0.0001]
Steps:  22%|██▏       | 129/600 [06:10<12:21,  1.58s/it, loss=0.0887, lr=0.0001]
Steps:  22%|██▏       | 130/600 [06:11<12:26,  1.59s/it, loss=0.0887, lr=0.0001]
Steps:  22%|██▏       | 130/600 [06:11<12:26,  1.59s/it, loss=0.0555, lr=0.0001]
Steps:  22%|██▏       | 131/600 [06:13<11:16,  1.44s/it, loss=0.0555, lr=0.0001]
Steps:  22%|██▏       | 131/600 [06:13<11:16,  1.44s/it, loss=0.155, lr=0.0001] 
Steps:  22%|██▏       | 132/600 [06:13<09:37,  1.23s/it, loss=0.155, lr=0.0001]
Steps:  22%|██▏       | 132/600 [06:13<09:37,  1.23s/it, loss=0.363, lr=0.0001]
Steps:  22%|██▏       | 133/600 [06:15<11:39,  1.50s/it, loss=0.363, lr=0.0001]
Steps:  22%|██▏       | 133/600 [06:15<11:39,  1.50s/it, loss=0.0932, lr=0.0001]
Steps:  22%|██▏       | 134/600 [06:17<11:59,  1.54s/it, loss=0.0932, lr=0.0001]
Steps:  22%|██▏       | 134/600 [06:17<11:59,  1.54s/it, loss=0.0805, lr=0.0001]
Steps:  22%|██▎       | 135/600 [06:19<12:21,  1.60s/it, loss=0.0805, lr=0.0001]
Steps:  22%|██▎       | 135/600 [06:19<12:21,  1.60s/it, loss=0.0711, lr=0.0001]
Steps:  23%|██▎       | 136/600 [06:20<12:40,  1.64s/it, loss=0.0711, lr=0.0001]
Steps:  23%|██▎       | 136/600 [06:20<12:40,  1.64s/it, loss=0.113, lr=0.0001] 
Steps:  23%|██▎       | 137/600 [06:22<12:51,  1.67s/it, loss=0.113, lr=0.0001]
Steps:  23%|██▎       | 137/600 [06:22<12:51,  1.67s/it, loss=0.104, lr=0.0001]
Steps:  23%|██▎       | 138/600 [06:24<12:48,  1.66s/it, loss=0.104, lr=0.0001]
Steps:  23%|██▎       | 138/600 [06:24<12:48,  1.66s/it, loss=0.127, lr=0.0001]
Steps:  23%|██▎       | 139/600 [06:25<12:33,  1.63s/it, loss=0.127, lr=0.0001]
Steps:  23%|██▎       | 139/600 [06:25<12:33,  1.63s/it, loss=0.0204, lr=0.0001]
Steps:  23%|██▎       | 140/600 [06:27<12:14,  1.60s/it, loss=0.0204, lr=0.0001]
Steps:  23%|██▎       | 140/600 [06:27<12:14,  1.60s/it, loss=0.186, lr=0.0001] 
Steps:  24%|██▎       | 141/600 [06:28<11:38,  1.52s/it, loss=0.186, lr=0.0001]
Steps:  24%|██▎       | 141/600 [06:28<11:38,  1.52s/it, loss=0.0764, lr=0.0001]
Steps:  24%|██▎       | 142/600 [06:29<10:42,  1.40s/it, loss=0.0764, lr=0.0001]
Steps:  24%|██▎       | 142/600 [06:29<10:42,  1.40s/it, loss=0.103, lr=0.0001] 
Steps:  24%|██▍       | 143/600 [06:30<09:11,  1.21s/it, loss=0.103, lr=0.0001]
Steps:  24%|██▍       | 143/600 [06:30<09:11,  1.21s/it, loss=0.112, lr=0.0001]
Steps:  24%|██▍       | 144/600 [06:33<12:00,  1.58s/it, loss=0.112, lr=0.0001]
Steps:  24%|██▍       | 144/600 [06:33<12:00,  1.58s/it, loss=0.0303, lr=0.0001]
Steps:  24%|██▍       | 145/600 [06:34<12:17,  1.62s/it, loss=0.0303, lr=0.0001]
Steps:  24%|██▍       | 145/600 [06:34<12:17,  1.62s/it, loss=0.0487, lr=0.0001]
Steps:  24%|██▍       | 146/600 [06:36<11:53,  1.57s/it, loss=0.0487, lr=0.0001]
Steps:  24%|██▍       | 146/600 [06:36<11:53,  1.57s/it, loss=0.0273, lr=0.0001]
Steps:  24%|██▍       | 147/600 [06:37<12:00,  1.59s/it, loss=0.0273, lr=0.0001]
Steps:  24%|██▍       | 147/600 [06:37<12:00,  1.59s/it, loss=0.147, lr=0.0001] 
Steps:  25%|██▍       | 148/600 [06:39<11:50,  1.57s/it, loss=0.147, lr=0.0001]
Steps:  25%|██▍       | 148/600 [06:39<11:50,  1.57s/it, loss=0.048, lr=0.0001]
Steps:  25%|██▍       | 149/600 [06:41<12:05,  1.61s/it, loss=0.048, lr=0.0001]
Steps:  25%|██▍       | 149/600 [06:41<12:05,  1.61s/it, loss=0.031, lr=0.0001]
Steps:  25%|██▌       | 150/600 [06:42<12:03,  1.61s/it, loss=0.031, lr=0.0001]
Steps:  25%|██▌       | 150/600 [06:42<12:03,  1.61s/it, loss=0.3, lr=0.0001]  
Steps:  25%|██▌       | 151/600 [06:44<11:49,  1.58s/it, loss=0.3, lr=0.0001]
Steps:  25%|██▌       | 151/600 [06:44<11:49,  1.58s/it, loss=0.214, lr=0.0001]
Steps:  25%|██▌       | 152/600 [06:45<11:11,  1.50s/it, loss=0.214, lr=0.0001]
Steps:  25%|██▌       | 152/600 [06:45<11:11,  1.50s/it, loss=0.102, lr=0.0001]
Steps:  26%|██▌       | 153/600 [06:46<10:43,  1.44s/it, loss=0.102, lr=0.0001]
Steps:  26%|██▌       | 153/600 [06:46<10:43,  1.44s/it, loss=0.171, lr=0.0001]
Steps:  26%|██▌       | 154/600 [06:47<09:10,  1.24s/it, loss=0.171, lr=0.0001]
Steps:  26%|██▌       | 154/600 [06:47<09:10,  1.24s/it, loss=0.00432, lr=0.0001]
Steps:  26%|██▌       | 155/600 [06:50<12:15,  1.65s/it, loss=0.00432, lr=0.0001]
Steps:  26%|██▌       | 155/600 [06:50<12:15,  1.65s/it, loss=0.201, lr=0.0001]  
Steps:  26%|██▌       | 156/600 [06:51<11:42,  1.58s/it, loss=0.201, lr=0.0001]
Steps:  26%|██▌       | 156/600 [06:51<11:42,  1.58s/it, loss=0.187, lr=0.0001]
Steps:  26%|██▌       | 157/600 [06:53<11:19,  1.53s/it, loss=0.187, lr=0.0001]
Steps:  26%|██▌       | 157/600 [06:53<11:19,  1.53s/it, loss=0.0747, lr=0.0001]
Steps:  26%|██▋       | 158/600 [06:54<11:14,  1.53s/it, loss=0.0747, lr=0.0001]
Steps:  26%|██▋       | 158/600 [06:54<11:14,  1.53s/it, loss=0.113, lr=0.0001] 
Steps:  26%|██▋       | 159/600 [06:56<11:56,  1.62s/it, loss=0.113, lr=0.0001]
Steps:  26%|██▋       | 159/600 [06:56<11:56,  1.62s/it, loss=0.0799, lr=0.0001]
Steps:  27%|██▋       | 160/600 [06:58<12:09,  1.66s/it, loss=0.0799, lr=0.0001]
Steps:  27%|██▋       | 160/600 [06:58<12:09,  1.66s/it, loss=0.134, lr=0.0001] 
Steps:  27%|██▋       | 161/600 [06:59<11:31,  1.57s/it, loss=0.134, lr=0.0001]
Steps:  27%|██▋       | 161/600 [06:59<11:31,  1.57s/it, loss=0.0384, lr=0.0001]
Steps:  27%|██▋       | 162/600 [07:01<11:18,  1.55s/it, loss=0.0384, lr=0.0001]
Steps:  27%|██▋       | 162/600 [07:01<11:18,  1.55s/it, loss=0.0579, lr=0.0001]
Steps:  27%|██▋       | 163/600 [07:02<11:15,  1.54s/it, loss=0.0579, lr=0.0001]
Steps:  27%|██▋       | 163/600 [07:02<11:15,  1.54s/it, loss=0.00926, lr=0.0001]
Steps:  27%|██▋       | 164/600 [07:03<10:35,  1.46s/it, loss=0.00926, lr=0.0001]
Steps:  27%|██▋       | 164/600 [07:03<10:35,  1.46s/it, loss=0.115, lr=0.0001]  
Steps:  28%|██▊       | 165/600 [07:04<09:02,  1.25s/it, loss=0.115, lr=0.0001]
Steps:  28%|██▊       | 165/600 [07:04<09:02,  1.25s/it, loss=0.321, lr=0.0001]
Steps:  28%|██▊       | 166/600 [07:06<10:08,  1.40s/it, loss=0.321, lr=0.0001]
Steps:  28%|██▊       | 166/600 [07:06<10:08,  1.40s/it, loss=0.125, lr=0.0001]
Steps:  28%|██▊       | 167/600 [07:08<10:37,  1.47s/it, loss=0.125, lr=0.0001]
Steps:  28%|██▊       | 167/600 [07:08<10:37,  1.47s/it, loss=0.0779, lr=0.0001]
Steps:  28%|██▊       | 168/600 [07:09<11:07,  1.54s/it, loss=0.0779, lr=0.0001]
Steps:  28%|██▊       | 168/600 [07:09<11:07,  1.54s/it, loss=0.0375, lr=0.0001]
Steps:  28%|██▊       | 169/600 [07:11<11:50,  1.65s/it, loss=0.0375, lr=0.0001]
Steps:  28%|██▊       | 169/600 [07:11<11:50,  1.65s/it, loss=0.188, lr=0.0001] 
Steps:  28%|██▊       | 170/600 [07:13<12:02,  1.68s/it, loss=0.188, lr=0.0001]
Steps:  28%|██▊       | 170/600 [07:13<12:02,  1.68s/it, loss=0.141, lr=0.0001]
Steps:  28%|██▊       | 171/600 [07:14<11:47,  1.65s/it, loss=0.141, lr=0.0001]
Steps:  28%|██▊       | 171/600 [07:14<11:47,  1.65s/it, loss=0.216, lr=0.0001]
Steps:  29%|██▊       | 172/600 [07:16<11:34,  1.62s/it, loss=0.216, lr=0.0001]
Steps:  29%|██▊       | 172/600 [07:16<11:34,  1.62s/it, loss=0.195, lr=0.0001]
Steps:  29%|██▉       | 173/600 [07:18<11:18,  1.59s/it, loss=0.195, lr=0.0001]
Steps:  29%|██▉       | 173/600 [07:18<11:18,  1.59s/it, loss=0.129, lr=0.0001]
Steps:  29%|██▉       | 174/600 [07:19<11:07,  1.57s/it, loss=0.129, lr=0.0001]
Steps:  29%|██▉       | 174/600 [07:19<11:07,  1.57s/it, loss=0.0098, lr=0.0001]
Steps:  29%|██▉       | 175/600 [07:20<10:30,  1.48s/it, loss=0.0098, lr=0.0001]
Steps:  29%|██▉       | 175/600 [07:20<10:30,  1.48s/it, loss=0.178, lr=0.0001] 
Steps:  29%|██▉       | 176/600 [07:21<08:57,  1.27s/it, loss=0.178, lr=0.0001]
Steps:  29%|██▉       | 176/600 [07:21<08:57,  1.27s/it, loss=0.0222, lr=0.0001]
Steps:  30%|██▉       | 177/600 [07:24<12:00,  1.70s/it, loss=0.0222, lr=0.0001]
Steps:  30%|██▉       | 177/600 [07:24<12:00,  1.70s/it, loss=0.0303, lr=0.0001]
Steps:  30%|██▉       | 178/600 [07:25<11:54,  1.69s/it, loss=0.0303, lr=0.0001]
Steps:  30%|██▉       | 178/600 [07:25<11:54,  1.69s/it, loss=0.0417, lr=0.0001]
Steps:  30%|██▉       | 179/600 [07:27<11:15,  1.60s/it, loss=0.0417, lr=0.0001]
Steps:  30%|██▉       | 179/600 [07:27<11:15,  1.60s/it, loss=0.0112, lr=0.0001]
Steps:  30%|███       | 180/600 [07:28<11:14,  1.61s/it, loss=0.0112, lr=0.0001]
Steps:  30%|███       | 180/600 [07:28<11:14,  1.61s/it, loss=0.159, lr=0.0001] 
Steps:  30%|███       | 181/600 [07:30<11:09,  1.60s/it, loss=0.159, lr=0.0001]
Steps:  30%|███       | 181/600 [07:30<11:09,  1.60s/it, loss=0.0292, lr=0.0001]
Steps:  30%|███       | 182/600 [07:32<11:11,  1.61s/it, loss=0.0292, lr=0.0001]
Steps:  30%|███       | 182/600 [07:32<11:11,  1.61s/it, loss=0.0687, lr=0.0001]
Steps:  30%|███       | 183/600 [07:33<10:54,  1.57s/it, loss=0.0687, lr=0.0001]
Steps:  30%|███       | 183/600 [07:33<10:54,  1.57s/it, loss=0.0915, lr=0.0001]
Steps:  31%|███       | 184/600 [07:35<10:43,  1.55s/it, loss=0.0915, lr=0.0001]
Steps:  31%|███       | 184/600 [07:35<10:43,  1.55s/it, loss=0.191, lr=0.0001] 
Steps:  31%|███       | 185/600 [07:36<10:48,  1.56s/it, loss=0.191, lr=0.0001]
Steps:  31%|███       | 185/600 [07:36<10:48,  1.56s/it, loss=0.00971, lr=0.0001]
Steps:  31%|███       | 186/600 [07:38<10:09,  1.47s/it, loss=0.00971, lr=0.0001]
Steps:  31%|███       | 186/600 [07:38<10:09,  1.47s/it, loss=0.0841, lr=0.0001] 
Steps:  31%|███       | 187/600 [07:38<08:40,  1.26s/it, loss=0.0841, lr=0.0001]
Steps:  31%|███       | 187/600 [07:38<08:40,  1.26s/it, loss=0.0331, lr=0.0001]
Steps:  31%|███▏      | 188/600 [07:41<11:40,  1.70s/it, loss=0.0331, lr=0.0001]
Steps:  31%|███▏      | 188/600 [07:41<11:40,  1.70s/it, loss=0.0572, lr=0.0001]
Steps:  32%|███▏      | 189/600 [07:43<11:19,  1.65s/it, loss=0.0572, lr=0.0001]
Steps:  32%|███▏      | 189/600 [07:43<11:19,  1.65s/it, loss=0.116, lr=0.0001] 
Steps:  32%|███▏      | 190/600 [07:44<11:35,  1.70s/it, loss=0.116, lr=0.0001]
Steps:  32%|███▏      | 190/600 [07:44<11:35,  1.70s/it, loss=0.192, lr=0.0001]
Steps:  32%|███▏      | 191/600 [07:46<11:15,  1.65s/it, loss=0.192, lr=0.0001]
Steps:  32%|███▏      | 191/600 [07:46<11:15,  1.65s/it, loss=0.198, lr=0.0001]
Steps:  32%|███▏      | 192/600 [07:47<10:27,  1.54s/it, loss=0.198, lr=0.0001]
Steps:  32%|███▏      | 192/600 [07:47<10:27,  1.54s/it, loss=0.0971, lr=0.0001]
Steps:  32%|███▏      | 193/600 [07:49<11:05,  1.64s/it, loss=0.0971, lr=0.0001]
Steps:  32%|███▏      | 193/600 [07:49<11:05,  1.64s/it, loss=0.123, lr=0.0001] 
Steps:  32%|███▏      | 194/600 [07:51<11:14,  1.66s/it, loss=0.123, lr=0.0001]
Steps:  32%|███▏      | 194/600 [07:51<11:14,  1.66s/it, loss=0.124, lr=0.0001]
Steps:  32%|███▎      | 195/600 [07:52<10:54,  1.62s/it, loss=0.124, lr=0.0001]
Steps:  32%|███▎      | 195/600 [07:52<10:54,  1.62s/it, loss=0.00774, lr=0.0001]
Steps:  33%|███▎      | 196/600 [07:54<10:26,  1.55s/it, loss=0.00774, lr=0.0001]
Steps:  33%|███▎      | 196/600 [07:54<10:26,  1.55s/it, loss=0.0207, lr=0.0001] 
Steps:  33%|███▎      | 197/600 [07:55<09:51,  1.47s/it, loss=0.0207, lr=0.0001]
Steps:  33%|███▎      | 197/600 [07:55<09:51,  1.47s/it, loss=0.0373, lr=0.0001]
Steps:  33%|███▎      | 198/600 [07:56<08:25,  1.26s/it, loss=0.0373, lr=0.0001]
Steps:  33%|███▎      | 198/600 [07:56<08:25,  1.26s/it, loss=0.134, lr=0.0001] 
Steps:  33%|███▎      | 199/600 [07:58<10:03,  1.51s/it, loss=0.134, lr=0.0001]
Steps:  33%|███▎      | 199/600 [07:58<10:03,  1.51s/it, loss=0.0281, lr=0.0001]
Steps:  33%|███▎      | 200/600 [07:59<09:59,  1.50s/it, loss=0.0281, lr=0.0001]
Steps:  33%|███▎      | 200/600 [07:59<09:59,  1.50s/it, loss=0.141, lr=0.0001] 
Steps:  34%|███▎      | 201/600 [08:01<10:33,  1.59s/it, loss=0.141, lr=0.0001]
Steps:  34%|███▎      | 201/600 [08:01<10:33,  1.59s/it, loss=0.127, lr=0.0001]
Steps:  34%|███▎      | 202/600 [08:03<11:08,  1.68s/it, loss=0.127, lr=0.0001]
Steps:  34%|███▎      | 202/600 [08:03<11:08,  1.68s/it, loss=0.00985, lr=0.0001]
Steps:  34%|███▍      | 203/600 [08:05<11:09,  1.69s/it, loss=0.00985, lr=0.0001]
Steps:  34%|███▍      | 203/600 [08:05<11:09,  1.69s/it, loss=0.155, lr=0.0001]  
Steps:  34%|███▍      | 204/600 [08:07<11:59,  1.82s/it, loss=0.155, lr=0.0001]
Steps:  34%|███▍      | 204/600 [08:07<11:59,  1.82s/it, loss=0.00986, lr=0.0001]
Steps:  34%|███▍      | 205/600 [08:08<11:04,  1.68s/it, loss=0.00986, lr=0.0001]
Steps:  34%|███▍      | 205/600 [08:08<11:04,  1.68s/it, loss=0.0938, lr=0.0001] 
Steps:  34%|███▍      | 206/600 [08:10<10:58,  1.67s/it, loss=0.0938, lr=0.0001]
Steps:  34%|███▍      | 206/600 [08:10<10:58,  1.67s/it, loss=0.125, lr=0.0001] 
Steps:  34%|███▍      | 207/600 [08:11<10:56,  1.67s/it, loss=0.125, lr=0.0001]
Steps:  34%|███▍      | 207/600 [08:11<10:56,  1.67s/it, loss=0.129, lr=0.0001]
Steps:  35%|███▍      | 208/600 [08:13<10:08,  1.55s/it, loss=0.129, lr=0.0001]
Steps:  35%|███▍      | 208/600 [08:13<10:08,  1.55s/it, loss=0.0308, lr=0.0001]
Steps:  35%|███▍      | 209/600 [08:14<08:34,  1.32s/it, loss=0.0308, lr=0.0001]
Steps:  35%|███▍      | 209/600 [08:14<08:34,  1.32s/it, loss=0.022, lr=0.0001] 
Steps:  35%|███▌      | 210/600 [08:16<10:39,  1.64s/it, loss=0.022, lr=0.0001]
Steps:  35%|███▌      | 210/600 [08:16<10:39,  1.64s/it, loss=0.101, lr=0.0001]
Steps:  35%|███▌      | 211/600 [08:17<10:18,  1.59s/it, loss=0.101, lr=0.0001]
Steps:  35%|███▌      | 211/600 [08:17<10:18,  1.59s/it, loss=0.0847, lr=0.0001]
Steps:  35%|███▌      | 212/600 [08:19<10:11,  1.58s/it, loss=0.0847, lr=0.0001]
Steps:  35%|███▌      | 212/600 [08:19<10:11,  1.58s/it, loss=0.0153, lr=0.0001]
Steps:  36%|███▌      | 213/600 [08:21<10:43,  1.66s/it, loss=0.0153, lr=0.0001]
Steps:  36%|███▌      | 213/600 [08:21<10:43,  1.66s/it, loss=0.0069, lr=0.0001]
Steps:  36%|███▌      | 214/600 [08:22<10:13,  1.59s/it, loss=0.0069, lr=0.0001]
Steps:  36%|███▌      | 214/600 [08:22<10:13,  1.59s/it, loss=0.00643, lr=0.0001]
Steps:  36%|███▌      | 215/600 [08:24<10:01,  1.56s/it, loss=0.00643, lr=0.0001]
Steps:  36%|███▌      | 215/600 [08:24<10:01,  1.56s/it, loss=0.154, lr=0.0001]  
Steps:  36%|███▌      | 216/600 [08:25<10:06,  1.58s/it, loss=0.154, lr=0.0001]
Steps:  36%|███▌      | 216/600 [08:25<10:06,  1.58s/it, loss=0.131, lr=0.0001]
Steps:  36%|███▌      | 217/600 [08:27<10:50,  1.70s/it, loss=0.131, lr=0.0001]
Steps:  36%|███▌      | 217/600 [08:27<10:50,  1.70s/it, loss=0.0986, lr=0.0001]
Steps:  36%|███▋      | 218/600 [08:29<10:21,  1.63s/it, loss=0.0986, lr=0.0001]
Steps:  36%|███▋      | 218/600 [08:29<10:21,  1.63s/it, loss=0.132, lr=0.0001] 
Steps:  36%|███▋      | 219/600 [08:30<09:41,  1.53s/it, loss=0.132, lr=0.0001]
Steps:  36%|███▋      | 219/600 [08:30<09:41,  1.53s/it, loss=0.063, lr=0.0001]
Steps:  37%|███▋      | 220/600 [08:31<08:14,  1.30s/it, loss=0.063, lr=0.0001]
Steps:  37%|███▋      | 220/600 [08:31<08:14,  1.30s/it, loss=0.0295, lr=0.0001]
Steps:  37%|███▋      | 221/600 [08:33<09:36,  1.52s/it, loss=0.0295, lr=0.0001]
Steps:  37%|███▋      | 221/600 [08:33<09:36,  1.52s/it, loss=0.0964, lr=0.0001]
Steps:  37%|███▋      | 222/600 [08:35<09:52,  1.57s/it, loss=0.0964, lr=0.0001]
Steps:  37%|███▋      | 222/600 [08:35<09:52,  1.57s/it, loss=0.0805, lr=0.0001]
Steps:  37%|███▋      | 223/600 [08:36<10:04,  1.60s/it, loss=0.0805, lr=0.0001]
Steps:  37%|███▋      | 223/600 [08:36<10:04,  1.60s/it, loss=0.259, lr=0.0001] 
Steps:  37%|███▋      | 224/600 [08:38<10:03,  1.61s/it, loss=0.259, lr=0.0001]
Steps:  37%|███▋      | 224/600 [08:38<10:03,  1.61s/it, loss=0.0107, lr=0.0001]
Steps:  38%|███▊      | 225/600 [08:40<10:15,  1.64s/it, loss=0.0107, lr=0.0001]
Steps:  38%|███▊      | 225/600 [08:40<10:15,  1.64s/it, loss=0.128, lr=0.0001] 
Steps:  38%|███▊      | 226/600 [08:41<10:19,  1.66s/it, loss=0.128, lr=0.0001]
Steps:  38%|███▊      | 226/600 [08:41<10:19,  1.66s/it, loss=0.0919, lr=0.0001]
Steps:  38%|███▊      | 227/600 [08:43<10:08,  1.63s/it, loss=0.0919, lr=0.0001]
Steps:  38%|███▊      | 227/600 [08:43<10:08,  1.63s/it, loss=0.169, lr=0.0001] 
Steps:  38%|███▊      | 228/600 [08:45<10:13,  1.65s/it, loss=0.169, lr=0.0001]
Steps:  38%|███▊      | 228/600 [08:45<10:13,  1.65s/it, loss=0.303, lr=0.0001]
Steps:  38%|███▊      | 229/600 [08:46<09:52,  1.60s/it, loss=0.303, lr=0.0001]
Steps:  38%|███▊      | 229/600 [08:46<09:52,  1.60s/it, loss=0.0849, lr=0.0001]
Steps:  38%|███▊      | 230/600 [08:47<09:28,  1.54s/it, loss=0.0849, lr=0.0001]
Steps:  38%|███▊      | 230/600 [08:47<09:28,  1.54s/it, loss=0.0253, lr=0.0001]
Steps:  38%|███▊      | 231/600 [08:48<08:02,  1.31s/it, loss=0.0253, lr=0.0001]
Steps:  38%|███▊      | 231/600 [08:48<08:02,  1.31s/it, loss=0.0232, lr=0.0001]
Steps:  39%|███▊      | 232/600 [08:51<10:17,  1.68s/it, loss=0.0232, lr=0.0001]
Steps:  39%|███▊      | 232/600 [08:51<10:17,  1.68s/it, loss=0.0641, lr=0.0001]
Steps:  39%|███▉      | 233/600 [08:52<10:08,  1.66s/it, loss=0.0641, lr=0.0001]
Steps:  39%|███▉      | 233/600 [08:52<10:08,  1.66s/it, loss=0.133, lr=0.0001] 
Steps:  39%|███▉      | 234/600 [08:54<09:47,  1.60s/it, loss=0.133, lr=0.0001]
Steps:  39%|███▉      | 234/600 [08:54<09:47,  1.60s/it, loss=0.0535, lr=0.0001]
Steps:  39%|███▉      | 235/600 [08:56<10:04,  1.66s/it, loss=0.0535, lr=0.0001]
Steps:  39%|███▉      | 235/600 [08:56<10:04,  1.66s/it, loss=0.0943, lr=0.0001]
Steps:  39%|███▉      | 236/600 [08:57<09:46,  1.61s/it, loss=0.0943, lr=0.0001]
Steps:  39%|███▉      | 236/600 [08:57<09:46,  1.61s/it, loss=0.0109, lr=0.0001]
Steps:  40%|███▉      | 237/600 [08:58<09:22,  1.55s/it, loss=0.0109, lr=0.0001]
Steps:  40%|███▉      | 237/600 [08:58<09:22,  1.55s/it, loss=0.0561, lr=0.0001]
Steps:  40%|███▉      | 238/600 [09:00<09:03,  1.50s/it, loss=0.0561, lr=0.0001]
Steps:  40%|███▉      | 238/600 [09:00<09:03,  1.50s/it, loss=0.0597, lr=0.0001]
Steps:  40%|███▉      | 239/600 [09:02<09:40,  1.61s/it, loss=0.0597, lr=0.0001]
Steps:  40%|███▉      | 239/600 [09:02<09:40,  1.61s/it, loss=0.0445, lr=0.0001]
Steps:  40%|████      | 240/600 [09:03<09:29,  1.58s/it, loss=0.0445, lr=0.0001]
Steps:  40%|████      | 240/600 [09:03<09:29,  1.58s/it, loss=0.137, lr=0.0001] 
Steps:  40%|████      | 241/600 [09:05<08:54,  1.49s/it, loss=0.137, lr=0.0001]
Steps:  40%|████      | 241/600 [09:05<08:54,  1.49s/it, loss=0.0678, lr=0.0001]
Steps:  40%|████      | 242/600 [09:05<07:35,  1.27s/it, loss=0.0678, lr=0.0001]
Steps:  40%|████      | 242/600 [09:05<07:35,  1.27s/it, loss=0.0106, lr=0.0001]
Steps:  40%|████      | 243/600 [09:07<09:13,  1.55s/it, loss=0.0106, lr=0.0001]
Steps:  40%|████      | 243/600 [09:07<09:13,  1.55s/it, loss=0.202, lr=0.0001] 
Steps:  41%|████      | 244/600 [09:09<09:19,  1.57s/it, loss=0.202, lr=0.0001]
Steps:  41%|████      | 244/600 [09:09<09:19,  1.57s/it, loss=0.0115, lr=0.0001]
Steps:  41%|████      | 245/600 [09:11<09:09,  1.55s/it, loss=0.0115, lr=0.0001]
Steps:  41%|████      | 245/600 [09:11<09:09,  1.55s/it, loss=0.142, lr=0.0001] 
Steps:  41%|████      | 246/600 [09:12<09:09,  1.55s/it, loss=0.142, lr=0.0001]
Steps:  41%|████      | 246/600 [09:12<09:09,  1.55s/it, loss=0.167, lr=0.0001]
Steps:  41%|████      | 247/600 [09:14<09:08,  1.55s/it, loss=0.167, lr=0.0001]
Steps:  41%|████      | 247/600 [09:14<09:08,  1.55s/it, loss=0.125, lr=0.0001]
Steps:  41%|████▏     | 248/600 [09:15<09:19,  1.59s/it, loss=0.125, lr=0.0001]
Steps:  41%|████▏     | 248/600 [09:15<09:19,  1.59s/it, loss=0.273, lr=0.0001]
Steps:  42%|████▏     | 249/600 [09:17<09:17,  1.59s/it, loss=0.273, lr=0.0001]
Steps:  42%|████▏     | 249/600 [09:17<09:17,  1.59s/it, loss=0.127, lr=0.0001]
Steps:  42%|████▏     | 250/600 [09:19<09:13,  1.58s/it, loss=0.127, lr=0.0001]
Steps:  42%|████▏     | 250/600 [09:19<09:13,  1.58s/it, loss=0.132, lr=0.0001]
Steps:  42%|████▏     | 251/600 [09:20<09:20,  1.60s/it, loss=0.132, lr=0.0001]
Steps:  42%|████▏     | 251/600 [09:20<09:20,  1.60s/it, loss=0.199, lr=0.0001]
Steps:  42%|████▏     | 252/600 [09:22<09:09,  1.58s/it, loss=0.199, lr=0.0001]
Steps:  42%|████▏     | 252/600 [09:22<09:09,  1.58s/it, loss=0.188, lr=0.0001]
Steps:  42%|████▏     | 253/600 [09:22<07:43,  1.33s/it, loss=0.188, lr=0.0001]
Steps:  42%|████▏     | 253/600 [09:22<07:43,  1.33s/it, loss=0.0945, lr=0.0001]
Steps:  42%|████▏     | 254/600 [09:25<09:29,  1.64s/it, loss=0.0945, lr=0.0001]
Steps:  42%|████▏     | 254/600 [09:25<09:29,  1.64s/it, loss=0.16, lr=0.0001]  
Steps:  42%|████▎     | 255/600 [09:26<08:58,  1.56s/it, loss=0.16, lr=0.0001]
Steps:  42%|████▎     | 255/600 [09:26<08:58,  1.56s/it, loss=0.08, lr=0.0001]
Steps:  43%|████▎     | 256/600 [09:28<09:11,  1.60s/it, loss=0.08, lr=0.0001]
Steps:  43%|████▎     | 256/600 [09:28<09:11,  1.60s/it, loss=0.149, lr=0.0001]
Steps:  43%|████▎     | 257/600 [09:30<09:13,  1.61s/it, loss=0.149, lr=0.0001]
Steps:  43%|████▎     | 257/600 [09:30<09:13,  1.61s/it, loss=0.14, lr=0.0001] 
Steps:  43%|████▎     | 258/600 [09:31<08:48,  1.55s/it, loss=0.14, lr=0.0001]
Steps:  43%|████▎     | 258/600 [09:31<08:48,  1.55s/it, loss=0.164, lr=0.0001]
Steps:  43%|████▎     | 259/600 [09:32<08:37,  1.52s/it, loss=0.164, lr=0.0001]
Steps:  43%|████▎     | 259/600 [09:32<08:37,  1.52s/it, loss=0.0141, lr=0.0001]
Steps:  43%|████▎     | 260/600 [09:34<09:00,  1.59s/it, loss=0.0141, lr=0.0001]
Steps:  43%|████▎     | 260/600 [09:34<09:00,  1.59s/it, loss=0.221, lr=0.0001] 
Steps:  44%|████▎     | 261/600 [09:36<09:11,  1.63s/it, loss=0.221, lr=0.0001]
Steps:  44%|████▎     | 261/600 [09:36<09:11,  1.63s/it, loss=0.099, lr=0.0001]
Steps:  44%|████▎     | 262/600 [09:38<09:24,  1.67s/it, loss=0.099, lr=0.0001]
Steps:  44%|████▎     | 262/600 [09:38<09:24,  1.67s/it, loss=0.0807, lr=0.0001]
Steps:  44%|████▍     | 263/600 [09:39<08:56,  1.59s/it, loss=0.0807, lr=0.0001]
Steps:  44%|████▍     | 263/600 [09:39<08:56,  1.59s/it, loss=0.0811, lr=0.0001]
Steps:  44%|████▍     | 264/600 [09:40<07:32,  1.35s/it, loss=0.0811, lr=0.0001]
Steps:  44%|████▍     | 264/600 [09:40<07:32,  1.35s/it, loss=0.35, lr=0.0001]  
Steps:  44%|████▍     | 265/600 [09:42<09:39,  1.73s/it, loss=0.35, lr=0.0001]
Steps:  44%|████▍     | 265/600 [09:42<09:39,  1.73s/it, loss=0.0299, lr=0.0001]
Steps:  44%|████▍     | 266/600 [09:44<09:52,  1.77s/it, loss=0.0299, lr=0.0001]
Steps:  44%|████▍     | 266/600 [09:44<09:52,  1.77s/it, loss=0.143, lr=0.0001] 
Steps:  44%|████▍     | 267/600 [09:46<09:45,  1.76s/it, loss=0.143, lr=0.0001]
Steps:  44%|████▍     | 267/600 [09:46<09:45,  1.76s/it, loss=0.19, lr=0.0001] 
Steps:  45%|████▍     | 268/600 [09:48<09:28,  1.71s/it, loss=0.19, lr=0.0001]
Steps:  45%|████▍     | 268/600 [09:48<09:28,  1.71s/it, loss=0.187, lr=0.0001]
Steps:  45%|████▍     | 269/600 [09:49<08:52,  1.61s/it, loss=0.187, lr=0.0001]
Steps:  45%|████▍     | 269/600 [09:49<08:52,  1.61s/it, loss=0.161, lr=0.0001]
Steps:  45%|████▌     | 270/600 [09:51<08:44,  1.59s/it, loss=0.161, lr=0.0001]
Steps:  45%|████▌     | 270/600 [09:51<08:44,  1.59s/it, loss=0.2, lr=0.0001]  
Steps:  45%|████▌     | 271/600 [09:52<08:12,  1.50s/it, loss=0.2, lr=0.0001]
Steps:  45%|████▌     | 271/600 [09:52<08:12,  1.50s/it, loss=0.249, lr=0.0001]
Steps:  45%|████▌     | 272/600 [09:53<08:26,  1.55s/it, loss=0.249, lr=0.0001]
Steps:  45%|████▌     | 272/600 [09:53<08:26,  1.55s/it, loss=0.0318, lr=0.0001]
Steps:  46%|████▌     | 273/600 [09:55<08:25,  1.55s/it, loss=0.0318, lr=0.0001]
Steps:  46%|████▌     | 273/600 [09:55<08:25,  1.55s/it, loss=0.0207, lr=0.0001]
Steps:  46%|████▌     | 274/600 [09:56<08:10,  1.50s/it, loss=0.0207, lr=0.0001]
Steps:  46%|████▌     | 274/600 [09:56<08:10,  1.50s/it, loss=0.149, lr=0.0001] 
Steps:  46%|████▌     | 275/600 [09:57<06:56,  1.28s/it, loss=0.149, lr=0.0001]
Steps:  46%|████▌     | 275/600 [09:57<06:56,  1.28s/it, loss=0.0132, lr=0.0001]
Steps:  46%|████▌     | 276/600 [09:59<08:31,  1.58s/it, loss=0.0132, lr=0.0001]
Steps:  46%|████▌     | 276/600 [09:59<08:31,  1.58s/it, loss=0.196, lr=0.0001] 
Steps:  46%|████▌     | 277/600 [10:01<08:40,  1.61s/it, loss=0.196, lr=0.0001]
Steps:  46%|████▌     | 277/600 [10:01<08:40,  1.61s/it, loss=0.0144, lr=0.0001]
Steps:  46%|████▋     | 278/600 [10:03<09:05,  1.69s/it, loss=0.0144, lr=0.0001]
Steps:  46%|████▋     | 278/600 [10:03<09:05,  1.69s/it, loss=0.218, lr=0.0001] 
Steps:  46%|████▋     | 279/600 [10:05<08:59,  1.68s/it, loss=0.218, lr=0.0001]
Steps:  46%|████▋     | 279/600 [10:05<08:59,  1.68s/it, loss=0.315, lr=0.0001]
Steps:  47%|████▋     | 280/600 [10:06<08:36,  1.61s/it, loss=0.315, lr=0.0001]
Steps:  47%|████▋     | 280/600 [10:06<08:36,  1.61s/it, loss=0.0255, lr=0.0001]
Steps:  47%|████▋     | 281/600 [10:08<08:14,  1.55s/it, loss=0.0255, lr=0.0001]
Steps:  47%|████▋     | 281/600 [10:08<08:14,  1.55s/it, loss=0.0646, lr=0.0001]
Steps:  47%|████▋     | 282/600 [10:09<08:26,  1.59s/it, loss=0.0646, lr=0.0001]
Steps:  47%|████▋     | 282/600 [10:09<08:26,  1.59s/it, loss=0.163, lr=0.0001] 
Steps:  47%|████▋     | 283/600 [10:11<08:15,  1.56s/it, loss=0.163, lr=0.0001]
Steps:  47%|████▋     | 283/600 [10:11<08:15,  1.56s/it, loss=0.14, lr=0.0001] 
Steps:  47%|████▋     | 284/600 [10:12<08:28,  1.61s/it, loss=0.14, lr=0.0001]
Steps:  47%|████▋     | 284/600 [10:12<08:28,  1.61s/it, loss=0.132, lr=0.0001]
Steps:  48%|████▊     | 285/600 [10:14<07:58,  1.52s/it, loss=0.132, lr=0.0001]
Steps:  48%|████▊     | 285/600 [10:14<07:58,  1.52s/it, loss=0.176, lr=0.0001]
Steps:  48%|████▊     | 286/600 [10:15<06:46,  1.30s/it, loss=0.176, lr=0.0001]
Steps:  48%|████▊     | 286/600 [10:15<06:46,  1.30s/it, loss=0.131, lr=0.0001]
Steps:  48%|████▊     | 287/600 [10:17<08:19,  1.59s/it, loss=0.131, lr=0.0001]
Steps:  48%|████▊     | 287/600 [10:17<08:19,  1.59s/it, loss=0.0265, lr=0.0001]
Steps:  48%|████▊     | 288/600 [10:18<08:19,  1.60s/it, loss=0.0265, lr=0.0001]
Steps:  48%|████▊     | 288/600 [10:18<08:19,  1.60s/it, loss=0.204, lr=0.0001] 
Steps:  48%|████▊     | 289/600 [10:20<08:29,  1.64s/it, loss=0.204, lr=0.0001]
Steps:  48%|████▊     | 289/600 [10:20<08:29,  1.64s/it, loss=0.0259, lr=0.0001]
Steps:  48%|████▊     | 290/600 [10:22<08:29,  1.64s/it, loss=0.0259, lr=0.0001]
Steps:  48%|████▊     | 290/600 [10:22<08:29,  1.64s/it, loss=0.0265, lr=0.0001]
Steps:  48%|████▊     | 291/600 [10:23<08:01,  1.56s/it, loss=0.0265, lr=0.0001]
Steps:  48%|████▊     | 291/600 [10:23<08:01,  1.56s/it, loss=0.188, lr=0.0001] 
Steps:  49%|████▊     | 292/600 [10:25<07:44,  1.51s/it, loss=0.188, lr=0.0001]
Steps:  49%|████▊     | 292/600 [10:25<07:44,  1.51s/it, loss=0.022, lr=0.0001]
Steps:  49%|████▉     | 293/600 [10:26<08:14,  1.61s/it, loss=0.022, lr=0.0001]
Steps:  49%|████▉     | 293/600 [10:26<08:14,  1.61s/it, loss=0.0578, lr=0.0001]
Steps:  49%|████▉     | 294/600 [10:28<08:03,  1.58s/it, loss=0.0578, lr=0.0001]
Steps:  49%|████▉     | 294/600 [10:28<08:03,  1.58s/it, loss=0.141, lr=0.0001] 
Steps:  49%|████▉     | 295/600 [10:30<08:18,  1.63s/it, loss=0.141, lr=0.0001]
Steps:  49%|████▉     | 295/600 [10:30<08:18,  1.63s/it, loss=0.00921, lr=0.0001]
Steps:  49%|████▉     | 296/600 [10:31<07:56,  1.57s/it, loss=0.00921, lr=0.0001]
Steps:  49%|████▉     | 296/600 [10:31<07:56,  1.57s/it, loss=0.191, lr=0.0001]  
Steps:  50%|████▉     | 297/600 [10:32<06:42,  1.33s/it, loss=0.191, lr=0.0001]
Steps:  50%|████▉     | 297/600 [10:32<06:42,  1.33s/it, loss=0.317, lr=0.0001]
Steps:  50%|████▉     | 298/600 [10:34<08:11,  1.63s/it, loss=0.317, lr=0.0001]
Steps:  50%|████▉     | 298/600 [10:34<08:11,  1.63s/it, loss=0.0161, lr=0.0001]
Steps:  50%|████▉     | 299/600 [10:36<08:21,  1.67s/it, loss=0.0161, lr=0.0001]
Steps:  50%|████▉     | 299/600 [10:36<08:21,  1.67s/it, loss=0.232, lr=0.0001] 
Steps:  50%|█████     | 300/600 [10:38<08:31,  1.71s/it, loss=0.232, lr=0.0001]
Steps:  50%|█████     | 300/600 [10:38<08:31,  1.71s/it, loss=0.0162, lr=0.0001]
Steps:  50%|█████     | 301/600 [10:39<08:25,  1.69s/it, loss=0.0162, lr=0.0001]
Steps:  50%|█████     | 301/600 [10:39<08:25,  1.69s/it, loss=0.281, lr=0.0001] 
Steps:  50%|█████     | 302/600 [10:41<07:51,  1.58s/it, loss=0.281, lr=0.0001]
Steps:  50%|█████     | 302/600 [10:41<07:51,  1.58s/it, loss=0.236, lr=0.0001]
Steps:  50%|█████     | 303/600 [10:42<07:34,  1.53s/it, loss=0.236, lr=0.0001]
Steps:  50%|█████     | 303/600 [10:42<07:34,  1.53s/it, loss=0.161, lr=0.0001]
Steps:  51%|█████     | 304/600 [10:44<07:56,  1.61s/it, loss=0.161, lr=0.0001]
Steps:  51%|█████     | 304/600 [10:44<07:56,  1.61s/it, loss=0.217, lr=0.0001]
Steps:  51%|█████     | 305/600 [10:46<08:03,  1.64s/it, loss=0.217, lr=0.0001]
Steps:  51%|█████     | 305/600 [10:46<08:03,  1.64s/it, loss=0.216, lr=0.0001]
Steps:  51%|█████     | 306/600 [10:47<07:51,  1.60s/it, loss=0.216, lr=0.0001]
Steps:  51%|█████     | 306/600 [10:47<07:51,  1.60s/it, loss=0.00356, lr=0.0001]
Steps:  51%|█████     | 307/600 [10:48<07:20,  1.50s/it, loss=0.00356, lr=0.0001]
Steps:  51%|█████     | 307/600 [10:48<07:20,  1.50s/it, loss=0.134, lr=0.0001]  
Steps:  51%|█████▏    | 308/600 [10:49<06:14,  1.28s/it, loss=0.134, lr=0.0001]
Steps:  51%|█████▏    | 308/600 [10:49<06:14,  1.28s/it, loss=0.29, lr=0.0001] 
Steps:  52%|█████▏    | 309/600 [10:51<07:21,  1.52s/it, loss=0.29, lr=0.0001]
Steps:  52%|█████▏    | 309/600 [10:51<07:21,  1.52s/it, loss=0.21, lr=0.0001]
Steps:  52%|█████▏    | 310/600 [10:53<07:34,  1.57s/it, loss=0.21, lr=0.0001]
Steps:  52%|█████▏    | 310/600 [10:53<07:34,  1.57s/it, loss=0.159, lr=0.0001]
Steps:  52%|█████▏    | 311/600 [10:54<07:25,  1.54s/it, loss=0.159, lr=0.0001]
Steps:  52%|█████▏    | 311/600 [10:54<07:25,  1.54s/it, loss=0.102, lr=0.0001]
Steps:  52%|█████▏    | 312/600 [10:56<07:43,  1.61s/it, loss=0.102, lr=0.0001]
Steps:  52%|█████▏    | 312/600 [10:56<07:43,  1.61s/it, loss=0.0252, lr=0.0001]
Steps:  52%|█████▏    | 313/600 [10:58<07:53,  1.65s/it, loss=0.0252, lr=0.0001]
Steps:  52%|█████▏    | 313/600 [10:58<07:53,  1.65s/it, loss=0.162, lr=0.0001] 
Steps:  52%|█████▏    | 314/600 [11:00<07:58,  1.67s/it, loss=0.162, lr=0.0001]
Steps:  52%|█████▏    | 314/600 [11:00<07:58,  1.67s/it, loss=0.0714, lr=0.0001]
Steps:  52%|█████▎    | 315/600 [11:01<07:55,  1.67s/it, loss=0.0714, lr=0.0001]
Steps:  52%|█████▎    | 315/600 [11:01<07:55,  1.67s/it, loss=0.0116, lr=0.0001]
Steps:  53%|█████▎    | 316/600 [11:03<07:52,  1.66s/it, loss=0.0116, lr=0.0001]
Steps:  53%|█████▎    | 316/600 [11:03<07:52,  1.66s/it, loss=0.298, lr=0.0001] 
Steps:  53%|█████▎    | 317/600 [11:05<07:55,  1.68s/it, loss=0.298, lr=0.0001]
Steps:  53%|█████▎    | 317/600 [11:05<07:55,  1.68s/it, loss=0.0477, lr=0.0001]
Steps:  53%|█████▎    | 318/600 [11:06<07:05,  1.51s/it, loss=0.0477, lr=0.0001]
Steps:  53%|█████▎    | 318/600 [11:06<07:05,  1.51s/it, loss=0.0441, lr=0.0001]
Steps:  53%|█████▎    | 319/600 [11:07<06:01,  1.29s/it, loss=0.0441, lr=0.0001]
Steps:  53%|█████▎    | 319/600 [11:07<06:01,  1.29s/it, loss=0.0419, lr=0.0001]
Steps:  53%|█████▎    | 320/600 [11:09<07:25,  1.59s/it, loss=0.0419, lr=0.0001]
Steps:  53%|█████▎    | 320/600 [11:09<07:25,  1.59s/it, loss=0.0123, lr=0.0001]
Steps:  54%|█████▎    | 321/600 [11:11<07:38,  1.64s/it, loss=0.0123, lr=0.0001]
Steps:  54%|█████▎    | 321/600 [11:11<07:38,  1.64s/it, loss=0.229, lr=0.0001] 
Steps:  54%|█████▎    | 322/600 [11:12<07:23,  1.60s/it, loss=0.229, lr=0.0001]
Steps:  54%|█████▎    | 322/600 [11:12<07:23,  1.60s/it, loss=0.145, lr=0.0001]
Steps:  54%|█████▍    | 323/600 [11:14<07:34,  1.64s/it, loss=0.145, lr=0.0001]
Steps:  54%|█████▍    | 323/600 [11:14<07:34,  1.64s/it, loss=0.141, lr=0.0001]
Steps:  54%|█████▍    | 324/600 [11:16<07:42,  1.68s/it, loss=0.141, lr=0.0001]
Steps:  54%|█████▍    | 324/600 [11:16<07:42,  1.68s/it, loss=0.229, lr=0.0001]
Steps:  54%|█████▍    | 325/600 [11:17<07:42,  1.68s/it, loss=0.229, lr=0.0001]
Steps:  54%|█████▍    | 325/600 [11:17<07:42,  1.68s/it, loss=0.229, lr=0.0001]
Steps:  54%|█████▍    | 326/600 [11:19<07:15,  1.59s/it, loss=0.229, lr=0.0001]
Steps:  54%|█████▍    | 326/600 [11:19<07:15,  1.59s/it, loss=0.0889, lr=0.0001]
Steps:  55%|█████▍    | 327/600 [11:20<07:26,  1.64s/it, loss=0.0889, lr=0.0001]
Steps:  55%|█████▍    | 327/600 [11:20<07:26,  1.64s/it, loss=0.118, lr=0.0001] 
Steps:  55%|█████▍    | 328/600 [11:22<07:28,  1.65s/it, loss=0.118, lr=0.0001]
Steps:  55%|█████▍    | 328/600 [11:22<07:28,  1.65s/it, loss=0.126, lr=0.0001]
Steps:  55%|█████▍    | 329/600 [11:23<06:43,  1.49s/it, loss=0.126, lr=0.0001]
Steps:  55%|█████▍    | 329/600 [11:23<06:43,  1.49s/it, loss=0.0287, lr=0.0001]
Steps:  55%|█████▌    | 330/600 [11:24<05:44,  1.27s/it, loss=0.0287, lr=0.0001]
Steps:  55%|█████▌    | 330/600 [11:24<05:44,  1.27s/it, loss=0.165, lr=0.0001] 
Steps:  55%|█████▌    | 331/600 [11:26<06:59,  1.56s/it, loss=0.165, lr=0.0001]
Steps:  55%|█████▌    | 331/600 [11:26<06:59,  1.56s/it, loss=0.0204, lr=0.0001]
Steps:  55%|█████▌    | 332/600 [11:28<07:08,  1.60s/it, loss=0.0204, lr=0.0001]
Steps:  55%|█████▌    | 332/600 [11:28<07:08,  1.60s/it, loss=0.00329, lr=0.0001]
Steps:  56%|█████▌    | 333/600 [11:30<07:14,  1.63s/it, loss=0.00329, lr=0.0001]
Steps:  56%|█████▌    | 333/600 [11:30<07:14,  1.63s/it, loss=0.137, lr=0.0001]  
Steps:  56%|█████▌    | 334/600 [11:32<07:36,  1.72s/it, loss=0.137, lr=0.0001]
Steps:  56%|█████▌    | 334/600 [11:32<07:36,  1.72s/it, loss=0.19, lr=0.0001] 
Steps:  56%|█████▌    | 335/600 [11:33<07:32,  1.71s/it, loss=0.19, lr=0.0001]
Steps:  56%|█████▌    | 335/600 [11:33<07:32,  1.71s/it, loss=0.129, lr=0.0001]
Steps:  56%|█████▌    | 336/600 [11:35<07:27,  1.69s/it, loss=0.129, lr=0.0001]
Steps:  56%|█████▌    | 336/600 [11:35<07:27,  1.69s/it, loss=0.0125, lr=0.0001]
Steps:  56%|█████▌    | 337/600 [11:37<07:16,  1.66s/it, loss=0.0125, lr=0.0001]
Steps:  56%|█████▌    | 337/600 [11:37<07:16,  1.66s/it, loss=0.0947, lr=0.0001]
Steps:  56%|█████▋    | 338/600 [11:38<06:51,  1.57s/it, loss=0.0947, lr=0.0001]
Steps:  56%|█████▋    | 338/600 [11:38<06:51,  1.57s/it, loss=0.156, lr=0.0001] 
Steps:  56%|█████▋    | 339/600 [11:39<06:46,  1.56s/it, loss=0.156, lr=0.0001]
Steps:  56%|█████▋    | 339/600 [11:39<06:46,  1.56s/it, loss=0.124, lr=0.0001]
Steps:  57%|█████▋    | 340/600 [11:41<06:19,  1.46s/it, loss=0.124, lr=0.0001]
Steps:  57%|█████▋    | 340/600 [11:41<06:19,  1.46s/it, loss=0.151, lr=0.0001]
Steps:  57%|█████▋    | 341/600 [11:41<05:24,  1.25s/it, loss=0.151, lr=0.0001]
Steps:  57%|█████▋    | 341/600 [11:41<05:24,  1.25s/it, loss=0.192, lr=0.0001]
Steps:  57%|█████▋    | 342/600 [11:44<06:39,  1.55s/it, loss=0.192, lr=0.0001]
Steps:  57%|█████▋    | 342/600 [11:44<06:39,  1.55s/it, loss=0.0455, lr=0.0001]
Steps:  57%|█████▋    | 343/600 [11:45<06:30,  1.52s/it, loss=0.0455, lr=0.0001]
Steps:  57%|█████▋    | 343/600 [11:45<06:30,  1.52s/it, loss=0.134, lr=0.0001] 
Steps:  57%|█████▋    | 344/600 [11:47<06:40,  1.56s/it, loss=0.134, lr=0.0001]
Steps:  57%|█████▋    | 344/600 [11:47<06:40,  1.56s/it, loss=0.062, lr=0.0001]
Steps:  57%|█████▊    | 345/600 [11:48<06:37,  1.56s/it, loss=0.062, lr=0.0001]
Steps:  57%|█████▊    | 345/600 [11:48<06:37,  1.56s/it, loss=0.162, lr=0.0001]
Steps:  58%|█████▊    | 346/600 [11:50<06:30,  1.54s/it, loss=0.162, lr=0.0001]
Steps:  58%|█████▊    | 346/600 [11:50<06:30,  1.54s/it, loss=0.00654, lr=0.0001]
Steps:  58%|█████▊    | 347/600 [11:51<06:30,  1.54s/it, loss=0.00654, lr=0.0001]
Steps:  58%|█████▊    | 347/600 [11:51<06:30,  1.54s/it, loss=0.0849, lr=0.0001] 
Steps:  58%|█████▊    | 348/600 [11:53<06:39,  1.59s/it, loss=0.0849, lr=0.0001]
Steps:  58%|█████▊    | 348/600 [11:53<06:39,  1.59s/it, loss=0.188, lr=0.0001] 
Steps:  58%|█████▊    | 349/600 [11:55<06:50,  1.63s/it, loss=0.188, lr=0.0001]
Steps:  58%|█████▊    | 349/600 [11:55<06:50,  1.63s/it, loss=0.123, lr=0.0001]
Steps:  58%|█████▊    | 350/600 [11:56<06:35,  1.58s/it, loss=0.123, lr=0.0001]
Steps:  58%|█████▊    | 350/600 [11:56<06:35,  1.58s/it, loss=0.27, lr=0.0001] 
Steps:  58%|█████▊    | 351/600 [11:58<06:27,  1.55s/it, loss=0.27, lr=0.0001]
Steps:  58%|█████▊    | 351/600 [11:58<06:27,  1.55s/it, loss=0.019, lr=0.0001]
Steps:  59%|█████▊    | 352/600 [11:59<05:26,  1.32s/it, loss=0.019, lr=0.0001]
Steps:  59%|█████▊    | 352/600 [11:59<05:26,  1.32s/it, loss=0.067, lr=0.0001]
Steps:  59%|█████▉    | 353/600 [12:01<06:39,  1.62s/it, loss=0.067, lr=0.0001]
Steps:  59%|█████▉    | 353/600 [12:01<06:39,  1.62s/it, loss=0.00333, lr=0.0001]
Steps:  59%|█████▉    | 354/600 [12:02<06:41,  1.63s/it, loss=0.00333, lr=0.0001]
Steps:  59%|█████▉    | 354/600 [12:02<06:41,  1.63s/it, loss=0.145, lr=0.0001]  
Steps:  59%|█████▉    | 355/600 [12:04<06:43,  1.65s/it, loss=0.145, lr=0.0001]
Steps:  59%|█████▉    | 355/600 [12:04<06:43,  1.65s/it, loss=0.0916, lr=0.0001]
Steps:  59%|█████▉    | 356/600 [12:06<06:50,  1.68s/it, loss=0.0916, lr=0.0001]
Steps:  59%|█████▉    | 356/600 [12:06<06:50,  1.68s/it, loss=0.137, lr=0.0001] 
Steps:  60%|█████▉    | 357/600 [12:07<06:38,  1.64s/it, loss=0.137, lr=0.0001]
Steps:  60%|█████▉    | 357/600 [12:07<06:38,  1.64s/it, loss=0.268, lr=0.0001]
Steps:  60%|█████▉    | 358/600 [12:09<06:22,  1.58s/it, loss=0.268, lr=0.0001]
Steps:  60%|█████▉    | 358/600 [12:09<06:22,  1.58s/it, loss=0.154, lr=0.0001]
Steps:  60%|█████▉    | 359/600 [12:10<06:14,  1.55s/it, loss=0.154, lr=0.0001]
Steps:  60%|█████▉    | 359/600 [12:10<06:14,  1.55s/it, loss=0.17, lr=0.0001] 
Steps:  60%|██████    | 360/600 [12:12<06:19,  1.58s/it, loss=0.17, lr=0.0001]
Steps:  60%|██████    | 360/600 [12:12<06:19,  1.58s/it, loss=0.0741, lr=0.0001]
Steps:  60%|██████    | 361/600 [12:14<06:25,  1.61s/it, loss=0.0741, lr=0.0001]
Steps:  60%|██████    | 361/600 [12:14<06:25,  1.61s/it, loss=0.0355, lr=0.0001]
Steps:  60%|██████    | 362/600 [12:15<05:56,  1.50s/it, loss=0.0355, lr=0.0001]
Steps:  60%|██████    | 362/600 [12:15<05:56,  1.50s/it, loss=0.113, lr=0.0001] 
Steps:  60%|██████    | 363/600 [12:16<05:03,  1.28s/it, loss=0.113, lr=0.0001]
Steps:  60%|██████    | 363/600 [12:16<05:03,  1.28s/it, loss=0.0122, lr=0.0001]
Steps:  61%|██████    | 364/600 [12:18<05:43,  1.46s/it, loss=0.0122, lr=0.0001]
Steps:  61%|██████    | 364/600 [12:18<05:43,  1.46s/it, loss=0.131, lr=0.0001] 
Steps:  61%|██████    | 365/600 [12:19<05:43,  1.46s/it, loss=0.131, lr=0.0001]
Steps:  61%|██████    | 365/600 [12:19<05:43,  1.46s/it, loss=0.0525, lr=0.0001]
Steps:  61%|██████    | 366/600 [12:21<06:02,  1.55s/it, loss=0.0525, lr=0.0001]
Steps:  61%|██████    | 366/600 [12:21<06:02,  1.55s/it, loss=0.0236, lr=0.0001]
Steps:  61%|██████    | 367/600 [12:23<06:13,  1.60s/it, loss=0.0236, lr=0.0001]
Steps:  61%|██████    | 367/600 [12:23<06:13,  1.60s/it, loss=0.0537, lr=0.0001]
Steps:  61%|██████▏   | 368/600 [12:24<06:27,  1.67s/it, loss=0.0537, lr=0.0001]
Steps:  61%|██████▏   | 368/600 [12:24<06:27,  1.67s/it, loss=0.0458, lr=0.0001]
Steps:  62%|██████▏   | 369/600 [12:26<06:36,  1.72s/it, loss=0.0458, lr=0.0001]
Steps:  62%|██████▏   | 369/600 [12:26<06:36,  1.72s/it, loss=0.158, lr=0.0001] 
Steps:  62%|██████▏   | 370/600 [12:28<06:17,  1.64s/it, loss=0.158, lr=0.0001]
Steps:  62%|██████▏   | 370/600 [12:28<06:17,  1.64s/it, loss=0.0923, lr=0.0001]
Steps:  62%|██████▏   | 371/600 [12:29<06:08,  1.61s/it, loss=0.0923, lr=0.0001]
Steps:  62%|██████▏   | 371/600 [12:29<06:08,  1.61s/it, loss=0.132, lr=0.0001] 
Steps:  62%|██████▏   | 372/600 [12:31<06:21,  1.67s/it, loss=0.132, lr=0.0001]
Steps:  62%|██████▏   | 372/600 [12:31<06:21,  1.67s/it, loss=0.0079, lr=0.0001]
Steps:  62%|██████▏   | 373/600 [12:32<05:49,  1.54s/it, loss=0.0079, lr=0.0001]
Steps:  62%|██████▏   | 373/600 [12:32<05:49,  1.54s/it, loss=0.03, lr=0.0001]  
Steps:  62%|██████▏   | 374/600 [12:33<04:55,  1.31s/it, loss=0.03, lr=0.0001]
Steps:  62%|██████▏   | 374/600 [12:33<04:55,  1.31s/it, loss=0.0259, lr=0.0001]
Steps:  62%|██████▎   | 375/600 [12:35<06:08,  1.64s/it, loss=0.0259, lr=0.0001]
Steps:  62%|██████▎   | 375/600 [12:35<06:08,  1.64s/it, loss=0.103, lr=0.0001] 
Steps:  63%|██████▎   | 376/600 [12:37<06:10,  1.65s/it, loss=0.103, lr=0.0001]
Steps:  63%|██████▎   | 376/600 [12:37<06:10,  1.65s/it, loss=0.106, lr=0.0001]
Steps:  63%|██████▎   | 377/600 [12:38<05:40,  1.53s/it, loss=0.106, lr=0.0001]
Steps:  63%|██████▎   | 377/600 [12:38<05:40,  1.53s/it, loss=0.15, lr=0.0001] 
Steps:  63%|██████▎   | 378/600 [12:40<05:54,  1.60s/it, loss=0.15, lr=0.0001]
Steps:  63%|██████▎   | 378/600 [12:40<05:54,  1.60s/it, loss=0.127, lr=0.0001]
Steps:  63%|██████▎   | 379/600 [12:42<05:50,  1.59s/it, loss=0.127, lr=0.0001]
Steps:  63%|██████▎   | 379/600 [12:42<05:50,  1.59s/it, loss=0.242, lr=0.0001]
Steps:  63%|██████▎   | 380/600 [12:44<06:04,  1.66s/it, loss=0.242, lr=0.0001]
Steps:  63%|██████▎   | 380/600 [12:44<06:04,  1.66s/it, loss=0.109, lr=0.0001]
Steps:  64%|██████▎   | 381/600 [12:45<05:56,  1.63s/it, loss=0.109, lr=0.0001]
Steps:  64%|██████▎   | 381/600 [12:45<05:56,  1.63s/it, loss=0.0218, lr=0.0001]
Steps:  64%|██████▎   | 382/600 [12:47<06:01,  1.66s/it, loss=0.0218, lr=0.0001]
Steps:  64%|██████▎   | 382/600 [12:47<06:01,  1.66s/it, loss=0.245, lr=0.0001] 
Steps:  64%|██████▍   | 383/600 [12:48<06:01,  1.67s/it, loss=0.245, lr=0.0001]
Steps:  64%|██████▍   | 383/600 [12:48<06:01,  1.67s/it, loss=0.0917, lr=0.0001]
Steps:  64%|██████▍   | 384/600 [12:50<05:31,  1.54s/it, loss=0.0917, lr=0.0001]
Steps:  64%|██████▍   | 384/600 [12:50<05:31,  1.54s/it, loss=0.0228, lr=0.0001]
Steps:  64%|██████▍   | 385/600 [12:50<04:40,  1.31s/it, loss=0.0228, lr=0.0001]
Steps:  64%|██████▍   | 385/600 [12:50<04:40,  1.31s/it, loss=0.228, lr=0.0001] 
Steps:  64%|██████▍   | 386/600 [12:53<05:50,  1.64s/it, loss=0.228, lr=0.0001]
Steps:  64%|██████▍   | 386/600 [12:53<05:50,  1.64s/it, loss=0.0093, lr=0.0001]
Steps:  64%|██████▍   | 387/600 [12:55<05:51,  1.65s/it, loss=0.0093, lr=0.0001]
Steps:  64%|██████▍   | 387/600 [12:55<05:51,  1.65s/it, loss=0.0824, lr=0.0001]
Steps:  65%|██████▍   | 388/600 [12:56<05:39,  1.60s/it, loss=0.0824, lr=0.0001]
Steps:  65%|██████▍   | 388/600 [12:56<05:39,  1.60s/it, loss=0.128, lr=0.0001] 
Steps:  65%|██████▍   | 389/600 [12:58<05:43,  1.63s/it, loss=0.128, lr=0.0001]
Steps:  65%|██████▍   | 389/600 [12:58<05:43,  1.63s/it, loss=0.0216, lr=0.0001]
Steps:  65%|██████▌   | 390/600 [12:59<05:37,  1.61s/it, loss=0.0216, lr=0.0001]
Steps:  65%|██████▌   | 390/600 [12:59<05:37,  1.61s/it, loss=0.258, lr=0.0001] 
Steps:  65%|██████▌   | 391/600 [13:01<05:32,  1.59s/it, loss=0.258, lr=0.0001]
Steps:  65%|██████▌   | 391/600 [13:01<05:32,  1.59s/it, loss=0.181, lr=0.0001]
Steps:  65%|██████▌   | 392/600 [13:03<05:35,  1.61s/it, loss=0.181, lr=0.0001]
Steps:  65%|██████▌   | 392/600 [13:03<05:35,  1.61s/it, loss=0.0262, lr=0.0001]
Steps:  66%|██████▌   | 393/600 [13:04<05:28,  1.59s/it, loss=0.0262, lr=0.0001]
Steps:  66%|██████▌   | 393/600 [13:04<05:28,  1.59s/it, loss=0.0494, lr=0.0001]
Steps:  66%|██████▌   | 394/600 [13:06<05:21,  1.56s/it, loss=0.0494, lr=0.0001]
Steps:  66%|██████▌   | 394/600 [13:06<05:21,  1.56s/it, loss=0.139, lr=0.0001] 
Steps:  66%|██████▌   | 395/600 [13:07<05:13,  1.53s/it, loss=0.139, lr=0.0001]
Steps:  66%|██████▌   | 395/600 [13:07<05:13,  1.53s/it, loss=0.269, lr=0.0001]
Steps:  66%|██████▌   | 396/600 [13:08<04:24,  1.30s/it, loss=0.269, lr=0.0001]
Steps:  66%|██████▌   | 396/600 [13:08<04:24,  1.30s/it, loss=0.211, lr=0.0001]
Steps:  66%|██████▌   | 397/600 [13:10<05:27,  1.61s/it, loss=0.211, lr=0.0001]
Steps:  66%|██████▌   | 397/600 [13:10<05:27,  1.61s/it, loss=0.00271, lr=0.0001]
Steps:  66%|██████▋   | 398/600 [13:12<05:14,  1.56s/it, loss=0.00271, lr=0.0001]
Steps:  66%|██████▋   | 398/600 [13:12<05:14,  1.56s/it, loss=0.0636, lr=0.0001] 
Steps:  66%|██████▋   | 399/600 [13:13<05:17,  1.58s/it, loss=0.0636, lr=0.0001]
Steps:  66%|██████▋   | 399/600 [13:13<05:17,  1.58s/it, loss=0.0367, lr=0.0001]
Steps:  67%|██████▋   | 400/600 [13:15<05:12,  1.56s/it, loss=0.0367, lr=0.0001]
Steps:  67%|██████▋   | 400/600 [13:15<05:12,  1.56s/it, loss=0.0709, lr=0.0001]
Steps:  67%|██████▋   | 401/600 [13:16<05:19,  1.61s/it, loss=0.0709, lr=0.0001]
Steps:  67%|██████▋   | 401/600 [13:16<05:19,  1.61s/it, loss=0.0394, lr=0.0001]
Steps:  67%|██████▋   | 402/600 [13:18<05:17,  1.60s/it, loss=0.0394, lr=0.0001]
Steps:  67%|██████▋   | 402/600 [13:18<05:17,  1.60s/it, loss=0.152, lr=0.0001] 
Steps:  67%|██████▋   | 403/600 [13:20<05:14,  1.60s/it, loss=0.152, lr=0.0001]
Steps:  67%|██████▋   | 403/600 [13:20<05:14,  1.60s/it, loss=0.0667, lr=0.0001]
Steps:  67%|██████▋   | 404/600 [13:21<05:12,  1.59s/it, loss=0.0667, lr=0.0001]
Steps:  67%|██████▋   | 404/600 [13:21<05:12,  1.59s/it, loss=0.193, lr=0.0001] 
Steps:  68%|██████▊   | 405/600 [13:23<05:16,  1.62s/it, loss=0.193, lr=0.0001]
Steps:  68%|██████▊   | 405/600 [13:23<05:16,  1.62s/it, loss=0.224, lr=0.0001]
Steps:  68%|██████▊   | 406/600 [13:24<04:55,  1.52s/it, loss=0.224, lr=0.0001]
Steps:  68%|██████▊   | 406/600 [13:24<04:55,  1.52s/it, loss=0.195, lr=0.0001]
Steps:  68%|██████▊   | 407/600 [13:25<04:09,  1.29s/it, loss=0.195, lr=0.0001]
Steps:  68%|██████▊   | 407/600 [13:25<04:09,  1.29s/it, loss=0.00991, lr=0.0001]
Steps:  68%|██████▊   | 408/600 [13:27<04:51,  1.52s/it, loss=0.00991, lr=0.0001]
Steps:  68%|██████▊   | 408/600 [13:27<04:51,  1.52s/it, loss=0.0715, lr=0.0001] 
Steps:  68%|██████▊   | 409/600 [13:29<05:00,  1.57s/it, loss=0.0715, lr=0.0001]
Steps:  68%|██████▊   | 409/600 [13:29<05:00,  1.57s/it, loss=0.245, lr=0.0001] 
Steps:  68%|██████▊   | 410/600 [13:30<04:53,  1.54s/it, loss=0.245, lr=0.0001]
Steps:  68%|██████▊   | 410/600 [13:30<04:53,  1.54s/it, loss=0.132, lr=0.0001]
Steps:  68%|██████▊   | 411/600 [13:32<05:14,  1.66s/it, loss=0.132, lr=0.0001]
Steps:  68%|██████▊   | 411/600 [13:32<05:14,  1.66s/it, loss=0.133, lr=0.0001]
Steps:  69%|██████▊   | 412/600 [13:34<05:11,  1.66s/it, loss=0.133, lr=0.0001]
Steps:  69%|██████▊   | 412/600 [13:34<05:11,  1.66s/it, loss=0.203, lr=0.0001]
Steps:  69%|██████▉   | 413/600 [13:35<05:13,  1.68s/it, loss=0.203, lr=0.0001]
Steps:  69%|██████▉   | 413/600 [13:35<05:13,  1.68s/it, loss=0.0219, lr=0.0001]
Steps:  69%|██████▉   | 414/600 [13:37<05:08,  1.66s/it, loss=0.0219, lr=0.0001]
Steps:  69%|██████▉   | 414/600 [13:37<05:08,  1.66s/it, loss=0.00651, lr=0.0001]
Steps:  69%|██████▉   | 415/600 [13:38<04:51,  1.58s/it, loss=0.00651, lr=0.0001]
Steps:  69%|██████▉   | 415/600 [13:38<04:51,  1.58s/it, loss=0.101, lr=0.0001]  
Steps:  69%|██████▉   | 416/600 [13:40<04:48,  1.57s/it, loss=0.101, lr=0.0001]
Steps:  69%|██████▉   | 416/600 [13:40<04:48,  1.57s/it, loss=0.0885, lr=0.0001]
Steps:  70%|██████▉   | 417/600 [13:41<04:43,  1.55s/it, loss=0.0885, lr=0.0001]
Steps:  70%|██████▉   | 417/600 [13:41<04:43,  1.55s/it, loss=0.163, lr=0.0001] 
Steps:  70%|██████▉   | 418/600 [13:42<03:58,  1.31s/it, loss=0.163, lr=0.0001]
Steps:  70%|██████▉   | 418/600 [13:42<03:58,  1.31s/it, loss=0.0398, lr=0.0001]
Steps:  70%|██████▉   | 419/600 [13:44<04:46,  1.58s/it, loss=0.0398, lr=0.0001]
Steps:  70%|██████▉   | 419/600 [13:44<04:46,  1.58s/it, loss=0.041, lr=0.0001] 
Steps:  70%|███████   | 420/600 [13:46<04:48,  1.60s/it, loss=0.041, lr=0.0001]
Steps:  70%|███████   | 420/600 [13:46<04:48,  1.60s/it, loss=0.0141, lr=0.0001]
Steps:  70%|███████   | 421/600 [13:48<04:48,  1.61s/it, loss=0.0141, lr=0.0001]
Steps:  70%|███████   | 421/600 [13:48<04:48,  1.61s/it, loss=0.0728, lr=0.0001]
Steps:  70%|███████   | 422/600 [13:49<04:34,  1.54s/it, loss=0.0728, lr=0.0001]
Steps:  70%|███████   | 422/600 [13:49<04:34,  1.54s/it, loss=0.31, lr=0.0001]  
Steps:  70%|███████   | 423/600 [13:51<04:51,  1.65s/it, loss=0.31, lr=0.0001]
Steps:  70%|███████   | 423/600 [13:51<04:51,  1.65s/it, loss=0.149, lr=0.0001]
Steps:  71%|███████   | 424/600 [13:53<04:41,  1.60s/it, loss=0.149, lr=0.0001]
Steps:  71%|███████   | 424/600 [13:53<04:41,  1.60s/it, loss=0.177, lr=0.0001]
Steps:  71%|███████   | 425/600 [13:54<04:33,  1.56s/it, loss=0.177, lr=0.0001]
Steps:  71%|███████   | 425/600 [13:54<04:33,  1.56s/it, loss=0.128, lr=0.0001]
Steps:  71%|███████   | 426/600 [13:56<04:44,  1.64s/it, loss=0.128, lr=0.0001]
Steps:  71%|███████   | 426/600 [13:56<04:44,  1.64s/it, loss=0.0297, lr=0.0001]
Steps:  71%|███████   | 427/600 [13:58<04:52,  1.69s/it, loss=0.0297, lr=0.0001]
Steps:  71%|███████   | 427/600 [13:58<04:52,  1.69s/it, loss=0.214, lr=0.0001] 
Steps:  71%|███████▏  | 428/600 [13:59<04:21,  1.52s/it, loss=0.214, lr=0.0001]
Steps:  71%|███████▏  | 428/600 [13:59<04:21,  1.52s/it, loss=0.0208, lr=0.0001]
Steps:  72%|███████▏  | 429/600 [13:59<03:41,  1.29s/it, loss=0.0208, lr=0.0001]
Steps:  72%|███████▏  | 429/600 [13:59<03:41,  1.29s/it, loss=0.25, lr=0.0001]  
Steps:  72%|███████▏  | 430/600 [14:02<04:25,  1.56s/it, loss=0.25, lr=0.0001]
Steps:  72%|███████▏  | 430/600 [14:02<04:25,  1.56s/it, loss=0.114, lr=0.0001]
Steps:  72%|███████▏  | 431/600 [14:04<04:38,  1.65s/it, loss=0.114, lr=0.0001]
Steps:  72%|███████▏  | 431/600 [14:04<04:38,  1.65s/it, loss=0.17, lr=0.0001] 
Steps:  72%|███████▏  | 432/600 [14:05<04:29,  1.60s/it, loss=0.17, lr=0.0001]
Steps:  72%|███████▏  | 432/600 [14:05<04:29,  1.60s/it, loss=0.116, lr=0.0001]
Steps:  72%|███████▏  | 433/600 [14:07<04:31,  1.63s/it, loss=0.116, lr=0.0001]
Steps:  72%|███████▏  | 433/600 [14:07<04:31,  1.63s/it, loss=0.0468, lr=0.0001]
Steps:  72%|███████▏  | 434/600 [14:09<04:41,  1.69s/it, loss=0.0468, lr=0.0001]
Steps:  72%|███████▏  | 434/600 [14:09<04:41,  1.69s/it, loss=0.0206, lr=0.0001]
Steps:  72%|███████▎  | 435/600 [14:10<04:30,  1.64s/it, loss=0.0206, lr=0.0001]
Steps:  72%|███████▎  | 435/600 [14:10<04:30,  1.64s/it, loss=0.13, lr=0.0001]  
Steps:  73%|███████▎  | 436/600 [14:12<04:20,  1.59s/it, loss=0.13, lr=0.0001]
Steps:  73%|███████▎  | 436/600 [14:12<04:20,  1.59s/it, loss=0.0399, lr=0.0001]
Steps:  73%|███████▎  | 437/600 [14:13<04:34,  1.68s/it, loss=0.0399, lr=0.0001]
Steps:  73%|███████▎  | 437/600 [14:13<04:34,  1.68s/it, loss=0.0815, lr=0.0001]
Steps:  73%|███████▎  | 438/600 [14:15<04:24,  1.63s/it, loss=0.0815, lr=0.0001]
Steps:  73%|███████▎  | 438/600 [14:15<04:24,  1.63s/it, loss=0.0491, lr=0.0001]
Steps:  73%|███████▎  | 439/600 [14:16<04:05,  1.53s/it, loss=0.0491, lr=0.0001]
Steps:  73%|███████▎  | 439/600 [14:16<04:05,  1.53s/it, loss=0.028, lr=0.0001] 
Steps:  73%|███████▎  | 440/600 [14:17<03:27,  1.30s/it, loss=0.028, lr=0.0001]
Steps:  73%|███████▎  | 440/600 [14:17<03:27,  1.30s/it, loss=0.0306, lr=0.0001]
Steps:  74%|███████▎  | 441/600 [14:19<04:14,  1.60s/it, loss=0.0306, lr=0.0001]
Steps:  74%|███████▎  | 441/600 [14:19<04:14,  1.60s/it, loss=0.159, lr=0.0001] 
Steps:  74%|███████▎  | 442/600 [14:21<04:20,  1.65s/it, loss=0.159, lr=0.0001]
Steps:  74%|███████▎  | 442/600 [14:21<04:20,  1.65s/it, loss=0.0394, lr=0.0001]
Steps:  74%|███████▍  | 443/600 [14:22<04:06,  1.57s/it, loss=0.0394, lr=0.0001]
Steps:  74%|███████▍  | 443/600 [14:22<04:06,  1.57s/it, loss=0.152, lr=0.0001] 
Steps:  74%|███████▍  | 444/600 [14:24<04:08,  1.59s/it, loss=0.152, lr=0.0001]
Steps:  74%|███████▍  | 444/600 [14:24<04:08,  1.59s/it, loss=0.0923, lr=0.0001]
Steps:  74%|███████▍  | 445/600 [14:26<04:09,  1.61s/it, loss=0.0923, lr=0.0001]
Steps:  74%|███████▍  | 445/600 [14:26<04:09,  1.61s/it, loss=0.0109, lr=0.0001]
Steps:  74%|███████▍  | 446/600 [14:27<04:03,  1.58s/it, loss=0.0109, lr=0.0001]
Steps:  74%|███████▍  | 446/600 [14:27<04:03,  1.58s/it, loss=0.155, lr=0.0001] 
Steps:  74%|███████▍  | 447/600 [14:29<04:04,  1.60s/it, loss=0.155, lr=0.0001]
Steps:  74%|███████▍  | 447/600 [14:29<04:04,  1.60s/it, loss=0.0705, lr=0.0001]
Steps:  75%|███████▍  | 448/600 [14:31<04:05,  1.62s/it, loss=0.0705, lr=0.0001]
Steps:  75%|███████▍  | 448/600 [14:31<04:05,  1.62s/it, loss=0.0443, lr=0.0001]
Steps:  75%|███████▍  | 449/600 [14:32<04:06,  1.63s/it, loss=0.0443, lr=0.0001]
Steps:  75%|███████▍  | 449/600 [14:32<04:06,  1.63s/it, loss=0.0947, lr=0.0001]
Steps:  75%|███████▌  | 450/600 [14:34<03:54,  1.56s/it, loss=0.0947, lr=0.0001]
Steps:  75%|███████▌  | 450/600 [14:34<03:54,  1.56s/it, loss=0.00899, lr=0.0001]
Steps:  75%|███████▌  | 451/600 [14:34<03:16,  1.32s/it, loss=0.00899, lr=0.0001]
Steps:  75%|███████▌  | 451/600 [14:34<03:16,  1.32s/it, loss=0.248, lr=0.0001]  
Steps:  75%|███████▌  | 452/600 [14:37<04:08,  1.68s/it, loss=0.248, lr=0.0001]
Steps:  75%|███████▌  | 452/600 [14:37<04:08,  1.68s/it, loss=0.0154, lr=0.0001]
Steps:  76%|███████▌  | 453/600 [14:38<04:02,  1.65s/it, loss=0.0154, lr=0.0001]
Steps:  76%|███████▌  | 453/600 [14:38<04:02,  1.65s/it, loss=0.0977, lr=0.0001]
Steps:  76%|███████▌  | 454/600 [14:40<03:55,  1.61s/it, loss=0.0977, lr=0.0001]
Steps:  76%|███████▌  | 454/600 [14:40<03:55,  1.61s/it, loss=0.0532, lr=0.0001]
Steps:  76%|███████▌  | 455/600 [14:42<03:48,  1.58s/it, loss=0.0532, lr=0.0001]
Steps:  76%|███████▌  | 455/600 [14:42<03:48,  1.58s/it, loss=0.165, lr=0.0001] 
Steps:  76%|███████▌  | 456/600 [14:43<03:46,  1.58s/it, loss=0.165, lr=0.0001]
Steps:  76%|███████▌  | 456/600 [14:43<03:46,  1.58s/it, loss=0.136, lr=0.0001]
Steps:  76%|███████▌  | 457/600 [14:45<03:44,  1.57s/it, loss=0.136, lr=0.0001]
Steps:  76%|███████▌  | 457/600 [14:45<03:44,  1.57s/it, loss=0.119, lr=0.0001]
Steps:  76%|███████▋  | 458/600 [14:46<03:53,  1.65s/it, loss=0.119, lr=0.0001]
Steps:  76%|███████▋  | 458/600 [14:46<03:53,  1.65s/it, loss=0.0978, lr=0.0001]
Steps:  76%|███████▋  | 459/600 [14:48<03:34,  1.52s/it, loss=0.0978, lr=0.0001]
Steps:  76%|███████▋  | 459/600 [14:48<03:34,  1.52s/it, loss=0.175, lr=0.0001] 
Steps:  77%|███████▋  | 460/600 [14:50<03:48,  1.63s/it, loss=0.175, lr=0.0001]
Steps:  77%|███████▋  | 460/600 [14:50<03:48,  1.63s/it, loss=0.00719, lr=0.0001]
Steps:  77%|███████▋  | 461/600 [14:51<03:37,  1.56s/it, loss=0.00719, lr=0.0001]
Steps:  77%|███████▋  | 461/600 [14:51<03:37,  1.56s/it, loss=0.138, lr=0.0001]  
Steps:  77%|███████▋  | 462/600 [14:52<03:02,  1.32s/it, loss=0.138, lr=0.0001]
Steps:  77%|███████▋  | 462/600 [14:52<03:02,  1.32s/it, loss=0.00314, lr=0.0001]
Steps:  77%|███████▋  | 463/600 [14:54<03:46,  1.66s/it, loss=0.00314, lr=0.0001]
Steps:  77%|███████▋  | 463/600 [14:54<03:46,  1.66s/it, loss=0.0309, lr=0.0001] 
Steps:  77%|███████▋  | 464/600 [14:56<03:48,  1.68s/it, loss=0.0309, lr=0.0001]
Steps:  77%|███████▋  | 464/600 [14:56<03:48,  1.68s/it, loss=0.142, lr=0.0001] 
Steps:  78%|███████▊  | 465/600 [14:57<03:32,  1.57s/it, loss=0.142, lr=0.0001]
Steps:  78%|███████▊  | 465/600 [14:57<03:32,  1.57s/it, loss=0.0147, lr=0.0001]
Steps:  78%|███████▊  | 466/600 [14:59<03:29,  1.57s/it, loss=0.0147, lr=0.0001]
Steps:  78%|███████▊  | 466/600 [14:59<03:29,  1.57s/it, loss=0.207, lr=0.0001] 
Steps:  78%|███████▊  | 467/600 [15:00<03:34,  1.61s/it, loss=0.207, lr=0.0001]
Steps:  78%|███████▊  | 467/600 [15:00<03:34,  1.61s/it, loss=0.0158, lr=0.0001]
Steps:  78%|███████▊  | 468/600 [15:02<03:30,  1.60s/it, loss=0.0158, lr=0.0001]
Steps:  78%|███████▊  | 468/600 [15:02<03:30,  1.60s/it, loss=0.00384, lr=0.0001]
Steps:  78%|███████▊  | 469/600 [15:04<03:24,  1.56s/it, loss=0.00384, lr=0.0001]
Steps:  78%|███████▊  | 469/600 [15:04<03:24,  1.56s/it, loss=0.111, lr=0.0001]  
Steps:  78%|███████▊  | 470/600 [15:05<03:29,  1.62s/it, loss=0.111, lr=0.0001]
Steps:  78%|███████▊  | 470/600 [15:05<03:29,  1.62s/it, loss=0.0165, lr=0.0001]
Steps:  78%|███████▊  | 471/600 [15:07<03:37,  1.69s/it, loss=0.0165, lr=0.0001]
Steps:  78%|███████▊  | 471/600 [15:07<03:37,  1.69s/it, loss=0.0754, lr=0.0001]
Steps:  79%|███████▊  | 472/600 [15:08<03:19,  1.56s/it, loss=0.0754, lr=0.0001]
Steps:  79%|███████▊  | 472/600 [15:08<03:19,  1.56s/it, loss=0.0393, lr=0.0001]
Steps:  79%|███████▉  | 473/600 [15:09<02:47,  1.32s/it, loss=0.0393, lr=0.0001]
Steps:  79%|███████▉  | 473/600 [15:09<02:47,  1.32s/it, loss=0.117, lr=0.0001] 
Steps:  79%|███████▉  | 474/600 [15:11<03:24,  1.62s/it, loss=0.117, lr=0.0001]
Steps:  79%|███████▉  | 474/600 [15:11<03:24,  1.62s/it, loss=0.202, lr=0.0001]
Steps:  79%|███████▉  | 475/600 [15:13<03:14,  1.56s/it, loss=0.202, lr=0.0001]
Steps:  79%|███████▉  | 475/600 [15:13<03:14,  1.56s/it, loss=0.187, lr=0.0001]
Steps:  79%|███████▉  | 476/600 [15:14<03:05,  1.50s/it, loss=0.187, lr=0.0001]
Steps:  79%|███████▉  | 476/600 [15:14<03:05,  1.50s/it, loss=0.133, lr=0.0001]
Steps:  80%|███████▉  | 477/600 [15:16<03:06,  1.51s/it, loss=0.133, lr=0.0001]
Steps:  80%|███████▉  | 477/600 [15:16<03:06,  1.51s/it, loss=0.0464, lr=0.0001]
Steps:  80%|███████▉  | 478/600 [15:17<03:10,  1.56s/it, loss=0.0464, lr=0.0001]
Steps:  80%|███████▉  | 478/600 [15:17<03:10,  1.56s/it, loss=0.0102, lr=0.0001]
Steps:  80%|███████▉  | 479/600 [15:19<03:20,  1.66s/it, loss=0.0102, lr=0.0001]
Steps:  80%|███████▉  | 479/600 [15:19<03:20,  1.66s/it, loss=0.163, lr=0.0001] 
Steps:  80%|████████  | 480/600 [15:21<03:12,  1.60s/it, loss=0.163, lr=0.0001]
Steps:  80%|████████  | 480/600 [15:21<03:12,  1.60s/it, loss=0.0242, lr=0.0001]
Steps:  80%|████████  | 481/600 [15:23<03:16,  1.65s/it, loss=0.0242, lr=0.0001]
Steps:  80%|████████  | 481/600 [15:23<03:16,  1.65s/it, loss=0.142, lr=0.0001] 
Steps:  80%|████████  | 482/600 [15:24<03:14,  1.65s/it, loss=0.142, lr=0.0001]
Steps:  80%|████████  | 482/600 [15:24<03:14,  1.65s/it, loss=0.064, lr=0.0001]
Steps:  80%|████████  | 483/600 [15:26<03:06,  1.59s/it, loss=0.064, lr=0.0001]
Steps:  80%|████████  | 483/600 [15:26<03:06,  1.59s/it, loss=0.00837, lr=0.0001]
Steps:  81%|████████  | 484/600 [15:26<02:35,  1.34s/it, loss=0.00837, lr=0.0001]
Steps:  81%|████████  | 484/600 [15:26<02:35,  1.34s/it, loss=0.119, lr=0.0001]  
Steps:  81%|████████  | 485/600 [15:29<03:08,  1.64s/it, loss=0.119, lr=0.0001]
Steps:  81%|████████  | 485/600 [15:29<03:08,  1.64s/it, loss=0.0171, lr=0.0001]
Steps:  81%|████████  | 486/600 [15:30<03:04,  1.62s/it, loss=0.0171, lr=0.0001]
Steps:  81%|████████  | 486/600 [15:30<03:04,  1.62s/it, loss=0.0394, lr=0.0001]
Steps:  81%|████████  | 487/600 [15:32<03:11,  1.69s/it, loss=0.0394, lr=0.0001]
Steps:  81%|████████  | 487/600 [15:32<03:11,  1.69s/it, loss=0.0927, lr=0.0001]
Steps:  81%|████████▏ | 488/600 [15:34<03:14,  1.73s/it, loss=0.0927, lr=0.0001]
Steps:  81%|████████▏ | 488/600 [15:34<03:14,  1.73s/it, loss=0.0934, lr=0.0001]
Steps:  82%|████████▏ | 489/600 [15:35<02:59,  1.61s/it, loss=0.0934, lr=0.0001]
Steps:  82%|████████▏ | 489/600 [15:35<02:59,  1.61s/it, loss=0.0703, lr=0.0001]
Steps:  82%|████████▏ | 490/600 [15:37<02:58,  1.63s/it, loss=0.0703, lr=0.0001]
Steps:  82%|████████▏ | 490/600 [15:37<02:58,  1.63s/it, loss=0.285, lr=0.0001] 
Steps:  82%|████████▏ | 491/600 [15:38<02:48,  1.55s/it, loss=0.285, lr=0.0001]
Steps:  82%|████████▏ | 491/600 [15:38<02:48,  1.55s/it, loss=0.387, lr=0.0001]
Steps:  82%|████████▏ | 492/600 [15:40<02:43,  1.51s/it, loss=0.387, lr=0.0001]
Steps:  82%|████████▏ | 492/600 [15:40<02:43,  1.51s/it, loss=0.0203, lr=0.0001]
Steps:  82%|████████▏ | 493/600 [15:42<02:48,  1.57s/it, loss=0.0203, lr=0.0001]
Steps:  82%|████████▏ | 493/600 [15:42<02:48,  1.57s/it, loss=0.0892, lr=0.0001]
Steps:  82%|████████▏ | 494/600 [15:43<02:42,  1.53s/it, loss=0.0892, lr=0.0001]
Steps:  82%|████████▏ | 494/600 [15:43<02:42,  1.53s/it, loss=0.101, lr=0.0001] 
Steps:  82%|████████▎ | 495/600 [15:44<02:16,  1.30s/it, loss=0.101, lr=0.0001]
Steps:  82%|████████▎ | 495/600 [15:44<02:16,  1.30s/it, loss=0.113, lr=0.0001]
Steps:  83%|████████▎ | 496/600 [15:46<02:46,  1.60s/it, loss=0.113, lr=0.0001]
Steps:  83%|████████▎ | 496/600 [15:46<02:46,  1.60s/it, loss=0.236, lr=0.0001]
Steps:  83%|████████▎ | 497/600 [15:48<02:50,  1.65s/it, loss=0.236, lr=0.0001]
Steps:  83%|████████▎ | 497/600 [15:48<02:50,  1.65s/it, loss=0.206, lr=0.0001]
Steps:  83%|████████▎ | 498/600 [15:49<02:43,  1.60s/it, loss=0.206, lr=0.0001]
Steps:  83%|████████▎ | 498/600 [15:49<02:43,  1.60s/it, loss=0.053, lr=0.0001]
Steps:  83%|████████▎ | 499/600 [15:51<02:37,  1.56s/it, loss=0.053, lr=0.0001]
Steps:  83%|████████▎ | 499/600 [15:51<02:37,  1.56s/it, loss=0.172, lr=0.0001]
Steps:  83%|████████▎ | 500/600 [15:52<02:34,  1.54s/it, loss=0.172, lr=0.0001]10/13/2023 09:28:04 - INFO - accelerate.accelerator - Saving current state to logs/sweep_final_0_20231013091146/checkpoint-500
Model weights saved in logs/sweep_final_0_20231013091146/checkpoint-500/pytorch_lora_weights.safetensors
10/13/2023 09:28:05 - INFO - accelerate.checkpointing - Optimizer state saved in logs/sweep_final_0_20231013091146/checkpoint-500/optimizer.bin
10/13/2023 09:28:05 - INFO - accelerate.checkpointing - Scheduler state saved in logs/sweep_final_0_20231013091146/checkpoint-500/scheduler.bin
10/13/2023 09:28:05 - INFO - accelerate.checkpointing - Gradient scaler state saved in logs/sweep_final_0_20231013091146/checkpoint-500/scaler.pt
10/13/2023 09:28:05 - INFO - accelerate.checkpointing - Random states saved in logs/sweep_final_0_20231013091146/checkpoint-500/random_states_0.pkl
10/13/2023 09:28:05 - INFO - __main__ - Saved state to logs/sweep_final_0_20231013091146/checkpoint-500

Steps:  83%|████████▎ | 500/600 [15:53<02:34,  1.54s/it, loss=0.00504, lr=0.0001]
Steps:  84%|████████▎ | 501/600 [15:55<03:05,  1.87s/it, loss=0.00504, lr=0.0001]
Steps:  84%|████████▎ | 501/600 [15:55<03:05,  1.87s/it, loss=0.0968, lr=0.0001] 
Steps:  84%|████████▎ | 502/600 [15:56<02:49,  1.73s/it, loss=0.0968, lr=0.0001]
Steps:  84%|████████▎ | 502/600 [15:56<02:49,  1.73s/it, loss=0.258, lr=0.0001] 
Steps:  84%|████████▍ | 503/600 [15:58<02:50,  1.76s/it, loss=0.258, lr=0.0001]
Steps:  84%|████████▍ | 503/600 [15:58<02:50,  1.76s/it, loss=0.106, lr=0.0001]
Steps:  84%|████████▍ | 504/600 [16:00<02:44,  1.71s/it, loss=0.106, lr=0.0001]
Steps:  84%|████████▍ | 504/600 [16:00<02:44,  1.71s/it, loss=0.026, lr=0.0001]
Steps:  84%|████████▍ | 505/600 [16:01<02:25,  1.53s/it, loss=0.026, lr=0.0001]
Steps:  84%|████████▍ | 505/600 [16:01<02:25,  1.53s/it, loss=0.155, lr=0.0001]
Steps:  84%|████████▍ | 506/600 [16:02<02:02,  1.30s/it, loss=0.155, lr=0.0001]
Steps:  84%|████████▍ | 506/600 [16:02<02:02,  1.30s/it, loss=0.0109, lr=0.0001]
Steps:  84%|████████▍ | 507/600 [16:04<02:25,  1.56s/it, loss=0.0109, lr=0.0001]
Steps:  84%|████████▍ | 507/600 [16:04<02:25,  1.56s/it, loss=0.0204, lr=0.0001]
Steps:  85%|████████▍ | 508/600 [16:05<02:24,  1.57s/it, loss=0.0204, lr=0.0001]
Steps:  85%|████████▍ | 508/600 [16:05<02:24,  1.57s/it, loss=0.136, lr=0.0001] 
Steps:  85%|████████▍ | 509/600 [16:07<02:23,  1.57s/it, loss=0.136, lr=0.0001]
Steps:  85%|████████▍ | 509/600 [16:07<02:23,  1.57s/it, loss=0.145, lr=0.0001]
Steps:  85%|████████▌ | 510/600 [16:08<02:19,  1.56s/it, loss=0.145, lr=0.0001]
Steps:  85%|████████▌ | 510/600 [16:08<02:19,  1.56s/it, loss=0.0353, lr=0.0001]
Steps:  85%|████████▌ | 511/600 [16:10<02:17,  1.55s/it, loss=0.0353, lr=0.0001]
Steps:  85%|████████▌ | 511/600 [16:10<02:17,  1.55s/it, loss=0.0333, lr=0.0001]
Steps:  85%|████████▌ | 512/600 [16:12<02:17,  1.56s/it, loss=0.0333, lr=0.0001]
Steps:  85%|████████▌ | 512/600 [16:12<02:17,  1.56s/it, loss=0.313, lr=0.0001] 
Steps:  86%|████████▌ | 513/600 [16:13<02:17,  1.58s/it, loss=0.313, lr=0.0001]
Steps:  86%|████████▌ | 513/600 [16:13<02:17,  1.58s/it, loss=0.121, lr=0.0001]
Steps:  86%|████████▌ | 514/600 [16:15<02:18,  1.61s/it, loss=0.121, lr=0.0001]
Steps:  86%|████████▌ | 514/600 [16:15<02:18,  1.61s/it, loss=0.0071, lr=0.0001]
Steps:  86%|████████▌ | 515/600 [16:17<02:17,  1.62s/it, loss=0.0071, lr=0.0001]
Steps:  86%|████████▌ | 515/600 [16:17<02:17,  1.62s/it, loss=0.187, lr=0.0001] 
Steps:  86%|████████▌ | 516/600 [16:18<02:06,  1.51s/it, loss=0.187, lr=0.0001]
Steps:  86%|████████▌ | 516/600 [16:18<02:06,  1.51s/it, loss=0.226, lr=0.0001]
Steps:  86%|████████▌ | 517/600 [16:19<01:46,  1.28s/it, loss=0.226, lr=0.0001]
Steps:  86%|████████▌ | 517/600 [16:19<01:46,  1.28s/it, loss=0.00348, lr=0.0001]
Steps:  86%|████████▋ | 518/600 [16:21<02:03,  1.50s/it, loss=0.00348, lr=0.0001]
Steps:  86%|████████▋ | 518/600 [16:21<02:03,  1.50s/it, loss=0.199, lr=0.0001]  
Steps:  86%|████████▋ | 519/600 [16:22<02:02,  1.51s/it, loss=0.199, lr=0.0001]
Steps:  86%|████████▋ | 519/600 [16:22<02:02,  1.51s/it, loss=0.149, lr=0.0001]
Steps:  87%|████████▋ | 520/600 [16:24<02:00,  1.50s/it, loss=0.149, lr=0.0001]
Steps:  87%|████████▋ | 520/600 [16:24<02:00,  1.50s/it, loss=0.0256, lr=0.0001]
Steps:  87%|████████▋ | 521/600 [16:25<02:03,  1.56s/it, loss=0.0256, lr=0.0001]
Steps:  87%|████████▋ | 521/600 [16:25<02:03,  1.56s/it, loss=0.00478, lr=0.0001]
Steps:  87%|████████▋ | 522/600 [16:27<02:04,  1.60s/it, loss=0.00478, lr=0.0001]
Steps:  87%|████████▋ | 522/600 [16:27<02:04,  1.60s/it, loss=0.0457, lr=0.0001] 
Steps:  87%|████████▋ | 523/600 [16:29<02:08,  1.67s/it, loss=0.0457, lr=0.0001]
Steps:  87%|████████▋ | 523/600 [16:29<02:08,  1.67s/it, loss=0.283, lr=0.0001] 
Steps:  87%|████████▋ | 524/600 [16:30<02:03,  1.62s/it, loss=0.283, lr=0.0001]
Steps:  87%|████████▋ | 524/600 [16:30<02:03,  1.62s/it, loss=0.144, lr=0.0001]
Steps:  88%|████████▊ | 525/600 [16:32<01:57,  1.57s/it, loss=0.144, lr=0.0001]
Steps:  88%|████████▊ | 525/600 [16:32<01:57,  1.57s/it, loss=0.045, lr=0.0001]
Steps:  88%|████████▊ | 526/600 [16:33<01:54,  1.55s/it, loss=0.045, lr=0.0001]
Steps:  88%|████████▊ | 526/600 [16:33<01:54,  1.55s/it, loss=0.00609, lr=0.0001]
Steps:  88%|████████▊ | 527/600 [16:35<01:49,  1.50s/it, loss=0.00609, lr=0.0001]
Steps:  88%|████████▊ | 527/600 [16:35<01:49,  1.50s/it, loss=0.0529, lr=0.0001] 
Steps:  88%|████████▊ | 528/600 [16:35<01:31,  1.27s/it, loss=0.0529, lr=0.0001]
Steps:  88%|████████▊ | 528/600 [16:35<01:31,  1.27s/it, loss=0.329, lr=0.0001] 
Steps:  88%|████████▊ | 529/600 [16:38<01:51,  1.57s/it, loss=0.329, lr=0.0001]
Steps:  88%|████████▊ | 529/600 [16:38<01:51,  1.57s/it, loss=0.133, lr=0.0001]
Steps:  88%|████████▊ | 530/600 [16:39<01:48,  1.55s/it, loss=0.133, lr=0.0001]
Steps:  88%|████████▊ | 530/600 [16:39<01:48,  1.55s/it, loss=0.0218, lr=0.0001]
Steps:  88%|████████▊ | 531/600 [16:41<01:53,  1.64s/it, loss=0.0218, lr=0.0001]
Steps:  88%|████████▊ | 531/600 [16:41<01:53,  1.64s/it, loss=0.133, lr=0.0001] 
Steps:  89%|████████▊ | 532/600 [16:43<01:55,  1.70s/it, loss=0.133, lr=0.0001]
Steps:  89%|████████▊ | 532/600 [16:43<01:55,  1.70s/it, loss=0.145, lr=0.0001]
Steps:  89%|████████▉ | 533/600 [16:44<01:51,  1.66s/it, loss=0.145, lr=0.0001]
Steps:  89%|████████▉ | 533/600 [16:44<01:51,  1.66s/it, loss=0.0365, lr=0.0001]
Steps:  89%|████████▉ | 534/600 [16:46<01:47,  1.62s/it, loss=0.0365, lr=0.0001]
Steps:  89%|████████▉ | 534/600 [16:46<01:47,  1.62s/it, loss=0.063, lr=0.0001] 
Steps:  89%|████████▉ | 535/600 [16:47<01:41,  1.56s/it, loss=0.063, lr=0.0001]
Steps:  89%|████████▉ | 535/600 [16:47<01:41,  1.56s/it, loss=0.14, lr=0.0001] 
Steps:  89%|████████▉ | 536/600 [16:49<01:43,  1.61s/it, loss=0.14, lr=0.0001]
Steps:  89%|████████▉ | 536/600 [16:49<01:43,  1.61s/it, loss=0.221, lr=0.0001]
Steps:  90%|████████▉ | 537/600 [16:50<01:33,  1.49s/it, loss=0.221, lr=0.0001]
Steps:  90%|████████▉ | 537/600 [16:50<01:33,  1.49s/it, loss=0.106, lr=0.0001]
Steps:  90%|████████▉ | 538/600 [16:52<01:28,  1.43s/it, loss=0.106, lr=0.0001]
Steps:  90%|████████▉ | 538/600 [16:52<01:28,  1.43s/it, loss=0.265, lr=0.0001]
Steps:  90%|████████▉ | 539/600 [16:52<01:14,  1.23s/it, loss=0.265, lr=0.0001]
Steps:  90%|████████▉ | 539/600 [16:52<01:14,  1.23s/it, loss=0.278, lr=0.0001]
Steps:  90%|█████████ | 540/600 [16:54<01:28,  1.48s/it, loss=0.278, lr=0.0001]
Steps:  90%|█████████ | 540/600 [16:54<01:28,  1.48s/it, loss=0.0142, lr=0.0001]
Steps:  90%|█████████ | 541/600 [16:56<01:30,  1.54s/it, loss=0.0142, lr=0.0001]
Steps:  90%|█████████ | 541/600 [16:56<01:30,  1.54s/it, loss=0.0142, lr=0.0001]
Steps:  90%|█████████ | 542/600 [16:58<01:31,  1.57s/it, loss=0.0142, lr=0.0001]
Steps:  90%|█████████ | 542/600 [16:58<01:31,  1.57s/it, loss=0.0135, lr=0.0001]
Steps:  90%|█████████ | 543/600 [17:00<01:33,  1.64s/it, loss=0.0135, lr=0.0001]
Steps:  90%|█████████ | 543/600 [17:00<01:33,  1.64s/it, loss=0.0914, lr=0.0001]
Steps:  91%|█████████ | 544/600 [17:01<01:26,  1.55s/it, loss=0.0914, lr=0.0001]
Steps:  91%|█████████ | 544/600 [17:01<01:26,  1.55s/it, loss=0.0322, lr=0.0001]
Steps:  91%|█████████ | 545/600 [17:02<01:24,  1.54s/it, loss=0.0322, lr=0.0001]
Steps:  91%|█████████ | 545/600 [17:02<01:24,  1.54s/it, loss=0.242, lr=0.0001] 
Steps:  91%|█████████ | 546/600 [17:04<01:24,  1.56s/it, loss=0.242, lr=0.0001]
Steps:  91%|█████████ | 546/600 [17:04<01:24,  1.56s/it, loss=0.0879, lr=0.0001]
Steps:  91%|█████████ | 547/600 [17:06<01:26,  1.64s/it, loss=0.0879, lr=0.0001]
Steps:  91%|█████████ | 547/600 [17:06<01:26,  1.64s/it, loss=0.0239, lr=0.0001]
Steps:  91%|█████████▏| 548/600 [17:07<01:23,  1.61s/it, loss=0.0239, lr=0.0001]
Steps:  91%|█████████▏| 548/600 [17:07<01:23,  1.61s/it, loss=0.0439, lr=0.0001]
Steps:  92%|█████████▏| 549/600 [17:09<01:17,  1.51s/it, loss=0.0439, lr=0.0001]
Steps:  92%|█████████▏| 549/600 [17:09<01:17,  1.51s/it, loss=0.17, lr=0.0001]  
Steps:  92%|█████████▏| 550/600 [17:09<01:04,  1.28s/it, loss=0.17, lr=0.0001]
Steps:  92%|█████████▏| 550/600 [17:09<01:04,  1.28s/it, loss=0.0445, lr=0.0001]
Steps:  92%|█████████▏| 551/600 [17:12<01:19,  1.62s/it, loss=0.0445, lr=0.0001]
Steps:  92%|█████████▏| 551/600 [17:12<01:19,  1.62s/it, loss=0.103, lr=0.0001] 
Steps:  92%|█████████▏| 552/600 [17:13<01:17,  1.62s/it, loss=0.103, lr=0.0001]
Steps:  92%|█████████▏| 552/600 [17:13<01:17,  1.62s/it, loss=0.325, lr=0.0001]
Steps:  92%|█████████▏| 553/600 [17:15<01:14,  1.59s/it, loss=0.325, lr=0.0001]
Steps:  92%|█████████▏| 553/600 [17:15<01:14,  1.59s/it, loss=0.0662, lr=0.0001]
Steps:  92%|█████████▏| 554/600 [17:17<01:17,  1.68s/it, loss=0.0662, lr=0.0001]
Steps:  92%|█████████▏| 554/600 [17:17<01:17,  1.68s/it, loss=0.157, lr=0.0001] 
Steps:  92%|█████████▎| 555/600 [17:18<01:13,  1.63s/it, loss=0.157, lr=0.0001]
Steps:  92%|█████████▎| 555/600 [17:18<01:13,  1.63s/it, loss=0.13, lr=0.0001] 
Steps:  93%|█████████▎| 556/600 [17:20<01:11,  1.62s/it, loss=0.13, lr=0.0001]
Steps:  93%|█████████▎| 556/600 [17:20<01:11,  1.62s/it, loss=0.0987, lr=0.0001]
Steps:  93%|█████████▎| 557/600 [17:21<01:08,  1.60s/it, loss=0.0987, lr=0.0001]
Steps:  93%|█████████▎| 557/600 [17:21<01:08,  1.60s/it, loss=0.258, lr=0.0001] 
Steps:  93%|█████████▎| 558/600 [17:23<01:09,  1.66s/it, loss=0.258, lr=0.0001]
Steps:  93%|█████████▎| 558/600 [17:23<01:09,  1.66s/it, loss=0.0764, lr=0.0001]
Steps:  93%|█████████▎| 559/600 [17:25<01:07,  1.65s/it, loss=0.0764, lr=0.0001]
Steps:  93%|█████████▎| 559/600 [17:25<01:07,  1.65s/it, loss=0.0326, lr=0.0001]
Steps:  93%|█████████▎| 560/600 [17:26<00:59,  1.50s/it, loss=0.0326, lr=0.0001]
Steps:  93%|█████████▎| 560/600 [17:26<00:59,  1.50s/it, loss=0.0374, lr=0.0001]
Steps:  94%|█████████▎| 561/600 [17:27<00:49,  1.28s/it, loss=0.0374, lr=0.0001]
Steps:  94%|█████████▎| 561/600 [17:27<00:49,  1.28s/it, loss=0.146, lr=0.0001] 10/13/2023 09:29:38 - INFO - __main__ - Running validation... 
 Generating 4 images with prompts: "a photo of Brad Pitt in a suit and sunglasses showing <thumbs_up> thumbs up", "a photo of Barack Obama wearing a vest showing <thumbs_up> thumbs up", "a photo of a black man at the beach showing <thumbs_up> thumbs up".


Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]Loaded scheduler as EulerDiscreteScheduler from `scheduler` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer_2 as CLIPTokenizer from `tokenizer_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...: 100%|██████████| 7/7 [00:00<00:00, 67.62it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:00<00:00, 67.19it/s]
{'variance_type', 'lambda_min_clipped', 'thresholding', 'solver_order', 'algorithm_type', 'lower_order_final', 'dynamic_thresholding_ratio', 'solver_type'} was not found in config. Values will be initialized to default values.
10/13/2023 09:30:36 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/13/2023 09:31:26 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/13/2023 09:32:16 - INFO - __main__ - Image features shape: torch.Size([5, 75648])

Steps:  94%|█████████▎| 562/600 [20:14<32:21, 51.08s/it, loss=0.146, lr=0.0001]
Steps:  94%|█████████▎| 562/600 [20:14<32:21, 51.08s/it, loss=0.221, lr=0.0001]
Steps:  94%|█████████▍| 563/600 [20:16<22:19, 36.21s/it, loss=0.221, lr=0.0001]
Steps:  94%|█████████▍| 563/600 [20:16<22:19, 36.21s/it, loss=0.0138, lr=0.0001]
Steps:  94%|█████████▍| 564/600 [20:18<15:33, 25.94s/it, loss=0.0138, lr=0.0001]
Steps:  94%|█████████▍| 564/600 [20:18<15:33, 25.94s/it, loss=0.0848, lr=0.0001]
Steps:  94%|█████████▍| 565/600 [20:19<10:51, 18.61s/it, loss=0.0848, lr=0.0001]
Steps:  94%|█████████▍| 565/600 [20:19<10:51, 18.61s/it, loss=0.101, lr=0.0001] 
Steps:  94%|█████████▍| 566/600 [20:21<07:39, 13.51s/it, loss=0.101, lr=0.0001]
Steps:  94%|█████████▍| 566/600 [20:21<07:39, 13.51s/it, loss=0.178, lr=0.0001]
Steps:  94%|█████████▍| 567/600 [20:23<05:30, 10.00s/it, loss=0.178, lr=0.0001]
Steps:  94%|█████████▍| 567/600 [20:23<05:30, 10.00s/it, loss=0.0466, lr=0.0001]
Steps:  95%|█████████▍| 568/600 [20:24<03:57,  7.42s/it, loss=0.0466, lr=0.0001]
Steps:  95%|█████████▍| 568/600 [20:24<03:57,  7.42s/it, loss=0.0221, lr=0.0001]
Steps:  95%|█████████▍| 569/600 [20:25<02:53,  5.59s/it, loss=0.0221, lr=0.0001]
Steps:  95%|█████████▍| 569/600 [20:25<02:53,  5.59s/it, loss=0.162, lr=0.0001] 
Steps:  95%|█████████▌| 570/600 [20:27<02:10,  4.36s/it, loss=0.162, lr=0.0001]
Steps:  95%|█████████▌| 570/600 [20:27<02:10,  4.36s/it, loss=0.137, lr=0.0001]
Steps:  95%|█████████▌| 571/600 [20:28<01:41,  3.50s/it, loss=0.137, lr=0.0001]
Steps:  95%|█████████▌| 571/600 [20:28<01:41,  3.50s/it, loss=0.177, lr=0.0001]
Steps:  95%|█████████▌| 572/600 [20:29<01:14,  2.68s/it, loss=0.177, lr=0.0001]
Steps:  95%|█████████▌| 572/600 [20:29<01:14,  2.68s/it, loss=0.00272, lr=0.0001]
Steps:  96%|█████████▌| 573/600 [20:31<01:07,  2.51s/it, loss=0.00272, lr=0.0001]
Steps:  96%|█████████▌| 573/600 [20:31<01:07,  2.51s/it, loss=0.00269, lr=0.0001]
Steps:  96%|█████████▌| 574/600 [20:32<00:56,  2.17s/it, loss=0.00269, lr=0.0001]
Steps:  96%|█████████▌| 574/600 [20:32<00:56,  2.17s/it, loss=0.0901, lr=0.0001] 
Steps:  96%|█████████▌| 575/600 [20:34<00:50,  2.02s/it, loss=0.0901, lr=0.0001]
Steps:  96%|█████████▌| 575/600 [20:34<00:50,  2.02s/it, loss=0.0098, lr=0.0001]
Steps:  96%|█████████▌| 576/600 [20:36<00:46,  1.92s/it, loss=0.0098, lr=0.0001]
Steps:  96%|█████████▌| 576/600 [20:36<00:46,  1.92s/it, loss=0.0485, lr=0.0001]
Steps:  96%|█████████▌| 577/600 [20:37<00:42,  1.83s/it, loss=0.0485, lr=0.0001]
Steps:  96%|█████████▌| 577/600 [20:37<00:42,  1.83s/it, loss=0.00419, lr=0.0001]
Steps:  96%|█████████▋| 578/600 [20:39<00:37,  1.70s/it, loss=0.00419, lr=0.0001]
Steps:  96%|█████████▋| 578/600 [20:39<00:37,  1.70s/it, loss=0.334, lr=0.0001]  
Steps:  96%|█████████▋| 579/600 [20:41<00:36,  1.72s/it, loss=0.334, lr=0.0001]
Steps:  96%|█████████▋| 579/600 [20:41<00:36,  1.72s/it, loss=0.0293, lr=0.0001]
Steps:  97%|█████████▋| 580/600 [20:43<00:35,  1.77s/it, loss=0.0293, lr=0.0001]
Steps:  97%|█████████▋| 580/600 [20:43<00:35,  1.77s/it, loss=0.231, lr=0.0001] 
Steps:  97%|█████████▋| 581/600 [20:44<00:32,  1.71s/it, loss=0.231, lr=0.0001]
Steps:  97%|█████████▋| 581/600 [20:44<00:32,  1.71s/it, loss=0.149, lr=0.0001]
Steps:  97%|█████████▋| 582/600 [20:46<00:29,  1.63s/it, loss=0.149, lr=0.0001]
Steps:  97%|█████████▋| 582/600 [20:46<00:29,  1.63s/it, loss=0.231, lr=0.0001]
Steps:  97%|█████████▋| 583/600 [20:46<00:23,  1.37s/it, loss=0.231, lr=0.0001]
Steps:  97%|█████████▋| 583/600 [20:46<00:23,  1.37s/it, loss=0.0929, lr=0.0001]
Steps:  97%|█████████▋| 584/600 [20:48<00:25,  1.61s/it, loss=0.0929, lr=0.0001]
Steps:  97%|█████████▋| 584/600 [20:48<00:25,  1.61s/it, loss=0.248, lr=0.0001] 
Steps:  98%|█████████▊| 585/600 [20:50<00:23,  1.56s/it, loss=0.248, lr=0.0001]
Steps:  98%|█████████▊| 585/600 [20:50<00:23,  1.56s/it, loss=0.167, lr=0.0001]
Steps:  98%|█████████▊| 586/600 [20:52<00:22,  1.58s/it, loss=0.167, lr=0.0001]
Steps:  98%|█████████▊| 586/600 [20:52<00:22,  1.58s/it, loss=0.0175, lr=0.0001]
Steps:  98%|█████████▊| 587/600 [20:53<00:20,  1.58s/it, loss=0.0175, lr=0.0001]
Steps:  98%|█████████▊| 587/600 [20:53<00:20,  1.58s/it, loss=0.149, lr=0.0001] 
Steps:  98%|█████████▊| 588/600 [20:55<00:19,  1.61s/it, loss=0.149, lr=0.0001]
Steps:  98%|█████████▊| 588/600 [20:55<00:19,  1.61s/it, loss=0.113, lr=0.0001]
Steps:  98%|█████████▊| 589/600 [20:57<00:18,  1.69s/it, loss=0.113, lr=0.0001]
Steps:  98%|█████████▊| 589/600 [20:57<00:18,  1.69s/it, loss=0.0168, lr=0.0001]
Steps:  98%|█████████▊| 590/600 [20:58<00:16,  1.67s/it, loss=0.0168, lr=0.0001]
Steps:  98%|█████████▊| 590/600 [20:58<00:16,  1.67s/it, loss=0.0716, lr=0.0001]
Steps:  98%|█████████▊| 591/600 [21:00<00:14,  1.59s/it, loss=0.0716, lr=0.0001]
Steps:  98%|█████████▊| 591/600 [21:00<00:14,  1.59s/it, loss=0.03, lr=0.0001]  
Steps:  99%|█████████▊| 592/600 [21:02<00:13,  1.66s/it, loss=0.03, lr=0.0001]
Steps:  99%|█████████▊| 592/600 [21:02<00:13,  1.66s/it, loss=0.0729, lr=0.0001]
Steps:  99%|█████████▉| 593/600 [21:03<00:10,  1.54s/it, loss=0.0729, lr=0.0001]
Steps:  99%|█████████▉| 593/600 [21:03<00:10,  1.54s/it, loss=0.187, lr=0.0001] 
Steps:  99%|█████████▉| 594/600 [21:04<00:07,  1.31s/it, loss=0.187, lr=0.0001]
Steps:  99%|█████████▉| 594/600 [21:04<00:07,  1.31s/it, loss=0.00324, lr=0.0001]
Steps:  99%|█████████▉| 595/600 [21:06<00:07,  1.57s/it, loss=0.00324, lr=0.0001]
Steps:  99%|█████████▉| 595/600 [21:06<00:07,  1.57s/it, loss=0.192, lr=0.0001]  
Steps:  99%|█████████▉| 596/600 [21:08<00:06,  1.64s/it, loss=0.192, lr=0.0001]
Steps:  99%|█████████▉| 596/600 [21:08<00:06,  1.64s/it, loss=0.161, lr=0.0001]
Steps: 100%|█████████▉| 597/600 [21:09<00:05,  1.68s/it, loss=0.161, lr=0.0001]
Steps: 100%|█████████▉| 597/600 [21:09<00:05,  1.68s/it, loss=0.206, lr=0.0001]
Steps: 100%|█████████▉| 598/600 [21:11<00:03,  1.64s/it, loss=0.206, lr=0.0001]
Steps: 100%|█████████▉| 598/600 [21:11<00:03,  1.64s/it, loss=0.199, lr=0.0001]
Steps: 100%|█████████▉| 599/600 [21:12<00:01,  1.62s/it, loss=0.199, lr=0.0001]
Steps: 100%|█████████▉| 599/600 [21:12<00:01,  1.62s/it, loss=0.1, lr=0.0001]  
Steps: 100%|██████████| 600/600 [21:14<00:00,  1.58s/it, loss=0.1, lr=0.0001]
Steps: 100%|██████████| 600/600 [21:14<00:00,  1.58s/it, loss=0.0751, lr=0.0001]Model weights saved in logs/sweep_final_0_20231013091146/pytorch_lora_weights.safetensors


Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]Loaded scheduler as EulerDiscreteScheduler from `scheduler` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded text_encoder_2 as CLIPTextModelWithProjection from `text_encoder_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...:  29%|██▊       | 2/7 [00:00<00:02,  2.27it/s]Loaded text_encoder as CLIPTextModel from `text_encoder` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...:  43%|████▎     | 3/7 [00:01<00:01,  2.75it/s]Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
{'dropout', 'attention_type'} was not found in config. Values will be initialized to default values.
Loaded unet as UNet2DConditionModel from `unet` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...:  71%|███████▏  | 5/7 [00:03<00:01,  1.08it/s]Loaded tokenizer_2 as CLIPTokenizer from `tokenizer_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.

Loading pipeline components...: 100%|██████████| 7/7 [00:03<00:00,  1.76it/s]
{'variance_type', 'lambda_min_clipped', 'thresholding', 'solver_order', 'algorithm_type', 'lower_order_final', 'dynamic_thresholding_ratio', 'solver_type'} was not found in config. Values will be initialized to default values.
Loading unet.


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.40it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.25it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.83it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.61it/s]

 10%|█         | 5/50 [00:00<00:08,  5.51it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.44it/s]

 14%|█▍        | 7/50 [00:01<00:07,  5.40it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.38it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.36it/s]

 20%|██        | 10/50 [00:01<00:07,  5.35it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.35it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.33it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.32it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.32it/s]

 30%|███       | 15/50 [00:02<00:06,  5.33it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.32it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.32it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.32it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.32it/s]

 40%|████      | 20/50 [00:03<00:05,  5.32it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.33it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.32it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.31it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.31it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.32it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.32it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.32it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.31it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.32it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.31it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.31it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.31it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.31it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.31it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.31it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.31it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.31it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.31it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.31it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.31it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.31it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.30it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.30it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.31it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.31it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.32it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.31it/s]

 96%|█████████▌| 48/50 [00:08<00:00,  5.30it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.30it/s]

100%|██████████| 50/50 [00:09<00:00,  5.30it/s]
100%|██████████| 50/50 [00:09<00:00,  5.34it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.42it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.22it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.77it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.58it/s]

 10%|█         | 5/50 [00:00<00:08,  5.49it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.41it/s]

 14%|█▍        | 7/50 [00:01<00:07,  5.38it/s]

 16%|█▌        | 8/50 [00:01<00:11,  3.65it/s]

 18%|█▊        | 9/50 [00:01<00:10,  4.04it/s]

 20%|██        | 10/50 [00:02<00:09,  4.36it/s]

 22%|██▏       | 11/50 [00:02<00:08,  4.61it/s]

 24%|██▍       | 12/50 [00:02<00:07,  4.81it/s]

 26%|██▌       | 13/50 [00:02<00:07,  4.94it/s]

 28%|██▊       | 14/50 [00:02<00:07,  5.04it/s]

 30%|███       | 15/50 [00:03<00:06,  5.11it/s]

 32%|███▏      | 16/50 [00:03<00:06,  5.17it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.21it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.25it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.25it/s]

 40%|████      | 20/50 [00:03<00:05,  5.27it/s]

 42%|████▏     | 21/50 [00:04<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.30it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.30it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.29it/s]

 52%|█████▏    | 26/50 [00:05<00:04,  5.30it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.30it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.29it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.30it/s]

 62%|██████▏   | 31/50 [00:06<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.29it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.28it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.28it/s]

 72%|███████▏  | 36/50 [00:07<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:07<00:02,  5.29it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.26it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.23it/s]

 84%|████████▍ | 42/50 [00:08<00:01,  5.31it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.31it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.31it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:09<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.17it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.38it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.20it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.76it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.56it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.37it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.33it/s]

 20%|██        | 10/50 [00:01<00:07,  5.32it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.30it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.30it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.28it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.28it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.30it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.29it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.30it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.29it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.29it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.28it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.29it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.29it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.28it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.29it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.29it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.30it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.39it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.21it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.75it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.55it/s]

 10%|█         | 5/50 [00:00<00:08,  5.46it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.31it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.31it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.30it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.30it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.29it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.30it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.29it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.28it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.28it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.29it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.30it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.29it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.28it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.28it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.27it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.27it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.27it/s]

100%|██████████| 50/50 [00:09<00:00,  5.27it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]
10/13/2023 09:34:22 - INFO - __main__ - Image features shape: torch.Size([5, 75648])


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.43it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.24it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.78it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.59it/s]

 10%|█         | 5/50 [00:00<00:08,  5.48it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.37it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.35it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.33it/s]

 20%|██        | 10/50 [00:01<00:07,  5.30it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.32it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.32it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.32it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.32it/s]

 30%|███       | 15/50 [00:02<00:06,  5.32it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.32it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.31it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.31it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.29it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.31it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.31it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.31it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.31it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.30it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.30it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.29it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.30it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.30it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.30it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.27it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.30it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.29it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.29it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.29it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.29it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.30it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.29it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.29it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.32it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.38it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.20it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.75it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.57it/s]

 10%|█         | 5/50 [00:00<00:08,  5.47it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.31it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.30it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.30it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.30it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.30it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.30it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.29it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.29it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.29it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.29it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.27it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.27it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.28it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.29it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.30it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.29it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.30it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.29it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.29it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.29it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.29it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.32it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.37it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.19it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.75it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.55it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.37it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.32it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.32it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.26it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.29it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.31it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.31it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.30it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.29it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.29it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.29it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.29it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.30it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.28it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.28it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.27it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.27it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.27it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.29it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.27it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.27it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.27it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.27it/s]

100%|██████████| 50/50 [00:09<00:00,  5.26it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.38it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.18it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.74it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.56it/s]

 10%|█         | 5/50 [00:00<00:08,  5.46it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.30it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.28it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.29it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.27it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.27it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.27it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.27it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.26it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.26it/s]

 64%|██████▍   | 32/50 [00:06<00:04,  4.19it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  4.49it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  4.70it/s]

 70%|███████   | 35/50 [00:06<00:03,  4.87it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  4.98it/s]

 74%|███████▍  | 37/50 [00:07<00:02,  5.06it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.12it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.17it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.19it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.22it/s]

 84%|████████▍ | 42/50 [00:08<00:01,  5.24it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.25it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.25it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.27it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.27it/s]

 94%|█████████▍| 47/50 [00:09<00:00,  5.26it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.22it/s]
10/13/2023 09:35:12 - INFO - __main__ - Image features shape: torch.Size([5, 75648])


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.40it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.21it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.77it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.58it/s]

 10%|█         | 5/50 [00:00<00:08,  5.49it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.43it/s]

 14%|█▍        | 7/50 [00:01<00:07,  5.40it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.36it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.34it/s]

 20%|██        | 10/50 [00:01<00:07,  5.33it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.33it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.32it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.31it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.31it/s]

 30%|███       | 15/50 [00:02<00:06,  5.31it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.31it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.30it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.31it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.31it/s]

 40%|████      | 20/50 [00:03<00:05,  5.31it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.30it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.30it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.27it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.30it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.29it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.28it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.29it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.28it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.29it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.29it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.29it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.32it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.38it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.19it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.73it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.53it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.31it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.28it/s]

 30%|███       | 15/50 [00:02<00:06,  5.28it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.28it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.29it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.29it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.29it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.30it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.29it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.29it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.29it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.29it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.29it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.27it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.27it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.27it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.38it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.18it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.74it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.55it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.33it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.33it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.30it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.30it/s]

 30%|███       | 15/50 [00:02<00:06,  5.28it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.28it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.29it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.27it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.27it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.27it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.27it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.27it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.27it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.27it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.28it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.27it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.28it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.28it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.27it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.26it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.27it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.27it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.27it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.27it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.30it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.37it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.16it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.72it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.54it/s]

 10%|█         | 5/50 [00:00<00:08,  5.46it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.32it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.30it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.29it/s]

 26%|██▌       | 13/50 [00:02<00:07,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.28it/s]

 30%|███       | 15/50 [00:02<00:06,  5.28it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.28it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.27it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.29it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.28it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.27it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.27it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.27it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.26it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.27it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.27it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.27it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.26it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.27it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.27it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.26it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.26it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.26it/s]

100%|██████████| 50/50 [00:09<00:00,  5.26it/s]
100%|██████████| 50/50 [00:09<00:00,  5.30it/s]
10/13/2023 09:36:01 - INFO - __main__ - Image features shape: torch.Size([5, 75648])


optimizer.bin:   0%|          | 0.00/47.4M [00:00<?, ?B/s]


pytorch_lora_weights.safetensors:   0%|          | 0.00/23.4M [00:00<?, ?B/s]




scheduler.bin:   0%|          | 0.00/563 [00:00<?, ?B/s]



random_states_0.pkl:   0%|          | 0.00/14.6k [00:00<?, ?B/s]





scaler.pt:   0%|          | 0.00/557 [00:00<?, ?B/s]






Upload 6 LFS files:   0%|          | 0/6 [00:00<?, ?it/s]





scaler.pt: 100%|██████████| 557/557 [00:00<00:00, 907B/s]

optimizer.bin:   0%|          | 8.19k/47.4M [00:00<1:04:09, 12.3kB/s]


pytorch_lora_weights.safetensors:   0%|          | 8.19k/23.4M [00:00<31:28, 12.4kB/s]



random_states_0.pkl:  56%|█████▌    | 8.19k/14.6k [00:00<00:00, 12.5kB/s]




scheduler.bin: 100%|██████████| 563/563 [00:00<00:00, 852B/s]
scaler.pt: 100%|██████████| 557/557 [00:00<00:00, 819B/s]

scheduler.bin: 100%|██████████| 563/563 [00:00<00:00, 770B/s]


optimizer.bin:   1%|          | 311k/47.4M [00:00<01:28, 535kB/s]    


pytorch_lora_weights.safetensors:   1%|▏         | 311k/23.4M [00:00<00:42, 538kB/s]  
random_states_0.pkl: 100%|██████████| 14.6k/14.6k [00:00<00:00, 17.7kB/s]


optimizer.bin:   4%|▎         | 1.70M/47.4M [00:00<00:14, 3.13MB/s]


pytorch_lora_weights.safetensors:   8%|▊         | 1.77M/23.4M [00:00<00:06, 3.27MB/s]



pytorch_lora_weights.safetensors:   0%|          | 0.00/23.4M [00:00<?, ?B/s]

optimizer.bin:  16%|█▌        | 7.45M/47.4M [00:01<00:02, 14.5MB/s]


pytorch_lora_weights.safetensors:  32%|███▏      | 7.47M/23.4M [00:00<00:01, 14.5MB/s]



pytorch_lora_weights.safetensors:   1%|▏         | 311k/23.4M [00:00<00:08, 2.72MB/s]

optimizer.bin:  32%|███▏      | 15.3M/47.4M [00:01<00:01, 28.7MB/s]


pytorch_lora_weights.safetensors:  66%|██████▌   | 15.4M/23.4M [00:01<00:00, 28.6MB/s]



pytorch_lora_weights.safetensors:   8%|▊         | 1.85M/23.4M [00:00<00:02, 9.28MB/s]

optimizer.bin:  41%|████      | 19.4M/47.4M [00:01<00:00, 30.1MB/s]



pytorch_lora_weights.safetensors:  33%|███▎      | 7.67M/23.4M [00:00<00:00, 28.7MB/s]

optimizer.bin:  55%|█████▍    | 25.9M/47.4M [00:01<00:00, 37.8MB/s]



pytorch_lora_weights.safetensors:  66%|██████▋   | 15.6M/23.4M [00:00<00:00, 45.6MB/s]

optimizer.bin:  68%|██████▊   | 32.0M/47.4M [00:01<00:00, 36.2MB/s]


pytorch_lora_weights.safetensors:  83%|████████▎ | 19.4M/23.4M [00:01<00:00, 15.8MB/s]

optimizer.bin:  87%|████████▋ | 41.4M/47.4M [00:01<00:00, 49.7MB/s]



pytorch_lora_weights.safetensors:  86%|████████▌ | 20.1M/23.4M [00:00<00:00, 31.7MB/s]
optimizer.bin: 100%|██████████| 47.4M/47.4M [00:01<00:00, 24.5MB/s]

pytorch_lora_weights.safetensors: 100%|██████████| 23.4M/23.4M [00:01<00:00, 11.9MB/s]

pytorch_lora_weights.safetensors: 100%|██████████| 23.4M/23.4M [00:01<00:00, 22.0MB/s]







Upload 6 LFS files:  17%|█▋        | 1/6 [00:02<00:11,  2.23s/it]
Upload 6 LFS files: 100%|██████████| 6/6 [00:02<00:00,  2.69it/s]