logs/model_worker_7c887a.log

2024-07-10 18:08:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.60.182:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-40B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2024-07-10 18:08:24 | INFO | model_worker | Loading the model InternVL2-40B on worker 7c887a ...
2024-07-10 18:08:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-10 18:08:24 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-10 18:08:30 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
2024-07-10 18:08:30 | ERROR | stderr |   warnings.warn(
2024-07-10 18:08:33 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/17 [00:00<?, ?it/s]
2024-07-10 18:08:35 | ERROR | stderr | 
Loading checkpoint shards:   6%|▌         | 1/17 [00:02<00:36,  2.28s/it]
2024-07-10 18:08:38 | ERROR | stderr | 
Loading checkpoint shards:  12%|█▏        | 2/17 [00:04<00:33,  2.23s/it]
2024-07-10 18:08:40 | ERROR | stderr | 
Loading checkpoint shards:  18%|█▊        | 3/17 [00:06<00:31,  2.28s/it]
2024-07-10 18:08:42 | ERROR | stderr | 
Loading checkpoint shards:  24%|██▎       | 4/17 [00:09<00:29,  2.29s/it]
2024-07-10 18:08:45 | ERROR | stderr | 
Loading checkpoint shards:  29%|██▉       | 5/17 [00:11<00:27,  2.33s/it]
2024-07-10 18:08:47 | ERROR | stderr | 
Loading checkpoint shards:  35%|███▌      | 6/17 [00:13<00:25,  2.32s/it]
2024-07-10 18:08:49 | ERROR | stderr | 
Loading checkpoint shards:  41%|████      | 7/17 [00:16<00:23,  2.31s/it]
2024-07-10 18:08:52 | ERROR | stderr | 
Loading checkpoint shards:  47%|████▋     | 8/17 [00:18<00:20,  2.33s/it]
2024-07-10 18:08:54 | ERROR | stderr | 
Loading checkpoint shards:  53%|█████▎    | 9/17 [00:20<00:18,  2.28s/it]
2024-07-10 18:08:56 | ERROR | stderr | 
Loading checkpoint shards:  59%|█████▉    | 10/17 [00:22<00:15,  2.24s/it]
2024-07-10 18:08:58 | ERROR | stderr | 
Loading checkpoint shards:  65%|██████▍   | 11/17 [00:25<00:13,  2.25s/it]
2024-07-10 18:09:00 | ERROR | stderr | 
Loading checkpoint shards:  71%|███████   | 12/17 [00:27<00:11,  2.21s/it]
2024-07-10 18:09:03 | ERROR | stderr | 
Loading checkpoint shards:  76%|███████▋  | 13/17 [00:29<00:08,  2.21s/it]