2024-07-11 22:15:00 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40003, worker_address='http://10.140.60.25:40003', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-4B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2024-07-11 22:15:00 | INFO | model_worker | Loading the model InternVL2-4B on worker 21fda5 ...
2024-07-11 22:15:00 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-11 22:15:00 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-11 22:15:02 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl-apex/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
2024-07-11 22:15:02 | ERROR | stderr |   warnings.warn(
2024-07-11 22:15:03 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
2024-07-11 22:15:05 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 1/2 [00:01<00:01,  1.92s/it]
2024-07-11 22:15:06 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 2/2 [00:03<00:00,  1.48s/it]
2024-07-11 22:15:06 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 2/2 [00:03<00:00,  1.55s/it]
2024-07-11 22:15:06 | ERROR | stderr | 
2024-07-11 22:15:10 | INFO | model_worker | Register to controller
2024-07-11 22:15:10 | ERROR | stderr | INFO:     Started server process [47359]
2024-07-11 22:15:10 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-11 22:15:10 | ERROR | stderr | INFO:     Application startup complete.
2024-07-11 22:15:10 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40003 (Press CTRL+C to quit)
2024-07-11 22:15:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:15:27 | INFO | stdout | INFO:     10.140.60.209:37814 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:15:27 | INFO | stdout | INFO:     10.140.60.209:37826 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:15:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:15:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:49 | INFO | stdout | INFO:     10.140.60.209:38560 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:17:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:10 | INFO | model_worker | Register to controller
2024-07-11 22:18:17 | INFO | stdout | INFO:     10.140.60.209:38752 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:21 | INFO | stdout | INFO:     10.140.60.209:38878 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:22 | INFO | stdout | INFO:     10.140.60.209:38898 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:22 | INFO | stdout | INFO:     10.140.60.209:38918 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:32 | INFO | stdout | INFO:     10.140.60.209:39360 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:19:32 | INFO | stdout | INFO:     10.140.60.209:39376 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:19:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:59 | INFO | stdout | INFO:     10.140.60.209:39474 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:19:59 | INFO | stdout | INFO:     10.140.60.209:39492 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:20:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:20:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:20:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:20:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:13 | INFO | stdout | INFO:     10.140.60.209:42100 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:16 | INFO | stdout | INFO:     10.140.60.209:42204 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:17 | INFO | stdout | INFO:     10.140.60.209:42238 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:18 | INFO | stdout | INFO:     10.140.60.209:42258 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:32 | INFO | stdout | INFO:     10.140.60.209:42358 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:34 | INFO | stdout | INFO:     10.140.60.209:42375 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:34 | INFO | stdout | INFO:     10.140.60.209:42388 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:42 | INFO | stdout | INFO:     10.140.60.209:42410 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:44 | INFO | stdout | INFO:     10.140.60.209:42424 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:44 | INFO | stdout | INFO:     10.140.60.209:42438 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:51 | INFO | stdout | INFO:     10.140.60.209:42506 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:53 | INFO | stdout | INFO:     10.140.60.209:42538 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:54 | INFO | stdout | INFO:     10.140.60.209:42554 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:54 | INFO | stdout | INFO:     10.140.60.209:42570 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-07-11 22:27:55 | INFO | stdout | INFO:     10.140.60.209:42586 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-11 22:27:55 | INFO | model_worker | max_input_tile_list: [12]
2024-07-11 22:27:55 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
2024-07-11 22:27:55 | INFO | model_worker | []
2024-07-11 22:27:55 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fad8c264490>}
2024-07-11 22:27:55 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
2024-07-11 22:27:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-07-11 22:27:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:28:04 | INFO | stdout | INFO:     10.140.60.209:42592 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:07 | INFO | stdout | INFO:     10.140.60.209:42612 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:10 | INFO | stdout | INFO:     10.140.60.209:42640 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:28:12 | INFO | stdout | INFO:     10.140.60.209:42685 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:14 | INFO | stdout | INFO:     10.140.60.209:42728 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:14 | INFO | stdout | INFO:     10.140.60.209:42752 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:22 | INFO | stdout | INFO:     10.140.60.209:42944 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:25 | INFO | stdout | INFO:     10.140.60.209:42964 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:28:26 | INFO | stdout | INFO:     10.140.60.209:42988 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:26 | INFO | stdout | INFO:     10.140.60.209:43008 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:36 | INFO | stdout | INFO:     10.140.60.209:43068 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:37 | INFO | stdout | INFO:     10.140.60.209:43093 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:38 | INFO | stdout | INFO:     10.140.60.209:43116 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:28:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:29:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:29:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:29:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:29:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:30:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:30:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:30:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:30:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:31:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:31:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:31:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:31:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:32:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:32:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:32:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:32:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:33:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:33:11 | INFO | stdout | INFO:     10.140.60.209:44668 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:33:13 | INFO | stdout | INFO:     10.140.60.209:44722 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:33:13 | INFO | stdout | INFO:     10.140.60.209:44744 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:33:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:33:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:33:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:34:02 | INFO | stdout | INFO:     10.140.60.209:45132 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:34:04 | INFO | stdout | INFO:     10.140.60.209:45152 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:34:05 | INFO | stdout | INFO:     10.140.60.209:45172 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:34:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:34:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:34:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:34:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:35:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:35:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:35:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:35:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:36:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:36:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:36:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:36:43 | INFO | stdout | INFO:     10.140.60.209:46218 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:36:49 | INFO | stdout | INFO:     10.140.60.209:46236 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:36:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:36:56 | INFO | stdout | INFO:     10.140.60.209:46338 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:00 | INFO | stdout | INFO:     10.140.60.209:46360 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:01 | INFO | stdout | INFO:     10.140.60.209:46382 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:37:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:37:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:37:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:38:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:38:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:38:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:38:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:39:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:39:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:39:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:39:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:40:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:40:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:40:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:40:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:40:59 | INFO | stdout | INFO:     10.140.60.209:48246 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:01 | INFO | stdout | INFO:     10.140.60.209:48266 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:01 | INFO | stdout | INFO:     10.140.60.209:48286 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:41:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:41:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:41:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:42:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:42:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:42:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:42:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:43:07 | INFO | stdout | INFO:     10.140.60.209:48944 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:08 | INFO | stdout | INFO:     10.140.60.209:48964 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:08 | INFO | stdout | INFO:     10.140.60.209:48984 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:43:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:43:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:43:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:44:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:44:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:44:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:44:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:45:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:45:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:45:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:45:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:46:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:46:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:46:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:46:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:47:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:47:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:47:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:47:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:48:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:48:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:48:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:48:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:49:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:49:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:49:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:49:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:50:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:50:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:50:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:50:54 | INFO | stdout | INFO:     10.140.60.209:51538 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:50:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:51:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:51:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:51:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:51:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:52:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:52:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:52:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:52:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:53:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:53:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:53:28 | INFO | stdout | INFO:     10.140.60.209:52460 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:53:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:53:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:54:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:54:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:54:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:55:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:55:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:55:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:55:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:56:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:56:22 | INFO | stdout | INFO:     10.140.60.209:53412 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:56:24 | INFO | stdout | INFO:     10.140.60.209:53432 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:56:24 | INFO | stdout | INFO:     10.140.60.209:53452 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:56:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:56:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:56:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:57:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:57:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:57:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:57:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:58:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:58:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:58:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:58:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:59:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:59:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:59:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:59:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:00:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:00:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:00:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:00:45 | INFO | stdout | INFO:     10.140.60.209:54880 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:00:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:01:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:01:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:01:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:01:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:02:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:02:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:02:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:02:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:03:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:03:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:03:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:03:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:04:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:04:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:04:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:04:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:05:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:05:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:05:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:05:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:06:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:06:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:06:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:06:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:07:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:07:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:07:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:07:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:08:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:08:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:08:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:08:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:09:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:09:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:09:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:09:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:10:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:10:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:10:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:10:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:11:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:11:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:11:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:11:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:12:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:12:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:12:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:12:45 | INFO | stdout | INFO:     10.140.60.209:59832 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:12:47 | INFO | stdout | INFO:     10.140.60.209:59852 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:12:47 | INFO | stdout | INFO:     10.140.60.209:59880 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:12:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:13:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:13:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:13:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:14:08 | INFO | stdout | INFO:     10.140.60.209:60410 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:13 | INFO | stdout | INFO:     10.140.60.209:60476 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:14:16 | INFO | stdout | INFO:     10.140.60.209:60556 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:16 | INFO | stdout | INFO:     10.140.60.209:60582 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:21 | INFO | stdout | INFO:     10.140.60.209:60744 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:23 | INFO | stdout | INFO:     10.140.60.209:60818 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:14:33 | INFO | stdout | INFO:     10.140.60.209:60852 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:37 | INFO | stdout | INFO:     10.140.60.209:60872 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:38 | INFO | stdout | INFO:     10.140.60.209:60892 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:14:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:15:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:15:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:15:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:15:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:16:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:16:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:16:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:16:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:17:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:17:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:17:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:18:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:18:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:18:20 | INFO | stdout | INFO:     10.140.60.209:34350 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:18:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:18:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:19:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:19:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:19:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:19:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:20:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:20:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:20:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:20:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:21:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:21:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:21:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:21:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:22:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:22:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:22:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:22:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:23:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:23:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:23:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:23:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:24:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:24:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:24:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:24:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:25:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:25:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:25:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:25:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:26:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:26:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:26:29 | INFO | stdout | INFO:     10.140.60.209:37526 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:26:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:26:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:26:48 | INFO | stdout | INFO:     10.140.60.209:37598 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:26:53 | INFO | stdout | INFO:     10.140.60.209:37670 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:26:53 | INFO | stdout | INFO:     10.140.60.209:37698 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:27:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:27:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:27:29 | INFO | stdout | INFO:     10.140.60.209:37992 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:27:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:27:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:28:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:28:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:28:29 | INFO | stdout | INFO:     10.140.60.209:38470 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:28:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:28:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:29:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:29:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:29:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:29:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:30:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:30:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:30:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:30:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:31:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:31:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:31:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:31:35 | INFO | stdout | INFO:     10.140.60.209:39650 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:31:37 | INFO | stdout | INFO:     10.140.60.209:39670 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:31:37 | INFO | stdout | INFO:     10.140.60.209:39690 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:31:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:31:51 | INFO | stdout | INFO:     10.140.60.209:39726 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:32:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:32:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:32:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:32:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:33:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:33:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:33:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:33:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:34:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:34:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:34:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:34:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:35:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:35:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:35:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:35:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:36:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:36:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:36:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:36:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:37:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:37:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:37:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:37:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:38:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:38:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:38:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:38:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:39:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:39:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:39:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:39:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:40:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:40:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:40:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:40:41 | INFO | stdout | INFO:     10.140.60.209:43114 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:43:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:43:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:43:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:44:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:44:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:44:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:44:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:45:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:45:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:45:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:45:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:46:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:46:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:50:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:51:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:51:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:51:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:51:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:52:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:52:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:52:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:52:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:53:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:53:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:53:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:53:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:54:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:54:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:54:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:55:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:55:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:55:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:55:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:56:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:56:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:56:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:56:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:57:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:57:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:57:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:57:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:58:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:58:09 | INFO | stdout | INFO:     10.140.60.209:50000 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:58:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:58:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:58:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:59:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:59:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:59:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 23:59:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:00:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:00:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:00:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:00:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:01:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:01:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:01:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:01:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:02:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:02:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:02:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:02:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:03:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:03:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:03:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-12 00:03:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-4B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1