2024-07-11 22:15:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40002, worker_address='http://10.140.60.25:40002', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-2B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2024-07-11 22:15:24 | INFO | model_worker | Loading the model InternVL2-2B on worker 4e9294 ...
2024-07-11 22:15:25 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-11 22:15:25 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-11 22:15:30 | ERROR | stderr | /mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `None` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.
2024-07-11 22:15:30 | ERROR | stderr |   warnings.warn(
2024-07-11 22:15:32 | INFO | model_worker | Register to controller
2024-07-11 22:15:32 | ERROR | stderr | INFO:     Started server process [50491]
2024-07-11 22:15:32 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-11 22:15:32 | ERROR | stderr | INFO:     Application startup complete.
2024-07-11 22:15:32 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40002 (Press CTRL+C to quit)
2024-07-11 22:15:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:16:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:17:49 | INFO | stdout | INFO:     10.140.60.209:45806 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:02 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe0305d39d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-11 22:18:07 | ERROR | model_worker | heart beat error: HTTPConnectionPool(host='10.140.60.209', port=10075): Max retries exceeded with url: /receive_heart_beat (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe0306203a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-11 22:18:12 | INFO | model_worker | Register to controller
2024-07-11 22:18:17 | INFO | stdout | INFO:     10.140.60.209:46002 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:21 | INFO | stdout | INFO:     10.140.60.209:46128 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:22 | INFO | stdout | INFO:     10.140.60.209:46148 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:22 | INFO | stdout | INFO:     10.140.60.209:46168 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:18:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:18:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:32 | INFO | stdout | INFO:     10.140.60.209:46612 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:19:32 | INFO | stdout | INFO:     10.140.60.209:46628 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:19:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:19:59 | INFO | stdout | INFO:     10.140.60.209:46724 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:19:59 | INFO | stdout | INFO:     10.140.60.209:46742 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:20:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:20:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:20:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:20:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:21:57 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:22:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:23:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:24:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:25:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:26:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:13 | INFO | stdout | INFO:     10.140.60.209:49350 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:16 | INFO | stdout | INFO:     10.140.60.209:49454 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:17 | INFO | stdout | INFO:     10.140.60.209:49488 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:18 | INFO | stdout | INFO:     10.140.60.209:49508 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: None. global_counter: 0
2024-07-11 22:27:32 | INFO | stdout | INFO:     10.140.60.209:49610 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:34 | INFO | stdout | INFO:     10.140.60.209:49624 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:34 | INFO | stdout | INFO:     10.140.60.209:49638 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-07-11 22:27:35 | INFO | stdout | INFO:     10.140.60.209:49644 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-11 22:27:35 | INFO | model_worker | max_input_tile_list: [12]
2024-07-11 22:27:35 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
2024-07-11 22:27:35 | INFO | model_worker | []
2024-07-11 22:27:35 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fe03066ba60>}
2024-07-11 22:27:35 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
2024-07-11 22:27:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:27:42 | INFO | stdout | INFO:     10.140.60.209:49660 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-11 22:27:44 | INFO | stdout | INFO:     10.140.60.209:49674 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:44 | INFO | stdout | INFO:     10.140.60.209:49688 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-11 22:27:44 | INFO | stdout | INFO:     10.140.60.209:49694 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-11 22:27:44 | INFO | model_worker | max_input_tile_list: [12]
2024-07-11 22:27:45 | INFO | model_worker | Split images to torch.Size([9, 3, 448, 448])
2024-07-11 22:27:45 | INFO | model_worker | []
2024-07-11 22:27:45 | INFO | model_worker | Generation config: {'num_beams': 1, 'max_new_tokens': 2048, 'do_sample': True, 'temperature': 0.8, 'repetition_penalty': 1.1, 'max_length': 8192, 'top_p': 0.7, 'streamer': <transformers.generation.streamers.TextIteratorStreamer object at 0x7fe01c702140>}
2024-07-11 22:27:45 | WARNING | transformers.generation.utils | Both `max_new_tokens` (=2048) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
2024-07-11 22:27:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:27:51 | INFO | stdout | INFO:     10.140.60.209:49756 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:53 | INFO | stdout | INFO:     10.140.60.209:49788 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:54 | INFO | stdout | INFO:     10.140.60.209:49804 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:54 | INFO | stdout | INFO:     10.140.60.209:49820 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:27:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:28:04 | INFO | stdout | INFO:     10.140.60.209:49842 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:07 | INFO | stdout | INFO:     10.140.60.209:49862 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:10 | INFO | stdout | INFO:     10.140.60.209:49890 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:12 | INFO | stdout | INFO:     10.140.60.209:49934 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:28:14 | INFO | stdout | INFO:     10.140.60.209:49978 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:14 | INFO | stdout | INFO:     10.140.60.209:50002 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:22 | INFO | stdout | INFO:     10.140.60.209:50194 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:25 | INFO | stdout | INFO:     10.140.60.209:50214 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:26 | INFO | stdout | INFO:     10.140.60.209:50238 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:26 | INFO | stdout | INFO:     10.140.60.209:50258 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:28:36 | INFO | stdout | INFO:     10.140.60.209:50318 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:37 | INFO | stdout | INFO:     10.140.60.209:50342 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:38 | INFO | stdout | INFO:     10.140.60.209:50366 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:28:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:28:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:29:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:29:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:29:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:29:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:30:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:30:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:30:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:30:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:31:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:31:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:31:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:31:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:32:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:32:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:32:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:32:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:33:11 | INFO | stdout | INFO:     10.140.60.209:51918 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:33:13 | INFO | stdout | INFO:     10.140.60.209:51972 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:33:13 | INFO | stdout | INFO:     10.140.60.209:51994 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:33:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:33:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:33:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:33:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:34:02 | INFO | stdout | INFO:     10.140.60.209:52382 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:34:04 | INFO | stdout | INFO:     10.140.60.209:52402 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:34:05 | INFO | stdout | INFO:     10.140.60.209:52422 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:34:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:34:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:34:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:34:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:35:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:35:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:35:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:35:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:36:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:36:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:36:43 | INFO | stdout | INFO:     10.140.60.209:53468 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:36:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:36:49 | INFO | stdout | INFO:     10.140.60.209:53486 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:36:56 | INFO | stdout | INFO:     10.140.60.209:53588 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:36:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:37:00 | INFO | stdout | INFO:     10.140.60.209:53610 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:01 | INFO | stdout | INFO:     10.140.60.209:53632 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:37:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:37:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:37:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:38:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:38:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:38:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:38:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:39:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:39:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:39:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:39:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:40:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:40:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:40:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:40:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:40:59 | INFO | stdout | INFO:     10.140.60.209:55496 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:01 | INFO | stdout | INFO:     10.140.60.209:55516 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:01 | INFO | stdout | INFO:     10.140.60.209:55536 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:41:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:41:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:41:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:42:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:42:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:42:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:42:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:43:07 | INFO | stdout | INFO:     10.140.60.209:56194 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:08 | INFO | stdout | INFO:     10.140.60.209:56214 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:08 | INFO | stdout | INFO:     10.140.60.209:56234 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:43:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:43:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:43:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:44:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:44:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:44:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:44:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:45:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:45:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:45:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:45:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:46:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:46:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:46:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:46:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:47:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:47:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:47:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:48:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:48:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:48:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:48:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:49:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:49:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:49:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:49:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:50:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:50:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:50:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:50:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:50:54 | INFO | stdout | INFO:     10.140.60.209:58788 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:51:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:51:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:51:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:51:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:52:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:52:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:52:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:52:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:53:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:53:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:53:28 | INFO | stdout | INFO:     10.140.60.209:59710 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:53:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:53:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:54:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:54:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:54:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:54:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:55:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:55:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:55:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:55:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:56:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:56:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:56:22 | INFO | stdout | INFO:     10.140.60.209:60662 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:56:24 | INFO | stdout | INFO:     10.140.60.209:60682 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:56:24 | INFO | stdout | INFO:     10.140.60.209:60702 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:56:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:56:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:57:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:57:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:57:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:57:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:58:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:58:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:58:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:58:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:59:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:59:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:59:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 22:59:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:00:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:00:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:00:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:00:45 | INFO | stdout | INFO:     10.140.60.209:33898 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:00:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:01:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:01:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:01:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:01:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:02:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:02:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:02:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:02:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:03:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:03:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:03:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:03:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:04:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:04:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:04:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:04:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:05:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:05:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:05:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:05:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:06:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:06:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:06:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:06:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:07:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:07:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:07:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:07:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:08:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:08:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:08:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:08:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:09:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:09:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:09:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:09:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:10:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:10:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:10:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:10:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:11:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:11:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:11:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:11:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:12:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:12:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:12:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:12:45 | INFO | stdout | INFO:     10.140.60.209:38850 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:12:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:12:47 | INFO | stdout | INFO:     10.140.60.209:38870 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:12:47 | INFO | stdout | INFO:     10.140.60.209:38898 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:13:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:13:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:13:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:13:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:14:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:14:08 | INFO | stdout | INFO:     10.140.60.209:39428 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:13 | INFO | stdout | INFO:     10.140.60.209:39494 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:16 | INFO | stdout | INFO:     10.140.60.209:39574 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:16 | INFO | stdout | INFO:     10.140.60.209:39600 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:14:21 | INFO | stdout | INFO:     10.140.60.209:39762 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:23 | INFO | stdout | INFO:     10.140.60.209:39837 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:14:33 | INFO | stdout | INFO:     10.140.60.209:39870 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:37 | INFO | stdout | INFO:     10.140.60.209:39890 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:38 | INFO | stdout | INFO:     10.140.60.209:39910 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:14:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:15:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:15:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:15:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:15:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:16:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:16:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:16:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:16:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:17:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:17:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:17:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:17:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:18:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:18:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:18:20 | INFO | stdout | INFO:     10.140.60.209:41602 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:18:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:18:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:19:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:19:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:19:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:19:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:20:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:20:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:20:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:20:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:21:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:21:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:21:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:21:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:22:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:22:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:22:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:22:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:23:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:23:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:23:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:23:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:24:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:24:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:24:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:24:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:25:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:25:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:25:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:25:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:26:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:26:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:26:29 | INFO | stdout | INFO:     10.140.60.209:44776 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:26:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:26:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:26:48 | INFO | stdout | INFO:     10.140.60.209:44848 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:26:53 | INFO | stdout | INFO:     10.140.60.209:44920 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:26:53 | INFO | stdout | INFO:     10.140.60.209:44948 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:27:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:27:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:27:29 | INFO | stdout | INFO:     10.140.60.209:45244 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:27:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:27:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:28:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:28:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:28:29 | INFO | stdout | INFO:     10.140.60.209:45720 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:28:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:28:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:29:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:29:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:29:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:29:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:30:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:30:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:30:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:30:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:31:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:31:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:31:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:31:35 | INFO | stdout | INFO:     10.140.60.209:46900 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:31:37 | INFO | stdout | INFO:     10.140.60.209:46920 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:31:37 | INFO | stdout | INFO:     10.140.60.209:46940 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:31:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:31:51 | INFO | stdout | INFO:     10.140.60.209:46976 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:32:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:32:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:32:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:32:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:33:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:33:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:33:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:33:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:34:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:34:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:34:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:34:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:35:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:35:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:35:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:35:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:36:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:36:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:36:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:36:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:37:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:37:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:37:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:37:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:38:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:38:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:38:33 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:38:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:39:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:39:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:39:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:39:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:40:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:40:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:40:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:40:41 | INFO | stdout | INFO:     10.140.60.209:50364 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:40:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:41:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:41:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:41:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:41:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:42:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:42:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:42:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:42:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:43:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:43:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:43:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:43:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:44:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:44:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:44:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:44:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:45:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:45:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:45:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:45:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:46:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:46:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:46:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:46:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:47:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:47:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:47:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:47:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:48:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:48:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:48:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:48:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:49:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:49:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:49:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:49:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:50:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:50:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:50:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:50:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:51:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:51:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:51:34 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:51:49 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:52:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:52:19 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:52:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:52:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:53:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:53:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:53:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:53:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:54:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:54:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:54:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:54:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:55:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:55:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:55:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:55:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:56:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:56:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:56:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:56:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:57:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:57:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:57:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:57:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:58:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:58:09 | INFO | stdout | INFO:     10.140.60.209:57250 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 23:58:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:58:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:58:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:59:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:59:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:59:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-11 23:59:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:00:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:00:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:00:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:00:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:01:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:01:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:01:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:01:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:02:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:02:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:02:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:02:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:03:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:03:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:03:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-12 00:03:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-2B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2