InternVL

Running

App Files Files Community

InternVL / logs /model_worker_6ed459.log

czczup

Upload folder using huggingface_hub

3f1b7f0 verified 5 months ago

raw

history blame

54.2 kB

	2024-07-10 18:23:55 \| INFO \| model_worker \| args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
	2024-07-10 18:23:55 \| INFO \| model_worker \| Loading the model InternVL2-Pro on worker 6ed459 ...
	2024-07-10 18:23:55 \| WARNING \| transformers.tokenization_utils_base \| Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
	2024-07-10 18:23:55 \| WARNING \| transformers.tokenization_utils_base \| Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
	2024-07-10 18:24:03 \| ERROR \| stderr \| Loading checkpoint shards: 0%\| \| 0/33 [00:00<?, ?it/s]
	2024-07-10 18:24:05 \| ERROR \| stderr \| Loading checkpoint shards: 3%\|▎ \| 1/33 [00:02<01:07, 2.12s/it]
	2024-07-10 18:24:07 \| ERROR \| stderr \| Loading checkpoint shards: 6%\|▌ \| 2/33 [00:04<01:05, 2.10s/it]
	2024-07-10 18:24:09 \| ERROR \| stderr \| Loading checkpoint shards: 9%\|▉ \| 3/33 [00:06<01:03, 2.12s/it]
	2024-07-10 18:24:11 \| ERROR \| stderr \| Loading checkpoint shards: 12%\|█▏ \| 4/33 [00:08<01:00, 2.10s/it]
	2024-07-10 18:24:13 \| ERROR \| stderr \| Loading checkpoint shards: 15%\|█▌ \| 5/33 [00:10<01:00, 2.18s/it]
	2024-07-10 18:24:16 \| ERROR \| stderr \| Loading checkpoint shards: 18%\|█▊ \| 6/33 [00:12<00:59, 2.20s/it]
	2024-07-10 18:24:18 \| ERROR \| stderr \| Loading checkpoint shards: 21%\|██ \| 7/33 [00:15<00:56, 2.16s/it]
	2024-07-10 18:24:20 \| ERROR \| stderr \| Loading checkpoint shards: 24%\|██▍ \| 8/33 [00:17<00:53, 2.13s/it]
	2024-07-10 18:24:22 \| ERROR \| stderr \| Loading checkpoint shards: 27%\|██▋ \| 9/33 [00:19<00:51, 2.13s/it]
	2024-07-10 18:24:24 \| ERROR \| stderr \| Loading checkpoint shards: 30%\|███ \| 10/33 [00:21<00:49, 2.14s/it]
	2024-07-10 18:24:26 \| ERROR \| stderr \| Loading checkpoint shards: 33%\|███▎ \| 11/33 [00:23<00:46, 2.12s/it]
	2024-07-10 18:24:28 \| ERROR \| stderr \| Loading checkpoint shards: 36%\|███▋ \| 12/33 [00:25<00:43, 2.09s/it]
	2024-07-10 18:24:30 \| ERROR \| stderr \| Loading checkpoint shards: 39%\|███▉ \| 13/33 [00:27<00:41, 2.08s/it]
	2024-07-10 18:24:32 \| ERROR \| stderr \| Loading checkpoint shards: 42%\|████▏ \| 14/33 [00:29<00:39, 2.09s/it]
	2024-07-10 18:24:34 \| ERROR \| stderr \| Loading checkpoint shards: 45%\|████▌ \| 15/33 [00:31<00:37, 2.08s/it]
	2024-07-10 18:24:36 \| ERROR \| stderr \| Loading checkpoint shards: 48%\|████▊ \| 16/33 [00:33<00:35, 2.09s/it]
	2024-07-10 18:24:39 \| ERROR \| stderr \| Loading checkpoint shards: 52%\|█████▏ \| 17/33 [00:35<00:33, 2.09s/it]
	2024-07-10 18:24:41 \| ERROR \| stderr \| Loading checkpoint shards: 55%\|█████▍ \| 18/33 [00:38<00:31, 2.11s/it]
	2024-07-10 18:24:43 \| ERROR \| stderr \| Loading checkpoint shards: 58%\|█████▊ \| 19/33 [00:40<00:29, 2.09s/it]
	2024-07-10 18:24:45 \| ERROR \| stderr \| Loading checkpoint shards: 61%\|██████ \| 20/33 [00:42<00:26, 2.07s/it]
	2024-07-10 18:24:47 \| ERROR \| stderr \| Loading checkpoint shards: 64%\|██████▎ \| 21/33 [00:44<00:24, 2.06s/it]
	2024-07-10 18:24:49 \| ERROR \| stderr \| Loading checkpoint shards: 67%\|██████▋ \| 22/33 [00:46<00:22, 2.07s/it]
	2024-07-10 18:24:51 \| ERROR \| stderr \| Loading checkpoint shards: 70%\|██████▉ \| 23/33 [00:48<00:20, 2.05s/it]
	2024-07-10 18:24:53 \| ERROR \| stderr \| Loading checkpoint shards: 73%\|███████▎ \| 24/33 [00:50<00:18, 2.03s/it]
	2024-07-10 18:24:55 \| ERROR \| stderr \| Loading checkpoint shards: 76%\|███████▌ \| 25/33 [00:52<00:16, 2.02s/it]
	2024-07-10 18:24:57 \| ERROR \| stderr \| Loading checkpoint shards: 79%\|███████▉ \| 26/33 [00:54<00:14, 2.03s/it]
	2024-07-10 18:24:59 \| ERROR \| stderr \| Loading checkpoint shards: 82%\|████████▏ \| 27/33 [00:56<00:12, 2.04s/it]
	2024-07-10 18:25:01 \| ERROR \| stderr \| Loading checkpoint shards: 85%\|████████▍ \| 28/33 [00:58<00:10, 2.02s/it]
	2024-07-10 18:25:03 \| ERROR \| stderr \| Loading checkpoint shards: 88%\|████████▊ \| 29/33 [01:00<00:08, 2.03s/it]
	2024-07-10 18:25:05 \| ERROR \| stderr \| Loading checkpoint shards: 91%\|█████████ \| 30/33 [01:02<00:06, 2.06s/it]
	2024-07-10 18:25:07 \| ERROR \| stderr \| Loading checkpoint shards: 94%\|█████████▍\| 31/33 [01:04<00:04, 2.04s/it]
	2024-07-10 18:25:09 \| ERROR \| stderr \| Loading checkpoint shards: 97%\|█████████▋\| 32/33 [01:06<00:01, 1.92s/it]
	2024-07-10 18:25:10 \| ERROR \| stderr \| Loading checkpoint shards: 100%\|██████████\| 33/33 [01:07<00:00, 1.70s/it]
	2024-07-10 18:25:10 \| ERROR \| stderr \| Loading checkpoint shards: 100%\|██████████\| 33/33 [01:07<00:00, 2.04s/it]
	2024-07-10 18:25:10 \| ERROR \| stderr \|
	2024-07-10 18:25:11 \| INFO \| model_worker \| Register to controller
	2024-07-10 18:25:11 \| ERROR \| stderr \| INFO: Started server process [14778]
	2024-07-10 18:25:11 \| ERROR \| stderr \| INFO: Waiting for application startup.
	2024-07-10 18:25:11 \| ERROR \| stderr \| INFO: Application startup complete.
	2024-07-10 18:25:11 \| ERROR \| stderr \| INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
	2024-07-10 18:25:18 \| INFO \| stdout \| INFO: 10.140.60.209:50882 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:25:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:25:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:25:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:26:08 \| INFO \| stdout \| INFO: 10.140.60.209:50960 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:26:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:26:16 \| INFO \| stdout \| INFO: 10.140.60.209:51084 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:26:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:26:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:26:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:27:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:27:18 \| INFO \| stdout \| INFO: 10.140.60.209:51352 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:27:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:27:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:27:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:28:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:28:25 \| INFO \| stdout \| INFO: 10.140.60.209:51600 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:28:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:28:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:28:56 \| INFO \| stdout \| INFO: 10.140.60.209:51640 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:28:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:29:05 \| INFO \| stdout \| INFO: 10.140.60.209:51666 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:29:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:29:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:29:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:29:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:30:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:30:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:30:34 \| INFO \| stdout \| INFO: 10.140.60.209:52062 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:30:40 \| INFO \| stdout \| INFO: 10.140.60.209:52084 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:30:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:30:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:31:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:31:23 \| INFO \| stdout \| INFO: 10.140.60.209:52274 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:31:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:31:31 \| INFO \| stdout \| INFO: 10.140.60.209:52294 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:31:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:31:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:32:02 \| INFO \| stdout \| INFO: 10.140.60.209:52342 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:32:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:32:12 \| INFO \| stdout \| INFO: 10.140.60.209:52372 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:32:19 \| INFO \| stdout \| INFO: 10.140.60.209:52552 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:32:22 \| INFO \| stdout \| INFO: 10.140.60.209:52574 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:32:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:32:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:32:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:33:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:33:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:33:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:33:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:34:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:34:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:34:41 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:34:56 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:35:11 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
	2024-07-10 18:35:17 \| INFO \| stdout \| INFO: 10.140.60.209:53134 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:35:25 \| INFO \| stdout \| INFO: 10.140.60.209:53186 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:35:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
	2024-07-10 18:35:26 \| INFO \| stdout \| INFO: 10.140.60.209:53192 - "POST /worker_generate_stream HTTP/1.1" 200 OK
	2024-07-10 18:35:26 \| INFO \| stdout \| history: [['Image-1: <image>\nDescribe this image in detail.', "The image depicts a close-up of a man dressed in what appears to be Viking or Norse warrior attire. He has a fierce and determined expression on his face, with piercing blue eyes that seem to stare directly at the viewer. His thick, reddish-brown beard and mustache are well-groomed, adding to his imposing and rugged appearance.\n\nThe man is wearing a helmet with two large, curved horns on top, reminiscent of traditional Viking helmets. The helmet is adorned with metal rivets and has a leather strap that encircles his head, providing a secure fit. The helmet's design suggests it is meant for battle, offering protection while also serving as a symbol of his warrior status.\n\nHis attire includes a fur-lined cloak or cape, which adds to the overall impression of his readiness for harsh, cold climates. The fur appears soft and thick, likely providing warmth and comfort in cold weather. The cloak is draped over his shoulders and is secured by a leather strap or clasp, ensuring it stays in place during movement.\n\nThe man's skin is fair, and his facial features are strong and defined, with high cheekbones and a prominent jawline. His expression is intense and focused, suggesting he is a seasoned warrior or leader.\n\nThe background of the image is blurred, drawing the viewer's attention to the man's face and attire. The lighting is dramatic, with shadows accentuating the contours of his face and the texture of his beard and fur cloak. The overall mood of the image is one of strength, determination, and readiness for battle. "]]
	2024-07-10 18:35:26 \| INFO \| stdout \| question: Pretrain Speech Encoder啥意思
	2024-07-10 18:35:26 \| INFO \| stdout \| pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F598C93BB50>]
	2024-07-10 18:35:26 \| INFO \| model_worker \| dynamic_image_size: True
	2024-07-10 18:35:26 \| INFO \| model_worker \| use_thumbnail: True
	2024-07-10 18:35:26 \| INFO \| model_worker \| Resize images to 448x448
	2024-07-10 18:35:26 \| INFO \| model_worker \| Split images to torch.Size([10, 3, 448, 448])
	2024-07-10 18:35:26 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
	2024-07-10 18:35:27 \| WARNING \| transformers.generation.utils \| Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
	2024-07-10 18:35:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
	2024-07-10 18:35:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
	2024-07-10 18:36:02 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:36:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:36:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:36:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:36:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:37:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:37:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:37:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:37:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:38:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:38:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:38:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:38:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:39:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:39:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:39:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:39:57 \| INFO \| stdout \| INFO: 10.140.60.209:53982 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:39:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:40:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:40:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:40:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:40:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:40:59 \| INFO \| stdout \| INFO: 10.140.60.209:54238 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:02 \| INFO \| stdout \| INFO: 10.140.60.209:54258 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:03 \| INFO \| stdout \| INFO: 10.140.60.209:54282 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:04 \| INFO \| stdout \| INFO: 10.140.60.209:54302 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:06 \| INFO \| stdout \| INFO: 10.140.60.209:54322 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:08 \| INFO \| stdout \| INFO: 10.140.60.209:54344 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:41:13 \| INFO \| stdout \| INFO: 10.140.60.209:54408 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:14 \| INFO \| stdout \| INFO: 10.140.60.209:54442 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:41:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:41:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:41:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:42:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:42:15 \| INFO \| stdout \| INFO: 10.140.60.209:54692 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:42:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:42:30 \| INFO \| stdout \| INFO: 10.140.60.209:54796 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:42:38 \| INFO \| stdout \| INFO: 10.140.60.209:54824 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:42:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:42:48 \| INFO \| stdout \| INFO: 10.140.60.209:54860 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:42:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:42:58 \| INFO \| stdout \| INFO: 10.140.60.209:54888 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:43:24 \| INFO \| stdout \| INFO: 10.140.60.209:55076 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:25 \| INFO \| stdout \| INFO: 10.140.60.209:55096 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
	2024-07-10 18:43:30 \| INFO \| stdout \| INFO: 10.140.60.209:55118 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:34 \| INFO \| stdout \| INFO: 10.140.60.209:55138 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:35 \| INFO \| stdout \| INFO: 10.140.60.209:55158 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:36 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:43:36 \| INFO \| stdout \| INFO: 10.140.60.209:55164 - "POST /worker_generate_stream HTTP/1.1" 200 OK
	2024-07-10 18:43:36 \| INFO \| stdout \| history: []
	2024-07-10 18:43:36 \| INFO \| stdout \| question: Image-1: <image>
	2024-07-10 18:43:36 \| INFO \| stdout \| Describe this image in detail.
	2024-07-10 18:43:36 \| INFO \| stdout \| pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F59657D5840>]
	2024-07-10 18:43:36 \| INFO \| model_worker \| dynamic_image_size: True
	2024-07-10 18:43:36 \| INFO \| model_worker \| use_thumbnail: True
	2024-07-10 18:43:36 \| INFO \| model_worker \| Resize images to 448x448
	2024-07-10 18:43:36 \| INFO \| model_worker \| Split images to torch.Size([10, 3, 448, 448])
	2024-07-10 18:43:37 \| WARNING \| transformers.generation.utils \| Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
	2024-07-10 18:43:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:43:57 \| INFO \| stdout \| INFO: 10.140.60.209:55194 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:43:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:44:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:44:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:44:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:44:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
	2024-07-10 18:44:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:45:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:45:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:45:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:45:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:46:02 \| INFO \| stdout \| INFO: 10.140.60.209:55616 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:03 \| INFO \| stdout \| INFO: 10.140.60.209:55636 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:07 \| INFO \| stdout \| INFO: 10.140.60.209:55656 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:46:21 \| INFO \| stdout \| INFO: 10.140.60.209:55848 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:22 \| INFO \| stdout \| INFO: 10.140.60.209:55868 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:23 \| INFO \| stdout \| INFO: 10.140.60.209:55888 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:46:28 \| INFO \| stdout \| INFO: 10.140.60.209:55918 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:46:44 \| INFO \| stdout \| INFO: 10.140.60.209:56018 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:56 \| INFO \| stdout \| INFO: 10.140.60.209:56062 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:46:59 \| INFO \| stdout \| INFO: 10.140.60.209:56086 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:46:59 \| INFO \| stdout \| INFO: 10.140.60.209:56106 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:09 \| INFO \| stdout \| INFO: 10.140.60.209:56132 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:47:14 \| INFO \| stdout \| INFO: 10.140.60.209:56222 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:21 \| INFO \| stdout \| INFO: 10.140.60.209:56374 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:47:29 \| INFO \| stdout \| INFO: 10.140.60.209:56410 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:32 \| INFO \| stdout \| INFO: 10.140.60.209:56448 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:35 \| INFO \| stdout \| INFO: 10.140.60.209:56468 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:35 \| INFO \| stdout \| INFO: 10.140.60.209:56488 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:47:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:47:57 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:48:12 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:48:15 \| INFO \| stdout \| INFO: 10.140.60.209:56674 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:48:27 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:48:42 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:48:47 \| INFO \| stdout \| INFO: 10.140.60.209:56808 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:48:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:49:12 \| INFO \| stdout \| INFO: 10.140.60.209:56864 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:49:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:49:16 \| INFO \| stdout \| INFO: 10.140.60.209:56974 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:49:25 \| INFO \| stdout \| INFO: 10.140.60.209:57057 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:49:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:49:36 \| INFO \| stdout \| INFO: 10.140.60.209:57084 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:49:36 \| INFO \| stdout \| INFO: 10.140.60.209:57104 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:49:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:49:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:50:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:50:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:50:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:50:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:51:06 \| INFO \| stdout \| INFO: 10.140.60.209:57340 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:51:09 \| INFO \| stdout \| INFO: 10.140.60.209:57362 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:51:10 \| INFO \| stdout \| INFO: 10.140.60.209:57382 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:51:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:51:13 \| INFO \| stdout \| INFO: 10.140.60.209:57434 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:51:14 \| INFO \| stdout \| INFO: 10.140.60.209:57476 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:51:15 \| INFO \| stdout \| INFO: 10.140.60.209:57524 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:51:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:51:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:51:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:52:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:52:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:52:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:52:45 \| INFO \| stdout \| INFO: 10.140.60.209:58028 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:52:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:53:08 \| INFO \| stdout \| INFO: 10.140.60.209:58062 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:53:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:53:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:53:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:53:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:54:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:54:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:54:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:54:54 \| INFO \| stdout \| INFO: 10.140.60.209:58638 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:54:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:55:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:55:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:55:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:55:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:56:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:56:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:56:38 \| INFO \| stdout \| INFO: 10.140.60.209:59154 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:56:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:56:56 \| INFO \| stdout \| INFO: 10.140.60.209:59178 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 18:56:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:57:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:57:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:57:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:57:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:58:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:58:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:58:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:58:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:59:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:59:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:59:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 18:59:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:00:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:00:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:00:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:00:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:01:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:01:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:01:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:01:58 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:02:13 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:02:28 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:02:43 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:02:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:03:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:03:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:03:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:03:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:04:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:04:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:04:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:04:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:05:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:05:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:05:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:05:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:06:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:06:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:06:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:06:51 \| INFO \| stdout \| INFO: 10.140.60.209:33692 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:06:56 \| INFO \| stdout \| INFO: 10.140.60.209:33712 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:06:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:07:03 \| INFO \| stdout \| INFO: 10.140.60.209:33748 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:07:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:07:14 \| INFO \| stdout \| INFO: 10.140.60.209:33854 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:07:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:07:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:07:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:08:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:08:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:08:40 \| INFO \| stdout \| INFO: 10.140.60.209:34340 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:08:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:08:44 \| INFO \| stdout \| INFO: 10.140.60.209:34372 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:08:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:09:05 \| INFO \| stdout \| INFO: 10.140.60.209:34478 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:09:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:09:16 \| INFO \| stdout \| INFO: 10.140.60.209:34672 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:09:17 \| INFO \| stdout \| INFO: 10.140.60.209:34718 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:09:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:09:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:09:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:10:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:10:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:10:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:10:51 \| INFO \| stdout \| INFO: 10.140.60.209:35142 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:10:52 \| INFO \| stdout \| INFO: 10.140.60.209:35162 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:10:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:11:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:11:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:11:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:11:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:12:07 \| INFO \| stdout \| INFO: 10.140.60.209:35462 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:12:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:12:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:12:44 \| INFO \| stdout \| INFO: 10.140.60.209:35714 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:12:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:12:44 \| INFO \| stdout \| INFO: 10.140.60.209:35734 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:12:50 \| INFO \| stdout \| INFO: 10.140.60.209:35760 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:12:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:13:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:13:17 \| INFO \| stdout \| INFO: 10.140.60.209:35904 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:13:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:13:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:13:46 \| INFO \| stdout \| INFO: 10.140.60.209:36000 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:13:47 \| INFO \| stdout \| INFO: 10.140.60.209:36026 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:13:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:14:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:14:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:14:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:14:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:15:14 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:15:29 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:15:44 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:15:59 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:16:02 \| INFO \| stdout \| INFO: 10.140.60.209:36498 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:16:15 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:16:16 \| INFO \| stdout \| INFO: 10.140.60.209:36626 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:16:23 \| INFO \| stdout \| INFO: 10.140.60.209:36718 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:16:30 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:16:31 \| INFO \| stdout \| INFO: 10.140.60.209:36744 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:16:40 \| INFO \| stdout \| INFO: 10.140.60.209:36766 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:16:41 \| INFO \| stdout \| INFO: 10.140.60.209:36788 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:16:45 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:17:00 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:17:00 \| INFO \| stdout \| INFO: 10.140.60.209:36818 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:04 \| INFO \| stdout \| INFO: 10.140.60.209:36838 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:08 \| INFO \| stdout \| INFO: 10.140.60.209:36860 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:10 \| INFO \| stdout \| INFO: 10.140.60.209:36880 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:15 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:17:19 \| INFO \| stdout \| INFO: 10.140.60.209:37080 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:30 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:17:41 \| INFO \| stdout \| INFO: 10.140.60.209:37110 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:45 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:17:46 \| INFO \| stdout \| INFO: 10.140.60.209:37130 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:47 \| INFO \| stdout \| INFO: 10.140.60.209:37150 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:51 \| INFO \| stdout \| INFO: 10.140.60.209:37172 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:17:54 \| INFO \| stdout \| INFO: 10.140.60.209:37194 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:00 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:18:00 \| INFO \| stdout \| INFO: 10.140.60.209:37220 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:11 \| INFO \| stdout \| INFO: 10.140.60.209:37242 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:12 \| INFO \| stdout \| INFO: 10.140.60.209:37276 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:12 \| INFO \| stdout \| INFO: 10.140.60.209:37304 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:15 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:18:30 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:18:37 \| INFO \| stdout \| INFO: 10.140.60.209:37490 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:41 \| INFO \| stdout \| INFO: 10.140.60.209:37516 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:45 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:18:49 \| INFO \| stdout \| INFO: 10.140.60.209:37546 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:54 \| INFO \| stdout \| INFO: 10.140.60.209:37564 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:18:55 \| INFO \| stdout \| INFO: 10.140.60.209:37582 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:19:00 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:19:15 \| INFO \| model_worker \| Send heart beat. Models: ['InternVL2-Pro']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
	2024-07-10 19:19:21 \| INFO \| stdout \| INFO: 10.140.60.209:37784 - "POST /worker_get_status HTTP/1.1" 200 OK
	2024-07-10 19:19:22 \| INFO \| stdout \| INFO: 10.140.60.209:37810 - "POST /worker_get_status HTTP/1.1" 200 OK