2024-07-10 03:40:29 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2024-07-10 03:40:29 | INFO | model_worker | Loading the model InternVL2-1B on worker 8e389c ...
2024-07-10 03:40:29 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-10 03:40:29 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-10 03:40:31 | INFO | model_worker | Register to controller
2024-07-10 03:40:31 | ERROR | stderr | INFO:     Started server process [94419]
2024-07-10 03:40:31 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-10 03:40:31 | ERROR | stderr | INFO:     Application startup complete.
2024-07-10 03:40:31 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit)
2024-07-10 03:40:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0
2024-07-10 03:40:52 | INFO | stdout | INFO:     10.140.60.209:45088 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:40:54 | INFO | stdout | INFO:     10.140.60.209:45094 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:40:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-07-10 03:40:55 | INFO | stdout | INFO:     10.140.60.209:45100 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 03:40:55 | INFO | stdout | history: []
2024-07-10 03:40:55 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F7AF0375000>]
2024-07-10 03:40:55 | INFO | stdout | Caught Unknown Error local variable 'images' referenced before assignment
2024-07-10 03:40:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 03:41:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 03:41:11 | INFO | stdout | INFO:     10.140.60.209:45110 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:41:13 | INFO | stdout | INFO:     10.140.60.209:45154 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:41:13 | INFO | stdout | INFO:     10.140.60.209:45166 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-10 03:41:14 | INFO | stdout | INFO:     10.140.60.209:45190 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 03:41:14 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', '']]
2024-07-10 03:41:14 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F7AF03B6E90>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=571x1280 at 0x7F7AF03B6EF0>]
2024-07-10 03:41:14 | INFO | stdout | Caught Unknown Error local variable 'images' referenced before assignment
2024-07-10 03:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-10 03:41:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-10 03:41:28 | INFO | stdout | INFO:     10.140.60.209:45278 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:41:30 | INFO | stdout | INFO:     10.140.60.209:45286 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:41:30 | INFO | stdout | INFO:     10.140.60.209:45292 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 03:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
2024-07-10 03:41:31 | INFO | stdout | INFO:     10.140.60.209:45298 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 03:41:31 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', ''], ['Image-2: <image>\nddd', '']]
2024-07-10 03:41:31 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7F7AF03B72B0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=571x1280 at 0x7F7AF03B74C0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=410x1570 at 0x7F7AF03B7520>]
2024-07-10 03:41:31 | INFO | stdout | Caught Unknown Error local variable 'images' referenced before assignment
2024-07-10 03:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:41:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:41:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:42:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:42:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:42:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:42:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:43:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:43:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:43:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:43:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:44:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:44:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:44:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:44:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:45:01 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:45:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:45:31 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:45:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:46:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:46:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:46:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:46:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:47:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:47:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:47:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:47:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:48:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:48:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:49:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:49:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:49:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:50:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:50:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 03:50:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3