|
2024-07-10 04:29:23 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False) |
|
2024-07-10 04:29:23 | INFO | model_worker | Loading the model InternVL2-1B on worker 2fa00c ... |
|
2024-07-10 04:29:23 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. |
|
2024-07-10 04:29:23 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. |
|
2024-07-10 04:29:26 | INFO | model_worker | Register to controller |
|
2024-07-10 04:29:26 | ERROR | stderr | INFO: Started server process [72266] |
|
2024-07-10 04:29:26 | ERROR | stderr | INFO: Waiting for application startup. |
|
2024-07-10 04:29:26 | ERROR | stderr | INFO: Application startup complete. |
|
2024-07-10 04:29:26 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit) |
|
2024-07-10 04:29:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:29:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:30:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:30:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:30:35 | INFO | stdout | INFO: 10.140.60.209:53702 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 04:30:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:30:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:31:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:31:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:31:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:31:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:32:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:32:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:32:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:32:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:33:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 04:33:12 | INFO | stdout | INFO: 10.140.60.209:54042 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 04:33:15 | INFO | stdout | INFO: 10.140.60.209:54122 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 04:33:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1 |
|
2024-07-10 04:33:16 | INFO | stdout | INFO: 10.140.60.209:54144 - "POST /worker_generate_stream HTTP/1.1" 200 OK |
|
2024-07-10 04:33:16 | INFO | stdout | history: [] |
|
2024-07-10 04:33:16 | INFO | stdout | question: Image-1: <image> |
|
2024-07-10 04:33:16 | INFO | stdout | Describe this image in detail. |
|
2024-07-10 04:33:16 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FA17808C190>] |
|
2024-07-10 04:33:16 | INFO | model_worker | dynamic_image_size: True |
|
2024-07-10 04:33:16 | INFO | model_worker | use_thumbnail: True |
|
2024-07-10 04:33:16 | INFO | model_worker | Resize images to 448x448 |
|
2024-07-10 04:33:16 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448]) |
|
2024-07-10 04:33:16 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation. |
|
2024-07-10 04:33:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 04:33:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 04:33:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 04:33:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 04:34:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 04:34:13 | INFO | stdout | INFO: 10.140.60.209:54250 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 04:34:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2 |
|
2024-07-10 04:34:14 | INFO | stdout | INFO: 10.140.60.209:54270 - "POST /worker_generate_stream HTTP/1.1" 200 OK |
|
2024-07-10 04:34:14 | INFO | stdout | history: [['Image-1: <image>\nDescribe this image in detail.', "The image depicts three cheetahs in a natural setting, likely a savannah or grassland environment. The cheetahs are positioned in a semi-circle formation, with the adult and two cubs positioned in the center. \n\nThe adult cheetah is positioned on the right side of the image, standing tall with its head slightly tilted forward. It has a sharp, muscular build and a prominent black muzzle. The cheetah’s fur is a mix of brown and black spots, typical of its species, and its eyes are dark and focused, giving it a determined and alert expression.\n\nThe cubs are positioned on the left side of the image, with their heads slightly bowed. The cub on the left is facing the camera, while the one on the right is turned away from the camera, giving a more side profile view. Both cubs have similar coloration and patterns, with the adult cheetah's fur being darker than the cubs’.\n\nThe background of the image is a softly blurred mix of golden and yellow tones, suggesting a late afternoon or early morning setting. This warm, golden light casts a gentle glow on the cheetahs, highlighting their fur and making them stand out against the background.\n\nThe grassy ground is tall and golden, creating a stark contrast with the warm colors of the cheetahs and the background. The overall composition of the image is serene and majestic, capturing the essence of the cheetah's natural habitat.<|im_end|>"]] |
|
2024-07-10 04:34:14 | INFO | stdout | question: 翻译成中文 |
|
2024-07-10 04:34:14 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FA1780D20E0>] |
|
2024-07-10 04:34:14 | INFO | model_worker | dynamic_image_size: True |
|
2024-07-10 04:34:14 | INFO | model_worker | use_thumbnail: True |
|
2024-07-10 04:34:14 | INFO | model_worker | Resize images to 448x448 |
|
2024-07-10 04:34:14 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448]) |
|
2024-07-10 04:34:14 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation. |
|
2024-07-10 04:34:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:34:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:34:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:34:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:35:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:35:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:35:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:35:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:36:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:36:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:36:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:36:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:37:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:37:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:37:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:37:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:38:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:38:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:38:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:38:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:39:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:39:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:39:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:39:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:40:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:40:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:40:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:40:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:41:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:41:27 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 04:41:42 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
|
