|
2024-07-10 03:30:07 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False) |
|
2024-07-10 03:30:07 | INFO | model_worker | Loading the model InternVL2-1B on worker 91b7e4 ... |
|
2024-07-10 03:30:07 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. |
|
2024-07-10 03:30:07 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. |
|
2024-07-10 03:30:10 | INFO | model_worker | Register to controller |
|
2024-07-10 03:30:10 | ERROR | stderr | INFO: Started server process [70957] |
|
2024-07-10 03:30:10 | ERROR | stderr | INFO: Waiting for application startup. |
|
2024-07-10 03:30:10 | ERROR | stderr | INFO: Application startup complete. |
|
2024-07-10 03:30:10 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit) |
|
2024-07-10 03:30:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 03:30:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 03:30:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 03:31:02 | INFO | stdout | INFO: 10.140.60.209:43487 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 03:31:04 | INFO | stdout | INFO: 10.140.60.209:43492 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 03:31:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1 |
|
2024-07-10 03:31:04 | INFO | stdout | INFO: 10.140.60.209:43498 - "POST /worker_generate_stream HTTP/1.1" 200 OK |
|
2024-07-10 03:31:04 | INFO | model_worker | max_input_tiles: 12 |
|
2024-07-10 03:31:04 | INFO | stdout | history: [['Describe this image in detail.']] |
|
2024-07-10 03:31:04 | INFO | stdout | Caught Unknown Error name 'model' is not defined |
|
2024-07-10 03:31:04 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 03:31:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 03:31:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 03:31:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 03:31:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 03:32:09 | INFO | stdout | INFO: 10.140.60.209:43666 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 03:32:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1 |
|
2024-07-10 03:32:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2 |
|
2024-07-10 03:32:10 | INFO | stdout | INFO: 10.140.60.209:43672 - "POST /worker_generate_stream HTTP/1.1" 200 OK |
|
2024-07-10 03:32:10 | INFO | model_worker | max_input_tiles: 12 |
|
2024-07-10 03:32:10 | INFO | stdout | history: [['Describe this image in detail.', ''], ['sss']] |
|
2024-07-10 03:32:10 | INFO | stdout | Caught Unknown Error name 'model' is not defined |
|
2024-07-10 03:32:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:32:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:32:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:32:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:33:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:33:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:33:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:33:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:34:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:34:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:34:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:34:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:35:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:35:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:35:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:35:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:36:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:36:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:36:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:36:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:37:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:37:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:37:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:37:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:38:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:38:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:38:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:38:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:39:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:39:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:39:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:39:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
2024-07-10 03:40:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2 |
|
|
