|
2024-07-10 17:32:54 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40001, worker_address='http://10.140.60.25:40001', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-1B/', model_name=None, device='cuda', limit_model_concurrency=5, stream_interval=1, load_8bit=False) |
|
2024-07-10 17:32:54 | INFO | model_worker | Loading the model InternVL2-1B on worker 578439 ... |
|
2024-07-10 17:32:54 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. |
|
2024-07-10 17:32:54 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. |
|
2024-07-10 17:32:58 | INFO | model_worker | Register to controller |
|
2024-07-10 17:32:58 | ERROR | stderr | INFO: Started server process [129001] |
|
2024-07-10 17:32:58 | ERROR | stderr | INFO: Waiting for application startup. |
|
2024-07-10 17:32:58 | ERROR | stderr | INFO: Application startup complete. |
|
2024-07-10 17:32:58 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40001 (Press CTRL+C to quit) |
|
2024-07-10 17:33:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:33:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:33:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:33:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:34:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:34:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:34:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:34:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:35:10 | INFO | stdout | INFO: 10.140.60.209:51128 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:35:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:35:15 | INFO | stdout | INFO: 10.140.60.209:51229 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:35:19 | INFO | stdout | INFO: 10.140.60.209:51294 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:35:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:35:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:35:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:36:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:36:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:36:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:36:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:37:13 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:37:28 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:37:43 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:37:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:38:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:38:15 | INFO | stdout | INFO: 10.140.60.209:51886 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:38:17 | INFO | stdout | INFO: 10.140.60.209:51956 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:38:26 | INFO | stdout | INFO: 10.140.60.209:52000 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:38:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:38:29 | INFO | stdout | INFO: 10.140.60.209:52016 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:38:30 | INFO | stdout | INFO: 10.140.60.209:52030 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:38:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:38:50 | INFO | stdout | INFO: 10.140.60.209:52054 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:38:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:39:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:39:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:39:42 | INFO | stdout | INFO: 10.140.60.209:52258 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:39:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:39:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:40:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:40:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:40:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:40:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:41:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:41:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:41:31 | INFO | stdout | INFO: 10.140.60.209:52672 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:41:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:41:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:42:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:42:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:42:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:42:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:43:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:43:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:43:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:43:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:44:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:44:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:44:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:44:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:45:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:45:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:45:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:45:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:46:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:46:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:46:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:46:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:47:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:47:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:47:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:47:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:48:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:48:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:48:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:48:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:49:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:49:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:49:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:49:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:50:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:50:29 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:50:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:50:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:51:14 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:51:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:51:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:52:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:52:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:52:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:52:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:53:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:53:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:53:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:53:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:54:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:54:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:54:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:54:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:55:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:55:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:55:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:55:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:56:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:56:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:56:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:56:33 | INFO | stdout | INFO: 10.140.60.209:56368 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:56:36 | INFO | stdout | INFO: 10.140.60.209:56390 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:56:37 | INFO | stdout | INFO: 10.140.60.209:56408 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 17:56:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:57:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:57:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:57:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:57:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:58:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:58:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:58:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:58:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:59:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:59:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:59:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 17:59:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:00:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:00:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:00:15 | INFO | stdout | INFO: 10.140.60.209:57202 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:00:18 | INFO | stdout | INFO: 10.140.60.209:57282 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:00:19 | INFO | stdout | INFO: 10.140.60.209:57300 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:00:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:00:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:01:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:01:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:01:30 | INFO | stdout | INFO: 10.140.60.209:57518 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:01:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:01:33 | INFO | stdout | INFO: 10.140.60.209:57532 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:01:36 | INFO | stdout | INFO: 10.140.60.209:57548 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:01:38 | INFO | stdout | INFO: 10.140.60.209:57564 - "POST /worker_get_status HTTP/1.1" 200 OK |
|
2024-07-10 18:01:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:02:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:02:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:02:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:02:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:03:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:03:15 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:03:30 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:03:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
2024-07-10 18:04:00 | INFO | model_worker | Send heart beat. Models: ['InternVL2-1B']. Semaphore: None. global_counter: 0 |
|
|
