InternVL / logs /model_worker_6a86a0.log
czczup's picture
Upload folder using huggingface_hub
3f1b7f0 verified
raw
history blame
9.73 kB
2024-07-11 22:35:44 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40008, worker_address='http://10.140.60.182:40008', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-Pro/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2024-07-11 22:35:44 | INFO | model_worker | Loading the model InternVL2-Pro on worker 6a86a0 ...
2024-07-11 22:35:44 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-11 22:35:44 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-11 22:35:48 | ERROR | stderr | Loading checkpoint shards: 0%| | 0/33 [00:00<?, ?it/s]
2024-07-11 22:35:50 | ERROR | stderr | Loading checkpoint shards: 3%|▎ | 1/33 [00:02<01:12, 2.25s/it]
2024-07-11 22:35:53 | ERROR | stderr | Loading checkpoint shards: 6%|▌ | 2/33 [00:04<01:09, 2.24s/it]
2024-07-11 22:35:55 | ERROR | stderr | Loading checkpoint shards: 9%|▉ | 3/33 [00:06<01:06, 2.22s/it]
2024-07-11 22:35:57 | ERROR | stderr | Loading checkpoint shards: 12%|█▏ | 4/33 [00:08<01:03, 2.18s/it]
2024-07-11 22:35:59 | ERROR | stderr | Loading checkpoint shards: 15%|█▌ | 5/33 [00:10<01:00, 2.17s/it]
2024-07-11 22:36:01 | ERROR | stderr | Loading checkpoint shards: 18%|█▊ | 6/33 [00:13<00:59, 2.19s/it]
2024-07-11 22:36:03 | ERROR | stderr | Loading checkpoint shards: 21%|██ | 7/33 [00:15<00:56, 2.17s/it]
2024-07-11 22:36:06 | ERROR | stderr | Loading checkpoint shards: 24%|██▍ | 8/33 [00:17<00:52, 2.12s/it]
2024-07-11 22:36:08 | ERROR | stderr | Loading checkpoint shards: 27%|██▋ | 9/33 [00:19<00:50, 2.11s/it]
2024-07-11 22:36:10 | ERROR | stderr | Loading checkpoint shards: 30%|███ | 10/33 [00:21<00:48, 2.11s/it]
2024-07-11 22:36:12 | ERROR | stderr | Loading checkpoint shards: 33%|███▎ | 11/33 [00:23<00:46, 2.10s/it]
2024-07-11 22:36:14 | ERROR | stderr | Loading checkpoint shards: 36%|███▋ | 12/33 [00:25<00:43, 2.09s/it]
2024-07-11 22:36:16 | ERROR | stderr | Loading checkpoint shards: 39%|███▉ | 13/33 [00:27<00:41, 2.06s/it]
2024-07-11 22:36:18 | ERROR | stderr | Loading checkpoint shards: 42%|████▏ | 14/33 [00:29<00:39, 2.08s/it]
2024-07-11 22:36:20 | ERROR | stderr | Loading checkpoint shards: 45%|████▌ | 15/33 [00:31<00:37, 2.06s/it]
2024-07-11 22:36:22 | ERROR | stderr | Loading checkpoint shards: 48%|████▊ | 16/33 [00:33<00:34, 2.03s/it]
2024-07-11 22:36:24 | ERROR | stderr | Loading checkpoint shards: 52%|█████▏ | 17/33 [00:35<00:32, 2.04s/it]
2024-07-11 22:36:26 | ERROR | stderr | Loading checkpoint shards: 55%|█████▍ | 18/33 [00:37<00:30, 2.05s/it]
2024-07-11 22:36:28 | ERROR | stderr | Loading checkpoint shards: 58%|█████▊ | 19/33 [00:39<00:28, 2.04s/it]
2024-07-11 22:36:30 | ERROR | stderr | Loading checkpoint shards: 61%|██████ | 20/33 [00:41<00:26, 2.01s/it]
2024-07-11 22:36:32 | ERROR | stderr | Loading checkpoint shards: 64%|██████▎ | 21/33 [00:43<00:23, 1.98s/it]
2024-07-11 22:36:34 | ERROR | stderr | Loading checkpoint shards: 67%|██████▋ | 22/33 [00:45<00:21, 1.99s/it]
2024-07-11 22:36:36 | ERROR | stderr | Loading checkpoint shards: 70%|██████▉ | 23/33 [00:47<00:19, 1.98s/it]
2024-07-11 22:36:38 | ERROR | stderr | Loading checkpoint shards: 73%|███████▎ | 24/33 [00:49<00:17, 1.94s/it]
2024-07-11 22:36:40 | ERROR | stderr | Loading checkpoint shards: 76%|███████▌ | 25/33 [00:51<00:15, 1.92s/it]
2024-07-11 22:36:42 | ERROR | stderr | Loading checkpoint shards: 79%|███████▉ | 26/33 [00:54<00:15, 2.17s/it]
2024-07-11 22:36:44 | ERROR | stderr | Loading checkpoint shards: 82%|████████▏ | 27/33 [00:56<00:12, 2.09s/it]
2024-07-11 22:36:46 | ERROR | stderr | Loading checkpoint shards: 85%|████████▍ | 28/33 [00:58<00:10, 2.04s/it]
2024-07-11 22:36:48 | ERROR | stderr | Loading checkpoint shards: 88%|████████▊ | 29/33 [01:00<00:08, 2.03s/it]
2024-07-11 22:36:50 | ERROR | stderr | Loading checkpoint shards: 91%|█████████ | 30/33 [01:02<00:06, 2.02s/it]
2024-07-11 22:36:52 | ERROR | stderr | Loading checkpoint shards: 94%|█████████▍| 31/33 [01:04<00:04, 2.01s/it]
2024-07-11 22:36:54 | ERROR | stderr | Loading checkpoint shards: 97%|█████████▋| 32/33 [01:05<00:01, 1.91s/it]
2024-07-11 22:36:55 | ERROR | stderr | Loading checkpoint shards: 100%|██████████| 33/33 [01:06<00:00, 1.70s/it]
2024-07-11 22:36:55 | ERROR | stderr | Loading checkpoint shards: 100%|██████████| 33/33 [01:06<00:00, 2.03s/it]
2024-07-11 22:36:55 | ERROR | stderr |
2024-07-11 22:36:56 | INFO | model_worker | Register to controller
2024-07-11 22:36:56 | ERROR | stderr | INFO: Started server process [20613]
2024-07-11 22:36:56 | ERROR | stderr | INFO: Waiting for application startup.
2024-07-11 22:36:56 | ERROR | stderr | INFO: Application startup complete.
2024-07-11 22:36:56 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:40008 (Press CTRL+C to quit)
2024-07-11 22:36:57 | INFO | stdout | INFO: 10.140.60.209:47186 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:00 | INFO | stdout | INFO: 10.140.60.209:47210 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:01 | INFO | stdout | INFO: 10.140.60.209:47230 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:37:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:37:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:37:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:37:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:38:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:38:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:38:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:38:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:39:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:39:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:39:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:39:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:40:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:40:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:40:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:40:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:40:59 | INFO | stdout | INFO: 10.140.60.209:49092 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:49112 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:01 | INFO | stdout | INFO: 10.140.60.209:49132 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:41:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:41:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:41:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:41:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:42:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:42:26 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:42:41 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:42:56 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0
2024-07-11 22:43:07 | INFO | stdout | INFO: 10.140.60.209:49790 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:49810 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:08 | INFO | stdout | INFO: 10.140.60.209:49830 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-11 22:43:11 | INFO | model_worker | Send heart beat. Models: ['InternVL2-Pro']. Semaphore: None. global_counter: 0