runtime error

[00:04<00:14, 308MB/s] model.safetensors: 31%|███▏ | 1.75G/5.59G [00:05<00:09, 389MB/s] model.safetensors: 40%|████ | 2.25G/5.59G [00:06<00:07, 425MB/s] model.safetensors: 48%|████▊ | 2.68G/5.59G [00:07<00:07, 392MB/s] model.safetensors: 55%|█████▌ | 3.09G/5.59G [00:12<00:13, 190MB/s] model.safetensors: 61%|██████ | 3.40G/5.59G [00:13<00:11, 189MB/s] model.safetensors: 66%|██████▌ | 3.67G/5.59G [00:14<00:09, 203MB/s] model.safetensors: 71%|███████ | 3.94G/5.59G [00:18<00:11, 146MB/s] model.safetensors: 74%|███████▍ | 4.15G/5.59G [00:20<00:11, 128MB/s] model.safetensors: 77%|███████▋ | 4.33G/5.59G [00:21<00:09, 134MB/s] model.safetensors: 82%|████████▏ | 4.58G/5.59G [00:22<00:06, 156MB/s] model.safetensors: 89%|████████▉ | 4.97G/5.59G [00:23<00:03, 199MB/s] model.safetensors: 93%|█████████▎| 5.21G/5.59G [00:26<00:02, 141MB/s] model.safetensors: 97%|█████████▋| 5.41G/5.59G [00:28<00:01, 144MB/s] model.safetensors: 100%|█████████▉| 5.59G/5.59G [00:31<00:00, 178MB/s] generation_config.json: 0%| | 0.00/111 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 111/111 [00:00<00:00, 743kB/s] WARNING:root:Some parameters are on the meta device device because they were offloaded to the cpu and disk. WARNING:accelerate.big_modeling:You shouldn't move a model when it is dispatched on multiple devices. Traceback (most recent call last): File "/home/user/app/app.py", line 17, in <module> model.to(device) File "/home/user/.local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 447, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.

Container logs: