can we run it on multi-gpu?
someone test it now on two RTX4090 48GB, need modify some code, remove model.to('cuda') code, this only move tensors block to one GPU. muti-gpu need some other coding...
· Sign up or log in to comment