run on multi-gpus?

#2
by ziyan1119 - opened

can we run it on multi-gpu?

someone test it now on two RTX4090 48GB, need modify some code, remove model.to('cuda') code, this only move tensors block to one GPU. muti-gpu need some other coding...

Sign up or log in to comment