inference can support multi gpu？
@loong yes should be possible by setting device_map='balanced'
· Sign up or log in to comment
