How do I manually get the same functionality as device_map="auto", given that device_map="auto" is not supported?
#33
by
narai
- opened
How do I manually get the same functionality as device_map="auto", given that device_map="auto" is not supported?
Hey @narai ,
The model currently does not support returning a few outputs as well as functionality such as device_map="auto". I have another issue open, but haven't received any response: https://huggingface.co/mosaicml/mpt-7b/discussions/30
@narai @abhinavkulkarni please see the discussion in the relevant PR https://huggingface.co/mosaicml/mpt-7b/discussions/23
sam-mosaic
changed discussion status to
closed