Requirements for commercial Use
#31
by
ananyaaa
- opened
Hi, I want to use MPT 7b commercially for one the products I work on. I want to know the system requirements (RAM GPU etc) that will be fast, as it will be used by end users.
I found a T4 to be too slow, but an A10 was good. You need enough RAM to load the model into RAM before moving to the GPU
sam-mosaic
changed discussion status to
closed