How much VRAM is required to run this model?
#2
by
pablohoffman
- opened
I'm trying to run this model (inference only) but my process runs out of memory, I have 12GB VRAM. How much would be needed?
I'm trying to run this model (inference only) but my process runs out of memory, I have 12GB VRAM. How much would be needed?