Hardware recommendations?
What's the minimum and recommended VRAM?
I see the space is running on an A100 40GB.
Any guidance on tradeoffs of popular cards?
Excited!
People have successfully run the model with 6GB of VRAM and 16GB of RAM with some tricks (quantized clip encoder, etc) and generating 512x512 resolution with 50 frames. This is the lowest VRAM requirement we've seen so far!
On an RTX 4090 users have generated 121 frames in 11 seconds, and on top-tier hardware (H100/fal.ai) it can generate a 512×768 video with 121 frames in just 4 seconds.
So the tradeoffs boil down to speed: lower VRAM setups may require reduced resolution, frame count, or slower generation times, while higher-end hardware can unlock lightning-fast performance and higher resolutions.
Thank you! Can you please tell how to quantize it? My friend has 8 GB VRAM and we wanted to run, but we got CUDA memory error.
Thank you! Can you please tell how to quantize it? My friend has 8 GB VRAM and we wanted to run, but we got CUDA memory error.
If a model is above 8 gb never expect it to run .. just use cogvideoX with cpu offload