black-forest-labs/FLUX.1-dev · CUDA out of memory

Sep 11

No matter which model I use (schnell/dev) I can't get it to run, and all the VRAM gets devoured. I have an RTX 4090 GPU. Am I doing something wrong?

torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 126.00 MiB. GPU 0 has a total capacity of 23.52 GiB of which 103.44 MiB is free. Process 2588 has 83.96 MiB memory in use. Including non-PyTorch memory, this process has 22.61 GiB memory in use. Of the allocated memory 22.22 GiB is allocated by PyTorch, and 15.45 MiB is reserved by PyTorch but unallocated.