Even the 8B model makes many consumer-grade graphics cards unable to run smoothly
Perhaps 6B or 4B, or perhaps the fp8 version of 8B will make flux easier to use
Hi @jian2023 , this is the alpha version and the plan is to soon release the 24Gb compatible model, with even less number of parameters
@dverdu-freepik Fits perfectly fine for 24gb vram on comfyui, if clip and vae are forced to cpu. Runs fine even if I don’t do that, I just like the extra room for Lora’s and upscaling.
The amount of parameters is perfect, so I’m hoping this amount, 8b will be kept and improved while smaller and larger parameter sizes are also offered. As far as I’m concerned this is the 24gb compatible model. However, we always welcome file size decrease, speed increase, with minimum to no quality loss and any future improvements.
Maybe something can be done to make the clip sizes smaller while maintaining 1:1 quality.
fp8 pweeez
We need this model but in FP8 imo.
guide to run on <= 16gb VRAM
https://huggingface.co/Freepik/flux.1-lite-8B-alpha/discussions/11#6726621bba7d809f4ee6a9cc