Support for fp8?

#23

by Pomfy - opened Apr 28

Discussion

Pomfy

Apr 28

I've noticed that Hyper-SD loras do not work when FP8 mode is enabled (in any UI).

Would the new version of these loras support it in the future?

Yanzuo

ByteDance org Apr 28

Hi, @Pomfy
We conduct training on BF16 precision and have no plan in support of FP8 currently.
And we are currently working on CFG-Preserved Hyper-SD15/SDXL that facilitate negative prompts and larger guidance scales.
But we are welcoming for public contribution. Thanks for your attention to our work.

Pomfy changed discussion status to closed Apr 28

Pomfy

May 3

Thanks, the new CFG-Preserved Hyper-SD15/SDXL loras appear to work when fp8 mode is enabled.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment