need fp8 for speed

#1
by Ai11Ali - opened

title

I don't really have any (tested) code for FP8 conversion, I think it might be better to ask the Comfy-Org people since they made the new scaled ones for SD3.5 as well

Technically you could also just do this w/ the original unet file if you wanted to do it locally (just make sure to select the right weight type).

image.png

Thanks for info, btw. does it apply LORA correctly when in GGUF, or not?

Cause I tried original and nope, it applies like half LORA weights.

I think you'd have to remap the LoRA block IDs for either version to work correctly, but I didn't see any list for which blocks were cut to make this one 8B.

Sign up or log in to comment