Diffusers run gguf?
#2
by
gabbo1995 - opened
Is there a way to run it with diffusers in python? Could you please provide an adapted example of how to load the DiT in gguf in diffusers? Thank you so much for your contribution!
We're working on a guide, for now you'll need to use something like ComfyUI
Thank you!!
Diffusers need to compile gguf in every running , very bad. Can you make it work like ComfyUI-GGUF without compiling. If diffusers can have gguf with cpp speed, it will be great. For now ,diffusers can not match comfyui with gguf and adaptive vram . Comfyui can run LTX2 with just 1G vram and less than 32G ram.