Inpaint has visual seams

#1
by SanthanamX02 - opened

I tried the original controlnet, it doesn't perform well on inpainting, so I was hoping your model could work since you combined with the model itself.

I am new to this kinda inpaint stuff, is it easy fix? Or the inpaint would not work properly?

i didn't not used your model yet, but there is a seam in your inpaint + pose(I use this work case) example

I tried the original controlnet, it doesn't perform well on inpainting, so I was hoping your model could work since you combined with the model itself.

I am new to this kinda inpaint stuff, is it easy fix? Or the inpaint would not work properly?

i didn't not used your model yet, but there is a seam in your inpaint + pose(I use this work case) example

You're right, the inpaint isn't working well; I had a lot of trouble generating a nearly good image. You need to try with different seeds until you find a reasonably good one. I believe it's a problem with the combination of the ControlNet weights and the Turbo version of the model. They released the 8-step version, and I'm testing it to see how it performs, but so far the image quality hasn't pleased me. One thing I noticed is that the inpaint looks better on 1024p images; when I try to increase the resolution, those mask marks become visible.

I will try implement differential diffusiion in this pipeline to better inpaint!

Sign up or log in to comment