What is the best way to use this model with comfyUI?

#1
by NullCode1337 - opened

I am quite struggling to think of a basic workflow to colorize an image, could there be a example workflow out there that i am not aware of? Simply KSampler with latent image seems to not work

Here's what I have attempted so far
image

I'm not very familiar with ComfyUI, but I believe the workflow should be similar to that of an inpainting model.
The key difference is that standard inpainting fills the masked area with a solid color (like gray), whereas this model requires the original content within the masked area to be preserved.

I'm not sure if there's an existing node that can achieve this functionality.
I might need to develop a custom node for it.

After a bit of research, I confirmed that the built-in nodes can't achieve this.
However, it only required a very small modification to implement.
Therefore, I created a custom node to handle it.

  1. Install the custom node: https://github.com/ShinoharaHare/ComfyUI-InpaintModelConditioningAdvanced
  2. Add InpaintModelConditioningAdvanced node, and change the following options:
    • Set concat_latent_image to original.
    • Set noise_mask to false.

image

thank you so much for your effort! I could never have gotten it to work with my current knowledge XD

image

I was successful in replicating your example, and will try some other images soon. Cheers!

NullCode1337 changed discussion status to closed

Sign up or log in to comment