ControlNet Canny Edge
Let's take the pestered cake and try to inpaint it again. Now I would like to use a sleeping cat for it:
I use Canny Edge node from comfyui_controlnet_aux. Don't forget to resize canny edge mask to 512 pixels:
Let's look at the result:
The first problem I see here is some kind of object behind the cat. Such objects appear since the inpainting mask strictly aligns with the removed object, the cake in our case. To remove such artifact we should expand our mask a little:
Now. what's up with cat back and tail? Let's see the inpainting mask and canny edge mask side to side:
The inpainting works (mostly) only in masked (white) area, so we cut off cat's back. The ControlNet mask should be inside the inpaint mask.
To address the issue I resized the mask to 256 pixels:
This is better but still have a room for improvement. The problem with edge mask downsampling is that edge lines tend to be broken and after some size we will got a mess:
Look at the edge mask, at this resolution it is so broken:
