docs/PROMPT_GUIDE.md

Image Prompter

There’s an image prompter UI that you can use in the app.

Prompt with points or boxes.

To prompt the segmentation area as desired, left-click on the part you want to use as the point. You'll see a blue dot in the image prompter.
Let's use the point (Blue dot) to segment the child.

Or alternatively, You can draw box around the child.

Prompt with point & box combination

What if we want to prompt only on the face of the child instead of the entire child?
Then you can draw a box around the child's face and emphasize that area with the point within the box.

Remember that you can't use the multiple box and point combinations prompt in SAM-2. You can only use one combination at a time.

Prompt with negative points

You can also use negative points (red dots) to segment a more specific part.
Use the wheel click to prompt negative points.
To segment only the face, place positive points (blue dots) on the face and a negative point on the body.

Known bugs in the Web UI

In the "Pixelize Filter" tab, you should reset the prompt by pressing the eraser button on the image prompter whenever you change the frame index, as the previous prompt remains even after you've changed the frame index.

This may occurs because the gradio-image-prompter does not support the change() API yet—it's on the Todo list now.