metadata
license: cc-by-4.0
language:
- en
pipeline_tag: image-segmentation
library_name: zim-anything
tags:
- matting
- segmentation
- segment anything
- zero-shot matting
ZIM-Anything-ViTB
Introduction
Zero-Shot Image Matting
Installation
pip install zim_anything
or
git clone https://github.com/naver-ai/ZIM.git
cd ZIM; pip install -e .
Usage
Download the model first and put it under the results directory.
from zim_anything import zim_model_registry, ZimPredictor
backbone = "vit_b"
ckpt_p = "results/zim_vit_b_2043"
model = zim_model_registry[backbone](checkpoint=ckpt_p)
if torch.cuda.is_available():
model.cuda()
predictor = ZimPredictor(model)
predictor.set_image(<image>)
masks, _, _ = predictor.predict(<input_prompts>)
Citation
If you find this project useful, please consider citing:
@article{kim2024zim,
title={ZIM: Zero-Shot Image Matting for Anything},
author={Kim, Beomyoung and Shin, Chanyong and Jeong, Joonhyun and Jung, Hyungsik and Lee, Se-Yun and Chun, Sewhan and Hwang, Dong-Hyun and Yu, Joonsang},
journal={arXiv preprint arXiv:2411.00626},
year={2024}
}