Interactive Image Segmentation with First Click Attention
Zheng Lin , Zhao Zhang , Lin-Zhuo Chen , Ming-Ming Cheng, Shao-Ping Lu*
Abstract
In the task of interactive image segmentation, users initially click one point to segment the main body of the target object and then provide more points on mislabeled regions iteratively for a precise segmentation. Existing methods treat all interaction points indiscriminately, ignoring the difference between the first click and the remaining ones. In this paper, we demonstrate the critical role of the first click about providing the location and main body information of the target object. A deep framework, named First Click Attention Network (FCA-Net), is proposed to make better use of the first click. In this network, the interactive segmentation result can be much improved with the following benefits: focus invariance, location guidance, and error-tolerant ability. We then put forward a click-based loss function and a structural integrity strategy for better segmentation effect. The visualized segmentation results and sufficient experiments on five datasets demonstrate the importance of the first click and the superiority of our FCA-Net.
Paper
Interactive Image Segmentation with First Click Attention, Zheng Lin, Zhao Zhang, Lin-Zhuo Chen, Ming-Ming Cheng, Shao-Ping Lu*, IEEE CVPR, 2020. [pdf|project|bib|code]
@inproceedings{fClick20CVPR,
title={Interactive Image Segmentation with First Click Attention},
author={Zheng Lin and Zhao Zhang and Lin-Zhuo Chen and Ming-Ming Cheng and Shao-Ping Lu},
booktitle={IEEE CVPR},
year={2020},
}
Video
Result
