Reviving Iterative Training with Mask Guidance for Interactive Segmentation

12 Feb 2021  ·  Konstantin Sofiiuk, Ilia A. Petrov, Anton Konushin ·

Recent works on click-based interactive segmentation have demonstrated state-of-the-art results by using various inference-time optimization schemes. These methods are considerably more computationally expensive compared to feedforward approaches, as they require performing backward passes through a network during inference and are hard to deploy on mobile frameworks that usually support only forward passes. In this paper, we extensively evaluate various design choices for interactive segmentation and discover that new state-of-the-art results can be obtained without any additional optimization schemes. Thus, we propose a simple feedforward model for click-based interactive segmentation that employs the segmentation masks from previous steps. It allows not only to segment an entirely new object, but also to start with an external mask and correct it. When analyzing the performance of models trained on different datasets, we observe that the choice of a training dataset greatly impacts the quality of interactive segmentation. We find that the models trained on a combination of COCO and LVIS with diverse and high-quality annotations show performance superior to all existing models. The code and trained models are available at https://github.com/saic-vul/ritm_interactive_segmentation.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Interactive Segmentation Berkeley RITM (HRNet18, SBD) NoC@90 3.22 # 10
Interactive Segmentation Berkeley RITM (HRNet18, C+L) NoC@90 2.26 # 7
Interactive Segmentation DAVIS RITM (HRNet18, SBD) NoC@85 4.36 # 7
NoC@90 5.74 # 8
Interactive Segmentation DAVIS RITM (HRNet-32, C+L) NoC@85 4.11 # 5
NoC@90 5.34 # 6
Interactive Segmentation GrabCut RITM (HRNet18, C+L) NoC@85 1.42 # 5
NoC@90 1.54 # 7
Interactive Segmentation GrabCut RITM (HRNet18, SBD) NoC@85 1.76 # 7
NoC@90 2.04 # 10
Interactive Segmentation SBD RITM (HRNet18, SBD) NoC@85 3.39 # 6
NoC@90 5.43 # 6

Methods


No methods listed for this paper. Add relevant methods here