Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each object instance).
( Image credit: Detectron2 )
|TREND||DATASET||BEST METHOD||PAPER TITLE||PAPER||CODE||COMPARE|
We view this work as a notable step towards building a simple procedure to harness unlabeled video sequences and extra images to surpass state-of-the-art performance on core computer vision tasks.
Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance.
Ranked #1 on Real-Time Object Detection on COCO minival (MAP metric)
3D INSTANCE SEGMENTATION HUMAN PART SEGMENTATION KEYPOINT DETECTION MULTI-HUMAN PARSING MULTI-PERSON POSE ESTIMATION MULTI-TISSUE NUCLEUS SEGMENTATION NUCLEAR SEGMENTATION PANOPTIC SEGMENTATION REAL-TIME OBJECT DETECTION
In this work, we perform a detailed study of this minimally extended version of Mask R-CNN with FPN, which we refer to as Panoptic FPN, and show it is a robust and accurate baseline for both tasks.
Ranked #4 on Panoptic Segmentation on KITTI Panoptic Segmentation
In this paper, we explore this mechanism in the backbone design for object detection.
Ranked #1 on Instance Segmentation on COCO test-dev
While image classification models have recently continued to advance, most downstream applications such as object detection and semantic segmentation still employ ResNet variants as the backbone network due to their simple and modular structure.
Ranked #1 on Semantic Segmentation on ADE20K val
Importantly, we take one step further by dynamically learning the mask head of the object segmenter such that the mask head is conditioned on the location.
Ranked #6 on Instance Segmentation on COCO test-dev
Multi-scale inference is commonly used to improve the results of semantic segmentation.
Ranked #1 on Semantic Segmentation on Cityscapes test (using extra training data)
We hope that CenterMask and VoVNetV2 can serve as a solid baseline of real-time instance segmentation and backbone network for various vision tasks, respectively.
Ranked #2 on Real-time Instance Segmentation on MSCOCO
More importantly, we introduce a parameter-free panoptic head which solves the panoptic segmentation via pixel-wise classification.
Ranked #3 on Panoptic Segmentation on KITTI Panoptic Segmentation