Browse SoTA > Computer Vision > Semantic Segmentation > Panoptic Segmentation

Panoptic Segmentation

29 papers with code · Computer Vision

Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each object instance).

( Image credit: Detectron2 )

Benchmarks

Greatest papers with code

Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation

ECCV 2020 tensorflow/models

We view this work as a notable step towards building a simple procedure to harness unlabeled video sequences and extra images to surpass state-of-the-art performance on core computer vision tasks.

OPTICAL FLOW ESTIMATION PANOPTIC SEGMENTATION PATCH MATCHING SCENE SEGMENTATION

Panoptic Feature Pyramid Networks

CVPR 2019 facebookresearch/detectron2

In this work, we perform a detailed study of this minimally extended version of Mask R-CNN with FPN, which we refer to as Panoptic FPN, and show it is a robust and accurate baseline for both tasks.

INSTANCE SEGMENTATION PANOPTIC SEGMENTATION

End-to-End Object Detection with Transformers

ECCV 2020 facebookresearch/detr

We present a new method that views object detection as a direct set prediction problem.

OBJECT DETECTION PANOPTIC SEGMENTATION

ResNeSt: Split-Attention Networks

19 Apr 2020dmlc/gluon-cv

While image classification models have recently continued to advance, most downstream applications such as object detection and semantic segmentation still employ ResNet variants as the backbone network due to their simple and modular structure.

IMAGE CLASSIFICATION INSTANCE SEGMENTATION OBJECT DETECTION PANOPTIC SEGMENTATION

SOLOv2: Dynamic, Faster and Stronger

23 Mar 2020aim-uofa/adet

Importantly, we take one step further by dynamically learning the mask head of the object segmenter such that the mask head is conditioned on the location.

INSTANCE SEGMENTATION OBJECT DETECTION PANOPTIC SEGMENTATION

Hierarchical Multi-Scale Attention for Semantic Segmentation

21 May 2020NVIDIA/semantic-segmentation

Multi-scale inference is commonly used to improve the results of semantic segmentation.

 Ranked #1 on Semantic Segmentation on Cityscapes test (using extra training data)

PANOPTIC SEGMENTATION

CenterMask : Real-Time Anchor-Free Instance Segmentation

arXiv 2019 youngwanLEE/CenterMask

We hope that CenterMask and VoVNetV2 can serve as a solid baseline of real-time instance segmentation and backbone network for various vision tasks, respectively.

PANOPTIC SEGMENTATION REAL-TIME INSTANCE SEGMENTATION REAL-TIME OBJECT DETECTION

UPSNet: A Unified Panoptic Segmentation Network

CVPR 2019 uber-research/UPSNet

More importantly, we introduce a parameter-free panoptic head which solves the panoptic segmentation via pixel-wise classification.

INSTANCE SEGMENTATION PANOPTIC SEGMENTATION