Browse SoTA > Computer Vision > Video > Video Object Segmentation

Video Object Segmentation

66 papers with code · Computer Vision
Subtask of Video

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Benchmarks

Latest papers with code

Discriminative Segmentation Tracking Using Dual Memory Banks

21 Sep 2020phiphiphi31/DMB

Existing template-based trackers usually localize the target in each frame with bounding box, thereby being limited in learning pixel-wise representation and handling complex and non-rigid transformation of the target.

SEMANTIC SEGMENTATION VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION

0
21 Sep 2020

PMVOS: Pixel-Level Matching-Based Video Object Segmentation

18 Sep 2020suhwan-cho/PMVOS

Semi-supervised video object segmentation (VOS) aims to segment arbitrary target objects in video when the ground truth segmentation mask of the initial frame is provided.

SEMANTIC SEGMENTATION VIDEO SEMANTIC SEGMENTATION YOUTUBE-VOS

7
18 Sep 2020

LSMVOS: Long-Short-Term Similarity Matching for Video Object

2 Sep 2020wudao001/LSMVOS

This paper explores a new propagation method, uses short-term matching modules to extract the information of the previous frame and apply it in propagation, and proposes the network of Long-Short-Term similarity matching for video object segmentation (LSMOVS) Method: By conducting pixel-level matching and correlation between long-term matching module and short-term matching module with the first frame and previous frame, global similarity map and local similarity map are obtained, as well as feature pattern of current frame and masking of previous frame.

OPTICAL FLOW ESTIMATION SEMANTIC SEGMENTATION SEMI-SUPERVISED VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION

1
02 Sep 2020

Making a Case for 3D Convolutions for Object Segmentation in Videos

26 Aug 2020sabarim/3DC-Seg

On the other hand, 3D convolutional networks have been successfully applied for video classification tasks, but have not been leveraged as effectively to problems involving dense per-pixel interpretation of videos compared to their 2D convolutional counterparts and lag behind the aforementioned networks in terms of performance.

 Ranked #1 on Unsupervised Video Object Segmentation on DAVIS-2016 (using extra training data)

SEMANTIC SEGMENTATION UNSUPERVISED VIDEO OBJECT SEGMENTATION VIDEO CLASSIFICATION VIDEO PREDICTION VIDEO SEMANTIC SEGMENTATION

4
26 Aug 2020

MATNet: Motion-Attentive Transition Network for Zero-Shot Video Object Segmentation

IEEE Transactions on Image Processing 2020 tfzhou/MATNet

To further demonstrate the generalization ability of our spatiotemporal learning framework, we extend MATNet to another relevant task: dynamic visual attention prediction (DVAP).

SEMANTIC SEGMENTATION UNSUPERVISED VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION

84
20 Aug 2020

Interactive Video Object Segmentation Using Global and Local Transfer Modules

ECCV 2020 yuk6heo/IVOS-ATNet

The global transfer module conveys the segmentation information in an annotated frame to a target frame, while the local transfer module propagates the segmentation information in a temporally adjacent frame to the target frame.

 Ranked #1 on Interactive Video Object Segmentation on DAVIS 2017 (using extra training data)

INTERACTIVE VIDEO OBJECT SEGMENTATION SEMANTIC SEGMENTATION VIDEO SEMANTIC SEGMENTATION

13
16 Jul 2020

Video Object Segmentation with Episodic Graph Memory Networks

ECCV 2020 carrierlxk/GraphMemVOS

How to make a segmentation model efficiently adapt to a specific video and to online target appearance variations are fundamentally crucial issues in the field of video object segmentation.

SEMANTIC SEGMENTATION VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION

48
14 Jul 2020

Learning Object Depth from Camera Motion and Video Object Segmentation

ECCV 2020 griffbr/ODMS

Video object segmentation, i. e., the separation of a target object from background in video, has made significant progress on real and challenging videos in recent years.

SEMANTIC SEGMENTATION VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION

34
11 Jul 2020

ALBA : Reinforcement Learning for Video Object Segmentation

26 May 2020kini5gowda/ALBA-RL-for-VOS

We treat this as a grouping problem by exploiting object proposals and making a joint inference about grouping over both space and time.

SEMANTIC SEGMENTATION UNSUPERVISED VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION YOUTUBE-VOS

1
26 May 2020

Physarum Powered Differentiable Linear Programming Layers and Applications

30 Apr 2020zihangm/Differentiable-LP-Layer

We describe our development and demonstrate the use of our solver in a video object segmentation task and meta-learning for few-shot learning.

FEW-SHOT LEARNING SEMANTIC SEGMENTATION VIDEO OBJECT SEGMENTATION VIDEO SEMANTIC SEGMENTATION

1
30 Apr 2020