Video Segmentation
104 papers with code • 1 benchmarks • 9 datasets
Benchmarks
These leaderboards are used to track progress in Video Segmentation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
Datasets
BDD100K
SegTrack-v2
PP-HumanSeg14K
PETRAW
EgoProceL
Dynamic Replica
TikTok Dataset
ConferenceVideoSegmentationDataset
Infinity Spills Basic Dataset
Subtasks
Latest papers
Tracking Anything with Decoupled Video Segmentation
hkchengrex/Tracking-Anything-with-DEVA
•
•
ICCV 2023
To 'track anything' without training on video data for every individual task, we develop a decoupled video segmentation approach (DEVA), composed of task-specific image-level segmentation and class/task-agnostic bi-directional temporal propagation.
VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentation
Existing approaches to unsupervised video instance segmentation typically rely on motion estimates and experience difficulties tracking small or divergent motions.
Robotic Scene Segmentation with Memory Network for Runtime Surgical Context Inference
uva-dsa/runtime_robscene_seg_2context
•
•
However, runtime context inference is challenging since it requires timely and accurate detection of the interactions among the tools and objects in the surgical scene based on the segmentation of video data.
MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions
henghuiding/MeViS
•
•
ICCV 2023
To investigate the feasibility of using motion expressions to ground and segment objects in videos, we propose a large-scale dataset called MeViS, which contains numerous motion expressions to indicate target objects in complex environments.
XMem++: Production-level Video Segmentation From Few Annotated Frames
Despite advancements in user-guided video segmentation, extracting complex objects consistently for highly complex scenes is still a labor-intensive task, especially for production.
Multiscale Memory Comparator Transformer for Few-Shot Video Segmentation
msiam/mmc-multiscalememory
•
•
We present a meta-learned Multiscale Memory Comparator (MMC) for few-shot video segmentation that combines information across scales within a transformer decoder.
Rectifying Noisy Labels with Sequential Prior: Multi-Scale Temporal Feature Affinity Learning for Robust Video Segmentation
Therefore, Temporal Feature Affinity Learning (TFAL) is devised to indicate possible noisy labels by evaluating the affinity between pixels in two adjacent frames.
Segment Anything Meets Point Tracking
syscv/sam-pt
•
•
The Segment Anything Model (SAM) has established itself as a powerful zero-shot image segmentation model, enabled by efficient point-centric annotation and prompt-based models.
Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentation
Our framework is a near-online approach that takes a short subclip as input and outputs the corresponding spatial-temporal tube masks.
Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentation
0liliulei/mask-vos
•
•
CVPR 2023
The objective of this paper is self-supervised learning of video object segmentation.
