Video Segmentation
104 papers with code • 1 benchmarks • 9 datasets
Benchmarks
These leaderboards are used to track progress in Video Segmentation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
Datasets
BDD100K
SegTrack-v2
PP-HumanSeg14K
PETRAW
EgoProceL
Dynamic Replica
TikTok Dataset
ConferenceVideoSegmentationDataset
Infinity Spills Basic Dataset
Subtasks
Latest papers
Global Knowledge Calibration for Fast Open-Vocabulary Segmentation
xujxyang/opentrans
•
•
ICCV 2023
Recent advancements in pre-trained vision-language models, such as CLIP, have enabled the segmentation of arbitrary concepts solely from textual inputs, a process commonly referred to as open-vocabulary semantic segmentation (OVS).
InstMove: Instance Motion for Object-centric Video Segmentation
A common solution is to use optical flow to provide motion information, but essentially it only considers pixel-level motion, which still relies on appearance similarity and hence is often inaccurate under occlusion and fast movement.
Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance Segmentation
simonzeng7108/video-transunet
•
•
This paper presents a deep learning framework for medical video segmentation.
PolyFormer: Referring Image Segmentation as Sequential Polygon Generation
amazon-science/polygon-transformer
•
•
CVPR 2023
In this work, instead of directly predicting the pixel-level segmentation masks, the problem of referring image segmentation is formulated as sequential polygon generation, and the predicted polygons can be later converted into segmentation masks.
TarViS: A Unified Approach for Target-based Video Segmentation
A single TarViS model can be trained jointly on a collection of datasets spanning different tasks, and can hot-swap between tasks during inference without any task-specific retraining.
Context-Aware Relative Object Queries To Unify Video Instance and Panoptic Segmentation
AnwesaChoudhuri/CAROQ
•
•
CVPR 2023
We evaluate the proposed approach across three challenging tasks: video instance segmentation, multi-object tracking and segmentation, and video panoptic segmentation.
Robust Online Video Instance Segmentation with Track Queries
We propose a fully online transformer-based video instance segmentation model that performs comparably to top offline methods on the YouTube-VIS 2019 benchmark and considerably outperforms them on UVO and OVIS.
EISeg: An Efficient Interactive Segmentation Tool based on PaddlePaddle
In recent years, the rapid development of deep learning has brought great advancements to image and video segmentation methods based on neural networks.
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relations
VISOR annotates videos from EPIC-KITCHENS, which comes with a new set of challenges not encountered in current video segmentation datasets.
Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward
yunlong10/ads-1k
•
•
The existing method performs well at video segmentation stages but suffers from the problems of dependencies on extra cumbersome models and poor performance at the segment assemblage stage.
