Unsupervised Universal Image Segmentation

1 code implementation • 28 Dec 2023 • Dantong Niu, Xudong Wang, Xinyang Han, Long Lian, Roei Herzig, Trevor Darrell

Several unsupervised image segmentation approaches have been proposed which eliminate the need for dense manually-annotated segmentation masks; current models separately handle either semantic segmentation (e. g., STEGO) or class-agnostic instance segmentation (e. g., CutLER), but not both (i. e., panoptic segmentation).

Image Segmentation Instance Segmentation +7

Object-based (yet Class-agnostic) Video Domain Adaptation

no code implementations • 29 Nov 2023 • Dantong Niu, Amir Bar, Roei Herzig, Trevor Darrell, Anna Rohrbach

Existing video-based action recognition systems typically require dense annotation and struggle in environments when there is significant distribution shift relative to the training data.

Action Recognition Domain Adaptation +1

Audio-Visual Instance Segmentation

no code implementations • 28 Oct 2023 • Ruohao Guo, Yaru Chen, Yanyu Qi, Wenzhen Yue, Dantong Niu, Xianghua Ying

In this paper, we propose a new multi-modal task, namely audio-visual instance segmentation (AVIS), in which the goal is to identify, segment, and track individual sounding object instances in audible videos, simultaneously.

Instance Segmentation Segmentation +1

Morié Attack (MA): A New Potential Risk of Screen Photos

1 code implementation • NeurIPS 2021 • Dantong Niu, Ruohao Guo, Yisen Wang

Images, captured by a camera, play a critical role in training Deep Neural Networks (DNNs).

Moiré Attack (MA): A New Potential Risk of Screen Photos

1 code implementation • 20 Oct 2021 • Dantong Niu, Ruohao Guo, Yisen Wang

Images, captured by a camera, play a critical role in training Deep Neural Networks (DNNs).

AdvDrop: Adversarial Attack to DNNs by Dropping Information

1 code implementation • ICCV 2021 • Ranjie Duan, Yuefeng Chen, Dantong Niu, Yun Yang, A. K. Qin, Yuan He

Human can easily recognize visual objects with lost information: even losing most details with only contour reserved, e. g. cartoon.

Adversarial Attack Adversarial Robustness

SOTR: Segmenting Objects with Transformers

1 code implementation • ICCV 2021 • Ruohao Guo, Dantong Niu, Liao Qu, Zhenbo Li

Most recent transformer-based models show impressive performance on vision tasks, even better than Convolution Neural Networks (CNN).

Instance Segmentation Segmentation +1

LeafMask: Towards Greater Accuracy on Leaf Segmentation

1 code implementation • 8 Aug 2021 • Ruohao Guo, Liao Qu, Dantong Niu, Zhenbo Li, Jun Yue

In this work, we present the LeafMask neural network, a new end-to-end model to delineate each leaf region and count the number of leaves, with two main components: 1) the mask assembly module merging position-sensitive bases of each predicted box after non-maximum suppression (NMS) and corresponding coefficients to generate original masks; 2) the mask refining module elaborating leaf boundaries from the mask assembly module by the point selection strategy and predictor.

Instance Segmentation Plant Phenotyping +1