TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	VAT (HM, ResNet-50)	Mean IoU	43.2	# 35
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	VAT (HM, ResNet-50)	FB-IoU	70	# 11
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-50)	Mean IoU	44.3	# 28
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-50)	FB-IoU	70.8	# 9
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-101)	Mean IoU	46.5	# 17
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-101)	FB-IoU	71.5	# 6
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-50)	Mean IoU	44.7	# 27
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-50)	FB-IoU	70.4	# 10
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-101)	Mean IoU	45.9	# 21
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-101)	FB-IoU	71.1	# 7
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-50)	Mean IoU	49.4	# 34
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-50)	FB-IoU	72.2	# 17
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-50)	Mean IoU	48.4	# 37
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-50)	FB-IoU	72.2	# 17
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-101)	Mean IoU	50.6	# 26
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-101)	FB-IoU	72.9	# 13
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	VAT (HM, ResNet-50)	Mean IoU	48.3	# 38
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	VAT (HM, ResNet-50)	FB-IoU	71.8	# 19
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-101)	Mean IoU	50.6	# 26
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-101)	FB-IoU	73.3	# 9
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (1-shot)	HSNet (HM, ResNet-101)	Mean IoU	66.5	# 6
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (1-shot)	VAT (HM, ResNet-50)	Mean IoU	65.1	# 8
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (1-shot)	HSNet (HM, ResNet-50)	Mean IoU	65.2	# 7
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (5-shot)	HSNet (HM, ResNet-50)	Mean IoU	69.7	# 6
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (5-shot)	VAT (HM, ResNet-50)	Mean IoU	69.7	# 6
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (5-shot)	HSNet (HM, ResNet-101)	Mean IoU	70.9	# 5
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	VAT (HM, ResNet-101)	Mean IoU	90.2	# 5
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	VAT (HM, ResNet-50)	Mean IoU	89.4	# 9
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	HSNet (HM, ResNet-101)	Mean IoU	87.8	# 13
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	HSNet (HM, ResNet-50)	Mean IoU	87.1	# 15
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	HSNet (HM, ResNet-50)	Mean IoU	88	# 15
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	HSNet (HM, ResNet-101)	Mean IoU	88.5	# 13
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	VAT (HM, ResNet-50)	Mean IoU	89.9	# 8
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	VAT (HM, ResNet-101)	Mean IoU	90.5	# 6
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-50)	Mean IoU	65	# 46
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-50)	FB-IoU	76.5	# 33
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-101)	Mean IoU	67.8	# 20
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-101)	FB-IoU	79.4	# 10
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-101)	Mean IoU	66.7	# 32
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-101)	FB-IoU	77.8	# 23
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-50)	Mean IoU	65.8	# 38
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-50)	FB-IoU	77.1	# 30
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-50)	Mean IoU	68.2	# 51
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-50)	FB-IoU	78.5	# 30
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-101)	Mean IoU	70.9	# 28
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-101)	FB-IoU	81.5	# 16
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-101)	Mean IoU	69.3	# 41
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-101)	FB-IoU	79.7	# 28
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-50)	Mean IoU	67.1	# 56
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-50)	FB-IoU	77.7	# 34

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-coco-20i-2)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-coco-20i-2?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-fss-1000-1)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-fss-1000-1?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-coco-20i)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-coco-20i?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-fss-1000-5)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-fss-1000-5?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-coco-20i-1)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-coco-20i-1?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-pascal-5i-1)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-pascal-5i-1?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-coco-20i-5)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-coco-20i-5?p=hmfs-hybrid-masking-for-few-shot-segmentation)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/hmfs-hybrid-masking-for-few-shot-segmentation/few-shot-semantic-segmentation-on-pascal-5i-5)](https://paperswithcode.com/sota/few-shot-semantic-segmentation-on-pascal-5i-5?p=hmfs-hybrid-masking-for-few-shot-segmentation)`

HM: Hybrid Masking for Few-Shot Segmentation

24 Mar 2022 · Seonghyeon Moon, Samuel S. Sohn, Honglu Zhou, Sejong Yoon, Vladimir Pavlovic, Muhammad Haris Khan, Mubbasir Kapadia ·

We study few-shot semantic segmentation that aims to segment a target object from a query image when provided with a few annotated support images of the target class. Several recent methods resort to a feature masking (FM) technique to discard irrelevant feature activations which eventually facilitates the reliable prediction of segmentation mask. A fundamental limitation of FM is the inability to preserve the fine-grained spatial details that affect the accuracy of segmentation mask, especially for small target objects. In this paper, we develop a simple, effective, and efficient approach to enhance feature masking (FM). We dub the enhanced FM as hybrid masking (HM). Specifically, we compensate for the loss of fine-grained spatial details in FM technique by investigating and leveraging a complementary basic input masking method. Experiments have been conducted on three publicly available benchmarks with strong few-shot segmentation (FSS) baselines. We empirically show improved performance against the current state-of-the-art methods by visible margins across different benchmarks. Our code and trained models are available at: https://github.com/moonsh/HM-Hybrid-Masking

PDF Abstract

Code

Add Remove Mark official

moonsh/hm-hybrid-masking official

Tasks

Add Remove

Few-Shot Semantic Segmentation

Segmentation

Semantic Segmentation

Datasets

MS COCO

PASCAL-5i

FSS-1000

Results from the Paper

Edit

Ranked #5 on Few-Shot Semantic Segmentation on FSS-1000 (1-shot)

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	VAT (HM, ResNet-50)	Mean IoU	43.2	# 35	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	VAT (HM, ResNet-50)	FB-IoU	70	# 11	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-50)	Mean IoU	44.3	# 28	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-50)	FB-IoU	70.8	# 9	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-101)	Mean IoU	46.5	# 17	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	HSNet (HM, ResNet-101)	FB-IoU	71.5	# 6	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-50)	Mean IoU	44.7	# 27	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-50)	FB-IoU	70.4	# 10	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-101)	Mean IoU	45.9	# 21	Compare
Few-Shot Semantic Segmentation	COCO-20i (1-shot)	ASNet (HM, ResNet-101)	FB-IoU	71.1	# 7	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-50)	Mean IoU	49.4	# 34	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-50)	FB-IoU	72.2	# 17	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-50)	Mean IoU	48.4	# 37	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-50)	FB-IoU	72.2	# 17	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-101)	Mean IoU	50.6	# 26	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	HSNet (HM, ResNet-101)	FB-IoU	72.9	# 13	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	VAT (HM, ResNet-50)	Mean IoU	48.3	# 38	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	VAT (HM, ResNet-50)	FB-IoU	71.8	# 19	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-101)	Mean IoU	50.6	# 26	Compare
Few-Shot Semantic Segmentation	COCO-20i (5-shot)	ASNet (HM, ResNet-101)	FB-IoU	73.3	# 9	Compare
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (1-shot)	HSNet (HM, ResNet-101)	Mean IoU	66.5	# 6	Compare
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (1-shot)	VAT (HM, ResNet-50)	Mean IoU	65.1	# 8	Compare
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (1-shot)	HSNet (HM, ResNet-50)	Mean IoU	65.2	# 7	Compare
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (5-shot)	HSNet (HM, ResNet-50)	Mean IoU	69.7	# 6	Compare
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (5-shot)	VAT (HM, ResNet-50)	Mean IoU	69.7	# 6	Compare
Few-Shot Semantic Segmentation	COCO-20i -> Pascal VOC (5-shot)	HSNet (HM, ResNet-101)	Mean IoU	70.9	# 5	Compare
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	VAT (HM, ResNet-101)	Mean IoU	90.2	# 5	Compare
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	VAT (HM, ResNet-50)	Mean IoU	89.4	# 9	Compare
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	HSNet (HM, ResNet-101)	Mean IoU	87.8	# 13	Compare
Few-Shot Semantic Segmentation	FSS-1000 (1-shot)	HSNet (HM, ResNet-50)	Mean IoU	87.1	# 15	Compare
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	HSNet (HM, ResNet-50)	Mean IoU	88	# 15	Compare
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	HSNet (HM, ResNet-101)	Mean IoU	88.5	# 13	Compare
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	VAT (HM, ResNet-50)	Mean IoU	89.9	# 8	Compare
Few-Shot Semantic Segmentation	FSS-1000 (5-shot)	VAT (HM, ResNet-101)	Mean IoU	90.5	# 6	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-50)	Mean IoU	65	# 46	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-50)	FB-IoU	76.5	# 33	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-101)	Mean IoU	67.8	# 20	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-101)	FB-IoU	79.4	# 10	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-101)	Mean IoU	66.7	# 32	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	HSNet (HM, ResNet-101)	FB-IoU	77.8	# 23	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-50)	Mean IoU	65.8	# 38	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (1-Shot)	VAT (HM, ResNet-50)	FB-IoU	77.1	# 30	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-50)	Mean IoU	68.2	# 51	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-50)	FB-IoU	78.5	# 30	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-101)	Mean IoU	70.9	# 28	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	VAT (HM, ResNet-101)	FB-IoU	81.5	# 16	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-101)	Mean IoU	69.3	# 41	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-101)	FB-IoU	79.7	# 28	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-50)	Mean IoU	67.1	# 56	Compare
Few-Shot Semantic Segmentation	PASCAL-5i (5-Shot)	HSNet (HM, ResNet-50)	FB-IoU	77.7	# 34	Compare

Methods

Add Remove

No methods listed for this paper. Add relevant methods here

Edit Social Preview

HM: Hybrid Masking for Few-Shot Segmentation

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove