Neural Architecture Search for Lightweight Non-Local Networks

Non-Local (NL) blocks have been widely studied in various vision tasks. However, it has been rarely explored to embed the NL blocks in mobile neural networks, mainly due to the following challenges: 1) NL blocks generally have heavy computation cost which makes it difficult to be applied in applications where computational resources are limited, and 2) it is an open problem to discover an optimal configuration to embed NL blocks into mobile neural networks... (read more)

PDF Abstract CVPR 2020 PDF CVPR 2020 Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Neural Architecture Search ImageNet AutoNL-S Top-1 Error Rate 23.5 # 15
Accuracy 76.5 # 15
Neural Architecture Search ImageNet AutoNL-L Top-1 Error Rate 22.3 # 8
Accuracy 77.7 # 8

Methods used in the Paper