Methods > Computer Vision > Convolutional Neural Networks

ResNeXt

Introduced by Xie et al. in Aggregated Residual Transformations for Deep Neural Networks
 
Edit

A ResNeXt repeats a building block that aggregates a set of transformations with the same topology. Compared to a ResNet, it exposes a new dimension, cardinality (the size of the set of transformations) $C$, as an essential factor in addition to the dimensions of depth and width.

Formally, a set of aggregated transformations can be represented as: $\mathcal{F}(x)=\sum_{i=1}^{C}\mathcal{T}_i(x)$, where $\mathcal{T}_i(x)$ can be an arbitrary function. Analogous to a simple neuron, $\mathcal{T}_i$ should project $x$ into an (optionally low-dimensional) embedding and then transform it.

Source: Aggregated Residual Transformations for Deep Neural Networks
Paper Code Snippet

Latest Papers

PAPER DATE
Large Scale Neural Architecture Search with Polyharmonic Splines
Ulrich Finkler • Michele Merler • Rameswar Panda • Mayoore S. Jaiswal • Hui Wu • Kandan Ramakrishnan • Chun-Fu Chen • Minsik Cho • David Kung • Rogerio Feris • Bishwaranjan Bhattacharjee
2020-11-20
Deep Transfer Learning for Automated Diagnosis of Skin Lesions from Photographs
Emma Rocheteau • Doyoon Kim
2020-11-06
Dynamically Throttleable Neural Networks (TNN)
Hengyue Liu • Samyak Parajuli • Jesse Hostetler • Sek Chai • Bir Bhanu
2020-11-01
Dynamic Graph: Learning Instance-aware Connectivity for Neural Networks
Kun Yuan • Quanquan Li • Dapeng Chen • Aojun Zhou • Junjie Yan
2020-10-02
Group Whitening: Balancing Learning Efficiency and Representational Capacity
Lei Huang • Li Liu • Fan Zhu • Ling Shao
2020-09-28
Late Temporal Modeling in 3D CNN Architectures with BERT for Action Recognition
| M. Esat Kalfaoglu • Sinan Kalkan • A. Aydin Alatan
# 1 ACTION RECOGNITION ON HMDB-51
2020-08-03
Mining Inter-Video Proposal Relations for Video Object Detection
| Mingfei Han • Yali Wang • Xiaojun Chang • Yu Qiao
# 1 VIDEO OBJECT DETECTION ON IMAGENET VID
2020-08-01
Privacy-Aware Activity Classification from First Person Office Videos
Partho Ghosh • Md. Abrar Istiak • Nayeeb Rashid • Ahsan Habib Akash • Ridwan Abrar • Ankan Ghosh Dastider • Asif Shahriyar Sushmit • Taufiq Hasan
2020-06-11
Interpolation between Residual and Non-Residual Networks
| Zonghan Yang • Yang Liu • Chenglong Bao • Zuoqiang Shi
2020-06-10
Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection
| Xiang Li • Wenhai Wang • Lijun Wu • Shuo Chen • Xiaolin Hu • Jun Li • Jinhui Tang • Jian Yang
# 19 OBJECT DETECTION ON COCO TEST-DEV
2020-06-08
Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks
Ning Zhang • Jingen Liu • Ke Wang • Dan Zeng • Tao Mei
2020-05-13
Memory Enhanced Global-Local Aggregation for Video Object Detection
| Yihong Chen • Yue Cao • Han Hu • Li-Wei Wang
# 2 VIDEO OBJECT DETECTION ON IMAGENET VID
2020-03-26
Multi-Plateau Ensemble for Endoscopic Artefact Segmentation and Detection
| Suyog Jadhav • Udbhav Bamba • Arnav Chavan • Rishabh Tiwari • Aryan Raj
2020-03-23
Provable, Scalable and Automatic Perturbation Analysis on General Computational Graphs
| Kaidi Xu • Zhouxing Shi • huan zhang • Yihan Wang • Kai-Wei Chang • Minlie Huang • Bhavya Kailkhura • Xue Lin • Cho-Jui Hsieh
2020-02-28
Graphcore C2 Card performance for image-based deep learning application: A Report
Ilyes Kacher • Maxime Portaz • Hicham Randrianarivo • Sylvain Peyronnet
2020-02-26
Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNets
Dongxian Wu • Yisen Wang • Shu-Tao Xia • James Bailey • Xingjun Ma
2020-02-14
Learning Hyperspectral Feature Extraction and Classification with ResNeXt Network
Divinah Nyasaka • Jing Wang • Haron Tinega
2020-02-07
All-in-One Image-Grounded Conversational Agents
Da Ju • Kurt Shuster • Y-Lan Boureau • Jason Weston
2019-12-28
Divided We Stand: A Novel Residual Group Attention Mechanism for Medical Image Segmentation
Chaitanya Kaul • Nick Pears • Suresh Manandhar
2019-12-04
CSPNet: A New Backbone that can Enhance Learning Capability of CNN
| Chien-Yao Wang • Hong-Yuan Mark Liao • I-Hau Yeh • Yueh-Hua Wu • Ping-Yang Chen • Jun-Wei Hsieh
# 70 IMAGE CLASSIFICATION ON IMAGENET
2019-11-27
CenterMask : Real-Time Anchor-Free Instance Segmentation
| Youngwan Lee • Jongyoul Park
# 2 REAL-TIME INSTANCE SEGMENTATION ON MSCOCO
2019-11-15
On Leveraging the Visual Modality for Neural Machine Translation
Vikas Raunak • Sang Keun Choe • Quanyang Lu • Yi Xu • Florian Metze
2019-10-07
PolarMask: Single Shot Instance Segmentation with Polar Representation
| Enze Xie • Peize Sun • Xiaoge Song • Wenhai Wang • Ding Liang • Chunhua Shen • Ping Luo
# 23 INSTANCE SEGMENTATION ON COCO TEST-DEV
2019-09-29
Fast and Accurate Convolutional Object Detectors for Real-time Embedded Platforms
| Min-Kook Choi • Jaehyung Park • Heechul Jung • Jin-Hee Lee • Soo-Heang Eo
2019-09-24
AdaptIS: Adaptive Instance Selection Network
| Konstantin Sofiiuk • Olga Barinova • Anton Konushin
# 3 PANOPTIC SEGMENTATION ON MAPILLARY VAL
2019-09-17
VACL: Variance-Aware Cross-Layer Regularization for Pruning Deep Residual Networks
Shuang Gao • Xin Liu • Lung-Sheng Chien • William Zhang • Jose M. Alvarez
2019-09-10
CBNet: A Novel Composite Backbone Network Architecture for Object Detection
| Yudong Liu • Yongtao Wang • Siwei Wang • Ting-Ting Liang • Qijie Zhao • Zhi Tang • Haibin Ling
# 3 INSTANCE SEGMENTATION ON COCO TEST-DEV
2019-09-09
FreeAnchor: Learning to Match Anchors for Visual Object Detection
| Xiaosong Zhang • Fang Wan • Chang Liu • Rongrong Ji • Qixiang Ye
# 35 OBJECT DETECTION ON COCO TEST-DEV
2019-09-05
Efficient Neural Architecture Transformation Searchin Channel-Level for Object Detection
Junran Peng • Ming Sun • Zhao-Xiang Zhang • Tieniu Tan • Junjie Yan
2019-09-05
Shadow Removal via Shadow Image Decomposition
Hieu Le • Dimitris Samaras
# 1 SHADOW REMOVAL ON ADJUSTED ISTD
2019-08-23
Mish: A Self Regularized Non-Monotonic Activation Function
| Diganta Misra
# 70 IMAGE CLASSIFICATION ON IMAGENET
2019-08-23
Differentiable Learning-to-Group Channels via Groupable Convolutional Neural Networks
Zhaoyang Zhang • Jingyu Li • Wenqi Shao • Zhanglin Peng • Ruimao Zhang • Xiaogang Wang • Ping Luo
2019-08-16
Pay attention to the activations: a modular attention mechanism for fine-grained image recognition
| Pau Rodríguez López • Diego Velazquez Dorta • Guillem Cucurull Preixens • Josep M. Gonfaus • F. Xavier Roca Marva • Jordi Gonzàlez Sabaté
2019-07-30
Automatic Grading of Individual Knee Osteoarthritis Features in Plain Radiographs using Deep Convolutional Neural Networks
| Aleksei Tiulpin • Simo Saarakkala
2019-07-18
Robustness properties of Facebook's ResNeXt WSL models
| A. Emin Orhan
2019-07-17
Acute Lymphoblastic Leukemia Classification from Microscopic Images using Convolutional Neural Networks
| Jonas Prellberg • Oliver Kramer
2019-06-21
Fixing the train-test resolution discrepancy
| Hugo Touvron • Andrea Vedaldi • Matthijs Douze • Hervé Jégou
# 9 IMAGE CLASSIFICATION ON IMAGENET
2019-06-14
Learning Instance Occlusion for Panoptic Segmentation
| Justin Lazarow • Kwonjoon Lee • Kunyu Shi • Zhuowen Tu
# 4 PANOPTIC SEGMENTATION ON COCO TEST-DEV
2019-06-13
On Network Design Spaces for Visual Recognition
| Ilija Radosavovic • Justin Johnson • Saining Xie • Wan-Yen Lo • Piotr Dollár
2019-05-30
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation
| Linfeng Zhang • Jiebo Song • Anni Gao • Jingwei Chen • Chenglong Bao • Kaisheng Ma
2019-05-17
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
| Sangdoo Yun • Dongyoon Han • Seong Joon Oh • Sanghyuk Chun • Junsuk Choe • Youngjoon Yoo
# 45 IMAGE CLASSIFICATION ON IMAGENET
2019-05-13
Billion-scale semi-supervised learning for image classification
| I. Zeki Yalniz • Hervé Jégou • Kan Chen • Manohar Paluri • Dhruv Mahajan
# 21 IMAGE CLASSIFICATION ON IMAGENET
2019-05-02
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond
| Yue Cao • Jiarui Xu • Stephen Lin • Fangyun Wei • Han Hu
# 7 INSTANCE SEGMENTATION ON COCO TEST-DEV
2019-04-25
RepPoints: Point Set Representation for Object Detection
| Ze Yang • Shaohui Liu • Han Hu • Li-Wei Wang • Stephen Lin
# 12 OBJECT DETECTION ON COCO MINIVAL
2019-04-25
Data-Driven Neuron Allocation for Scale Aggregation Networks
| Yi Li • Zhanghui Kuang • Yimin Chen • Wayne Zhang
# 67 IMAGE CLASSIFICATION ON IMAGENET
2019-04-20
Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution
| Yunpeng Chen • Haoqi Fan • Bing Xu • Zhicheng Yan • Yannis Kalantidis • Marcus Rohrbach • Shuicheng Yan • Jiashi Feng
# 36 IMAGE CLASSIFICATION ON IMAGENET
2019-04-10
FoveaBox: Beyond Anchor-based Object Detector
| Tao Kong • Fuchun Sun • Huaping Liu • Yuning Jiang • Lei LI • Jianbo Shi
# 39 OBJECT DETECTION ON COCO TEST-DEV
2019-04-08
Libra R-CNN: Towards Balanced Learning for Object Detection
| Jiangmiao Pang • Kai Chen • Jianping Shi • Huajun Feng • Wanli Ouyang • Dahua Lin
# 44 OBJECT DETECTION ON COCO TEST-DEV
2019-04-04
FCOS: Fully Convolutional One-Stage Object Detection
| Zhi Tian • Chunhua Shen • Hao Chen • Tong He
# 36 OBJECT DETECTION ON COCO TEST-DEV
2019-04-02
Res2Net: A New Multi-scale Backbone Architecture
| Shang-Hua Gao • Ming-Ming Cheng • Kai Zhao • Xin-Yu Zhang • Ming-Hsuan Yang • Philip Torr
# 4 RGB SALIENT OBJECT DETECTION ON ECSSD
2019-04-02
Why ResNet Works? Residuals Generalize
Fengxiang He • Tongliang Liu • DaCheng Tao
2019-04-02
Micro-Batch Training with Batch-Channel Normalization and Weight Standardization
| Siyuan Qiao • Huiyu Wang • Chenxi Liu • Wei Shen • Alan Yuille
# 12 INSTANCE SEGMENTATION ON COCO MINIVAL
2019-03-25
Selective Kernel Networks
| Xiang Li • Wenhai Wang • Xiaolin Hu • Jian Yang
# 25 IMAGE CLASSIFICATION ON CIFAR-100
2019-03-15
Feature Selective Anchor-Free Module for Single-Shot Object Detection
| Chenchen Zhu • Yihui He • Marios Savvides
# 34 OBJECT DETECTION ON COCO MINIVAL
2019-03-02
PEA265: Perceptual Assessment of Video Compression Artifacts
Liqun Lin • Shiqi Yu • Tiesong Zhao • Member • Zhou Wang • Fellow • IEEE
2019-03-01
To Ensemble or Not Ensemble: When does End-To-End Training Fail?
| Andrew M. Webb • Charles Reynolds • Wenlin Chen • Henry Reeve • Dan-Andrei Iliescu • Mikel Lujan • Gavin Brown
2019-02-12
Real-time Hand Gesture Detection and Classification Using Convolutional Neural Networks
| Okan Köpüklü • Ahmet Gunduz • Neslihan Kose • Gerhard Rigoll
# 1 HAND GESTURE RECOGNITION ON EGOGESTURE
2019-01-29
Hybrid Task Cascade for Instance Segmentation
| Kai Chen • Jiangmiao Pang • Jiaqi Wang • Yu Xiong • Xiaoxiao Li • Shuyang Sun • Wansen Feng • Ziwei Liu • Jianping Shi • Wanli Ouyang • Chen Change Loy • Dahua Lin
# 9 INSTANCE SEGMENTATION ON COCO TEST-DEV
2019-01-22
RetinaMask: Learning to predict masks improves state-of-the-art single-shot detection for free
| Cheng-Yang Fu • Mykhailo Shvets • Alexander C. Berg
# 37 OBJECT DETECTION ON COCO MINIVAL
2019-01-10
Panoptic Feature Pyramid Networks
| Alexander Kirillov • Ross Girshick • Kaiming He • Piotr Dollár
# 4 PANOPTIC SEGMENTATION ON KITTI PANOPTIC SEGMENTATION
2019-01-08
Attention-guided Unified Network for Panoptic Segmentation
Yanwei Li • Xinze Chen • Zheng Zhu • Lingxi Xie • Guan Huang • Dalong Du • Xingang Wang
# 5 PANOPTIC SEGMENTATION ON COCO TEST-DEV
2018-12-10
Can We Gain More from Orthogonality Regularizations in Training Deep Networks?
| Nitin Bansal • Xiaohan Chen • Zhangyang Wang
2018-12-01
Parsing R-CNN for Instance-Level Human Analysis
| Lu Yang • Qing Song • Zhihui Wang • Ming Jiang
# 1 HUMAN PART SEGMENTATION ON MHP V2.0
2018-11-30
Graph-Based Global Reasoning Networks
| Yunpeng Chen • Marcus Rohrbach • Zhicheng Yan • Shuicheng Yan • Jiashi Feng • Yannis Kalantidis
2018-11-30
Grid R-CNN
| Xin Lu • Buyu Li • Yuxin Yue • Quanquan Li • Junjie Yan
# 36 OBJECT DETECTION ON COCO MINIVAL
2018-11-29
Sequentially Aggregated Convolutional Networks
| Yiwen Huang • Rihui Wu • Pinglai Ou • Ziyong Feng
2018-11-27
Rethinking ImageNet Pre-training
| Kaiming He • Ross Girshick • Piotr Dollár
# 7 OBJECT DETECTION ON COCO MINIVAL
2018-11-21
Gradient Harmonized Single-stage Detector
| Buyu Li • Yu Liu • Xiaogang Wang
# 52 OBJECT DETECTION ON COCO TEST-DEV
2018-11-13
CINIC-10 is not ImageNet or CIFAR-10
| Luke N. Darlow • Elliot J. Crowley • Antreas Antoniou • Amos J. Storkey
# 5 IMAGE CLASSIFICATION ON CINIC-10
2018-10-02
LIT: Block-wise Intermediate Representation Training for Model Compression
Animesh Koratana • Daniel Kang • Peter Bailis • Matei Zaharia
2018-10-02
Skin Lesion Diagnosis using Ensembles, Unscaled Multi-Crop Evaluation and Loss Weighting
| Nils Gessert • Thilo Sentker • Frederic Madesta • Rüdiger Schmitz • Helge Kniep • Ivo Baltruschat • René Werner • Alexander Schlaefer
2018-08-05
MaskConnect: Connectivity Learning by Gradient Descent
Karim Ahmed • Lorenzo Torresani
2018-07-28
Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net
| Xingang Pan • Ping Luo • Jianping Shi • Xiaoou Tang
2018-07-25
CBAM: Convolutional Block Attention Module
| Sanghyun Woo • Jongchan Park • Joon-Young Lee • In So Kweon
2018-07-17
Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition
| Chun-Fu Chen • Quanfu Fan • Neil Mallinar • Tom Sercu • Rogerio Feris
2018-07-10
Spatio-Temporal Channel Correlation Networks for Action Classification
Ali Diba • Mohsen Fayyaz • Vivek Sharma • M. Mahdi Arzani • Rahman Yousefzadeh • Juergen Gall • Luc van Gool
2018-06-19
Instance Search via Instance Level Segmentation and Feature Representation
Yu Zhan • Wan-Lei Zhao
2018-06-10
Deep Neural Networks with Multi-Branch Architectures Are Less Non-Convex
| Hongyang Zhang • Junru Shao • Ruslan Salakhutdinov
2018-06-06
Fully Automated Organ Segmentation in Male Pelvic CT Images
Anjali Balagopal • Samaneh Kazemifar • Dan Nguyen • Mu-Han Lin • Raquibul Hannan • Amir Owrangi • Steve Jiang
2018-05-31
Evaluating ResNeXt Model Architecture for Image Classification
| Saifuddin Hitawala
2018-05-09
Exploring the Limits of Weakly Supervised Pretraining
| Dhruv Mahajan • Ross Girshick • Vignesh Ramanathan • Kaiming He • Manohar Paluri • Yixuan Li • Ashwin Bharambe • Laurens van der Maaten
# 15 IMAGE CLASSIFICATION ON IMAGENET
2018-05-02
TreeSegNet: Adaptive Tree CNNs for Subdecimeter Aerial Image Segmentation
Kai Yue • Lei Yang • Ruirui Li • Wei Hu • Fan Zhang • Wei Li
2018-04-29
ExFuse: Enhancing Feature Fusion for Semantic Segmentation
Zhenli Zhang • Xiangyu Zhang • Chao Peng • Dazhi Cheng • Jian Sun
# 2 SEMANTIC SEGMENTATION ON PASCAL VOC 2012 VAL
2018-04-11
Path Aggregation Network for Instance Segmentation
| Shu Liu • Lu Qi • Haifang Qin • Jianping Shi • Jiaya Jia
# 4 INSTANCE SEGMENTATION ON COCO TEST-DEV
2018-03-05
ShakeDrop Regularization for Deep Residual Learning
| Yoshihiro Yamada • Masakazu Iwamura • Takuya Akiba • Koichi Kise
2018-02-07
Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift
| Xiang Li • Shuo Chen • Xiaolin Hu • Jian Yang
2018-01-16
ShakeDrop regularization
Yoshihiro Yamada • Masakazu Iwamura • Koichi Kise
2018-01-01
Cascade R-CNN: Delving into High Quality Object Detection
| Zhaowei Cai • Nuno Vasconcelos
# 28 OBJECT DETECTION ON COCO MINIVAL
2017-12-03
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
| Kensho Hara • Hirokatsu Kataoka • Yutaka Satoh
# 15 ACTION RECOGNITION ON UCF101
2017-11-27
Non-local Neural Networks
| Xiaolong Wang • Ross Girshick • Abhinav Gupta • Kaiming He
# 7 KEYPOINT DETECTION ON COCO
2017-11-21
AOGNets: Compositional Grammatical Architectures for Deep Learning
| Xilai Li • Xi Song • Tianfu Wu
2017-11-15
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations
Yiping Lu • Aoxiao Zhong • Quanzheng Li • Bin Dong
2017-10-27
Focal Loss for Dense Object Detection
| Tsung-Yi Lin • Priya Goyal • Ross Girshick • Kaiming He • Piotr Dollár
# 3 DENSE OBJECT DETECTION ON SKU-110K
2017-08-07
Mask R-CNN
| Kaiming He • Georgia Gkioxari • Piotr Dollár • Ross Girshick
# 1 REAL-TIME OBJECT DETECTION ON COCO MINIVAL
2017-03-20
Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
| Antti Tarvainen • Harri Valpola
# 5 SEMI-SUPERVISED IMAGE CLASSIFICATION ON SVHN, 250 LABELS
2017-03-06
Deep Pyramidal Residual Networks with Separated Stochastic Depth
Yoshihiro Yamada • Masakazu Iwamura • Koichi Kise
2016-12-05
Aggregated Residual Transformations for Deep Neural Networks
| Saining Xie • Ross Girshick • Piotr Dollár • Zhuowen Tu • Kaiming He
# 56 IMAGE CLASSIFICATION ON IMAGENET
2016-11-16

Categories
Add Remove

Contact us on: [email protected]. Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Privacy Cookies policy