EfficientNet is a convolutional neural network architecture and scaling method that uniformly scales all dimensions of depth/width/resolution using a compound coefficient. Unlike conventional practice that arbitrary scales these factors, the EfficientNet scaling method uniformly scales network width, depth, and resolution with a set of fixed scaling coefficients. For example, if we want to use $2^N$ times more computational resources, then we can simply increase the network depth by $\alpha ^ N$, width by $\beta ^ N$, and image size by $\gamma ^ N$, where $\alpha, \beta, \gamma$ are constant coefficients determined by a small grid search on the original small model. EfficientNet uses a compound coefficient $\phi$ to uniformly scales network width, depth, and resolution in a principled way.

The compound scaling method is justified by the intuition that if the input image is bigger, then the network needs more layers to increase the receptive field and more channels to capture more fine-grained patterns on the bigger image.

The base EfficientNet-B0 network is based on the inverted bottleneck residual blocks of MobileNetV2, in addition to squeeze-and-excitation blocks.

Source: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

Latest Papers

PAPER DATE
Deep Learning Frameworks for Pavement Distress Classification: A Comparative Analysis
Vishal MandalAbdul Rashid MussahYaw Adu-Gyamfi
2020-10-21
Classification and understanding of cloud structures via satellite images with EfficientUNet
Tashin AhmedNoor Hossain Nuri Sabab
2020-09-27
ECOVNet: An Ensemble of Deep Convolutional Neural Networks Based on EfficientNet to Detect COVID-19 From Chest X-rays
Nihad Karim ChowdhuryMd. Muhtadir RahmanNoortaz RezoanaMuhammad Ashad Kabir
2020-09-24
Adversarial Exposure Attack on Diabetic Retinopathy Imagery
Yupeng ChengFelix Juefei-XuQing GuoHuazhu FuXiaofei XieShang-Wei LinWeisi LinYang Liu
2020-09-19
Image Captioning with Attention for Smart Local Tourism using EfficientNet
| Dhomas Hatta FudholiYurio WindiatmokoNurdi AfriantoPrastyo Eko SusantoMagfirah SuyutiAhmad Fathan HidayatullahRidho Rahmadi
2020-09-18
EfficientNet-eLite: Extremely Lightweight and Efficient CNN Models for Edge Devices by Network Candidate Search
| Ching-Chen WangChing-Te ChiuJheng-Yi Chang
2020-09-16
FastSal: a Computationally Efficient Network for Visual Saliency Prediction
Feiyan HuKevin McGuinness
2020-08-25
An Improved Person Re-identification Method by light-weight convolutional neural network
| Sajad Amouei SheshkalKazim Fouladi-GhalehHossein Aghababa
2020-08-21
The Ensemble Method for Thorax Diseases Classification
Bayu A. Nugroho
2020-08-07
Structured Convolutions for Efficient Neural Network Design
Yash BhalgatYizhe ZhangJamie LinFatih Porikli
2020-08-06
EfficientHRNet: Efficient Scaling for Lightweight High-Resolution Multi-Person Pose Estimation
Christopher NeffAneri ShethSteven FurgursonHamed Tabkhi
2020-07-16
Improving accuracy and speeding up Document Image Classification through parallel systems
| Javier FerrandoJuan Luis DominguezJordi TorresRaul GarciaDavid GarciaDaniel GarridoJordi CortadaMateo Valero
2020-06-16
Deep Learning based Diagnosis of COVID-19 usingChest CT-scan Images
| Talha AnwarSeemab Zakir
2020-05-20
AI Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Etiology on Chest CT
| Harrison X. BaiRobin WangZeng XiongBen HsiehKen ChangKasey HalseyThi My Linh TranJi Whae ChoiDong-Cui WangLin-Bo ShiJi MeiXiao-Long JiangIan PanQiu-Hua ZengPing-Feng HuYi-Hui LiFei-Xian FuRaymond Y. HuangRonnie SebroQi-Zhi YuMichael K. AtalayWei-Hua Liao
2020-04-27
EfficientPose: Scalable single-person pose estimation
| Daniel GroosHeri RamampiaroEspen Ihlen
2020-04-25
YOLOv4: Optimal Speed and Accuracy of Object Detection
| Alexey BochkovskiyChien-Yao WangHong-Yuan Mark Liao
2020-04-23
LSQ+: Improving low-bit quantization through learnable offsets and better initialization
| Yash BhalgatJinwon LeeMarkus NagelTijmen BlankevoortNojun Kwak
2020-04-20
DriftNet: Aggressive Driving Behavior Classification using 3D EfficientNet Architecture
Alam NoorBilel BenjdiraAdel AmmarAnis Koubaa
2020-04-18
Video Face Manipulation Detection Through Ensemble of CNNs
| Nicolò BonettiniEdoardo Daniele CannasSara MandelliLuca BondiPaolo BestaginiStefano Tubaro
2020-04-16
An Evaluation of DNN Architectures for Page Segmentation of Historical Newspapers
| Bernhard LieblManuel Burghardt
2020-04-15
Towards an Effective and Efficient Deep Learning Model for COVID-19 Patterns Detection in X-ray Images
| Eduardo LuzPedro Lopes SilvaRodrigo SilvaLudmila SilvaGladston MoreiraDavid Menotti
2020-04-12
Analysis on DeepLabV3+ Performance for Automatic Steel Defects Detection
Zheng NieJiachen XuShengchang Zhang
2020-04-09
Evolving Normalization-Activation Layers
| Hanxiao LiuAndrew BrockKaren SimonyanQuoc V. Le
2020-04-06
NBDT: Neural-Backed Decision Trees
| Alvin WanLisa DunlapDaniel HoJihan YinScott LeeHenry JinSuzanne PetrykSarah Adel BargalJoseph E. Gonzalez
2020-04-01
Circumventing Outliers of AutoAugment with Knowledge Distillation
Longhui WeiAn XiaoLingxi XieXin ChenXiaopeng ZhangQi Tian
2020-03-25
Multi-Plateau Ensemble for Endoscopic Artefact Segmentation and Detection
| Suyog JadhavUdbhav BambaArnav ChavanRishabh TiwariAryan Raj
2020-03-23
Meta Pseudo Labels
Hieu PhamQizhe XieZihang DaiQuoc V. Le
2020-03-23
Fixing the train-test resolution discrepancy: FixEfficientNet
| Hugo TouvronAndrea VedaldiMatthijs DouzeHervé Jégou
2020-03-18
Gimme Signals: Discriminative signal encoding for multimodal activity recognition
| Raphael MemmesheimerNick TheisenDietrich Paulus
2020-03-13
Learned Threshold Pruning
Kambiz AzarianYash BhalgatJinwon LeeTijmen Blankevoort
2020-02-28
MaxUp: A Simple Way to Improve Generalization of Neural Network Training
Chengyue GongTongzheng RenMao YeQiang Liu
2020-02-20
Attention-Based Face AntiSpoofing of RGB Images, using a Minimal End-2-End Neural Network
Ali GhofraniRahil Mahdian ToroghiSeyed Mojtaba Tabatabaie
2019-12-18
Structured Multi-Hashing for Model Compression
Elad EbanYair Movshovitz-AttiasHao WuMark SandlerAndrew PoonYerlan IdelbayevMiguel A. Carreira-Perpinan
2019-11-25
Fast Sparse ConvNets
| Erich ElsenMarat DukhanTrevor GaleKaren Simonyan
2019-11-21
Adversarial Examples Improve Image Recognition
| Cihang XieMingxing TanBoqing GongJiang WangAlan YuilleQuoc V. Le
2019-11-21
EfficientDet: Scalable and Efficient Object Detection
| Mingxing TanRuoming PangQuoc V. Le
2019-11-20
Experimental Exploration of Compact Convolutional Neural Network Architectures for Non-temporal Real-time Fire Detection
Ganesh Samarth C. A.Neelanjan BhowmikToby P. Breckon
2019-11-20
Self-training with Noisy Student improves ImageNet classification
| Qizhe XieMinh-Thang LuongEduard HovyQuoc V. Le
2019-11-11
Identification of primary angle-closure on AS-OCT images with Convolutional Neural Networks
Chenglang YuanCheng BianHongjian KangShu LiangKai MaYefeng Zheng
2019-10-23
ICPS-net: An End-to-End RGB-based Indoor Camera Positioning System using deep convolutional neural networks
Ali GhofraniRahil Mahdian ToroghiSayed Mojtaba Tabatabaie
2019-10-14
RandAugment: Practical automated data augmentation with a reduced search space
| Ekin D. CubukBarret ZophJonathon ShlensQuoc V. Le
2019-09-30
MutualNet: Adaptive ConvNet via Mutual Learning from Network Width and Resolution
| Taojiannan YangSijie ZhuChen ChenShen YanMi ZhangAndrew Willis
2019-09-27
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
| Mingxing TanQuoc V. Le
2019-05-28
CondConv: Conditionally Parameterized Convolutions for Efficient Inference
| Brandon YangGabriel BenderQuoc V. LeJiquan Ngiam
2019-04-10

Categories