Step Decay

Step Decay is a learning rate schedule that drops the learning rate by a factor every few epochs, where the number of epochs is a hyperparameter.

Image Credit: Suki Lau

Latest Papers

PAPER DATE
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection
| Jianyuan GuoKai HanYunhe WangChao ZhangZhaohui YangHan WuXinghao ChenChang Xu
2020-03-26
Harmonic Convolutional Networks based on Discrete Cosine Transform
| Matej UlicnyVladimir A. KrylovRozenn Dahyot
2020-01-18
MatrixNets: A New Scale and Aspect Ratio Aware Architecture for Object Detection
| Abdullah RashwanRishav AgarwalAgastya KalraPascal Poupart
2020-01-09
Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selection
| Shifeng ZhangCheng ChiYongqiang YaoZhen LeiStan Z. Li
2019-12-05
CSPNet: A New Backbone that can Enhance Learning Capability of CNN
| Chien-Yao WangHong-Yuan Mark LiaoI-Hau YehYueh-Hua WuPing-Yang ChenJun-Wei Hsieh
2019-11-27
Self-training with Noisy Student improves ImageNet classification
| Qizhe XieMinh-Thang LuongEduard HovyQuoc V. Le
2019-11-11
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
| Qilong WangBanggu WuPengfei ZhuPeihua LiWangmeng ZuoQinghua Hu
2019-10-08
FreeAnchor: Learning to Match Anchors for Visual Object Detection
| Xiaosong ZhangFang WanChang LiuRongrong JiQixiang Ye
2019-09-05
InstaBoost: Boosting Instance Segmentation via Probability Map Guided Copy-Pasting
| Hao-Shu FangJianhua SunRunzhong WangMinghao GouYong-Lu LiCewu Lu
2019-08-21
Deep High-Resolution Representation Learning for Visual Recognition
| Jingdong WangKe SunTianheng ChengBorui JiangChaorui DengYang ZhaoDong LiuYadong MuMingkui TanXinggang WangWenyu LiuBin Xiao
2019-08-20
SCARLET-NAS: Bridging the gap between Stability and Scalability in Weight-sharing Neural Architecture Search
| Xiangxiang ChuBo ZhangJixiang LiQingyuan LiRuijun Xu
2019-08-16
Compact Global Descriptor for Neural Networks
| Xiangyu HeKe ChengQiang ChenQinghao HuPeisong WangJian Cheng
2019-07-23
Stochastic algorithms with geometric step decay converge linearly on sharp functions
Damek DavisDmitriy DrusvyatskiyVasileios Charisopoulos
2019-07-22
Learning Data Augmentation Strategies for Object Detection
| Barret ZophEkin D. CubukGolnaz GhiasiTsung-Yi LinJonathon ShlensQuoc V. Le
2019-06-26
Spatial Group-wise Enhance: Improving Semantic Feature Learning in Convolutional Networks
| Xiang LiXiaolin HuJian Yang
2019-05-23
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
| Sangdoo YunDongyoon HanSeong Joon OhSanghyuk ChunJunsuk ChoeYoungjoon Yoo
2019-05-13
Searching for MobileNetV3
| Andrew HowardMark SandlerGrace ChuLiang-Chieh ChenBo ChenMingxing TanWeijun WangYukun ZhuRuoming PangVijay VasudevanQuoc V. LeHartwig Adam
2019-05-06
The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares
Rong GeSham M. KakadeRahul KidambiPraneeth Netrapalli
2019-04-29
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond
| Yue CaoJiarui XuStephen LinFangyun WeiHan Hu
2019-04-25
Local Relation Networks for Image Recognition
| Han HuZheng ZhangZhenda XieStephen Lin
2019-04-25
An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection
| Youngwan LeeJoong-won HwangSangrok LeeYuseok BaeJongyoul Park
2019-04-22
Data-Driven Neuron Allocation for Scale Aggregation Networks
| Yi LiZhanghui KuangYimin ChenWayne Zhang
2019-04-20
CenterNet: Keypoint Triplets for Object Detection
| Kaiwen DuanSong BaiLingxi XieHonggang QiQingming HuangQi Tian
2019-04-17
NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection
| Golnaz GhiasiTsung-Yi LinRuoming PangQuoc V. Le
2019-04-16
FoveaBox: Beyond Anchor-based Object Detector
| Tao KongFuchun SunHuaping LiuYuning JiangLei LiJianbo Shi
2019-04-08
Adaptive NMS: Refining Pedestrian Detection in a Crowd
Songtao LiuDi HuangYunhong Wang
2019-04-07
Libra R-CNN: Towards Balanced Learning for Object Detection
| Jiangmiao PangKai ChenJianping ShiHuajun FengWanli OuyangDahua Lin
2019-04-04
Res2Net: A New Multi-scale Backbone Architecture
| Shang-Hua GaoMing-Ming ChengKai ZhaoXin-Yu ZhangMing-Hsuan YangPhilip Torr
2019-04-02
ThunderNet: Towards Real-time Generic Object Detection
| Zheng QinZeming LiZhaoning ZhangYiping BaoGang YuYuxing PengJian Sun
2019-03-28
SRM : A Style-based Recalibration Module for Convolutional Neural Networks
| HyunJae LeeHyo-Eun KimHyeonseob Nam
2019-03-26
RetinaMask: Learning to predict masks improves state-of-the-art single-shot detection for free
| Cheng-Yang FuMykhailo ShvetsAlexander C. Berg
2019-01-10
Scale-Aware Trident Networks for Object Detection
| Yanghao LiYuntao ChenNaiyan WangZhaoxiang Zhang
2019-01-07
ELASTIC: Improving CNNs with Dynamic Scaling Policies
| Huiyu WangAniruddha KembhaviAli FarhadiAlan YuilleMohammad Rastegari
2018-12-13
Pelee: A Real-Time Object Detection System on Mobile Devices
| Jun WangTanner BohnCharles Ling
2018-12-01
M2Det: A Single-Shot Object Detector based on Multi-Level Feature Pyramid Network
| Qijie ZhaoTao ShengYongtao WangZhi TangYing ChenLing CaiHaibin Ling
2018-11-12
CornerNet: Detecting Objects as Paired Keypoints
| Hei LawJia Deng
2018-08-03
Acquisition of Localization Confidence for Accurate Object Detection
| Borui JiangRuixuan LuoJiayuan MaoTete XiaoYuning Jiang
2018-07-30
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
| Ningning MaXiangyu ZhangHai-Tao ZhengJian Sun
2018-07-30
CBAM: Convolutional Block Attention Module
| Sanghyun WooJongchan ParkJoon-Young LeeIn So Kweon
2018-07-17
Representation Learning with Contrastive Predictive Coding
| Aaron van den OordYazhe LiOriol Vinyals
2018-07-10
An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution
| Rosanne LiuJoel LehmanPiero MolinoFelipe Petroski SuchEric FrankAlex SergeevJason Yosinski
2018-07-09
DetNet: A Backbone network for Object Detection
| Zeming LiChao PengGang YuXiangyu ZhangYangdong DengJian Sun
2018-04-17
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
| Sachin MehtaMohammad RastegariAnat CaspiLinda ShapiroHannaneh Hajishirzi
2018-03-19
Squeeze-and-Excitation Networks
| Jie HuLi ShenSamuel AlbanieGang SunEnhua Wu
2017-09-05
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
| Chen SunAbhinav ShrivastavaSaurabh SinghAbhinav Gupta
2017-07-10
Dual Path Networks
| Yunpeng ChenJianan LiHuaxin XiaoXiaojie JinShuicheng YanJiashi Feng
2017-07-06
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
| Xiangyu ZhangXinyu ZhouMengxiao LinJian Sun
2017-07-04
Tacotron: Towards End-to-End Speech Synthesis
| Yuxuan WangRJ Skerry-RyanDaisy StantonYonghui WuRon J. WeissNavdeep JaitlyZongheng YangYing XiaoZhifeng ChenSamy BengioQuoc LeYannis AgiomyrgiannakisRob ClarkRif A. Saurous
2017-03-29
Active Convolution: Learning the Shape of Convolution for Image Classification
| Yunho JeonJunmo Kim
2017-03-27
YOLO9000: Better, Faster, Stronger
| Joseph RedmonAli Farhadi
2016-12-25
Aggregated Residual Transformations for Deep Neural Networks
| Saining XieRoss GirshickPiotr DollárZhuowen TuKaiming He
2016-11-16
Deep Pyramidal Residual Networks
| Dongyoon HanJiwhan KimJunmo Kim
2016-10-10
Xception: Deep Learning with Depthwise Separable Convolutions
| François Chollet
2016-10-07
Neural Photo Editing with Introspective Adversarial Networks
| Andrew BrockTheodore LimJ. M. RitchieNick Weston
2016-09-22
Densely Connected Convolutional Networks
| Gao HuangZhuang LiuLaurens van der MaatenKilian Q. Weinberger
2016-08-25
FractalNet: Ultra-Deep Neural Networks without Residuals
| Gustav LarssonMichael MaireGregory Shakhnarovich
2016-05-24
Stacked Hourglass Networks for Human Pose Estimation
| Alejandro NewellKaiyu YangJia Deng
2016-03-22
Identity Mappings in Deep Residual Networks
| Kaiming HeXiangyu ZhangShaoqing RenJian Sun
2016-03-16
Deep Residual Learning for Image Recognition
| Kaiming HeXiangyu ZhangShaoqing RenJian Sun
2015-12-10
You Only Look Once: Unified, Real-Time Object Detection
| Joseph RedmonSantosh DivvalaRoss GirshickAli Farhadi
2015-06-08
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
| Kaiming HeXiangyu ZhangShaoqing RenJian Sun
2015-02-06
Going Deeper with Convolutions
| Christian SzegedyWei LiuYangqing JiaPierre SermanetScott ReedDragomir AnguelovDumitru ErhanVincent VanhouckeAndrew Rabinovich
2014-09-17
Very Deep Convolutional Networks for Large-Scale Image Recognition
| Karen SimonyanAndrew Zisserman
2014-09-04
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
| Kaiming HeXiangyu ZhangShaoqing RenJian Sun
2014-06-18
Some Improvements on Deep Convolutional Neural Network Based Image Classification
| Andrew G. Howard
2013-12-19
Visualizing and Understanding Convolutional Networks
| Matthew D ZeilerRob Fergus
2013-11-12
ImageNet Classification with Deep Convolutional Neural Networks
| Alex KrizhevskyIlya SutskeverGeoffrey E. Hinton
2012-12-01

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories