Xavier Initialization

Xavier Initialization, or Glorot Initialization, is an initialization scheme for neural networks. Biases are initialized be 0 and the weights $W_{ij}$ at each layer are initialized as:

$$ W_{ij} \sim U\left[-\frac{1}{\sqrt{n}}, \frac{1}{\sqrt{n}}\right] $$

Where $U$ is a uniform distribution and $n$ is the size of the previous layer (number of columns in $W$).

Latest Papers

PAPER DATE
WaveGrad: Estimating Gradients for Waveform Generation
| Nanxin ChenYu ZhangHeiga ZenRon J. WeissMohammad NorouziWilliam Chan
2020-09-02
Reliable Tuberculosis Detection using Chest X-ray with Deep Learning, Segmentation and Visualization
Tawsifur RahmanAmith KhandakarMuhammad Abdul KadirKhandaker R. IslamKhandaker F. IslamRashid MazharTahir HamidMohammad T. IslamZaid B. MahbubMohamed Arselene AyariMuhammad E. H. Chowdhury
2020-07-29
SqueezeFacePoseNet: Lightweight Face Verification Across Different Poses for Mobile Platforms
Fernando Alonso-FernandezJavier BarrachinaKevin Hernandez-DiazJosef Bigun
2020-07-16
EDropout: Energy-Based Dropout and Pruning of Deep Neural Networks
| Hojjat SalehinejadShahrokh Valaee
2020-06-07
Grafted network for person re-identification
Jiabao WangYang LiShanshan JiaoZhuang MiaoRui Zhang
2020-06-02
BWCNN: Blink to Word, a Real-Time Convolutional Neural Network Approach
Albara Ah RamliRex LiuRahul KrishnamoorthyVishal I BXiaoxiao WangIlias TagkopoulosXin Liu
2020-06-01
Coronavirus: Comparing COVID-19, SARS and MERS in the eyes of AI
Anas TahirYazan QiblaweyAmith KhandakarTawsifur RahmanUzair KhurshidFarayi MusharavatiM. T. IslamSerkan KiranyazMuhammad E. H. Chowdhury
2020-05-23
Comparison and Benchmarking of AI Models and Frameworks on Mobile Devices
Chunjie LuoXiwen HeJianfeng ZhanLei WangWanling GaoJiahui Dai
2020-05-07
A Light CNN for detecting COVID-19 from CT scans of the chest
Matteo PolsinelliLuigi CinqueGiuseppe Placidi
2020-04-24
Deep-COVID: Predicting COVID-19 From Chest X-Ray Images Using Deep Transfer Learning
| Shervin MinaeeRahele KafiehMilan SonkaShakib YazdaniGhazaleh Jamalipour Soufi
2020-04-20
Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray
Tawsifur RahmanMuhammad E. H. ChowdhuryAmith KhandakarKhandaker R. IslamKhandaker F. IslamZaid B. MahbubMuhammad A. KadirSaad Kashem
2020-04-14
Deep Transfer Learning for Texture Classification in Colorectal Cancer Histology
Srinath JayachandranAshlin Ghosh
2020-04-03
Classification of the Chinese Handwritten Numbers with Supervised Projective Dictionary Pair Learning
Rasool AmeriSaideh FerdowsiAli AlameerVahid AbolghasemiKianoush Nazarpour
2020-03-26
Analyzing Visual Representations in Embodied Navigation Tasks
Erik WijmansJulian StraubDhruv BatraIrfan EssaJudy HoffmanAri Morcos
2020-03-12
Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network
| Jungkyu LeeTaeryun WonTae Kwan LeeHyemin LeeGeonmo GuKiho Hong
2020-01-17
Insights on Visual Representations for Embodied Navigation Tasks
Erik WijmansJulian StraubIrfan EssaDhruv BatraJudy HoffmanAri Morcos
2020-01-01
SaLite : A light-weight model for salient object detection
| Kitty VargheseSauradip Nag
2019-12-08
Crypto-Oriented Neural Architecture Design
| Avital ShafranGil SegevShmuel PelegYedid Hoshen
2019-11-27
A Scalable Multilabel Classification to Deploy Deep Learning Architectures For Edge Devices
Tolulope A. OdetolaOgheneuriri OderhohwoSyed Rafay Hasan
2019-11-05
Offline handwritten mathematical symbol recognition utilising deep learning
Azadeh NazemiNiloofar TavakolianDonal FitzpatrickChandrik a FernandoChing Y. Suen
2019-10-16
Mish: A Self Regularized Non-Monotonic Neural Activation Function
| Diganta Misra
2019-08-23
RRNet: Repetition-Reduction Network for Energy Efficient Decoder of Depth Estimation
Sangyun OhHye-Jin S. KimJongeun LeeJunmo Kim
2019-07-23
Data augmentation with Symbolic-to-Real Image Translation GANs for Traffic Sign Recognition
Nour SoufiMatias Valdenegro-Toro
2019-07-17
Scaling Limit of Neural Networks with the Xavier Initialization and Convergence to a Global Minimum
Justin SirignanoKonstantinos Spiliopoulos
2019-07-09
A deep-learning-based approach for fast and robust steel surface defects classification
Guizhong FuPeize Sun aWenbin ZhuJiangxin YangYanlong CaoMichael Ying YangYanpeng Cao
2019-05-15
American Sign Language Alphabet Recognition using Deep Learning
Nikhil KasukurthiBrij RokadShiv BidaniDr. Aju Dennisan
2019-05-14
HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precision
Zhen DongZhewei YaoAmir GholamiMichael MahoneyKurt Keutzer
2019-04-29
Scaling up deep neural networks: a capacity allocation perspective
Jonathan Donier
2019-03-11
ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs
| Amir GholamiKurt KeutzerGeorge Biros
2019-02-27
Software-Defined FPGA Accelerator Design for Mobile Deep Learning Applications
Panagiotis G. MousouliotisLoukas P. Petrou
2019-02-08
Dynamic Runtime Feature Map Pruning
| Tailin LiangLei WangShaobo ShiJohn Glossner
2018-12-24
Bag of Tricks for Image Classification with Convolutional Neural Networks
| Tong HeZhi ZhangHang ZhangZhongyue ZhangJunyuan XieMu Li
2018-12-04
Identification and Recognition of Rice Diseases and Pests Using Convolutional Neural Networks
Chowdhury Rafeed RahmanPreetom Saha ArkoMohammed Eunus AliMohammad Ashik Iqbal KhanSajid Hasan AponFarzana NowrinAbu Wasif
2018-12-03
NU-LiteNet: Mobile Landmark Recognition using Convolutional Neural Networks
Chakkrit TermritthikunSurachet KanpracharPaisarn Muneesawang
2018-10-02
Constrained Optimization Based Low-Rank Approximation of Deep Neural Networks
| Chong LiC. J. Richard Shi
2018-09-01
DNN Feature Map Compression using Learned Representation over GF(2)
| Denis A. GudovskiyAlec HodgkinsonLuca Rigazio
2018-08-15
PointSeg: Real-Time Semantic Segmentation Based on 3D LiDAR Point Cloud
| Yuan WangTianyue ShiPeng YunLei TaiMing Liu
2018-07-17
BRIEF: Backward Reduction of CNNs with Information Flow Analysis
Yu-Hsun LinChun-Nan ChouEdward Y. Chang
2018-07-16
Fire SSD: Wide Fire Modules based Single Shot Detector on Edge Device
Hengfui LiauNimmagadda YaminiYengLiong Wong
2018-06-14
Deep Neural Networks with Multi-Branch Architectures Are Less Non-Convex
| Hongyang ZhangJunru ShaoRuslan Salakhutdinov
2018-06-06
Study and development of a Computer-Aided Diagnosis system for classification of chest x-ray images using convolutional neural networks pre-trained for ImageNet and data augmentation
Vinicius Pavanelli Vianna
2018-06-03
SqueezeJet: High-level Synthesis Accelerator Design for Deep Convolutional Neural Networks
Panagiotis G. MousouliotisLoukas P. Petrou
2018-05-06
SqueezeNext: Hardware-Aware Neural Network Design
| Amir GholamiKiseok KwonBichen WuZizheng TaiXiangyu YuePeter JinSicheng ZhaoKurt Keutzer
2018-03-23
Task-specific Deep LDA pruning of neural networks
Qing TianTal ArbelJames J. Clark
2018-03-21
Patch-based Fake Fingerprint Detection Using a Fully Convolutional Neural Network with a Small Number of Parameters and an Optimal Threshold
Eunsoo ParkXuenan CuiWeonjin KimJinsong LiuHakil Kim
2018-03-21
Tiny SSD: A Tiny Single-shot Detection Deep Convolutional Neural Network for Real-time Embedded Object Detection
| Alexander WongMohammad Javad ShafieeFrancis LiBrendan Chwyl
2018-02-19
Towards Principled Design of Deep Convolutional Networks: Introducing SimpNet
| Seyyed Hossein HasanpourMohammad RouhaniMohsen FayyazMohammad SabokrouEhsan Adeli
2018-02-17
Stacked Filters Stationary Flow For Hardware-Oriented Acceleration Of Deep Convolutional Neural Networks
Yuechao GaoNianhong LiuSheng Zhang
2018-01-23
SquishedNets: Squishing SqueezeNet further for edge device scenarios via deep evolutionary synthesis
Mohammad Javad ShafieeFrancis LiBrendan ChwylAlexander Wong
2017-11-20
Strengths and Weaknesses of Deep Learning Models for Face Recognition Against Image Degradations
| Klemen GrmVitomir ŠtrucAnais ArtigesMatthieu CaronHazim Kemal Ekenel
2017-10-04
Best Practices in Convolutional Networks for Forward-Looking Sonar Image Recognition
Matias Valdenegro-Toro
2017-09-08
DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devices
Dawei LiXiaolong WangDeguang Kong
2017-08-16
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
| Chen SunAbhinav ShrivastavaSaurabh SinghAbhinav Gupta
2017-07-10
Using Convolutional Neural Networks in Robots with Limited Computational Resources: Detecting NAO Robots while Playing Soccer
Nicolás CruzKenzo Lobos-TsunekawaJavier Ruiz-del-Solar
2017-06-20
The Compressed Model of Residual CNDS
Hussam QassimDavid FeinzimerAbhishek Verma
2017-06-15
Deep Convolutional Neural Network Inference with Floating-point Weights and Fixed-point Activations
Liangzhen LaiNaveen SudaVikas Chandra
2017-03-08
Fast and Energy-Efficient CNN Inference on IoT Devices
Mohammad MotamediDaniel FongSoheil Ghiasi
2016-11-22
Maximizing CNN Accelerator Efficiency Through Resource Partitioning
Yongming ShenMichael FerdmanPeter Milder
2016-06-30
FractalNet: Ultra-Deep Neural Networks without Residuals
| Gustav LarssonMichael MaireGregory Shakhnarovich
2016-05-24
Ristretto: Hardware-Oriented Approximation of Convolutional Neural Networks
| Philipp Gysel
2016-05-20
Hardware-oriented Approximation of Convolutional Neural Networks
Philipp GyselMohammad MotamediSoheil Ghiasi
2016-04-11
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
| Forrest N. IandolaSong HanMatthew W. MoskewiczKhalid AshrafWilliam J. DallyKurt Keutzer
2016-02-24
Very Deep Convolutional Networks for Large-Scale Image Recognition
| Karen SimonyanAndrew Zisserman
2014-09-04

Tasks

TASK PAPERS SHARE
Image Classification 11 16.42%
Object Detection 11 16.42%
Semantic Segmentation 5 7.46%
Autonomous Driving 2 2.99%
Pose Estimation 2 2.99%
Quantization 2 2.99%
Object Recognition 2 2.99%
Face Recognition 2 2.99%
Face Verification 2 2.99%

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories