Search Results for author: Aneel Damaraju

Found 2 papers, 0 papers with code

Shallow Univariate ReLu Networks as Splines: Initialization, Loss Surface, Hessian, & Gradient Flow Dynamics

no code implementations4 Aug 2020 Justin Sahs, Ryan Pyle, Aneel Damaraju, Josue Ortega Caro, Onur Tavaslioglu, Andy Lu, Ankit Patel

Our implicit regularization results are complementary to recent work arXiv:1906. 07842, done independently, which showed that initialization scale critically controls implicit regularization via a kernel-based argument.

Inductive Bias

A Functional Characterization of Randomly Initialized Gradient Descent in Deep ReLU Networks

no code implementations25 Sep 2019 Justin Sahs, Aneel Damaraju, Ryan Pyle, Onur Tavaslioglu, Josue Ortega Caro, Hao Yang Lu, Ankit Patel

Despite their popularity and successes, deep neural networks are poorly understood theoretically and treated as 'black box' systems.

Cannot find the paper you are looking for? You can Submit a new open access paper.