no code implementations • 4 Aug 2020 • Justin Sahs, Ryan Pyle, Aneel Damaraju, Josue Ortega Caro, Onur Tavaslioglu, Andy Lu, Ankit Patel
Our implicit regularization results are complementary to recent work arXiv:1906. 07842, done independently, which showed that initialization scale critically controls implicit regularization via a kernel-based argument.
no code implementations • 25 Sep 2019 • Justin Sahs, Aneel Damaraju, Ryan Pyle, Onur Tavaslioglu, Josue Ortega Caro, Hao Yang Lu, Ankit Patel
Despite their popularity and successes, deep neural networks are poorly understood theoretically and treated as 'black box' systems.