Search Results for author: Adam Klukowski

Found 3 papers, 0 papers with code

Exact Count of Boundary Pieces of ReLU Classifiers: Towards the Proper Complexity Measure for Classification

no code implementations15 Jun 2023 Paweł Piwek, Adam Klukowski, Tianyang Hu

Classic learning theory suggests that proper regularization is the key to good generalization and robustness.

Learning Theory

Rate of Convergence of Polynomial Networks to Gaussian Processes

no code implementations4 Nov 2021 Adam Klukowski

For networks with a polynomial activation, we demonstrate that the rate of this convergence in 2-Wasserstein metric is $O(n^{-\frac{1}{2}})$, where $n$ is the number of hidden neurons.

Gaussian Processes

Gradient Explosion and Representation Shrinkage in Infinite Networks

no code implementations29 Sep 2021 Adam Klukowski

We study deep fully-connected neural networks using the mean field formalism, and carry out a non-perturbative analysis of signal propagation.

Cannot find the paper you are looking for? You can Submit a new open access paper.