Learning Curves for Deep Neural Networks: A field theory perspective

no code implementations • 25 Sep 2019 • Omry Cohen, Or Malka, Zohar Ringel

A series of recent works established a rigorous correspondence between very wide deep neural networks (DNNs), trained in a particular manner, and noiseless Bayesian Inference with a certain Gaussian Process (GP) known as the Neural Tangent Kernel (NTK).

Bayesian Inference

Learning Curves for Deep Neural Networks: A Gaussian Field Theory Perspective

no code implementations • 12 Jun 2019 • Omry Cohen, Or Malka, Zohar Ringel

In the past decade, deep neural networks (DNNs) came to the fore as the leading machine learning algorithms for a variety of tasks.

Bayesian Inference Gaussian Processes