no code implementations • 11 Mar 2024 • Kedar Karhadkar, Erin George, Michael Murray, Guido Montúfar, Deanna Needell
The problem of benign overfitting asks whether it is possible for a model to perfectly fit noisy training data and still generalize well.
no code implementations • 31 May 2023 • Kedar Karhadkar, Michael Murray, Hanna Tseran, Guido Montúfar
We study the loss landscape of both shallow and deep, mildly overparameterized ReLU neural networks on a generic finite input dataset for the squared error loss.
1 code implementation • 21 Oct 2022 • Kedar Karhadkar, Pradeep Kr. Banerjee, Guido Montúfar
On the other hand, adding edges to the message-passing graph can lead to increasingly similar node representations and a problem known as oversmoothing.
1 code implementation • 6 Aug 2022 • Pradeep Kr. Banerjee, Kedar Karhadkar, Yu Guang Wang, Uri Alon, Guido Montúfar
We compare the spectral expansion properties of our algorithm with that of an existing curvature-based non-local rewiring strategy.