no code implementations • 20 Mar 2024 • Alessandro Favero, Luca Zancato, Matthew Trager, Siddharth Choudhary, Pramuditha Perera, Alessandro Achille, Ashwin Swaminathan, Stefano Soatto
In particular, we show that as more tokens are generated, the reliance on the visual prompt decreases, and this behavior strongly correlates with the emergence of hallucinations.
1 code implementation • 26 Feb 2024 • Antonio Sclocchi, Alessandro Favero, Matthieu Wyart
We find that the backward diffusion process acting after a time $t$ is governed by a phase transition at some threshold time, where the probability of reconstructing high-level features, like the class of an image, suddenly drops.
1 code implementation • 5 Jul 2023 • Francesco Cagnetta, Leonardo Petrini, Umberto M. Tomasini, Alessandro Favero, Matthieu Wyart
The model is a classification task where each class corresponds to a group of high-level features, chosen among several equivalent groups associated with the same class.
1 code implementation • NeurIPS 2023 • Guillermo Ortiz-Jimenez, Alessandro Favero, Pascal Frossard
Task arithmetic has recently emerged as a cost-effective and scalable approach to edit pre-trained models directly in weight space: By adding the fine-tuned weights of different tasks, the model's performance can be improved on these tasks, while negating them leads to task forgetting.
1 code implementation • 1 Aug 2022 • Francesco Cagnetta, Alessandro Favero, Matthieu Wyart
Interestingly, we find that, despite their hierarchical structure, the functions generated by infinitely-wide deep CNNs are too rich to be efficiently learnable in high dimension.
no code implementations • NeurIPS 2021 • Alessandro Favero, Francesco Cagnetta, Matthieu Wyart
Convolutional neural networks perform a local and translationally-invariant treatment of the data: quantifying which of these two aspects is central to their success remains a challenge.
2 code implementations • NeurIPS 2021 • Leonardo Petrini, Alessandro Favero, Mario Geiger, Matthieu Wyart
Understanding why deep nets can classify data in large dimensions remains a challenge.