1 code implementation • ICML 2020 • Romain Cosentino, Behnaam Aazhang
This framework allows us to generalize classical time-frequency transformations such as the Wavelet Transform, and to efficiently learn the representation of signals.
1 code implementation • 4 Dec 2023 • Randall Balestriero, Romain Cosentino, Sarath Shekkizhar
We obtain in closed form (i) the intrinsic dimension in which the Multi-Head Attention embeddings are constrained to exist and (ii) the partition and per-region affine mappings of the per-layer feedforward networks.
no code implementations • 18 Sep 2022 • Romain Cosentino, Sarath Shekkizhar, Mahdi Soltanolkotabi, Salman Avestimehr, Antonio Ortega
Self-supervised learning (SSL) has emerged as a desirable paradigm in computer vision due to the inability of supervised models to learn representations that can generalize in domains with limited labels.
no code implementations • 13 May 2022 • Romain Cosentino, Anirvan Sengupta, Salman Avestimehr, Mahdi Soltanolkotabi, Antonio Ortega, Ted Willke, Mariano Tepper
When used for transfer learning, the projector is discarded since empirical results show that its representation generalizes more poorly than the encoder's.
no code implementations • 16 Feb 2022 • Romain Cosentino, Randall Balestriero, Yanis Bahroun, Anirvan Sengupta, Richard Baraniuk, Behnaam Aazhang
This enables (i) the reduction of intrinsic nuisances associated with the data, reducing the complexity of the clustering task and increasing performances and producing state-of-the-art results, (ii) clustering in the input space of the data, leading to a fully interpretable clustering algorithm, and (iii) the benefit of convergence guarantees.
no code implementations • 16 Dec 2020 • Romain Cosentino, Randall Balestriero, Yanis Bahroun, Anirvan Sengupta, Richard Baraniuk, Behnaam Aazhang
We design an interpretable clustering algorithm aware of the nonlinear structure of image manifolds.
no code implementations • 14 Dec 2020 • Romain Cosentino, Randall Balestriero
The SMF-DSN enhances the DSN by (i) increasing the diversity of the scattering coefficients and (ii) improves its robustness with respect to non-stationary noise.
no code implementations • 10 Dec 2020 • Anton Banta, Romain Cosentino, Mathews M John, Allison Post, Skyler Buchan, Mehdi Razavi, Behnaam Aazhang
We will achieve this goal with 12-lead ECG reconstruction and by providing a new diagnostic tool for classifying atypical heartbeats.
no code implementations • 20 Sep 2020 • Romain Cosentino, Randall Balestriero, Richard Baraniuk, Behnaam Aazhang
Our regularizations leverage recent advances in the group of transformation learning to enable AEs to better approximate the data manifold without explicitly defining the group underlying the manifold.
1 code implementation • NeurIPS 2019 • Randall Balestriero, Romain Cosentino, Behnaam Aazhang, Richard Baraniuk
The subdivision process constrains the affine maps on the (exponentially many) power diagram regions to greatly reduce their complexity.
no code implementations • ICML 2018 • Randall Balestriero, Romain Cosentino, Herve Glotin, Richard Baraniuk
We propose to tackle the problem of end-to-end learning for raw waveform signals by introducing learnable continuous time-frequency atoms.
no code implementations • 25 Dec 2017 • Romain Cosentino, Randall Balestriero, Richard Baraniuk, Ankit Patel
In this work, we derive a generic overcomplete frame thresholding scheme based on risk minimization.