no code implementations • 8 Feb 2022 • Alnur Ali, Maxime Cauchois, John C. Duchi
The statistical machine learning community has demonstrated considerable resourcefulness over the years in developing highly expressive tools for estimation, prediction, and inference.
no code implementations • 20 Jan 2022 • Maxime Cauchois, Suyash Gupta, Alnur Ali, John Duchi
The expense of acquiring labels in large-scale statistical machine learning makes partially and weakly-labeled data attractive, though it is not always apparent how to leverage such data for model fitting or validation.
no code implementations • 20 Jan 2022 • Yue Sheng, Alnur Ali
Acceleration and momentum are the de facto standard in modern applications of machine learning and optimization, yet the bulk of the work on implicit regularization focuses instead on unaccelerated methods.
1 code implementation • 3 Mar 2021 • Akshay Agrawal, Alnur Ali, Stephen Boyd
Our software scales to data sets with millions of items and tens of millions of distortion functions.
no code implementations • 10 Aug 2020 • Maxime Cauchois, Suyash Gupta, Alnur Ali, John C. Duchi
One strategy -- coming from robust statistics and optimization -- is thus to build a model robust to distributional perturbations.
no code implementations • ICML 2020 • Alnur Ali, Edgar Dobriban, Ryan J. Tibshirani
We study the implicit regularization of mini-batch stochastic gradient descent, when applied to the fundamental problem of least squares regression.
no code implementations • 23 Oct 2018 • Alnur Ali, J. Zico Kolter, Ryan J. Tibshirani
Our primary focus is to compare the risk of gradient flow to that of ridge regression.
1 code implementation • 30 Oct 2017 • Penporn Koanantakool, Alnur Ali, Ariful Azad, Aydin Buluc, Dmitriy Morozov, Leonid Oliker, Katherine Yelick, Sang-Yun Oh
Across a variety of scientific disciplines, sparse inverse covariance estimation is a popular tool for capturing the underlying dependency relationships in multivariate data.