1 code implementation • 5 Dec 2023 • Michael Igorevich Ivanitskiy, Alex F. Spies, Tilman Räuker, Guillaume Corlouer, Chris Mathwin, Lucia Quirke, Can Rager, Rusheb Shah, Dan Valentine, Cecilia Diniz Behn, Katsumi Inoue, Samy Wu Fung
Transformer models underpin many recent advances in practical machine learning applications, yet understanding their internal behavior continues to elude researchers.
1 code implementation • 19 Sep 2023 • Michael Igorevich Ivanitskiy, Rusheb Shah, Alex F. Spies, Tilman Räuker, Dan Valentine, Can Rager, Lucia Quirke, Chris Mathwin, Guillaume Corlouer, Cecilia Diniz Behn, Samy Wu Fung
Understanding how machine learning models respond to distributional shifts is a key research challenge.
2 code implementations • 31 Jan 2023 • Daniel Mckenzie, Samy Wu Fung, Howard Heaton
In many applications, a combinatorial problem must be repeatedly solved with similar, but distinct parameters.
1 code implementation • 30 Nov 2022 • Alexander Vidal, Samy Wu Fung, Luis Tenorio, Stanley Osher, Levon Nurbekyan
Instead of tuning $\alpha$, we repeatedly solve the optimization problem for a fixed $\alpha$ effectively performing a JKO update with a time-step $\alpha$.
no code implementations • 29 Apr 2022 • Howard Heaton, Samy Wu Fung
Indecipherable black boxes are common in machine learning (ML), but applications increasingly require explainable artificial intelligence (XAI).
Explainable artificial intelligence Explainable Artificial Intelligence (XAI)
1 code implementation • 2 Jun 2021 • Daniel Mckenzie, Howard Heaton, Qiuwei Li, Samy Wu Fung, Stanley Osher, Wotao Yin
Systems of competing agents can often be modeled as games.
1 code implementation • 29 Apr 2021 • Howard Heaton, Samy Wu Fung, Aviv Gibali, Wotao Yin
This is accomplished using feasibility-based fixed point networks (F-FPNs).
2 code implementations • 23 Mar 2021 • Samy Wu Fung, Howard Heaton, Qiuwei Li, Daniel Mckenzie, Stanley Osher, Wotao Yin
Unlike traditional networks, implicit networks solve a fixed point equation to compute inferences.
1 code implementation • 9 Nov 2020 • Derek Onken, Levon Nurbekyan, Xingjian Li, Samy Wu Fung, Stanley Osher, Lars Ruthotto
Our approach is grid-free and scales efficiently to dimensions where grids become impractical or infeasible.
Optimization and Control
2 code implementations • 5 Aug 2020 • Howard Heaton, Samy Wu Fung, Alex Tong Lin, Stanley Osher, Wotao Yin
To bridge this gap, we present a new algorithm that takes samples from the manifold of true data as input and outputs an approximation of the projection operator onto this manifold.
3 code implementations • 29 May 2020 • Derek Onken, Samy Wu Fung, Xingjian Li, Lars Ruthotto
On five high-dimensional density estimation and generative modeling tasks, OT-Flow performs competitively to state-of-the-art CNFs while on average requiring one-fourth of the number of weights with an 8x speedup in training time and 24x speedup in inference.
1 code implementation • 27 May 2020 • Kelvin Kan, Samy Wu Fung, Lars Ruthotto
We present an interior point method to solve the quadratic projection problem efficiently.
Numerical Analysis Numerical Analysis
1 code implementation • 24 Feb 2020 • Alex Tong Lin, Samy Wu Fung, Wuchen Li, Levon Nurbekyan, Stanley J. Osher
By phrasing the problem in this manner, solving the MFG can be interpreted as a special case of training a generative adversarial network (GAN).
1 code implementation • 4 Dec 2019 • Lars Ruthotto, Stanley Osher, Wuchen Li, Levon Nurbekyan, Samy Wu Fung
State-of-the-art numerical methods for solving such problems utilize spatial discretization that leads to a curse-of-dimensionality.
1 code implementation • 27 Jan 2019 • Samy Wu Fung, Sanna Tyrväinen, Lars Ruthotto, Eldad Haber
Solution of the least-squares problem can be be accelerated by pre-computing a factorization or preconditioner, and the separability in the smooth, convex problem can be easily parallelized across examples.