Robust Second-Order Nonconvex Optimization and Its Application to Low Rank Matrix Sensing

no code implementations • NeurIPS 2023 • Shuyao Li, Yu Cheng, Ilias Diakonikolas, Jelena Diakonikolas, Rong Ge, Stephen J. Wright

We introduce a general framework for efficiently finding an approximate SOSP with \emph{dimension-independent} accuracy guarantees, using $\widetilde{O}({D^2}/{\epsilon})$ samples where $D$ is the ambient dimension and $\epsilon$ is the fraction of corrupted datapoints.

DAIL: Data Augmentation for In-Context Learning via Self-Paraphrase

no code implementations • 6 Nov 2023 • Dawei Li, Yaxuan Li, Dheeraj Mekala, Shuyao Li, Yulin Wang, Xueqi Wang, William Hogan, Jingbo Shang

DAIL leverages the intuition that large language models are more familiar with the content generated by themselves.

Data Augmentation In-Context Learning +1

A randomized algorithm for nonconvex minimization with inexact evaluations and complexity guarantees

no code implementations • 28 Oct 2023 • Shuyao Li, Stephen J. Wright

We consider minimization of a smooth nonconvex function with inexact oracle access to gradient and Hessian (without assuming access to the function value) to achieve approximate second-order optimality.