Active Importance Sampling for Variational Objectives Dominated by Rare Events: Consequences for Optimization and Generalization

1 code implementation • 11 Aug 2020 • Grant M. Rotskoff, Andrew R. Mitchell, Eric Vanden-Eijnden

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with dimensionality.

BIG-bench Machine Learning Learning Theory