Search Results for author: Mingyang Deng

Found 2 papers, 1 papers with code

Measuring Feature Sparsity in Language Models

no code implementations11 Oct 2023 Mingyang Deng, Lucas Tao, Joe Benton

We show our metrics can predict the level of sparsity on synthetic sparse linear activations, and can distinguish between sparse linear data and several other distributions.

Language Modelling

Restart Sampling for Improving Generative Processes

1 code implementation NeurIPS 2023 Yilun Xu, Mingyang Deng, Xiang Cheng, Yonglong Tian, Ziming Liu, Tommi Jaakkola

Restart not only outperforms the previous best SDE results, but also accelerates the sampling speed by 10-fold / 2-fold on CIFAR-10 / ImageNet $64 \times 64$.

Attribute

Cannot find the paper you are looking for? You can Submit a new open access paper.