Search Results for author: Shufan Wang

Found 13 papers, 5 papers with code

Online Restless Multi-Armed Bandits with Long-Term Fairness Constraints

no code implementations16 Dec 2023 Shufan Wang, Guojun Xiong, Jian Li

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints.

Decision Making Fairness +2

KNN-LM Does Not Improve Open-ended Text Generation

no code implementations24 May 2023 Shufan Wang, Yixiao Song, Andrew Drozdov, Aparna Garimella, Varun Manjunatha, Mohit Iyyer

Digging deeper, we find that interpolating with a retrieval distribution actually increases perplexity compared to a baseline Transformer LM for the majority of tokens in the WikiText-103 test set, even though the overall perplexity is lower due to a smaller number of tokens for which perplexity dramatically decreases after interpolation.

Retrieval Text Generation

Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing

no code implementations24 May 2023 Shufan Wang, Sebastien Jean, Sailik Sengupta, James Gung, Nikolaos Pappas, Yi Zhang

In executable task-oriented semantic parsing, the system aims to translate users' utterances in natural language to machine-interpretable programs (API calls) that can be executed according to pre-defined API specifications.

In-Context Learning Retrieval +2

You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM

1 code implementation28 Oct 2022 Andrew Drozdov, Shufan Wang, Razieh Rahimi, Andrew McCallum, Hamed Zamani, Mohit Iyyer

Retrieval-enhanced language models (LMs), which condition their predictions on text retrieved from large external datastores, have recently shown significant perplexity improvements compared to standard LMs.

Language Modelling Retrieval +2

Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding

1 code implementation7 Oct 2022 Zhichao Yang, Shufan Wang, Bhanu Pratap Singh Rawat, Avijit Mitra, Hong Yu

Automatic International Classification of Diseases (ICD) coding aims to assign multiple ICD codes to a medical note with average length of 3, 000+ tokens.

Contrastive Learning Medical Code Prediction

Modeling Exemplification in Long-form Question Answering via Retrieval

no code implementations NAACL 2022 Shufan Wang, Fangyuan Xu, Laure Thompson, Eunsol Choi, Mohit Iyyer

We show that not only do state-of-the-art LFQA models struggle to generate relevant examples, but also that standard evaluation metrics such as ROUGE are insufficient to judge exemplification quality.

Long Form Question Answering Retrieval

Whittle Index based Q-Learning for Wireless Edge Caching with Linear Function Approximation

no code implementations26 Feb 2022 Guojun Xiong, Shufan Wang, Jian Li, Rahul Singh

Using this structural result, we establish the indexability of our problem, and employ the Whittle index policy to minimize average latency.

Edge-computing Q-Learning +1

Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration

1 code implementation EMNLP 2021 Shufan Wang, Laure Thompson, Mohit Iyyer

Phrase representations derived from BERT often do not exhibit complex phrasal compositionality, as the model relies instead on lexical similarity to determine semantic relatedness.

Paraphrase Generation Topic Models

Achieving Adversarial Robustness via Sparsity

no code implementations11 Sep 2020 Shufan Wang, Ningyi Liao, Liyao Xiang, Nanyang Ye, Quanshi Zhang

Through experiments on a variety of adversarial pruning methods, we find that weights sparsity will not hurt but improve robustness, where both weights inheritance from the lottery ticket and adversarial training improve model robustness in network pruning.

Adversarial Robustness Network Pruning

Parametric Bootstrap for Differentially Private Confidence Intervals

no code implementations14 Jun 2020 Cecilia Ferrando, Shufan Wang, Daniel Sheldon

The goal of this paper is to develop a practical and general-purpose approach to construct confidence intervals for differentially private parametric estimation.

Online Algorithms for Multi-shop Ski Rental with Machine Learned Advice

1 code implementation NeurIPS 2020 Shufan Wang, Jian Li, Shiqiang Wang

We obtain both deterministic and randomized online algorithms with provably improved performance when either a single or multiple ML predictions are used to make decisions.

Decision Making

Casting Light on Invisible Cities: Computationally Engaging with Literary Criticism

no code implementations NAACL 2019 Shufan Wang, Mohit Iyyer

Literary critics often attempt to uncover meaning in a single work of literature through careful reading and analysis.

Cannot find the paper you are looking for? You can Submit a new open access paper.