Search Results for author: Howard Chen

Found 14 papers, 11 papers with code

Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading

no code implementations8 Oct 2023 Howard Chen, Ramakanth Pasunuru, Jason Weston, Asli Celikyilmaz

Large language models (LLMs) have advanced in large strides due to the effectiveness of the self-attention mechanism that processes and compares all tokens at once.

Question Answering Retrieval

COLLIE: Systematic Construction of Constrained Text Generation Tasks

1 code implementation17 Jul 2023 Shunyu Yao, Howard Chen, Austin W. Hanjie, Runzhe Yang, Karthik Narasimhan

Text generation under constraints have seen increasing interests in natural language processing, especially with the rapidly improving capabilities of large language models.

Logical Reasoning Sentence +1

C-STS: Conditional Semantic Textual Similarity

1 code implementation24 May 2023 Ameet Deshpande, Carlos E. Jimenez, Howard Chen, Vishvak Murahari, Victoria Graf, Tanmay Rajpurohit, Ashwin Kalyan, Danqi Chen, Karthik Narasimhan

Semantic textual similarity (STS), a cornerstone task in NLP, measures the degree of similarity between a pair of sentences, and has broad application in fields such as information retrieval and natural language understanding.

Information Retrieval Language Modelling +8

What In-Context Learning "Learns" In-Context: Disentangling Task Recognition and Task Learning

1 code implementation16 May 2023 Jane Pan, Tianyu Gao, Howard Chen, Danqi Chen

Large language models (LLMs) exploit in-context learning (ICL) to solve tasks with only a few demonstrations, but its mechanisms are not yet well-understood.

In-Context Learning

Controllable Text Generation with Language Constraints

no code implementations20 Dec 2022 Howard Chen, Huihan Li, Danqi Chen, Karthik Narasimhan

We consider the task of text generation in language models with constraints specified in natural language.

Attribute Language Modelling +1

WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

1 code implementation4 Jul 2022 Shunyu Yao, Howard Chen, John Yang, Karthik Narasimhan

Existing benchmarks for grounding language in interactive environments either lack real-world linguistic elements, or prove difficult to scale up due to substantial human involvement in the collection of data or feedback signals.

Imitation Learning Navigate

Can Rationalization Improve Robustness?

1 code implementation NAACL 2022 Howard Chen, Jacqueline He, Karthik Narasimhan, Danqi Chen

Our experiments reveal that the rationale models show the promise to improve robustness, while they struggle in certain scenarios--when the rationalizer is sensitive to positional bias or lexical choices of attack text.

Sentence

Non-Parametric Few-Shot Learning for Word Sense Disambiguation

1 code implementation NAACL 2021 Howard Chen, Mengzhou Xia, Danqi Chen

One significant challenge in supervised all-words WSD is to classify among senses for a majority of words that lie in the long-tail distribution.

Few-Shot Learning Word Sense Disambiguation

Persistence of Flare-Driven Atmospheric Chemistry on Rocky Habitable Zone Worlds

no code implementations12 Jan 2021 Howard Chen, Zhuchang Zhan, Allison Youngblood, Eric T. Wolf, Adina D. Feinstein, Daniel E. Horton

Low-mass stars show evidence of vigorous magnetic activity in the form of large flares and coronal mass ejections.

Earth and Planetary Astrophysics Solar and Stellar Astrophysics

Autoregressive Knowledge Distillation through Imitation Learning

2 code implementations EMNLP 2020 Alexander Lin, Jeremy Wohlwend, Howard Chen, Tao Lei

The performance of autoregressive models on natural language generation tasks has dramatically improved due to the adoption of deep, self-attentive architectures.

Imitation Learning Knowledge Distillation +3

Cannot find the paper you are looking for? You can Submit a new open access paper.