Search Results for author: Joe O'Connor

Found 2 papers, 2 papers with code

PromptBoosting: Black-Box Text Classification with Ten Forward Passes

2 code implementations19 Dec 2022 Bairu Hou, Joe O'Connor, Jacob Andreas, Shiyu Chang, Yang Zhang

Instead of directly optimizing in prompt space, PromptBoosting obtains a small pool of prompts via a gradient-free approach and then constructs a large pool of weak learners by pairing these prompts with different elements of the LM's output distribution.

Language Modelling text-classification +1

What Context Features Can Transformer Language Models Use?

1 code implementation ACL 2021 Joe O'Connor, Jacob Andreas

Transformer-based language models benefit from conditioning on contexts of hundreds to thousands of previous tokens.

Cannot find the paper you are looking for? You can Submit a new open access paper.