Search Results for author: Stephen Zhao

Found 3 papers, 3 papers with code

Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo

1 code implementation26 Apr 2024 Stephen Zhao, Rob Brekelmans, Alireza Makhzani, Roger Grosse

Numerous capability and safety techniques of Large Language Models (LLMs), including RLHF, automated red-teaming, prompt engineering, and infilling, can be cast as sampling from an unnormalized target distribution defined by a given reward or potential function over the full sequence.

Language Modelling Prompt Engineering

Proximal Learning With Opponent-Learning Awareness

1 code implementation18 Oct 2022 Stephen Zhao, Chris Lu, Roger Baker Grosse, Jakob Nicolaus Foerster

This problem is especially pronounced in the opponent modeling setting, where the opponent's policy is unknown and must be inferred from observations; in such settings, LOLA is ill-specified because behaviorally equivalent opponent policies can result in non-equivalent updates.

Multi-agent Reinforcement Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.