Search Results for author:
Found 6 papers, 4 papers with code
Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels
On single-turn dialogue and summarization, a SAMI-trained mistral-7b outperforms the initial pretrained model, with win rates between 66% and 77%.
Procedural Dilemma Generation for Evaluating Moral Reasoning in Humans and Language Models
We collected moral permissibility and intention judgments from human participants for a subset of our items and compared these judgments to those from two language models (GPT-4 and Claude-2) across eight conditions.
STaR-GATE: Teaching Language Models to Ask Clarifying Questions
After two iterations of self-improvement, the Questioner asks better questions, allowing it to generate responses that are preferred over responses from the initial model on 72% of tasks.
Social Contract AI: Aligning AI Assistants with Implicit Group Norms
We explore the idea of aligning an AI assistant by inverting a model of users' (unknown) preferences from observed interactions.
Understanding Social Reasoning in Language Models with Language Models
Using our framework, we create a new social reasoning benchmark (BigToM) for LLMs which consists of 25 controls and 5, 000 model-written evaluations.
