Search Results for author: Weiyan Shi

Found 33 papers, 14 papers with code

Towards Socially Intelligent Agents with Mental State Transition and Human Value

no code implementations SIGDIAL (ACL) 2022 Liang Qiu, Yizhou Zhao, Yuan Liang, Pan Lu, Weiyan Shi, Zhou Yu, Song-Chun Zhu

One of which is to track the agent’s mental state transition and teach the agent to make decisions guided by its value like a human.

CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

1 code implementation23 Apr 2024 Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Chunhua yu, Raya Horesh, Rogério Abreu de Paula, Diyi Yang

To enhance language models' cultural awareness, we design a generalizable pipeline to construct cultural knowledge bases from different online communities on a massive scale.

Language Modelling

Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future

no code implementations28 Feb 2024 Minzhi Li, Weiyan Shi, Caleb Ziems, Diyi Yang

As Natural Language Processing (NLP) systems become increasingly integrated into human social life, these technologies will need to increasingly rely on social intelligence.

The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

no code implementations14 Feb 2024 Myeongseob Ko, Feiyang Kang, Weiyan Shi, Ming Jin, Zhou Yu, Ruoxi Jia

Inspired by this, we introduce a new method for estimating the influence of training data, which requires calculating gradients for specific test samples, paired with a forward pass for each training point.

Memorization

How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs

1 code implementation12 Jan 2024 Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang, Ruoxi Jia, Weiyan Shi

This paper introduces a new perspective to jailbreak LLMs as human-like communicators, to explore this overlooked intersection between everyday language interaction and AI safety.

The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversation

no code implementations14 Dec 2023 Rongwu Xu, Brian S. Lin, Shujian Yang, Tianqi Zhang, Weiyan Shi, Tianwei Zhang, Zhixuan Fang, Wei Xu, Han Qiu

Therefore, in this study, we delve into LLMs' susceptibility to persuasive conversations, particularly on factual questions that they can answer correctly.

Misinformation

Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach

no code implementations16 Nov 2023 Yanchen Liu, Mingyu Derek Ma, Wenna Qin, Azure Zhou, Jiaao Chen, Weiyan Shi, Wei Wang, Diyi Yang

Using COVID-19 as a testbed domain, our experiments demonstrate a significant alignment between the susceptibility scores estimated by our computational modeling and human judgments, confirming the effectiveness of this latent modeling approach.

Misinformation

Controllable Mixed-Initiative Dialogue Generation through Prompting

1 code implementation6 May 2023 Maximillian Chen, Xiao Yu, Weiyan Shi, Urvi Awasthi, Zhou Yu

The standard approach has been fine-tuning pre-trained language models to perform generation conditioned on these intents.

Dialogue Generation

When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels

no code implementations28 Oct 2022 Weiyan Shi, Emily Dinan, Kurt Shuster, Jason Weston, Jing Xu

Deployed dialogue agents have the potential to integrate human feedback to continuously improve themselves.

Chatbot

Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks

no code implementations11 Oct 2022 Kushal Chawla, Weiyan Shi, Jingwen Zhang, Gale Lucas, Zhou Yu, Jonathan Gratch

Dialogue systems capable of social influence such as persuasion, negotiation, and therapy, are essential for extending the use of technology to numerous realistic scenarios.

Just Fine-tune Twice: Selective Differential Privacy for Large Language Models

1 code implementation15 Apr 2022 Weiyan Shi, Ryan Shea, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu

Utilizing the fact that sensitive information in language data tends to be sparse, Shi et al. (2021) formalized a DP notion extension called Selective Differential Privacy (SDP) to protect only the sensitive tokens defined by a policy function.

Seamlessly Integrating Factual Information and Social Content with Persuasive Dialogue

no code implementations15 Mar 2022 Maximillian Chen, Weiyan Shi, Feifan Yan, Ryan Hou, Jingwen Zhang, Saurav Sahay, Zhou Yu

Complex conversation settings such as persuasion involve communicating changes in attitude or behavior, so users' perspectives need to be addressed, even when not directly related to the topic.

Chatbot

Selective Differential Privacy for Language Modeling

1 code implementation NAACL 2022 Weiyan Shi, Aiqi Cui, Evan Li, Ruoxi Jia, Zhou Yu

Given that the private information in natural language is sparse (for example, the bulk of an email might not carry personally identifiable information), we propose a new privacy notion, selective differential privacy, to provide rigorous privacy guarantees on the sensitive portion of the data to improve model utility.

Language Modelling Privacy Preserving

LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing

1 code implementation ACL 2021 Yu Li, Josh Arnold, Feifan Yan, Weiyan Shi, Zhou Yu

We present LEGOEval, an open-source toolkit that enables researchers to easily evaluate dialogue systems in a few lines of code using the online crowdsource platform, Amazon Mechanical Turk.

DEUX: An Attribute-Guided Framework for Sociable Recommendation Dialog Systems

no code implementations16 Apr 2021 Yu Li, Shirley Anugrah Hayati, Weiyan Shi, Zhou Yu

It is important for sociable recommendation dialog systems to perform as both on-task content and social content to engage users and gain their favor.

Attribute dialog state tracking +1

Towards Socially Intelligent Agents with Mental State Transition and Human Utility

no code implementations12 Mar 2021 Liang Qiu, Yizhou Zhao, Yuan Liang, Pan Lu, Weiyan Shi, Zhou Yu, Song-Chun Zhu

One of which is to track the agent's mental state transition and teach the agent to make decisions guided by its value like a human.

Refine and Imitate: Reducing Repetition and Inconsistency in Dialogue Generation via Reinforcement Learning and Human Demonstration

no code implementations1 Jan 2021 Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu

Despite the recent success of large-scale language models on various downstream NLP tasks, the repetition and inconsistency problems still persist in dialogue response generation.

Dialogue Generation Language Modelling +2

Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human Demonstration

no code implementations Findings (EMNLP) 2021 Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu

Persuasion dialogue systems reflect the machine's ability to make strategic moves beyond verbal communication, and therefore differentiate themselves from task-oriented or open-domain dialogue systems and have their own unique values.

Language Modelling Reinforcement Learning (RL) +2

INSPIRED: Toward Sociable Recommendation Dialog Systems

1 code implementation EMNLP 2020 Shirley Anugrah Hayati, Dongyeop Kang, Qingxiaoyang Zhu, Weiyan Shi, Zhou Yu

To better understand how humans make recommendations in communication, we design an annotation scheme related to recommendation strategies based on social science theories and annotate these dialogs.

Movie Recommendation

Structured Attention for Unsupervised Dialogue Structure Induction

1 code implementation EMNLP 2020 Liang Qiu, Yizhou Zhao, Weiyan Shi, Yuan Liang, Feng Shi, Tao Yuan, Zhou Yu, Song-Chun Zhu

Inducing a meaningful structural representation from one or a set of dialogues is a crucial but challenging task in computational linguistics.

Inductive Bias Sentence +1

A Tailored Pre-Training Model for Task-Oriented Dialog Generation

1 code implementation24 Apr 2020 Jing Gu, Qingyang Wu, Chongruo wu, Weiyan Shi, Zhou Yu

The recent success of large pre-trained language models such as BERT and GPT-2 has suggested the effectiveness of incorporating language priors in downstream dialog generation tasks.

Knowledge Distillation Language Modelling +1

End-to-End Trainable Non-Collaborative Dialog System

1 code implementation25 Nov 2019 Yu Li, Kun Qian, Weiyan Shi, Zhou Yu

End-to-end task-oriented dialog models have achieved promising performance on collaborative tasks where users willingly coordinate with the system to complete a given task.

Sentence

How to Build User Simulators to Train RL-based Dialog Systems

1 code implementation IJCNLP 2019 Weiyan Shi, Kun Qian, Xuewei Wang, Zhou Yu

We propose a method of standardizing user simulator building that can be used by the community to compare dialog system quality using the same set of user simulators fairly.

Reinforcement Learning (RL) User Simulation

Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good

3 code implementations ACL 2019 Xuewei Wang, Weiyan Shi, Richard Kim, Yoojung Oh, Sijia Yang, Jingwen Zhang, Zhou Yu

Developing intelligent persuasive conversational agents to change people's opinions and actions for social good is the frontier in advancing the ethical development of automated dialogue systems.

Persuasion Strategies Sentence

Unsupervised Dialog Structure Learning

1 code implementation NAACL 2019 Weiyan Shi, Tiancheng Zhao, Zhou Yu

The learned dialog structure can shed light on how to analyze human dialogs, and more importantly contribute to the design and evaluation of dialog systems.

Exploiting Common Characters in Chinese and Japanese to Learn Cross-Lingual Word Embeddings via Matrix Factorization

no code implementations WS 2018 Jilei Wang, Shiying Luo, Weiyan Shi, Tao Dai, Shu-Tao Xia

Learning vector space representation of words (i. e., word embeddings) has recently attracted wide research interests, and has been extended to cross-lingual scenario.

Cross-Lingual Word Embeddings Machine Translation +4

Sentiment Adaptive End-to-End Dialog Systems

no code implementations ACL 2018 Weiyan Shi, Zhou Yu

End-to-end learning framework is useful for building dialog systems for its simplicity in training and efficiency in model updating.

reinforcement-learning Reinforcement Learning (RL)

Cannot find the paper you are looking for? You can Submit a new open access paper.