Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selection

In this paper, we study the task of selecting optimal response given user and system utterance history in retrieval-based multi-turn dialog systems. Recently, pre-trained language models (e.g., BERT, RoBERTa, and ELECTRA) have shown significant improvements in various natural language processing tasks... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Conversational Response Selection Ubuntu Dialogue (v1, Ranking) UMS_BERT+ [email protected] 0.875 # 2
[email protected] 0.942 # 2
[email protected] 0.988 # 2

Methods used in the Paper