Multimodal Contextual Dialogue Breakdown Detection for Conversational AI Models

no code implementations • 11 Apr 2024 • Md Messal Monem Miah, Ulie Schnaithmann, Arushi Raghuvanshi, Youngseo Son

Detecting dialogue breakdown in real time is critical for conversational AI systems, because it enables taking corrective action to successfully complete a task.

Navigate

EMONA: Event-level Moral Opinions in News Articles

1 code implementation • 2 Apr 2024 • Yuanyuan Lei, Md Messal Monem Miah, Ayesha Qamar, Sai Ramana Reddy, Jonathan Tong, Haotian Xu, Ruihong Huang

This paper initiates a new task to understand moral opinions towards events in news articles.

Hierarchical Fusion for Online Multimodal Dialog Act Classification

1 code implementation • EMNLP 2023 • Md Messal Monem Miah, Adarsh Pyarelal, Ruihong Huang

We propose a framework for online multimodal dialog act (DA) classification based on raw audio and ASR-generated transcriptions of current and past utterances.

Classification Dialog Act Classification +1