Search Results for author: Mengjie Zhao

Found 21 papers, 3 papers with code

Virtual Sensor for Real-Time Bearing Load Prediction Using Heterogeneous Temporal Graph Neural Networks

no code implementations2 Apr 2024 Mengjie Zhao, Cees Taal, Stephan Baggerohr, Olga Fink

Since temperature and vibration signals exhibit vastly different dynamics, we propose Heterogeneous Temporal Graph Neural Networks (HTGNN), which explicitly models these signal types and their interactions for effective load prediction.

Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning

no code implementations23 Mar 2024 Zhouhang Xie, Bodhisattwa Prasad Majumder, Mengjie Zhao, Yoshinori Maeda, Keiichi Yamada, Hiromi Wakaki, Julian McAuley

We consider the task of building a dialogue system that can motivate users to adopt positive lifestyle changes: Motivational Interviewing.

Instruction Following

DiffuCOMET: Contextual Commonsense Knowledge Diffusion

1 code implementation26 Feb 2024 Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut

Inferring contextually-relevant and diverse commonsense to understand narratives remains challenging for knowledge models.

Using Natural Language Inference to Improve Persona Extraction from Dialogue in a New Domain

no code implementations12 Jan 2024 Alexandra DeLucia, Mengjie Zhao, Yoshinori Maeda, Makoto Yoda, Keiichi Yamada, Hiromi Wakaki

To address both these issues, we introduce a natural language inference method for post-hoc adapting a trained persona extraction model to a new setting.

Natural Language Inference

Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association

no code implementations2 Oct 2023 Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, Yuki Mitsufuji

In this paper, we focus on the wide existence of reporting bias in visual-language datasets, embodied as the object-attribute association, which can subsequentially degrade models trained on them.

Attribute Object

Spatial-Temporal Graph Attention Fuser for Calibration in IoT Air Pollution Monitoring Systems

no code implementations8 Sep 2023 Keivan Faghih Niresi, Mengjie Zhao, Hugo Bissig, Henri Baumann, Olga Fink

The use of Internet of Things (IoT) sensors for air pollution monitoring has significantly increased, resulting in the deployment of low-cost sensors.

Graph Attention

DyEdgeGAT: Dynamic Edge via Graph Attention for Early Fault Detection in IIoT Systems

1 code implementation7 Jul 2023 Mengjie Zhao, Olga Fink

We rigorously evaluated DyEdgeGAT using both a synthetic dataset, simulating varying levels of fault severity, and a real-world industrial-scale multiphase flow facility benchmark with diverse fault types under varying operating conditions and detection complexities.

Fault Detection Time Series +1

Discrete and Soft Prompting for Multilingual Models

1 code implementation EMNLP 2021 Mengjie Zhao, Hinrich Schütze

It has been shown for English that discrete and soft prompting perform strongly in few-shot learning with pretrained language models (PLMs).

Few-Shot Learning Natural Language Inference

A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters

no code implementations ACL 2021 Mengjie Zhao, Yi Zhu, Ehsan Shareghi, Ivan Vulić, Roi Reichart, Anna Korhonen, Hinrich Schütze

Few-shot crosslingual transfer has been shown to outperform its zero-shot counterpart with pretrained encoders like multilingual BERT.

Few-Shot Learning

Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

no code implementations EMNLP 2020 Mengjie Zhao, Tao Lin, Fei Mi, Martin Jaggi, Hinrich Schütze

We present an efficient method of utilizing pretrained language models, where we learn selective binary masks for pretrained weights in lieu of modifying them through finetuning.

Quantifying the Contextualization of Word Representations with Semantic Class Probing

no code implementations Findings of the Association for Computational Linguistics 2020 Mengjie Zhao, Philipp Dufter, Yadollah Yaghoobzadeh, Hinrich Schütze

Pretrained language models have achieved a new state of the art on many NLP tasks, but there are still many open questions about how and why they work so well.

A Multilingual BPE Embedding Space for Universal Sentiment Lexicon Induction

no code implementations ACL 2019 Mengjie Zhao, Hinrich Sch{\"u}tze

We present a new method for sentiment lexicon induction that is designed to be applicable to the entire range of typological diversity of the world{'}s languages.

Domain Adaptation

Cannot find the paper you are looking for? You can Submit a new open access paper.