Search Results for author: Roy Ka-Wei Lee

Found 40 papers, 13 papers with code

I miss you babe: Analyzing Emotion Dynamics During COVID-19 Pandemic

no code implementations EMNLP (NLP+CSS) 2020 Hui Xian Lynnette Ng, Roy Ka-Wei Lee, Md Rabiul Awal

Through longitudinal analysis of each user, we construct emotion transition graphs, observing key transitions between disgust and anger, and self-transitions within anger and disgust emotional states.

Emotion Recognition Time Series +1

All in an Aggregated Image for In-Image Learning

1 code implementation28 Feb 2024 Lei Wang, Wanyu Xu, Zhiqiang Hu, Yihuai Lan, Shan Dong, Hao Wang, Roy Ka-Wei Lee, Ee-Peng Lim

This paper introduces a new in-context learning (ICL) mechanism called In-Image Learning (I$^2$L) that combines demonstration examples, visual cues, and chain-of-thought reasoning into an aggregated image to enhance the capabilities of Large Multimodal Models (e. g., GPT-4V) in multimodal reasoning tasks.

Hallucination In-Context Learning +1

MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation

1 code implementation24 Feb 2024 Han Wang, Roy Ka-Wei Lee

Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination.

Modularized Networks for Few-shot Hateful Meme Detection

1 code implementation19 Feb 2024 Rui Cao, Roy Ka-Wei Lee, Jing Jiang

We then use the few available annotated samples to train a module composer, which assigns weights to the LoRA modules based on their relevance.

Few-Shot Learning In-Context Learning

Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models

no code implementations30 Jan 2024 Ming Shan Hee, Shivam Sharma, Rui Cao, Palash Nandi, Tanmoy Chakraborty, Roy Ka-Wei Lee

In the evolving landscape of online communication, moderating hate speech (HS) presents an intricate challenge, compounded by the multimodal nature of digital content.

Prompting Large Language Models for Topic Modeling

no code implementations15 Dec 2023 Han Wang, Nirmalendu Prakash, Nguyen Khoi Hoang, Ming Shan Hee, Usman Naseem, Roy Ka-Wei Lee

Topic modeling is a widely used technique for revealing underlying thematic structures within textual data.

Sentence

MATK: The Meme Analytical Tool Kit

1 code implementation11 Dec 2023 Ming Shan Hee, Aditi Kumaresan, Nguyen Khoi Hoang, Nirmalendu Prakash, Rui Cao, Roy Ka-Wei Lee

The rise of social media platforms has brought about a new digital culture called memes.

Meme Classification

SBTRec- A Transformer Framework for Personalized Tour Recommendation Problem with Sentiment Analysis

no code implementations18 Nov 2023 Ngai Lam Ho, Roy Ka-Wei Lee, Kwan Hui Lim

In this paper, we propose the SBTRec algorithm: a BERT-based Trajectory Recommendation with sentiment analysis, for recommending personalized sequences of POIs as itineraries.

Recommendation Systems Sentiment Analysis

BTRec: BERT-Based Trajectory Recommendation for Personalized Tours

1 code implementation30 Oct 2023 Ngai Lam Ho, Roy Ka-Wei Lee, Kwan Hui Lim

An essential task for tourists having a pleasant holiday is to have a well-planned itinerary with relevant recommendations, especially when visiting unfamiliar cities.

Language Modelling Sentence +1

Using Audio Data to Facilitate Depression Risk Assessment in Primary Health Care

no code implementations17 Oct 2023 Adam Valen Levinson, Abhay Goyal, Roger Ho Chun Man, Roy Ka-Wei Lee, Koustuv Saha, Nimay Parekh, Frederick L. Altice, Lam Yin Cheung, Munmun De Choudhury, Navin Kumar

The objectives were to: 1) Collect audio data from 24 people (12 with depression and 12 without mental health or major health condition diagnoses); 2) Build a machine learning model to predict depression risk.

AutoML Depression Detection

Who Wrote it and Why? Prompting Large-Language Models for Authorship Verification

no code implementations12 Oct 2023 Chia-Yu Hung, Zhiqiang Hu, Yujia Hu, Roy Ka-Wei Lee

Authorship verification (AV) is a fundamental task in natural language processing (NLP) and computational linguistics, with applications in forensic analysis, plagiarism detection, and identification of deceptive content.

Authorship Verification

Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection

3 code implementations16 Aug 2023 Rui Cao, Ming Shan Hee, Adriel Kuek, Wen-Haw Chong, Roy Ka-Wei Lee, Jing Jiang

Specifically, we prompt a frozen PVLM by asking hateful content-related questions and use the answers as image captions (which we call Pro-Cap), so that the captions contain information critical for hateful content detection.

Image Captioning Language Modelling +2

ChatGPT and Bard Responses to Polarizing Questions

no code implementations13 Jul 2023 Abhay Goyal, Muhammad Siddique, Nimay Parekh, Zach Schwitzky, Clara Broekaert, Connor Michelotti, Allie Wong, Robin O Hanlon, Lam Yin Cheung, Munmun De Choudhury, Roy Ka-Wei Lee, Navin Kumar

Broadly, our results indicated a left-leaning bias for both ChatGPT and Bard, with Bard more likely to provide responses around polarizing topics.

Misinformation

TotalDefMeme: A Multi-Attribute Meme dataset on Total Defence in Singapore

no code implementations29 May 2023 Nirmalendu Prakash, Ming Shan Hee, Roy Ka-Wei Lee

While several countries have adopted total defence as their defence policy, very few studies have investigated its effectiveness.

Attribute Stance Classification

Decoding the Underlying Meaning of Multimodal Hateful Memes

1 code implementation28 May 2023 Ming Shan Hee, Wen-Haw Chong, Roy Ka-Wei Lee

Recent studies have proposed models that yielded promising performance for the hateful meme classification task.

Benchmarking Hateful Meme Classification

Evaluating GPT-3 Generated Explanations for Hateful Content Moderation

1 code implementation28 May 2023 Han Wang, Ming Shan Hee, Md Rabiul Awal, Kenny Tsu Wei Choo, Roy Ka-Wei Lee

A key concern is that these explanations, generated by LLMs, may lead to erroneous judgments about the nature of flagged content by both users and content moderators.

Informativeness Persuasiveness

Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer

no code implementations10 May 2023 Zhiqiang Hu, Roy Ka-Wei Lee, Nancy F. Chen

Adapting a large language model for multiple-attribute text style transfer via fine-tuning can be challenging due to the significant amount of computational resources and labeled data required for the specific task.

Attribute Language Modelling +4

Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models

3 code implementations6 May 2023 Lei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu, Yunshi Lan, Roy Ka-Wei Lee, Ee-Peng Lim

To address the calculation errors and improve the quality of generated reasoning steps, we extend PS prompting with more detailed instructions and derive PS+ prompting.

Math

LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models

2 code implementations4 Apr 2023 Zhiqiang Hu, Lei Wang, Yihuai Lan, Wanyu Xu, Ee-Peng Lim, Lidong Bing, Xing Xu, Soujanya Poria, Roy Ka-Wei Lee

The success of large language models (LLMs), like GPT-4 and ChatGPT, has led to the development of numerous cost-effective and accessible alternatives that are created by finetuning open-access LLMs with task-specific data (e. g., ChatDoctor) or instruction data (e. g., Alpaca).

Arithmetic Reasoning Language Modelling

Model-Agnostic Meta-Learning for Multilingual Hate Speech Detection

no code implementations4 Mar 2023 Md Rabiul Awal, Roy Ka-Wei Lee, Eshaan Tanwar, Tanmay Garg, Tanmoy Chakraborty

However, most of these studies are limited to detecting hate speech only in English, neglecting the bulk of hateful content that is generated in other languages, particularly in low-resource languages.

Cross-Lingual Transfer Domain Generalization +2

Prompting for Multimodal Hateful Meme Classification

no code implementations8 Feb 2023 Rui Cao, Roy Ka-Wei Lee, Wen-Haw Chong, Jing Jiang

Specifically, we construct simple prompts and provide a few in-context examples to exploit the implicit knowledge in the pre-trained RoBERTa language model for hateful meme classification.

Classification Hateful Meme Classification +1

Predicting Hate Intensity of Twitter Conversation Threads

no code implementations16 Jun 2022 Qing Meng, Tharun Suresh, Roy Ka-Wei Lee, Tanmoy Chakraborty

Tweets are the most concise form of communication in online social media, wherein a single tweet has the potential to make or break the discourse of the conversation.

On Explaining Multimodal Hateful Meme Detection Models

no code implementations4 Apr 2022 Ming Shan Hee, Roy Ka-Wei Lee, Wen-Haw Chong

For instance, it is unclear if these models are able to capture the derogatory or slurs references in multimodality (i. e., image and text) of the hateful memes.

Classification Hateful Meme Classification

Will You Dance To The Challenge? Predicting User Participation of TikTok Challenges

no code implementations26 Dec 2021 Lynnette Hui Xian Ng, John Yeh Han Tan, Darryl Jing Heng Tan, Roy Ka-Wei Lee

This paper investigates social contagion of TikTok challenges through predicting a user's participation.

Improving Text Auto-Completion with Next Phrase Prediction

no code implementations Findings (EMNLP) 2021 Dong-Ho Lee, Zhiqiang Hu, Roy Ka-Wei Lee

Language models such as GPT-2 have performed well on constructing syntactically sound sentences for text auto-completion task.

Language Modelling

AutoChart: A Dataset for Chart-to-Text Generation Task

no code implementations RANLP 2021 Jiawen Zhu, Jinye Ran, Roy Ka-Wei Lee, Kenny Choo, Zhi Li

The analytical description of charts is an exciting and important research area with many applications in academia and industry.

Text Generation

Syntax Matters! Syntax-Controlled in Text Style Transfer

no code implementations RANLP 2021 Zhiqiang Hu, Roy Ka-Wei Lee, Charu C. Aggarwal

Existing text style transfer (TST) methods rely on style classifiers to disentangle the text's content and style attributes for text style transfer.

Sentence Style Transfer +1

Disentangling Hate in Online Memes

no code implementations9 Aug 2021 Rui Cao, Ziqing Fan, Roy Ka-Wei Lee, Wen-Haw Chong, Jing Jiang

Our experiment results show that DisMultiHate is able to outperform state-of-the-art unimodal and multimodal baselines in the hateful meme classification task.

Classification Hateful Meme Classification

DeepHate: Hate Speech Detection via Multi-Faceted Text Representations

no code implementations14 Mar 2021 Rui Cao, Roy Ka-Wei Lee, Tuan-Anh Hoang

Online hate speech is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies.

Hate Speech Detection Word Embeddings

DeepStyle: User Style Embedding for Authorship Attribution of Short Texts

no code implementations14 Mar 2021 Zhiqiang Hu, Roy Ka-Wei Lee, Lei Wang, Ee-Peng Lim, Bo Dai

Authorship attribution (AA), which is the task of finding the owner of a given text, is an important and widely studied research topic with many applications.

Authorship Attribution text-classification +1

AngryBERT: Joint Learning Target and Emotion for Hate Speech Detection

no code implementations14 Mar 2021 Md Rabiul Awal, Rui Cao, Roy Ka-Wei Lee, Sandra Mitrovic

Automated hate speech detection in social media is a challenging task that has recently gained significant traction in the data mining and Natural Language Processing community.

Hate Speech Detection Sentiment Analysis +1

HateGAN: Adversarial Generative-Based Data Augmentation for Hate Speech Detection

no code implementations COLING 2020 Rui Cao, Roy Ka-Wei Lee

We also conduct case studies to empirically examine the HateGAN generated hate speeches and show that the generated tweets are diverse, coherent, and relevant to hate speech detection.

Data Augmentation Hate Speech Detection

Text Style Transfer: A Review and Experimental Evaluation

2 code implementations24 Oct 2020 Zhiqiang Hu, Roy Ka-Wei Lee, Charu C. Aggarwal, Aston Zhang

This article aims to provide a comprehensive review of recent research efforts on text style transfer.

Style Transfer Text Style Transfer

On Analyzing Antisocial Behaviors Amid COVID-19 Pandemic

no code implementations21 Jul 2020 Md Rabiul Awal, Rui Cao, Sandra Mitrovic, Roy Ka-Wei Lee

The COVID-19 pandemic has developed to be more than a bio-crisis as global news has reported a sharp rise in xenophobia and discrimination in both online and offline communities.

Graph-to-Tree Learning for Solving Math Word Problems

1 code implementation ACL 2020 Jipeng Zhang, Lei Wang, Roy Ka-Wei Lee, Yi Bin, Yan Wang, Jie Shao, Ee-Peng Lim

While the recent tree-based neural models have demonstrated promising results in generating solution expression for the math word problem (MWP), most of these models do not capture the relationships and order information among the quantities well.

Math Math Word Problem Solving

On Analyzing Annotation Consistency in Online Abusive Behavior Datasets

no code implementations24 Jun 2020 Md Rabiul Awal, Rui Cao, Roy Ka-Wei Lee, Sandra Mitrović

In this study, we proposed an analytical framework to study the annotation consistency in online hate and abusive content datasets.

Keen2Act: Activity Recommendation in Online Social Collaborative Platforms

no code implementations11 May 2020 Roy Ka-Wei Lee, Thong Hoang, Richard J. Oentaryo, David Lo

The Act step then recommends to the user which activities to perform on the identified set of items.

Recommendation Systems

Cannot find the paper you are looking for? You can Submit a new open access paper.