no code implementations • EMNLP (NLP+CSS) 2020 • Hui Xian Lynnette Ng, Roy Ka-Wei Lee, Md Rabiul Awal
Through longitudinal analysis of each user, we construct emotion transition graphs, observing key transitions between disgust and anger, and self-transitions within anger and disgust emotional states.
no code implementations • 3 May 2024 • Ri Chi Ng, Nirmalendu Prakash, Ming Shan Hee, Kenny Tsu Wei Choo, Roy Ka-Wei Lee
To address the limitations of current hate speech detection models, we introduce \textsf{SGHateCheck}, a novel framework designed for the linguistic and cultural context of Singapore and Southeast Asia.
1 code implementation • 28 Feb 2024 • Lei Wang, Wanyu Xu, Zhiqiang Hu, Yihuai Lan, Shan Dong, Hao Wang, Roy Ka-Wei Lee, Ee-Peng Lim
This paper introduces a new in-context learning (ICL) mechanism called In-Image Learning (I$^2$L) that combines demonstration examples, visual cues, and chain-of-thought reasoning into an aggregated image to enhance the capabilities of Large Multimodal Models (e. g., GPT-4V) in multimodal reasoning tasks.
1 code implementation • 24 Feb 2024 • Han Wang, Roy Ka-Wei Lee
Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination.
1 code implementation • 19 Feb 2024 • Rui Cao, Roy Ka-Wei Lee, Jing Jiang
We then use the few available annotated samples to train a module composer, which assigns weights to the LoRA modules based on their relevance.
no code implementations • 30 Jan 2024 • Ming Shan Hee, Shivam Sharma, Rui Cao, Palash Nandi, Tanmoy Chakraborty, Roy Ka-Wei Lee
In the evolving landscape of online communication, moderating hate speech (HS) presents an intricate challenge, compounded by the multimodal nature of digital content.
no code implementations • 15 Dec 2023 • Han Wang, Nirmalendu Prakash, Nguyen Khoi Hoang, Ming Shan Hee, Usman Naseem, Roy Ka-Wei Lee
Topic modeling is a widely used technique for revealing underlying thematic structures within textual data.
no code implementations • 11 Dec 2023 • Nirmalendu Prakash, Han Wang, Nguyen Khoi Hoang, Ming Shan Hee, Roy Ka-Wei Lee
The proliferation of social media has given rise to a new form of communication: memes.
1 code implementation • 11 Dec 2023 • Ming Shan Hee, Aditi Kumaresan, Nguyen Khoi Hoang, Nirmalendu Prakash, Rui Cao, Roy Ka-Wei Lee
The rise of social media platforms has brought about a new digital culture called memes.
no code implementations • 18 Nov 2023 • Ngai Lam Ho, Roy Ka-Wei Lee, Kwan Hui Lim
In this paper, we propose the SBTRec algorithm: a BERT-based Trajectory Recommendation with sentiment analysis, for recommending personalized sequences of POIs as itineraries.
1 code implementation • 31 Oct 2023 • Deepanway Ghosal, Navonil Majumder, Roy Ka-Wei Lee, Rada Mihalcea, Soujanya Poria
Visual question answering (VQA) is the task of answering questions about an image.
1 code implementation • 30 Oct 2023 • Ngai Lam Ho, Roy Ka-Wei Lee, Kwan Hui Lim
An essential task for tourists having a pleasant holiday is to have a well-planned itinerary with relevant recommendations, especially when visiting unfamiliar cities.
no code implementations • 17 Oct 2023 • Adam Valen Levinson, Abhay Goyal, Roger Ho Chun Man, Roy Ka-Wei Lee, Koustuv Saha, Nimay Parekh, Frederick L. Altice, Lam Yin Cheung, Munmun De Choudhury, Navin Kumar
The objectives were to: 1) Collect audio data from 24 people (12 with depression and 12 without mental health or major health condition diagnoses); 2) Build a machine learning model to predict depression risk.
no code implementations • 12 Oct 2023 • Chia-Yu Hung, Zhiqiang Hu, Yujia Hu, Roy Ka-Wei Lee
Authorship verification (AV) is a fundamental task in natural language processing (NLP) and computational linguistics, with applications in forensic analysis, plagiarism detection, and identification of deceptive content.
3 code implementations • 16 Aug 2023 • Rui Cao, Ming Shan Hee, Adriel Kuek, Wen-Haw Chong, Roy Ka-Wei Lee, Jing Jiang
Specifically, we prompt a frozen PVLM by asking hateful content-related questions and use the answers as image captions (which we call Pro-Cap), so that the captions contain information critical for hateful content detection.
no code implementations • 13 Jul 2023 • Abhay Goyal, Muhammad Siddique, Nimay Parekh, Zach Schwitzky, Clara Broekaert, Connor Michelotti, Allie Wong, Robin O Hanlon, Lam Yin Cheung, Munmun De Choudhury, Roy Ka-Wei Lee, Navin Kumar
Broadly, our results indicated a left-leaning bias for both ChatGPT and Bard, with Bard more likely to provide responses around polarizing topics.
no code implementations • 29 May 2023 • Nirmalendu Prakash, Ming Shan Hee, Roy Ka-Wei Lee
While several countries have adopted total defence as their defence policy, very few studies have investigated its effectiveness.
1 code implementation • 28 May 2023 • Ming Shan Hee, Wen-Haw Chong, Roy Ka-Wei Lee
Recent studies have proposed models that yielded promising performance for the hateful meme classification task.
1 code implementation • 28 May 2023 • Han Wang, Ming Shan Hee, Md Rabiul Awal, Kenny Tsu Wei Choo, Roy Ka-Wei Lee
A key concern is that these explanations, generated by LLMs, may lead to erroneous judgments about the nature of flagged content by both users and content moderators.
no code implementations • 10 May 2023 • Zhiqiang Hu, Roy Ka-Wei Lee, Nancy F. Chen
Adapting a large language model for multiple-attribute text style transfer via fine-tuning can be challenging due to the significant amount of computational resources and labeled data required for the specific task.
3 code implementations • 6 May 2023 • Lei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu, Yunshi Lan, Roy Ka-Wei Lee, Ee-Peng Lim
To address the calculation errors and improve the quality of generated reasoning steps, we extend PS prompting with more detailed instructions and derive PS+ prompting.
2 code implementations • 4 Apr 2023 • Zhiqiang Hu, Lei Wang, Yihuai Lan, Wanyu Xu, Ee-Peng Lim, Lidong Bing, Xing Xu, Soujanya Poria, Roy Ka-Wei Lee
The success of large language models (LLMs), like GPT-4 and ChatGPT, has led to the development of numerous cost-effective and accessible alternatives that are created by finetuning open-access LLMs with task-specific data (e. g., ChatDoctor) or instruction data (e. g., Alpaca).
no code implementations • 4 Mar 2023 • Md Rabiul Awal, Roy Ka-Wei Lee, Eshaan Tanwar, Tanmay Garg, Tanmoy Chakraborty
However, most of these studies are limited to detecting hate speech only in English, neglecting the bulk of hateful content that is generated in other languages, particularly in low-resource languages.
no code implementations • 8 Feb 2023 • Rui Cao, Roy Ka-Wei Lee, Wen-Haw Chong, Jing Jiang
Specifically, we construct simple prompts and provide a few in-context examples to exploit the implicit knowledge in the pre-trained RoBERTa language model for hateful meme classification.
Ranked #3 on Hateful Meme Classification on HarMeme
no code implementations • 16 Jun 2022 • Qing Meng, Tharun Suresh, Roy Ka-Wei Lee, Tanmoy Chakraborty
Tweets are the most concise form of communication in online social media, wherein a single tweet has the potential to make or break the discourse of the conversation.
no code implementations • 4 Apr 2022 • Ming Shan Hee, Roy Ka-Wei Lee, Wen-Haw Chong
For instance, it is unclear if these models are able to capture the derogatory or slurs references in multimodality (i. e., image and text) of the hateful memes.
no code implementations • 26 Dec 2021 • Lynnette Hui Xian Ng, John Yeh Han Tan, Darryl Jing Heng Tan, Roy Ka-Wei Lee
This paper investigates social contagion of TikTok challenges through predicting a user's participation.
no code implementations • Findings (EMNLP) 2021 • Dong-Ho Lee, Zhiqiang Hu, Roy Ka-Wei Lee
Language models such as GPT-2 have performed well on constructing syntactically sound sentences for text auto-completion task.
no code implementations • RANLP 2021 • Jiawen Zhu, Jinye Ran, Roy Ka-Wei Lee, Kenny Choo, Zhi Li
The analytical description of charts is an exciting and important research area with many applications in academia and industry.
no code implementations • RANLP 2021 • Zhiqiang Hu, Roy Ka-Wei Lee, Charu C. Aggarwal
Existing text style transfer (TST) methods rely on style classifiers to disentangle the text's content and style attributes for text style transfer.
no code implementations • 9 Aug 2021 • Rui Cao, Ziqing Fan, Roy Ka-Wei Lee, Wen-Haw Chong, Jing Jiang
Our experiment results show that DisMultiHate is able to outperform state-of-the-art unimodal and multimodal baselines in the hateful meme classification task.
Ranked #4 on Hateful Meme Classification on HarMeme
no code implementations • ACL 2021 • Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee
Orthogonality constraints encourage matrices to be orthogonal for numerical stability.
no code implementations • 14 Mar 2021 • Rui Cao, Roy Ka-Wei Lee, Tuan-Anh Hoang
Online hate speech is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies.
no code implementations • 14 Mar 2021 • Md Rabiul Awal, Rui Cao, Roy Ka-Wei Lee, Sandra Mitrovic
Automated hate speech detection in social media is a challenging task that has recently gained significant traction in the data mining and Natural Language Processing community.
no code implementations • 14 Mar 2021 • Zhiqiang Hu, Roy Ka-Wei Lee, Lei Wang, Ee-Peng Lim, Bo Dai
Authorship attribution (AA), which is the task of finding the owner of a given text, is an important and widely studied research topic with many applications.
no code implementations • COLING 2020 • Rui Cao, Roy Ka-Wei Lee
We also conduct case studies to empirically examine the HateGAN generated hate speeches and show that the generated tweets are diverse, coherent, and relevant to hate speech detection.
2 code implementations • 24 Oct 2020 • Zhiqiang Hu, Roy Ka-Wei Lee, Charu C. Aggarwal, Aston Zhang
This article aims to provide a comprehensive review of recent research efforts on text style transfer.
no code implementations • 21 Jul 2020 • Md Rabiul Awal, Rui Cao, Sandra Mitrovic, Roy Ka-Wei Lee
The COVID-19 pandemic has developed to be more than a bio-crisis as global news has reported a sharp rise in xenophobia and discrimination in both online and offline communities.
1 code implementation • ACL 2020 • Jipeng Zhang, Lei Wang, Roy Ka-Wei Lee, Yi Bin, Yan Wang, Jie Shao, Ee-Peng Lim
While the recent tree-based neural models have demonstrated promising results in generating solution expression for the math word problem (MWP), most of these models do not capture the relationships and order information among the quantities well.
Ranked #10 on Math Word Problem Solving on Math23K
no code implementations • 24 Jun 2020 • Md Rabiul Awal, Rui Cao, Roy Ka-Wei Lee, Sandra Mitrović
In this study, we proposed an analytical framework to study the annotation consistency in online hate and abusive content datasets.
no code implementations • 11 May 2020 • Roy Ka-Wei Lee, Thong Hoang, Richard J. Oentaryo, David Lo
The Act step then recommends to the user which activities to perform on the identified set of items.