Search Results for author: Hanjia Lyu

Found 20 papers, 3 papers with code

Harnessing GPT-4V(ision) for Insurance: A Preliminary Exploration

no code implementations15 Apr 2024 Chenwei Lin, Hanjia Lyu, Jiebo Luo, Xian Xu

The emergence of Large Multimodal Models (LMMs) marks a significant milestone in the development of artificial intelligence.

Hallucination

SoMeLVLM: A Large Vision Language Model for Social Media Processing

no code implementations20 Feb 2024 Xinnong Zhang, Haoyu Kuang, Xinyi Mou, Hanjia Lyu, Kun Wu, Siming Chen, Jiebo Luo, Xuanjing Huang, Zhongyu Wei

The powerful Large Vision Language Models make it possible to handle a variety of tasks simultaneously, but even with carefully designed prompting methods, the general domain models often fall short in aligning with the unique speaking style and context of social media tasks.

Language Modelling

Human vs. LMMs: Exploring the Discrepancy in Emoji Interpretation and Usage in Digital Communication

1 code implementation16 Jan 2024 Hanjia Lyu, Weihong Qi, Zhongyu Wei, Jiebo Luo

Leveraging Large Multimodal Models (LMMs) to simulate human behaviors when processing multimodal information, especially in the context of social media, has garnered immense interest due to its broad potential and far-reaching implications.

CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs

no code implementations5 Jan 2024 Daoan Zhang, Junming Yang, Hanjia Lyu, Zijian Jin, Yuan YAO, Mingkai Chen, Jiebo Luo

When exploring the development of Artificial General Intelligence (AGI), a critical task for these models involves interpreting and processing information from multiple image inputs.

Image Comprehension Text Matching +1

GPT-4V(ision) as A Social Media Analysis Engine

1 code implementation13 Nov 2023 Hanjia Lyu, Jinfa Huang, Daoan Zhang, Yongsheng Yu, Xinyi Mou, Jinsheng Pan, Zhengyuan Yang, Zhongyu Wei, Jiebo Luo

Our investigation begins with a preliminary quantitative analysis for each task using existing benchmark datasets, followed by a careful review of the results and a selection of qualitative samples that illustrate GPT-4V's potential in understanding multimodal social media content.

Hallucination Hate Speech Detection +1

Mixture of Weak & Strong Experts on Graphs

no code implementations9 Nov 2023 Hanqing Zeng, Hanjia Lyu, Diyi Hu, Yinglong Xia, Jiebo Luo

We propose to decouple the two modalities by mixture of weak and strong experts (Mowst), where the weak expert is a light-weight Multi-layer Perceptron (MLP), and the strong expert is an off-the-shelf Graph Neural Network (GNN).

Node Classification

Understanding Divergent Framing of the Supreme Court Controversies: Social Media vs. News Outlets

no code implementations18 Sep 2023 Jinsheng Pan, Zichen Wang, Weihong Qi, Hanjia Lyu, Jiebo Luo

Understanding the framing of political issues is of paramount importance as it significantly shapes how individuals perceive, interpret, and engage with these matters.

Decision Making

LLM-Rec: Personalized Recommendation via Prompting Large Language Models

no code implementations24 Jul 2023 Hanjia Lyu, Song Jiang, Hanqing Zeng, Yinglong Xia, Qifan Wang, Si Zhang, Ren Chen, Christopher Leung, Jiajie Tang, Jiebo Luo

Notably, the success of LLM-Rec lies in its prompting strategies, which effectively tap into the language model's comprehension of both general and specific item characteristics.

Learning to Evaluate the Artness of AI-generated Images

no code implementations8 May 2023 Junyu Chen, Jie An, Hanjia Lyu, Jiebo Luo

Assessing the artness of AI-generated images continues to be a challenge within the realm of image generation.

Image Generation

Predicting Adverse Neonatal Outcomes for Preterm Neonates with Multi-Task Learning

no code implementations28 Mar 2023 Jingyang Lin, Junyu Chen, Hanjia Lyu, Igor Khodak, Divya Chhabra, Colby L Day Richardson, Irina Prelipcean, Andrew M Dylag, Jiebo Luo

In this work, we first analyze the correlations between three adverse neonatal outcomes and then formulate the diagnosis of multiple neonatal outcomes as a multi-task learning (MTL) problem.

Feature Importance Multi-Task Learning

Bias or Diversity? Unraveling Fine-Grained Thematic Discrepancy in U.S. News Headlines

no code implementations28 Mar 2023 Jinsheng Pan, Weihong Qi, Zichen Wang, Hanjia Lyu, Jiebo Luo

There is a broad consensus that news media outlets incorporate ideological biases in their news articles.

Computational Assessment of Hyperpartisanship in News Titles

1 code implementation16 Jan 2023 Hanjia Lyu, Jinsheng Pan, Zichen Wang, Jiebo Luo

We first adopt a human-guided machine learning framework to develop a new dataset for hyperpartisan news title detection with 2, 200 manually labeled and 1. 8 million machine-labeled titles that were posted from 2014 to the present by nine representative media organizations across three media bias groups - Left, Central, and Right in an active learning manner.

Active Learning Language Modelling

Improving Visual-textual Sentiment Analysis by Fusing Expert Features

no code implementations23 Nov 2022 Junyu Chen, Jie An, Hanjia Lyu, Jiebo Luo

Visual-textual sentiment analysis aims to predict sentiment with the input of a pair of image and text.

Sentiment Analysis

Causal Inference via Nonlinear Variable Decorrelation for Healthcare Applications

no code implementations29 Sep 2022 Junda Wang, Weijian Li, Han Wang, Hanjia Lyu, Caroline Thirukumaran, Addisu Mesfin, Jiebo Luo

Causal inference and model interpretability research are gaining increasing attention, especially in the domains of healthcare and bioinformatics.

Causal Inference

Learning to Aggregate and Refine Noisy Labels for Visual Sentiment Analysis

no code implementations15 Sep 2021 Wei Zhu, Zihe Zheng, Haitian Zheng, Hanjia Lyu, Jiebo Luo

The learned prototypes and their labels can be regarded as denoising features and labels for the local regions and can guide the training process to prevent the model from overfitting the noisy cases.

Denoising Learning with noisy labels +1

Social Media Study of Public Opinions on Potential COVID-19 Vaccines: Informing Dissent, Disparities, and Dissemination

no code implementations3 Dec 2020 Hanjia Lyu, Wei Wu, Junda Wang, Viet Duong, Xiyang Zhang, Jiebo Luo

People who have the worst personal pandemic experience are more likely to hold the anti-vaccine opinion.

Social and Information Networks

Monitoring Depression Trend on Twitter during the COVID-19 Pandemic

no code implementations1 Jul 2020 Yi-Peng Zhang, Hanjia Lyu, Yubao Liu, Xiyang Zhang, Yu Wang, Jiebo Luo

The COVID-19 pandemic has severely affected people's daily lives and caused tremendous economic loss worldwide.

In the Eyes of the Beholder: Analyzing Social Media Use of Neutral and Controversial Terms for COVID-19

no code implementations21 Apr 2020 Long Chen, Hanjia Lyu, Tongyu Yang, Yu Wang, Jiebo Luo

To model the substantive difference of tweets with controversial terms and those with non-controversial terms, we apply topic modeling and LIWC-based sentiment analysis.

Sentiment Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.