Search Results for author: Haitao Mao

Found 21 papers, 11 papers with code

Graph Machine Learning in the Era of Large Language Models (LLMs)

no code implementations23 Apr 2024 Wenqi Fan, Shijie Wang, Jiani Huang, Zhikai Chen, Yu Song, Wenzhuo Tang, Haitao Mao, Hui Liu, Xiaorui Liu, Dawei Yin, Qing Li

Meanwhile, graphs, especially knowledge graphs, are rich in reliable factual knowledge, which can be utilized to enhance the reasoning capabilities of LLMs and potentially alleviate their limitations such as hallucinations and the lack of explainability.

Few-Shot Learning Knowledge Graphs +1

Addressing Shortcomings in Fair Graph Learning Datasets: Towards a New Benchmark

1 code implementation9 Mar 2024 Xiaowei Qian, Zhimeng Guo, Jialiang Li, Haitao Mao, Bingheng Li, Suhang Wang, Yao Ma

These datasets are thoughtfully designed to include relevant graph structures and bias information crucial for the fair evaluation of models.

Benchmarking Fairness +1

Universal Link Predictor By In-Context Learning on Graphs

no code implementations12 Feb 2024 Kaiwen Dong, Haitao Mao, Zhichun Guo, Nitesh V. Chawla

In this work, we introduce the Universal Link Predictor (UniLP), a novel model that combines the generalizability of heuristic approaches with the pattern learning capabilities of parametric models.

Hyperparameter Optimization In-Context Learning +1

A Data Generation Perspective to the Mechanism of In-Context Learning

no code implementations3 Feb 2024 Haitao Mao, Guangliang Liu, Yao Ma, Rongrong Wang, Jiliang Tang

In-Context Learning (ICL) empowers Large Language Models (LLMs) with the capacity to learn in context, achieving downstream generalization without gradient updates but with a few in-context examples.

In-Context Learning

Neural Scaling Laws on Graphs

no code implementations3 Feb 2024 Jingzhe Liu, Haitao Mao, Zhikai Chen, Tong Zhao, Neil Shah, Jiliang Tang

In this work, we delve into neural scaling laws on graphs from both model and data perspectives.

Graph Classification Link Prediction +1

Graph Foundation Models

no code implementations3 Feb 2024 Haitao Mao, Zhikai Chen, Wenzhuo Tang, Jianan Zhao, Yao Ma, Tong Zhao, Neil Shah, Mikhail Galkin, Jiliang Tang

Graph Foundation Model (GFM) is a new trending research topic in the graph domain, aiming to develop a graph model capable of generalizing across different graphs and tasks.

LPFormer: An Adaptive Graph Transformer for Link Prediction

1 code implementation17 Oct 2023 Harry Shomer, Yao Ma, Haitao Mao, Juanhui Li, Bo Wu, Jiliang Tang

In recent years, a new class of methods has emerged that combines the advantages of message-passing neural networks (MPNN) and heuristics methods.

Inductive Bias Link Prediction

Label-free Node Classification on Graphs with Large Language Models (LLMS)

1 code implementation7 Oct 2023 Zhikai Chen, Haitao Mao, Hongzhi Wen, Haoyu Han, Wei Jin, Haiyang Zhang, Hui Liu, Jiliang Tang

In light of these observations, this work introduces a label-free node classification on graphs with LLMs pipeline, LLM-GNN.

Node Classification

Revisiting Link Prediction: A Data Perspective

1 code implementation1 Oct 2023 Haitao Mao, Juanhui Li, Harry Shomer, Bingheng Li, Wenqi Fan, Yao Ma, Tong Zhao, Neil Shah, Jiliang Tang

We recognize three fundamental factors critical to link prediction: local structural proximity, global structural proximity, and feature proximity.

Link Prediction

Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs

2 code implementations7 Jul 2023 Zhikai Chen, Haitao Mao, Hang Li, Wei Jin, Hongzhi Wen, Xiaochi Wei, Shuaiqiang Wang, Dawei Yin, Wenqi Fan, Hui Liu, Jiliang Tang

The most popular pipeline for learning on graphs with textual node attributes primarily relies on Graph Neural Networks (GNNs), and utilizes shallow text embedding as initial node representations, which has limitations in general knowledge and profound semantic understanding.

General Knowledge Node Classification

Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?

1 code implementation NeurIPS 2023 Haitao Mao, Zhikai Chen, Wei Jin, Haoyu Han, Yao Ma, Tong Zhao, Neil Shah, Jiliang Tang

Recent studies on Graph Neural Networks(GNNs) provide both empirical and theoretical evidence supporting their effectiveness in capturing structural patterns on both homophilic and certain heterophilic graphs.

Node Classification

Company Competition Graph

no code implementations1 Apr 2023 Yanci Zhang, Yutong Lu, Haitao Mao, Jiawei Huang, Cien Zhang, Xinyi Li, Rui Dai

Based on the output from our system, we construct a knowledge graph with more than 700 nodes and 1200 edges.

Knowledge Graphs

Form 10-K Itemization

no code implementations18 Feb 2023 Yanci Zhang, Mengjia Xia, Mingyang Li, Haitao Mao, Yutong Lu, Yupeng Lan, Jinlin Ye, Rui Dai

With the segmented Item sections, NLP techniques can directly apply on those Item sections related to downstream tasks.

Retrieval

Whole Page Unbiased Learning to Rank

no code implementations19 Oct 2022 Haitao Mao, Lixin Zou, Yujia Zheng, Jiliang Tang, Xiaokai Chu, Jiashu Zhao, Qian Wang, Dawei Yin

To address the above challenges, we propose a Bias Agnostic whole-page unbiased Learning to rank algorithm, named BAL, to automatically find the user behavior model with causal discovery and mitigate the biases induced by multiple SERP features with no specific design.

Causal Discovery Information Retrieval +2

A Large Scale Search Dataset for Unbiased Learning to Rank

1 code implementation7 Jul 2022 Lixin Zou, Haitao Mao, Xiaokai Chu, Jiliang Tang, Wenwen Ye, Shuaiqiang Wang, Dawei Yin

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms.

Causal Discovery Language Modelling +3

Alternately Optimized Graph Neural Networks

no code implementations8 Jun 2022 Haoyu Han, Xiaorui Liu, Haitao Mao, MohamadAli Torkamani, Feng Shi, Victor Lee, Jiliang Tang

Extensive experiments demonstrate that the proposed method can achieve comparable or better performance with state-of-the-art baselines while it has significantly better computation and memory efficiency.

MULTI-VIEW LEARNING Node Classification

Source Free Unsupervised Graph Domain Adaptation

1 code implementation2 Dec 2021 Haitao Mao, Lun Du, Yujia Zheng, Qiang Fu, Zelin Li, Xu Chen, Shi Han, Dongmei Zhang

To address the non-trivial adaptation challenges in this practical scenario, we propose a model-agnostic algorithm called SOGA for domain adaptation to fully exploit the discriminative ability of the source model while preserving the consistency of structural proximity on the target graph.

Domain Adaptation Node Classification

Neuron with Steady Response Leads to Better Generalization

no code implementations30 Nov 2021 Qiang Fu, Lun Du, Haitao Mao, Xu Chen, Wei Fang, Shi Han, Dongmei Zhang

Based on the analysis results, we articulate the Neuron Steadiness Hypothesis: the neuron with similar responses to instances of the same class leads to better generalization.

Inductive Bias

Neuron Campaign for Initialization Guided by Information Bottleneck Theory

1 code implementation14 Aug 2021 Haitao Mao, Xu Chen, Qiang Fu, Lun Du, Shi Han, Dongmei Zhang

Initialization plays a critical role in the training of deep neural networks (DNN).

Cannot find the paper you are looking for? You can Submit a new open access paper.