Pairwise Learning for Neural Link Prediction

6 Dec 2021  ·  Zhitao Wang, Yong Zhou, Litao Hong, Yuanhang Zou, Hanjing Su, Shouzhi Chen ·

In this paper, we aim at providing an effective Pairwise Learning Neural Link Prediction (PLNLP) framework. The framework treats link prediction as a pairwise learning to rank problem and consists of four main components, i.e., neighborhood encoder, link predictor, negative sampler and objective function. The framework is flexible that any generic graph neural convolution or link prediction specific neural architecture could be employed as neighborhood encoder. For link predictor, we design different scoring functions, which could be selected based on different types of graphs. In negative sampler, we provide several sampling strategies, which are problem specific. As for objective function, we propose to use an effective ranking loss, which approximately maximizes the standard ranking metric AUC. We evaluate the proposed PLNLP framework on 4 link property prediction datasets of Open Graph Benchmark, including ogbl-ddi, ogbl-collab, ogbl-ppa and ogbl-ciation2. PLNLP achieves top 1 performance on ogbl-ddi and ogbl-collab, and top 2 performance on ogbl-ciation2 only with basic neural architecture. The performance demonstrates the effectiveness of PLNLP.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Link Property Prediction ogbl-citation2 PLNLP Test MRR 0.8492 ± 0.0029 # 10
Validation MRR 0.8490 ± 0.0031 # 10
Number of params 146514551 # 5
Ext. data No # 1
Link Property Prediction ogbl-collab PLNLP (random walk aug.) Test Hits@50 0.7059 ± 0.0029 # 5
Validation Hits@50 1.0000 ± 0.0000 # 1
Number of params 34980864 # 7
Ext. data No # 1
Link Property Prediction ogbl-collab PLNLP (val as input) Test Hits@50 0.6872 ± 0.0052 # 8
Validation Hits@50 1.0000 ± 0.0000 # 1
Number of params 35112192 # 6
Ext. data No # 1
Link Property Prediction ogbl-ddi PLNLP Test Hits@20 0.9088 ± 0.0313 # 6
Validation Hits@20 0.8242 ± 0.0253 # 8
Number of params 3497473 # 10
Ext. data No # 1

Methods