User Preference-aware Fake News Detection

25 Apr 2021  ·  Yingtong Dou, Kai Shu, Congying Xia, Philip S. Yu, Lichao Sun ·

Disinformation and fake news have posed detrimental effects on individuals and society in recent years, attracting broad attention to fake news detection. The majority of existing fake news detection algorithms focus on mining news content and/or the surrounding exogenous context for discovering deceptive signals; while the endogenous preference of a user when he/she decides to spread a piece of fake news or not is ignored. The confirmation bias theory has indicated that a user is more likely to spread a piece of fake news when it confirms his/her existing beliefs/preferences. Users' historical, social engagements such as posts provide rich information about users' preferences toward news and have great potential to advance fake news detection. However, the work on exploring user preference for fake news detection is somewhat limited. Therefore, in this paper, we study the novel problem of exploiting user preference for fake news detection. We propose a new framework, UPFD, which simultaneously captures various signals from user preferences by joint content and graph modeling. Experimental results on real-world datasets demonstrate the effectiveness of the proposed framework. We release our code and data as a benchmark for GNN-based fake news detection: https://github.com/safe-graph/GNN-FakeNews.

PDF Abstract

Datasets


Introduced in the Paper:

UPFD UPFD-GOS UPFD-POL

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Graph Classification UPFD-GOS UPFD-SAGE Accuracy (%) 97.54 # 1
Graph Classification UPFD-GOS UPFD-GAT Accuracy (%) 96.52 # 3
Graph Classification UPFD-GOS UPFD-GCNFN Accuracy (%) 96.11 # 4
Graph Classification UPFD-GOS GCNFN Accuracy (%) 95.90 # 5
Graph Classification UPFD-GOS UPFD-GCN Accuracy (%) 95.11 # 6
Graph Classification UPFD-GOS UPFD-BiGCN Accuracy (%) 91.27 # 8
Graph Classification UPFD-GOS GNNCL Accuracy (%) 93.60 # 7
Graph Classification UPFD-POL GNNCL Accuracy (%) 60.18 # 8
Graph Classification UPFD-POL UPFD-SAGE Accuracy (%) 84.62 # 2
Graph Classification UPFD-POL UPFD-GAT Accuracy (%) 82.81 # 5
Graph Classification UPFD-POL UPFD-GCN Accuracy (%) 81.90 # 7
Graph Classification UPFD-POL UPFD-BiGCN Accuracy (%) 83.26 # 4
Graph Classification UPFD-POL UPFD-GCNFN Accuracy (%) 82.35 # 6
Graph Classification UPFD-POL GCNFN Accuracy (%) 83.71 # 3

Methods