RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space

We study the problem of learning representations of entities and relations in knowledge graphs for predicting missing links. The success of such a task heavily relies on the ability of modeling and inferring the patterns of (or between) the relations. In this paper, we present a new approach for knowledge graph embedding called RotatE, which is able to model and infer various relation patterns including: symmetry/antisymmetry, inversion, and composition. Specifically, the RotatE model defines each relation as a rotation from the source entity to the target entity in the complex vector space. In addition, we propose a novel self-adversarial negative sampling technique for efficiently and effectively training the RotatE model. Experimental results on multiple benchmark knowledge graphs show that the proposed RotatE model is not only scalable, but also able to infer and model various relation patterns and significantly outperform existing state-of-the-art models for link prediction.

PDF Abstract ICLR 2019 PDF ICLR 2019 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Link Prediction FB122 RotatE HITS@3 70.8 # 2
Hits@5 73.57 # 2
Hits@10 77.0 # 2
MRR 67.8 # 2
Link Prediction FB15k RotatE MR 40 # 4
MRR 0.797 # 10
Hits@10 0.884 # 14
Hits@3 0.830 # 6
Hits@1 0.746 # 5
Link Prediction FB15k pRotatE MR 43 # 5
MRR 0.799 # 9
Hits@10 0.884 # 14
Hits@3 0.829 # 7
Hits@1 0.750 # 4
Link Prediction FB15k-237 pRotatE MRR 0.328 # 48
Hits@10 0.524 # 39
Hits@3 0.365 # 36
Hits@1 0.23 # 43
MR 178 # 18
Link Prediction FB15k-237 RotatE MRR 0.338 # 42
Hits@10 0.533 # 35
Hits@3 0.375 # 33
Hits@1 0.241 # 40
MR 177 # 17
Link Property Prediction ogbl-biokg RotatE Test MRR 0.7989 ± 0.0004 # 15
Validation MRR 0.7997 ± 0.0002 # 15
Number of params 187597000 # 5
Ext. data No # 1
Link Property Prediction ogbl-wikikg2 RotatE (250dim) Validation MRR 0.4353 ± 0.0028 # 22
Test MRR 0.4332 ± 0.0025 # 22
Number of params 1250435750 # 25
Ext. data No # 1
Link Property Prediction ogbl-wikikg2 RotatE (50dim) Validation MRR 0.2250 ± 0.0035 # 30
Test MRR 0.2530 ± 0.0034 # 30
Number of params 250087150 # 11
Ext. data No # 1
Link Prediction WN18 pRotatE MRR 0.947 # 16
Hits@10 0.957 # 14
Hits@3 0.950 # 12
Hits@1 0.942 # 13
MR 254 # 9
Link Prediction WN18 RotatE MRR 0.949 # 14
Hits@10 0.959 # 7
Hits@3 0.952 # 10
Hits@1 0.944 # 10
MR 309 # 12
Link Prediction WN18RR pRotatE MRR 0.462 # 51
Hits@10 0.552 # 47
Hits@3 0.479 # 41
Hits@1 0.417 # 47
MR 2923 # 19
Link Prediction WN18RR RotatE MRR 0.476 # 42
Hits@10 0.571 # 33
Hits@3 0.492 # 32
Hits@1 0.428 # 42
MR 3340 # 24

Methods