Using Graph Algorithms to Pretrain Graph Completion Transformers

no code implementations • 14 Oct 2022 • Jonathan Pilault, Michael Galkin, Bahare Fatemi, Perouz Taslakian, David Vasquez, Christopher Pal

While using our new path-finding algorithm as a pretraining signal provides 2-3% MRR improvements, we show that pretraining on all signals together gives the best knowledge graph completion results.

Knowledge Graph Completion Knowledge Graph Embedding +1