Large Language Model Meets Graph Neural Network in Knowledge Distillation

no code implementations • 8 Feb 2024 • Shengxiang Hu, Guobing Zou, Song Yang, Yanglan Gan, Bofeng Zhang, Yixin Chen

Despite recent community revelations about the advancements and potential applications of Large Language Models (LLMs) in understanding Text-Attributed Graph (TAG), the deployment of LLMs for production is hindered by its high computational and storage requirements, as well as long latencies during model inference.

Contrastive Learning Knowledge Distillation +4