HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs

Deepak Nathani; Jatin Chauhan; Charu Sharma; Manohar Kaul

Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs

Abstract

The recent proliferation of knowledge graphs (KGs) coupled with incomplete or partial information, in the form of missing relations (links) between entities, has fueled a lot of research on knowledge base completion (also known as relation prediction). Several recent works suggest that convolutional neural network (CNN) based models generate richer and more expressive feature embeddings and hence also perform well on relation prediction. However, we observe that these KG embeddings treat triples independently and thus fail to cover the complex and hidden information that is inherently implicit in the local neighborhood surrounding a triple. To this effect, our paper proposes a novel attention based feature embedding that captures both entity and relation features in any given entity's neighborhood. Additionally, we also encapsulate relation clusters and multihop relations in our model. Our empirical study offers insights into the efficacy of our attention based model and we show marked performance gains in comparison to state of the art methods on all datasets.

Code Repositories

KXY-PUBLIC/NASE
pytorch
Mentioned in GitHub
deepakn97/relationPrediction
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
knowledge-graph-completion-on-fb15k-237KBGAT
Hits@10: 62.6
Hits@3: 54
knowledge-graph-completion-on-fb15k-237KBAT
Hits@1: 46
MR: 0.210
MRR: 0.518
knowledge-graph-completion-on-wn18rrKBGAT
Hits@1: 0.361
Hits@10: 0.581
Hits@3: 0.483
link-prediction-on-wn18rrKBGAT
Hits@1: 0.361
Hits@10: 0.581
Hits@3: 0.483
MR: 1940.0
MRR: 0.44

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp