HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Adaptive Convolution for Multi-Relational Learning

{Bin Wang Xiaotian Jiang Quan Wang}

Adaptive Convolution for Multi-Relational Learning

Abstract

We consider the problem of learning distributed representations for entities and relations of multi-relational data so as to predict missing links therein. Convolutional neural networks have recently shown their superiority for this problem, bringing increased model expressiveness while remaining parameter efficient. Despite the success, previous convolution designs fail to model full interactions between input entities and relations, which potentially limits the performance of link prediction. In this work we introduce ConvR, an adaptive convolutional network designed to maximize entity-relation interactions in a convolutional fashion. ConvR adaptively constructs convolution filters from relation representations, and applies these filters across entity representations to generate convolutional features. As such, ConvR enables rich interactions between entity and relation representations at diverse regions, and all the convolutional features generated will be able to capture such interactions. We evaluate ConvR on multiple benchmark datasets. Experimental results show that: (1) ConvR performs substantially better than competitive baselines in almost all the metrics and on all the datasets; (2) Compared with state-of-the-art convolutional models, ConvR is not only more effective but also more efficient. It offers a 7{%} increase in MRR and a 6{%} increase in Hits@10, while saving 12{%} in parameter storage.

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-fb15kConvR
Hits@1: 0.720
Hits@10: 0.887
Hits@3: 0.826
MRR: 0.782
link-prediction-on-fb15k-237ConvR
Hits@1: 0.261
Hits@10: 0.528
Hits@3: 0.385
MRR: 0.350
link-prediction-on-wn18ConvR
Hits@1: 0.947
Hits@10: 0.958
Hits@3: 0.955
MRR: 0.951
link-prediction-on-wn18rrConvR
Hits@1: 0.443
Hits@10: 0.537
Hits@3: 0.489
MRR: 0.475

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp