Command Palette
Search for a command to run...
Erik Arakelyan; Daniel Daza; Pasquale Minervini; Michael Cochez

Abstract
Neural link predictors are immensely useful for identifying missing edges in large scale Knowledge Graphs. However, it is still not clear how to use these models for answering more complex queries that arise in a number of domains, such as queries using logical conjunctions ($\land$), disjunctions ($\lor$) and existential quantifiers ($\exists$), while accounting for missing edges. In this work, we propose a framework for efficiently answering complex queries on incomplete Knowledge Graphs. We translate each query into an end-to-end differentiable objective, where the truth value of each atom is computed by a pre-trained neural link predictor. We then analyse two solutions to the optimisation problem, including gradient-based and combinatorial search. In our experiments, the proposed approach produces more accurate results than state-of-the-art methods -- black-box neural models trained on millions of generated queries -- without the need of training on a large and diverse set of complex queries. Using orders of magnitude less training data, we obtain relative improvements ranging from 8% up to 40% in Hits@3 across different knowledge graphs containing factual information. Finally, we demonstrate that it is possible to explain the outcome of our model in terms of the intermediate solutions identified for each of the complex query atoms. All our source code and datasets are available online, at https://github.com/uclnlp/cqd.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| complex-query-answering-on-fb15k | CQD-CO | Hits@3 1p: 0.918 Hits@3 2i: 0.796 Hits@3 2p: 0.454 Hits@3 2u: 0.816 Hits@3 3i: 0.837 Hits@3 3p: 0.191 Hits@3 ip: 0.336 Hits@3 pi: 0.513 Hits@3 up: 0.319 |
| complex-query-answering-on-fb15k | CQD | MRR 1p: 0.892 MRR 2i: 0.771 MRR 2p: 0.653 MRR 2u: 0.723 MRR 3i: 0.806 MRR ip: 0.716 |
| complex-query-answering-on-fb15k | CQD-Beam | Hits@3 1p: 0.918 Hits@3 2i: 0.796 Hits@3 2p: 0.779 Hits@3 2u: 0.839 Hits@3 3i: 0.837 Hits@3 3p: 0.577 Hits@3 ip: 0.375 Hits@3 pi: 0.658 Hits@3 up: 0.345 |
| complex-query-answering-on-fb15k-237 | CQD | MRR 3i: 0.486 |
| complex-query-answering-on-fb15k-237 | CQD-CO | Hits@3 1p: 0.512 Hits@3 2i: 35.2 Hits@3 2p: 0.213 Hits@3 2u: 0.281 Hits@3 3i: 0.457 Hits@3 3p: 0.131 Hits@3 ip: 0.146 Hits@3 pi: 0.222 Hits@3 up: 0.132 |
| complex-query-answering-on-fb15k-237 | CQD-Beam | Hits@3 1p: 0.512 Hits@3 2i: 0.352 Hits@3 2p: 0.288 Hits@3 2u: 0.284 Hits@3 3i: 0.457 Hits@3 3p: 0.221 Hits@3 ip: 0.129 Hits@3 pi: 0.249 Hits@3 up: 0.121 |
| complex-query-answering-on-nell-995 | CQD | MRR 1p: 0.604 MRR 2i: 0.436 MRR ip: 0.256 |
| complex-query-answering-on-nell995 | CQD-CO | Hits@3 1p: 0.667 Hits@3 2i: 0.410 Hits@3 2p: 0.265 Hits@3 2u: 0.531 Hits@3 3i: 0.529 Hits@3 3p: 0.220 Hits@3 ip: 0.196 Hits@3 pi: 0.302 Hits@3 up: 0.194 |
| complex-query-answering-on-nell995 | CQD-Beam | Hits@3 2p: 0.350 Hits@3 3p: 0.288 Hits@3 ip: 0.171 Hits@3 pi: 0.277 Hits@3 up: 0.156 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.