HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Learning Multi-View Camera Relocalization With Graph Neural Networks

{ Junqiu Wang Shaojun Cai Xin Wu Fei Xue}

Learning Multi-View Camera Relocalization With Graph Neural Networks

Abstract

We propose to construct a view graph to excavate the information of the whole given sequence for absolute camera pose estimation. Specifically, we harness GNNs to model the graph, allowing even non-consecutive frames to exchange information with each other. Rather than adopting the regular GNNs directly, we redefine the nodes, edges, and embedded functions to fit the relocalization task. Redesigned GNNs cooperate with CNNs in guiding knowledge propagation and feature extraction respectively to process multi-view high-dimension image features iteratively at different levels. Besides, a general graph-based loss function beyond constraints between consecutive views is employed for training the network in an end-to-end fashion. Extensive experiments conducted on both indoor and outdoor datasets demonstrate that our method outperforms previous approaches especially in large-scale and challenging scenarios.

Benchmarks

BenchmarkMethodologyMetrics
camera-localization-on-oxford-robotcar-fullGNNMapNet
Mean Translation Error: 17.35
visual-localization-on-oxford-robotcar-fullGNNMapNet
Mean Translation Error: 17.35

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Learning Multi-View Camera Relocalization With Graph Neural Networks | Papers | HyperAI