HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

SpaGBOL: Spatial-Graph-Based Orientated Localisation

Shore Tavis ; Mendez Oscar ; Hadfield Simon

SpaGBOL: Spatial-Graph-Based Orientated Localisation

Abstract

Cross-View Geo-Localisation within urban regions is challenging in part dueto the lack of geo-spatial structuring within current datasets and techniques.We propose utilising graph representations to model sequences of localobservations and the connectivity of the target location. Modelling as a graphenables generating previously unseen sequences by sampling with new parameterconfigurations. To leverage this newly available information, we propose aGNN-based architecture, producing spatially strong embeddings and improvingdiscriminability over isolated image embeddings. We outline SpaGBOL,introducing three novel contributions. 1) The first graph-structured datasetfor Cross-View Geo-Localisation, containing multiple streetview images per nodeto improve generalisation. 2) Introducing GNNs to the problem, we develop thefirst system that exploits the correlation between node proximity and featuresimilarity. 3) Leveraging the unique properties of the graph representation -we demonstrate a novel retrieval filtering approach based on neighbourhoodbearings. SpaGBOL achieves state-of-the-art accuracies on the unseen test graph- with relative Top-1 retrieval improvements on previous techniques of 11%, and50% when filtering with Bearing Vector Matching on the SpaGBOL dataset.

Code Repositories

tavisshore/SpaGBOL
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
cross-view-geo-localisation-on-spagbolDSM
Top-1: 5.82
Top-1%: 18.62
Top-10: 14.13
Top-5: 10.21
cross-view-geo-localisation-on-spagbolSpaGBOL
Top-1: 56.48
Top-1%: 87.24
Top-10: 83.85
Top-5: 77.47
cross-view-geo-localisation-on-spagbolGeoDTR+
Top-1: 17.49
Top-1%: 59.41
Top-10: 52.01
Top-5: 40.27
cross-view-geo-localisation-on-spagbolCVM-Net
Top-1: 2.87
Top-1%: 28.33
Top-10: 21.51
Top-5: 13.02
cross-view-geo-localisation-on-spagbolSample4Geo
Top-1: 50.80
Top-1%: 82.32
Top-10: 79.96
Top-5: 74.22
cross-view-geo-localisation-on-spagbolCVFT
Top-1: 4.02
Top-1%: 27.19
Top-10: 20.29
cross-view-geo-localisation-on-spagbolSAIG-D
Top-1: 25.65
Top-1%: 68.22
Top-10: 62.29
Top-5: 51.44
cross-view-geo-localisation-on-spagbolL2LTR
Top-1: 11.23
Top-1%: 49.52
Top-10: 42.5
Top-5: 31.27
cross-view-geo-localisation-on-spagbol-180degSpaGBOL
Top-1: 40.88
Top-5: 63.79
cross-view-geo-localisation-on-spagbol-90degSpaGBOL
Top-1: 18.63
Top-5: 43.2
cross-view-geo-localisation-on-vigor-graphSpaGBOL
Accuracy (Top-1): 31.88

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp