HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

PVALane: Prior-Guided 3D Lane Detection with View-Agnostic Feature Alignment

{Xiaochen Yuan Chi-Man Pun Guoheng Huang Chengxin Li Xiang Gao Yongqiang Mou Xuemin Zhang Zewen Zheng}

Abstract

Monocular 3D lane detection is essential for a reliable autonomous driving system and has recently been rapidly developing. Existing popular methods mainly employ a predefined 3D anchor for lane detection based on front-viewed (FV) space, aiming to mitigate the effects of view transformations. However, the perspective geometric distortion between FV and 3D space in this FV-based approach introduces extremely dense anchor designs, which ultimately leads to confusing lane representations. In this paper, we introduce a novel prior-guided perspective on lane detection and propose an end-to-end framework named PVALane, which utilizes 2D prior knowledge to achieve precise and efficient 3D lane detection. Since 2D lane predictions can provide strong priors for lane existence, PVALane exploits FV features to generate sparse prior anchors with potential lanes in 2D space. These dynamic prior anchors help PVALane to achieve distinct lane representations and effectively improve the precision of PVALane due to the reduced lane search space. Additionally, by leveraging these prior anchors and representing lanes in both FV and bird-eye-viewed (BEV) spaces, we effectively align and merge semantic and geometric information from FV and BEV features. Extensive experiments conducted on the OpenLane and ONCE-3DLanes datasets demonstrate the superior performance of our method compared to existing state-of-the-art approaches and exhibit excellent robustness.

Benchmarks

BenchmarkMethodologyMetrics
3d-lane-detection-on-openlanePVALane (Swin-B)
Curve: 67.7
Extreme Weather: 64.0
F1 (all): 63.4
Intersection: 53.6
Merge u0026 Split: 60.8
Night: 58.6
Up u0026 Down: 56.1
3d-lane-detection-on-openlanePVALane (ResNet-50)
Curve: 67.3
Extreme Weather: 62.0
F1 (all): 62.7
Intersection: 53.4
Merge u0026 Split: 60.0
Night: 57.2
Up u0026 Down: 54.1
3d-lane-detection-on-openlanePVALane (ResNet-18)
Curve: 65.7
Extreme Weather: 59.5
F1 (all): 61.2
Intersection: 52.2
Merge u0026 Split: 58.7
Night: 56.5
Up u0026 Down: 52.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp