HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

LMSCNet: Lightweight Multiscale 3D Semantic Completion

Roldão Luis ; de Charette Raoul ; Verroust-Blondet Anne

LMSCNet: Lightweight Multiscale 3D Semantic Completion

Abstract

We introduce a new approach for multiscale 3Dsemantic scene completion fromvoxelized sparse 3D LiDAR scans. As opposed to the literature, we use a 2D UNetbackbone with comprehensive multiscale skip connections to enhance featureflow, along with 3D segmentation heads. On the SemanticKITTI benchmark, ourmethod performs on par on semantic completion and better on occupancycompletion than all other published methods -- while being significantlylighter and faster. As such it provides a great performance/speed trade-off formobile-robotics applications. The ablation studies demonstrate our method isrobust to lower density inputs, and that it enables very high speed semanticcompletion at the coarsest level. Our code is available athttps://github.com/cv-rits/LMSCNet.

Code Repositories

umich-curly/3dmapping
pytorch
Mentioned in GitHub
astra-vision/lmscnet
pytorch
Mentioned in GitHub
cv-rits/LMSCNet
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
3d-semantic-scene-completion-from-a-singleLMSCNet (rgb input - reported in MonoScene paper)
mIoU: 15.88
3d-semantic-scene-completion-from-a-single-1LMSCNet (rgb input - reported in MonoScene paper)
mIoU: 7.09
3d-semantic-scene-completion-on-kitti-360LMSCNet
mIoU: 13.65
3d-semantic-scene-completion-on-nyuv2LMSCNet-SS
mIoU: 28.4
3d-semantic-scene-completion-on-semantickittiLMSCNet
mIoU: 17
3d-semantic-scene-completion-on-semantickittiLMSCNet-SS
mIoU: 17.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp