HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

LaserMix for Semi-Supervised LiDAR Semantic Segmentation

Lingdong Kong Jiawei Ren Liang Pan Ziwei Liu

LaserMix for Semi-Supervised LiDAR Semantic Segmentation

Abstract

Densely annotating LiDAR point clouds is costly, which restrains the scalability of fully-supervised learning methods. In this work, we study the underexplored semi-supervised learning (SSL) in LiDAR segmentation. Our core idea is to leverage the strong spatial cues of LiDAR point clouds to better exploit unlabeled data. We propose LaserMix to mix laser beams from different LiDAR scans, and then encourage the model to make consistent and confident predictions before and after mixing. Our framework has three appealing properties: 1) Generic: LaserMix is agnostic to LiDAR representations (e.g., range view and voxel), and hence our SSL framework can be universally applied. 2) Statistically grounded: We provide a detailed analysis to theoretically explain the applicability of the proposed framework. 3) Effective: Comprehensive experimental analysis on popular LiDAR segmentation datasets (nuScenes, SemanticKITTI, and ScribbleKITTI) demonstrates our effectiveness and superiority. Notably, we achieve competitive results over fully-supervised counterparts with 2x to 5x fewer labels and improve the supervised-only baseline significantly by 10.8% on average. We hope this concise yet high-performing framework could facilitate future research in semi-supervised LiDAR segmentation. Code is publicly available.

Code Repositories

yuan-zm/dgt-st
pytorch
Mentioned in GitHub
ldkong1205/LaserMix
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
semi-supervised-semantic-segmentation-on-1LaserMix (DeepLab v3+, ImageNet pre- trained ResNet50, single scale inference)
Validation mIoU: 78.3%
semi-supervised-semantic-segmentation-on-2LaserMix (DeepLab v3+, ImageNet pre-trained ResNet50, single scale inference)
Validation mIoU: 77.1%
semi-supervised-semantic-segmentation-on-23LaserMix (Range View)
mIoU (1% Labels): 38.3
mIoU (10% Labels): 54.4
mIoU (20% Labels): 55.6
mIoU (50% Labels): 58.7
semi-supervised-semantic-segmentation-on-23LaserMix (Voxel)
mIoU (1% Labels): 44.2
mIoU (10% Labels): 53.7
mIoU (20% Labels): 55.1
mIoU (50% Labels): 56.8
semi-supervised-semantic-segmentation-on-24LaserMix (Voxel)
mIoU (1% Labels): 50.6
mIoU (10% Labels): 60.0
mIoU (20% Labels): 61.9
mIoU (50% Labels): 62.3
semi-supervised-semantic-segmentation-on-24LaserMix (Range View)
mIoU (1% Labels): 43.4
mIoU (10% Labels): 58.8
mIoU (20% Labels): 59.4
mIoU (50% Labels): 61.4
semi-supervised-semantic-segmentation-on-25LaserMix (Range View)
mIoU (1% Labels): 49.5
mIoU (10% Labels): 68.2
mIoU (20% Labels): 70.6
mIoU (50% Labels): 73.0
semi-supervised-semantic-segmentation-on-25LaserMix (Voxel)
mIoU (1% Labels): 55.3
mIoU (10% Labels): 69.9
mIoU (20% Labels): 71.8
mIoU (50% Labels): 73.2
semi-supervised-semantic-segmentation-on-8LaserMix (DeepLab v3+, ImageNet pre- trained ResNet50, single scale inference)
Validation mIoU: 79.1%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp