HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Benchmarking and Analyzing Point Cloud Classification under Corruptions

Jiawei Ren Liang Pan Ziwei Liu

Benchmarking and Analyzing Point Cloud Classification under Corruptions

Abstract

3D perception, especially point cloud classification, has achieved substantial progress. However, in real-world deployment, point cloud corruptions are inevitable due to the scene complexity, sensor inaccuracy, and processing imprecision. In this work, we aim to rigorously benchmark and analyze point cloud classification under corruptions. To conduct a systematic investigation, we first provide a taxonomy of common 3D corruptions and identify the atomic corruptions. Then, we perform a comprehensive evaluation on a wide range of representative point cloud models to understand their robustness and generalizability. Our benchmark results show that although point cloud classification performance improves over time, the state-of-the-art methods are on the verge of being less robust. Based on the obtained observations, we propose several effective techniques to enhance point cloud classifier robustness. We hope our comprehensive benchmark, in-depth analysis, and proposed techniques could spark future research in robust 3D perception.

Code Repositories

yossilevii100/critical_points2
pytorch
Mentioned in GitHub
jiawei-ren/modelnetc
Official
pytorch
Mentioned in GitHub
ldkong1205/PointCloud-C
pytorch
Mentioned in GitHub
yossilevii100/refocusing
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
point-cloud-classification-on-pointcloud-cWOLFMix (DGCNN)
mean Corruption Error (mCE): 0.590
point-cloud-classification-on-pointcloud-cWOLFMix (GDANet)
mean Corruption Error (mCE): 0.571
point-cloud-classification-on-pointcloud-cWOLFMix (RPC)
mean Corruption Error (mCE): 0.601
point-cloud-classification-on-pointcloud-cRPC
mean Corruption Error (mCE): 0.863
point-cloud-classification-on-pointcloud-cWOLFMix (PointNet)
mean Corruption Error (mCE): 1.180

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp