HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Decoupled Local Aggregation for Point Cloud Learning

Chen Binjie ; Xia Yunzhou ; Zang Yu ; Wang Cheng ; Li Jonathan

Decoupled Local Aggregation for Point Cloud Learning

Abstract

The unstructured nature of point clouds demands that local aggregation beadaptive to different local structures. Previous methods meet this byexplicitly embedding spatial relations into each aggregation process. Althoughthis coupled approach has been shown effective in generating clear semantics,aggregation can be greatly slowed down due to repeated relation learning andredundant computation to mix directional and point features. In this work, wepropose to decouple the explicit modelling of spatial relations from localaggregation. We theoretically prove that basic neighbor pooling operations cantoo function without loss of clarity in feature fusion, so long as essentialspatial information has been encoded in point features. As an instantiation ofdecoupled local aggregation, we present DeLA, a lightweight point network,where in each learning stage relative spatial encodings are first formed, andonly pointwise convolutions plus edge max-pooling are used for localaggregation then. Further, a regularization term is employed to reducepotential ambiguity through the prediction of relative coordinates.Conceptually simple though, experimental results on five classic benchmarksdemonstrate that DeLA achieves state-of-the-art performance with reduced orcomparable latency. Specifically, DeLA achieves over 90\% overall accuracy onScanObjectNN and 74\% mIoU on S3DIS Area 5. Our code is available athttps://github.com/Matrix-ASC/DeLA .

Code Repositories

matrix-asc/dela
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
3d-point-cloud-classification-on-modelnet40DeLA
FLOPs: 1.44G
Mean Accuracy: 92.2
Number of params: 5.3M
Overall Accuracy: 94.0
3d-point-cloud-classification-on-scanobjectnnDeLA
FLOPs: 1.5G
Mean Accuracy: 89.3
Number of params: 5.3M
Overall Accuracy: 90.4
semantic-segmentation-on-s3dis-area5DeLA
Number of params: 7.0M
mAcc: 80.0
mIoU: 74.1
oAcc: 92.2
semantic-segmentation-on-scannetDeLA
val mIoU: 75.9
supervised-only-3d-point-cloud-classificationDeLA
GFLOPs: 1.5
Number of params (M): 5.3
Overall Accuracy (PB_T50_RS): 90.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp