HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloud

Mutian Xu Junhao Zhang Zhipeng Zhou Mingye Xu Xiaojuan Qi Yu Qiao

Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloud

Abstract

In 2D image processing, some attempts decompose images into high and low frequency components for describing edge and smooth parts respectively. Similarly, the contour and flat area of 3D objects, such as the boundary and seat area of a chair, describe different but also complementary geometries. However, such investigation is lost in previous deep networks that understand point clouds by directly treating all points or local patches equally. To solve this problem, we propose Geometry-Disentangled Attention Network (GDANet). GDANet introduces Geometry-Disentangle Module to dynamically disentangle point clouds into the contour and flat part of 3D objects, respectively denoted by sharp and gentle variation components. Then GDANet exploits Sharp-Gentle Complementary Attention Module that regards the features from sharp and gentle variation components as two holistic representations, and pays different attentions to them while fusing them respectively with original point cloud features. In this way, our method captures and refines the holistic and complementary 3D geometric semantics from two distinct disentangled components to supplement the local information. Extensive experiments on 3D object classification and segmentation benchmarks demonstrate that GDANet achieves the state-of-the-arts with fewer parameters. Code is released on https://github.com/mutianxu/GDANet.

Code Repositories

yossilevii100/critical_points2
pytorch
Mentioned in GitHub
mutianxu/GDANet
Official
pytorch
Mentioned in GitHub
yossilevii100/refocusing
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
3d-part-segmentation-on-shapenet-partGDANet
Class Average IoU: 85.0
Instance Average IoU: 86.5
3d-point-cloud-classification-on-modelnet40GDANet
Overall Accuracy: 93.8
point-cloud-classification-on-pointcloud-cGDANet
mean Corruption Error (mCE): 0.892
point-cloud-segmentation-on-pointcloud-cGDANet
mean Corruption Error (mCE): 0.923

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp