HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection

{ Le Zhang Xuan-Yi Li Ming-Ming Cheng Deng-Ping Fan Yang Cao Jia-Xing Zhao}

Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection

Abstract

The large availability of depth sensors provides valuable complementary information for salient object detection (SOD) in RGBD images. However, due to the inherent difference between RGB and depth information, extracting features from the depth channel using ImageNet pre-trained backbone models and fusing them with RGB features directly are sub-optimal. In this paper, we utilize contrast prior, which used to be a dominant cue in none deep learning based SOD approaches, into CNNs-based architecture to enhance the depth information. The enhanced depth cues are further integrated with RGB features for SOD, using a novel fluid pyramid integration, which can make better use of multi-scale cross-modal features. Comprehensive experiments on 5 challenging benchmark datasets demonstrate the superiority of the architecture CPFP over 9 state-of-the-art alternative methods.

Benchmarks

BenchmarkMethodologyMetrics
rgb-d-salient-object-detection-on-desCPFP
Average MAE: 0.038
S-Measure: 87.2
max E-Measure: 92.3
max F-Measure: 84.6
rgb-d-salient-object-detection-on-lfsdCPFP
Average MAE: 0.088
S-Measure: 82.8
max E-Measure: 86.3
max F-Measure: 81.1
rgb-d-salient-object-detection-on-nju2kCPFP
Average MAE: 0.053
S-Measure: 87.8
max E-Measure: 92.6
max F-Measure: 87.7
rgb-d-salient-object-detection-on-nlprCPFP
Average MAE: 0.036
S-Measure: 88.8
max E-Measure: 93.2
max F-Measure: 86.7
rgb-d-salient-object-detection-on-sipCPFP
Average MAE: 0.064
S-Measure: 85.0
max E-Measure: 90.3
max F-Measure: 85.1
rgb-d-salient-object-detection-on-ssdCPFP
Average MAE: 0.082
S-Measure: 80.7
max E-Measure: 85.2
max F-Measure: 76.6
rgb-d-salient-object-detection-on-stereCPFP
Average MAE: 0.051
S-Measure: 87.9
max E-Measure: 92.5
max F-Measure: 87.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp