HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Efficient Mirror Detection via Multi-level Heterogeneous Learning

He Ruozhen ; Lin Jiaying ; Lau Rynson W. H.

Efficient Mirror Detection via Multi-level Heterogeneous Learning

Abstract

We present HetNet (Multi-level \textbf{Het}erogeneous \textbf{Net}work), ahighly efficient mirror detection network. Current mirror detection methodsfocus more on performance than efficiency, limiting the real-time applications(such as drones). Their lack of efficiency is aroused by the common design ofadopting homogeneous modules at different levels, which ignores the differencebetween different levels of features. In contrast, HetNet detects potentialmirror regions initially through low-level understandings (\textit{e.g.},intensity contrasts) and then combines with high-level understandings(contextual discontinuity for instance) to finalize the predictions. To performaccurate yet efficient mirror detection, HetNet follows an effectivearchitecture that obtains specific information at different stages to detectmirrors. We further propose a multi-orientation intensity-based contrastedmodule (MIC) and a reflection semantic logical module (RSL), equipped onHetNet, to predict potential mirror regions by low-level understandings andanalyze semantic logic in scenarios by high-level understandings, respectively.Compared to the state-of-the-art method, HetNet runs 664$\%$ faster and drawsan average performance gain of 8.9$\%$ on MAE, 3.1$\%$ on IoU, and 2.0$\%$ onF-measure on two mirror detection benchmarks.

Code Repositories

catherine-r-he/hetnet
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-segmentation-on-msd-mirror-segmentationHetNet
F-measure: 0.906
IoU: 0.828
MAE: 0.043
image-segmentation-on-pmdHetNet
F-measure: 0.814
IoU: 0.690
MAE: 0.029

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp