HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

HomoFormer: Homogenized Transformer for Image Shadow Removal

{Zheng-Jun Zha Kai Zhu Jie Huang Dong Li Yurui Zhu Xueyang Fu Jie Xiao}

HomoFormer: Homogenized Transformer for Image Shadow Removal

Abstract

The spatial non-uniformity and diverse patterns of shadow degradation conflict with the weight sharing manner of dominant models which may lead to an unsatisfactory compromise. To tackle with this issue we present a novel strategy from the view of shadow transformation in this paper: directly homogenizing the spatial distribution of shadow degradation. Our key design is the random shuffle operation and its corresponding inverse operation. Specifically random shuffle operation stochastically rearranges the pixels across spatial space and the inverse operation recovers the original order. After randomly shuffling the shadow diffuses in the whole image and the degradation appears in a homogenized way which can be effectively processed by the local self-attention layer. Moreover we further devise a new feed forward network with position modeling to exploit image structural information. Based on these elements we construct the final local window based transformer named HomoFormer for image shadow removal. Our HomoFormer can enjoy the linear complexity of local transformers while bypassing challenges of non-uniformity and diversity of shadow. Extensive experiments are conducted to verify the superiority of our HomoFormer across public datasets.

Benchmarks

BenchmarkMethodologyMetrics
shadow-removal-on-istd-1HomoFormer (CVPR 2024) (512x512)
LPIPS: 0.196
PSNR: 28.53
RMSE: 2.88
SSIM: 0.857
shadow-removal-on-istd-1HomoFormer (CVPR 2024) (256x256)
LPIPS: 0.348
PSNR: 26.72
RMSE: 3.37
SSIM: 0.732
shadow-removal-on-srdHomoFormer (CVPR 2024) (256x256)
LPIPS: 0.325
PSNR: 24.64
RMSE: 4.17
SSIM: 0.723
shadow-removal-on-srdHomoFormer (CVPR 2024) (512x512)
LPIPS: 0.219
PSNR: 26.21
RMSE: 3.62
SSIM: 0.827

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp