HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Make Explicit Calibration Implicit: Calibrate Denoiser Instead of the Noise Model

Xin Jin Jia-Wen Xiao Ling-Hao Han Chunle Guo Xialei Liu Chongyi Li Ming-Ming Cheng

Make Explicit Calibration Implicit: Calibrate Denoiser Instead of the Noise Model

Abstract

Explicit calibration-based methods have dominated RAW image denoising under extremely low-light environments. However, these methods are impeded by several critical limitations: a) the explicit calibration process is both labor- and time-intensive, b) challenge exists in transferring denoisers across different camera models, and c) the disparity between synthetic and real noise is exacerbated by digital gain. To address these issues, we introduce a groundbreaking pipeline named Lighting Every Darkness (LED), which is effective regardless of the digital gain or the camera sensor. LED eliminates the need for explicit noise model calibration, instead utilizing an implicit fine-tuning process that allows quick deployment and requires minimal data. Structural modifications are also included to reduce the discrepancy between synthetic and real noise without extra computational demands. Our method surpasses existing methods in various camera models, including new ones not in public datasets, with just a few pairs per digital gain and only 0.5% of the typical iterations. Furthermore, LED also allows researchers to focus more on deep learning advancements while still utilizing sensor engineering benefits. Code and related materials can be found in https://srameo.github.io/projects/led-iccv23/ .

Code Repositories

srameo/led
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-denoising-on-sid-sonya7s2-x100LED
PSNR (Raw): 41.98
SSIM (Raw): 0.954
image-denoising-on-sid-sonya7s2-x250LED
PSNR (Raw): 39.34
SSIM (Raw): 0.932
image-denoising-on-sid-sonya7s2-x300LED
PSNR (Raw): 36.67
SSIM (Raw): 0.915

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp