HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Simple Base Frame Guided Residual Network for RAW Burst Image Super-Resolution

{Helio Pedrini Cid Santos Gerson Barbosa Anderson Cotrim}

Simple Base Frame Guided Residual Network for RAW Burst Image Super-Resolution

Abstract

Burst super-resolution or multi-frame super-resolution (MFSR) has gained significant attention in recent years, particularly in the context of mobile photography. With modern handheld devices consistently increasing their processing power and the ability to capture multiple images even faster, the development of robust MFSR algorithms has become increasingly feasible. Furthermore, in contrast to extensively studied single-image super-resolution (SISR), burst super-resolution mitigates the ill-posed nature of reconstructing high-resolution images from low-resolution ones by merging information from multiple shifted frames. This research introduces a novel and effective deep learning approach, SBFBurst, designed to tackle this challenging problem. Our network takes multiple noisy RAW images as input and generates a denoised, super-resolved RGB image as output. We demonstrate that significant enhancements can be achieved in this problem by incorporating base frame-guided mechanisms through operations such as feature map concatenation and skip connections. Additionally, we highlight the significance of employing mosaicked convolution to enhance alignment, thus enhancing the overall network performance in super-resolution tasks. These relatively simple improvements underscore the competitiveness of our proposed method when compared to other state-of-the-art approaches.

Benchmarks

BenchmarkMethodologyMetrics
burst-image-super-resolution-onSBFBurst
LPIPS: 0.036
PSNR: 42.19
SSIM: 0.968
burst-image-super-resolution-on-burstsrSBFBurst
LPIPS: 0.022
PSNR: 48.87
SSIM: 0.987

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Simple Base Frame Guided Residual Network for RAW Burst Image Super-Resolution | Papers | HyperAI