HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Image Super-Resolution via Attention based Back Projection Networks

Zhi-Song Liu Li-Wen Wang Chu-Tak Li Wan-Chi Siu Yui-Lam Chan

Image Super-Resolution via Attention based Back Projection Networks

Abstract

Deep learning based image Super-Resolution (SR) has shown rapid development due to its ability of big data digestion. Generally, deeper and wider networks can extract richer feature maps and generate SR images with remarkable quality. However, the more complex network we have, the more time consumption is required for practical applications. It is important to have a simplified network for efficient image SR. In this paper, we propose an Attention based Back Projection Network (ABPN) for image super-resolution. Similar to some recent works, we believe that the back projection mechanism can be further developed for SR. Enhanced back projection blocks are suggested to iteratively update low- and high-resolution feature residues. Inspired by recent studies on attention models, we propose a Spatial Attention Block (SAB) to learn the cross-correlation across features at different layers. Based on the assumption that a good SR image should be close to the original LR image after down-sampling. We propose a Refined Back Projection Block (RBPB) for final reconstruction. Extensive experiments on some public and AIM2019 Image Super-Resolution Challenge datasets show that the proposed ABPN can provide state-of-the-art or even better performance in both quantitative and qualitative measurements.

Code Repositories

Holmes-Alan/ABPN
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-super-resolution-on-bsd100-16xABPN
PSNR: 22.72
SSIM: 0.512
image-super-resolution-on-bsd100-4x-upscalingABPN
PSNR: 27.82
SSIM: 0.743
image-super-resolution-on-bsd100-8x-upscalingABPN
PSNR: 24.99
SSIM: 0.604
image-super-resolution-on-div2k-val-16xABPN
PSNR: 24.38
SSIM: 0.641
image-super-resolution-on-div8k-val-16xABPN
PSNR: 26.71
SSIM: 0.65
image-super-resolution-on-manga109-16xABPN
PSNR: 21.25
SSIM: 0.673
image-super-resolution-on-manga109-4xABPN
PSNR: 31.79
SSIM: 0.921
image-super-resolution-on-manga109-8xABPN
PSNR: 25.29
SSIM: 0.802
image-super-resolution-on-set14-4x-upscalingABPN
PSNR: 28.94
SSIM: 0.789
image-super-resolution-on-set14-8x-upscalingABPN
PSNR: 25.08
SSIM: 0.638
image-super-resolution-on-set5-8x-upscalingABPN
PSNR: 27.25
SSIM: 0.786
image-super-resolution-on-urban100-16xABPN
PSNR: 20.39
SSIM: 0.515
image-super-resolution-on-urban100-4xABPN
PSNR: 27.06
SSIM: 0.811
image-super-resolution-on-urban100-8xABPN
PSNR: 23.04
SSIM: 0.641

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp