HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Boosting Flow-based Generative Super-Resolution Models via Learned Prior

Li-Yuan Tsao Yi-Chen Lo Chia-Che Chang Hao-Wei Chen Roy Tseng Chien Feng Chun-Yi Lee

Boosting Flow-based Generative Super-Resolution Models via Learned Prior

Abstract

Flow-based super-resolution (SR) models have demonstrated astonishing capabilities in generating high-quality images. However, these methods encounter several challenges during image generation, such as grid artifacts, exploding inverses, and suboptimal results due to a fixed sampling temperature. To overcome these issues, this work introduces a conditional learned prior to the inference phase of a flow-based SR model. This prior is a latent code predicted by our proposed latent module conditioned on the low-resolution image, which is then transformed by the flow model into an SR image. Our framework is designed to seamlessly integrate with any contemporary flow-based SR model without modifying its architecture or pre-trained weights. We evaluate the effectiveness of our proposed framework through extensive experiments and ablation analyses. The proposed framework successfully addresses all the inherent issues in flow-based SR models and enhances their performance in various SR scenarios. Our code is available at: https://github.com/liyuantsao/BFSR

Code Repositories

liyuantsao/BFSR
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-super-resolution-on-div2k-val-4xSRFlow-LP
LPIPS: 0.109
LRPSNR: 51.51
PSNR: 27.51
SSIM: 0.78
image-super-resolution-on-div2k-val-4xLINF-LP
LPIPS: 0.105
LRPSNR: 47.3
PSNR: 28.00
SSIM: 0.78

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp