HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge

Conghan Yue; Zhengwei Peng; Junlong Ma; Shiyan Du; Pengxu Wei; Dongyu Zhang

Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge

Abstract

Diffusion models exhibit powerful generative capabilities enabling noise mapping to data via reverse stochastic differential equations. However, in image restoration, the focus is on the mapping relationship from low-quality to high-quality images. Regarding this issue, we introduce the Generalized Ornstein-Uhlenbeck Bridge (GOUB) model. By leveraging the natural mean-reverting property of the generalized OU process and further eliminating the variance of its steady-state distribution through the Doob's h-transform, we achieve diffusion mappings from point to point enabling the recovery of high-quality images from low-quality ones. Moreover, we unravel the fundamental mathematical essence shared by various bridge models, all of which are special instances of GOUB and empirically demonstrate the optimality of our proposed models. Additionally, we present the corresponding Mean-ODE model adept at capturing both pixel-level details and structural perceptions. Experimental outcomes showcase the state-of-the-art performance achieved by both models across diverse tasks, including inpainting, deraining, and super-resolution. Code is available at \url{https://github.com/Hammour-steak/GOUB}.

Code Repositories

Hammour-steak/GOUB
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-super-resolution-on-div2k-val-4xGOUB
LPIPS: 0.220
PSNR: 26.89
SSIM: 0.7478
single-image-deraining-on-rain100hGOUB (Mean-ODE)
PSNR: 34.56
SSIM: 0.9414

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp