HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

DynaVSR: Dynamic Adaptive Blind Video Super-Resolution

Suyoung Lee Myungsub Choi Kyoung Mu Lee

DynaVSR: Dynamic Adaptive Blind Video Super-Resolution

Abstract

Most conventional supervised super-resolution (SR) algorithms assume that low-resolution (LR) data is obtained by downscaling high-resolution (HR) data with a fixed known kernel, but such an assumption often does not hold in real scenarios. Some recent blind SR algorithms have been proposed to estimate different downscaling kernels for each input LR image. However, they suffer from heavy computational overhead, making them infeasible for direct application to videos. In this work, we present DynaVSR, a novel meta-learning-based framework for real-world video SR that enables efficient downscaling model estimation and adaptation to the current input. Specifically, we train a multi-frame downscaling module with various types of synthetic blur kernels, which is seamlessly combined with a video SR network for input-aware adaptation. Experimental results show that DynaVSR consistently improves the performance of the state-of-the-art video SR models by a large margin, with an order of magnitude faster inference time compared to the existing blind SR approaches.

Code Repositories

esw0116/DynaVSR
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
video-super-resolution-on-msu-video-upscalersDynaVSR
PSNR: 26.12
SSIM: 0.916
VMAF: 56.86
video-super-resolution-on-msu-vsr-benchmarkDynaVSR-R
1 - LPIPS: 0.884
ERQAv1.0: 0.709
FPS: 0.177
PSNR: 28.377
QRCRv1.0: 0.557
SSIM: 0.865
Subjective score: 6.136
video-super-resolution-on-msu-vsr-benchmarkDynaVSR-V
1 - LPIPS: 0.859
ERQAv1.0: 0.643
FPS: 0.15
PSNR: 29.011
QRCRv1.0: 0.549
SSIM: 0.864
Subjective score: 4.359

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp