Command Palette
Search for a command to run...
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data
Xintao Wang Liangbin Xie Chao Dong Ying Shan

Abstract
Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general real-world degraded images. In this work, we extend the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data. Specifically, a high-order degradation modeling process is introduced to better simulate complex real-world degradations. We also consider the common ringing and overshoot artifacts in the synthesis process. In addition, we employ a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics. Extensive comparisons have shown its superior visual performance than prior works on various real datasets. We also provide efficient implementations to synthesize training pairs on the fly.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| video-super-resolution-on-msu-super-1 | Real-ESRGAN + uavs3e | BSQ-rate over ERQA: 7.225 BSQ-rate over LPIPS: 2.633 BSQ-rate over MS-SSIM: 4.612 BSQ-rate over PSNR: 15.144 BSQ-rate over Subjective Score: 1.417 BSQ-rate over VMAF: 2.122 |
| video-super-resolution-on-msu-super-1 | Real-ESRGAN + x264 | BSQ-rate over ERQA: 5.58 BSQ-rate over LPIPS: 0.733 BSQ-rate over MS-SSIM: 0.881 BSQ-rate over PSNR: 7.874 BSQ-rate over Subjective Score: 0.335 BSQ-rate over VMAF: 0.698 |
| video-super-resolution-on-msu-super-1 | Real-ESRGAN + x265 | BSQ-rate over ERQA: 6.328 BSQ-rate over LPIPS: 12.689 BSQ-rate over MS-SSIM: 5.393 BSQ-rate over PSNR: 8.113 BSQ-rate over Subjective Score: 0.64 BSQ-rate over VMAF: 1.464 |
| video-super-resolution-on-msu-super-1 | Real-ESRGAN + aomenc | BSQ-rate over ERQA: 11.584 BSQ-rate over LPIPS: 11.957 BSQ-rate over MS-SSIM: 6.857 BSQ-rate over PSNR: 15.144 BSQ-rate over Subjective Score: 1.398 BSQ-rate over VMAF: 2.712 |
| video-super-resolution-on-msu-super-1 | Real-ESRGAN + vvenc | BSQ-rate over ERQA: 6.712 BSQ-rate over LPIPS: 12.744 BSQ-rate over MS-SSIM: 5.95 BSQ-rate over PSNR: 14.561 BSQ-rate over VMAF: 3.8 |
| video-super-resolution-on-msu-video-upscalers | RealEsrgan-F | LPIPS: 0.185 PSNR: 28.82 SSIM: 0.850 |
| video-super-resolution-on-msu-video-upscalers | RealEsrgan | LPIPS: 0.181 PSNR: 29.14 SSIM: 0.855 |
| video-super-resolution-on-msu-video-upscalers | RealEsrgan-A | LPIPS: 0.244 PSNR: 28.71 SSIM: 0.830 |
| video-super-resolution-on-msu-video-upscalers | RealEsrgan-V | LPIPS: 0.333 PSNR: 25.52 SSIM: 0.795 |
| video-super-resolution-on-msu-video-upscalers | RealEsrnet | LPIPS: 0.296 PSNR: 30.52 SSIM: 0.878 |
| video-super-resolution-on-msu-video-upscalers | RealEsrnet-F | LPIPS: 0.280 PSNR: 30.01 SSIM: 0.868 |
| video-super-resolution-on-msu-vsr-benchmark | Real-ESRnet | 1 - LPIPS: 0.871 ERQAv1.0: 0.598 FPS: 1.019 PSNR: 27.195 QRCRv1.0: 0 SSIM: 0.824 Subjective score: 3.697 |
| video-super-resolution-on-msu-vsr-benchmark | Real-ESRGAN | 1 - LPIPS: 0.895 ERQAv1.0: 0.663 FPS: 1.01 PSNR: 24.441 QRCRv1.0: 0 SSIM: 0.774 Subjective score: 5.392 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.