HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Resolution-robust Large Mask Inpainting with Fourier Convolutions

Roman Suvorov; Elizaveta Logacheva; Anton Mashikhin; Anastasia Remizova; Arsenii Ashukha; Aleksei Silvestrov; Naejin Kong; Harshith Goka; Kiwoong Park; Victor Lempitsky

Resolution-robust Large Mask Inpainting with Fourier Convolutions

Abstract

Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that one of the main reasons for that is the lack of an effective receptive field in both the inpainting network and the loss function. To alleviate this issue, we propose a new method called large mask inpainting (LaMa). LaMa is based on i) a new inpainting network architecture that uses fast Fourier convolutions (FFCs), which have the image-wide receptive field; ii) a high receptive field perceptual loss; iii) large training masks, which unlocks the potential of the first two components. Our inpainting network improves the state-of-the-art across a range of datasets and achieves excellent performance even in challenging scenarios, e.g. completion of periodic structures. Our model generalizes surprisingly well to resolutions that are higher than those seen at train time, and achieves this at lower parameter&time costs than the competitive baselines. The code is available at \url{https://github.com/saic-mdal/lama}.

Code Repositories

saic-mdal/lama
Official
pytorch
Mentioned in GitHub
Moldoteck/lama
pytorch
Mentioned in GitHub
geekyutao/inpaint-anything
pytorch
Mentioned in GitHub
rawmean/lama
pytorch
Mentioned in GitHub
NilsBochow/lama_reconstruction
pytorch
Mentioned in GitHub
advimman/lama
pytorch
Mentioned in GitHub
haiv-lab/ospcoop_imagenet-bg
pytorch
Mentioned in GitHub
geomagical/lama-with-refiner
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-inpainting-on-celeba-hqLaMa
FID: 8.15
P-IDS: 2.07
U-IDS: 7.58
image-inpainting-on-places2-1LAMA
FID: 2.97
P-IDS: 13.09
U-IDS: 32.29
seeing-beyond-the-visible-on-kitti360-exLaMa
Average PSNR: 18.98

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp