HyperAIHyperAI

Command Palette

Search for a command to run...

U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation

Junho Kim Minjae Kim Hyeonwoo Kang Kwanghee Lee

Abstract

We propose a novel method for unsupervised image-to-image translation, whichincorporates a new attention module and a new learnable normalization functionin an end-to-end manner. The attention module guides our model to focus on moreimportant regions distinguishing between source and target domains based on theattention map obtained by the auxiliary classifier. Unlike previousattention-based method which cannot handle the geometric changes betweendomains, our model can translate both images requiring holistic changes andimages requiring large shape changes. Moreover, our new AdaLIN (AdaptiveLayer-Instance Normalization) function helps our attention-guided model toflexibly control the amount of change in shape and texture by learnedparameters depending on datasets. Experimental results show the superiority ofthe proposed method compared to the existing state-of-the-art models with afixed network architecture and hyper-parameters. Our code and datasets areavailable at https://github.com/taki0112/UGATIT orhttps://github.com/znxlwm/UGATIT-pytorch.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp