HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Judy Hoffman; Eric Tzeng; Taesung Park; Jun-Yan Zhu; Phillip Isola; Kate Saenko; Alexei A. Efros; Trevor Darrell

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Abstract

Domain adaptation is critical for success in new, unseen environments. Adversarial adaptation models applied in feature spaces discover domain invariant representations, but are difficult to visualize and sometimes fail to capture pixel-level and low-level domain shifts. Recent work has shown that generative adversarial networks combined with cycle-consistency constraints are surprisingly effective at mapping images between domains, even without the use of aligned image pairs. We propose a novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model. CyCADA adapts representations at both the pixel-level and feature-level, enforces cycle-consistency while leveraging a task loss, and does not require aligned pairs. Our model can be applied in a variety of visual recognition and prediction settings. We show new state-of-the-art results across multiple adaptation tasks, including digit classification and semantic segmentation of road scenes demonstrating transfer from synthetic to real world domains.

Code Repositories

thuml/Transfer-Learning-Library
pytorch
Mentioned in GitHub
jhoffman/cycada_release
Official
pytorch
Mentioned in GitHub
tkhkaeio/CyCADA
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
domain-adaptation-on-svhn-to-mnistCYCADA
Accuracy: 90.4
image-to-image-translation-on-synthia-fall-toCyCADA
Per-pixel Accuracy: 92.1%
fwIOU: 85.7
mIoU: 63.3
synthetic-to-real-translation-on-gtav-toCyCADA pixel-only
mIoU: 34.8
synthetic-to-real-translation-on-gtav-toCyCADA pixel+feat
Per-pixel Accuracy: 82.3%
fwIOU: 72.4
mIoU: 39.5
unsupervised-image-to-image-translation-onCyCADA pixel+feat
Classification Accuracy: 90.4%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp