HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation

Xiang Jiang Qicheng Lao Stan Matwin Mohammad Havaei

Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation

Abstract

We present an approach for unsupervised domain adaptation---with a strong focus on practical considerations of within-domain class imbalance and between-domain class distribution shift---from a class-conditioned domain alignment perspective. Current methods for class-conditioned domain alignment aim to explicitly minimize a loss function based on pseudo-label estimations of the target domain. However, these methods suffer from pseudo-label bias in the form of error accumulation. We propose a method that removes the need for explicit optimization of model parameters from pseudo-labels directly. Instead, we present a sampling-based implicit alignment approach, where the sample selection procedure is implicitly guided by the pseudo-labels. Theoretical analysis reveals the existence of a domain-discriminator shortcut in misaligned classes, which is addressed by the proposed implicit alignment approach to facilitate domain-adversarial learning. Empirical results and ablation studies confirm the effectiveness of the proposed approach, especially in the presence of within-domain class imbalance and between-domain class distribution shift.

Code Repositories

xiangdal/implicit_alignment
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
unsupervised-domain-adaptation-on-office-31Implicit Alignment (with MDD)
Avg accuracy: 88.8
unsupervised-domain-adaptation-on-office-homeImplicit Alignment (with MDD)
Avg accuracy: 69.5
unsupervised-domain-adaptation-on-office-home-1COAL
Average Per-Class Accuracy: 58.4
unsupervised-domain-adaptation-on-office-home-1MDD
Average Per-Class Accuracy: 55.44
unsupervised-domain-adaptation-on-office-home-1Implicit Alignment (with MDD)
Average Per-Class Accuracy: 61.67
unsupervised-domain-adaptation-on-office-home-1DANN
Average Per-Class Accuracy: 56.91
unsupervised-domain-adaptation-on-office-home-1Source Only
Average Per-Class Accuracy: 52.81
unsupervised-domain-adaptation-on-visda2017Implicit Alignment (with MDD)
Accuracy: 75.8

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp