HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Provably End-to-end Label-Noise Learning without Anchor Points

Xuefeng Li Tongliang Liu Bo Han Gang Niu Masashi Sugiyama

Provably End-to-end Label-Noise Learning without Anchor Points

Abstract

In label-noise learning, the transition matrix plays a key role in building statistically consistent classifiers. Existing consistent estimators for the transition matrix have been developed by exploiting anchor points. However, the anchor-point assumption is not always satisfied in real scenarios. In this paper, we propose an end-to-end framework for solving label-noise learning without anchor points, in which we simultaneously optimize two objectives: the cross entropy loss between the noisy label and the predicted probability by the neural network, and the volume of the simplex formed by the columns of the transition matrix. Our proposed framework can identify the transition matrix if the clean class-posterior probabilities are sufficiently scattered. This is by far the mildest assumption under which the transition matrix is provably identifiable and the learned classifier is statistically consistent. Experimental results on benchmark datasets demonstrate the effectiveness and robustness of the proposed method.

Benchmarks

BenchmarkMethodologyMetrics
learning-with-noisy-labels-on-cifar-100nVolMinNet
Accuracy (mean): 57.80
learning-with-noisy-labels-on-cifar-10nVolMinNet
Accuracy (mean): 89.70
learning-with-noisy-labels-on-cifar-10n-1VolMinNet
Accuracy (mean): 88.30
learning-with-noisy-labels-on-cifar-10n-2VolMinNet
Accuracy (mean): 88.27
learning-with-noisy-labels-on-cifar-10n-3VolMinNet
Accuracy (mean): 88.19
learning-with-noisy-labels-on-cifar-10n-worstVolMinNet
Accuracy (mean): 80.53

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp