HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

The Group Loss for Deep Metric Learning

Ismail Elezi Sebastiano Vascon Alessandro Torcinovich Marcello Pelillo Laura Leal-Taixe

The Group Loss for Deep Metric Learning

Abstract

Deep metric learning has yielded impressive results in tasks such as clustering and image retrieval by leveraging neural networks to obtain highly discriminative feature embeddings, which can be used to group samples into different classes. Much research has been devoted to the design of smart loss functions or data mining strategies for training such networks. Most methods consider only pairs or triplets of samples within a mini-batch to compute the loss function, which is commonly based on the distance between embeddings. We propose Group Loss, a loss function based on a differentiable label-propagation method that enforces embedding similarity across all samples of a group while promoting, at the same time, low-density regions amongst data points belonging to different groups. Guided by the smoothness assumption that "similar objects should belong to the same group", the proposed loss trains the neural network for a classification task, enforcing a consistent labelling amongst samples within a class. We show state-of-the-art results on clustering and image retrieval on several datasets, and show the potential of our method when combined with other techniques such as ensembles

Code Repositories

laurinwagner/grouploss_plus
pytorch
Mentioned in GitHub
dvl-tum/group_loss
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
metric-learning-on-cars196Group Loss
R@1: 85.6
metric-learning-on-cub-200-2011BN-Inception + Group Loss
R@1: 65.5
metric-learning-on-stanford-online-products-1Group Loss
R@1: 75.7

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp