HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Constellation Nets for Few-Shot Learning

{Zhuowen Tu Huaijin Wang Yifan Xu Weijian Xu}

Constellation Nets for Few-Shot Learning

Abstract

The success of deep convolutional neural networks builds on top of the learning of effective convolution operations, capturing a hierarchy of structured features via filtering, activation, and pooling. However, the explicit structured features, e.g. object parts, are not expressive in the existing CNN frameworks. In this paper, we tackle the few-shot learning problem and make an effort to enhance structured features by expanding CNNs with a constellation model, which performs cell feature clustering and encoding with a dense part representation; the relationships among the cell features are further modeled by an attention mechanism. With the additional constellation branch to increase the awareness of object parts, our method is able to attain the advantages of the CNNs while making the overall internal representations more robust in the few-shot learning setting. Our approach attains a significant improvement over the existing methods in few-shot learning on the CIFAR-FS, FC100, and mini-ImageNet benchmarks.

Benchmarks

BenchmarkMethodologyMetrics
few-shot-image-classification-on-cifar-fs-5ConstellationNets
Accuracy: 75.4
few-shot-image-classification-on-cifar-fs-5-1ConstellationNets
Accuracy: 86.8
few-shot-image-classification-on-fc100-5-wayConstellationNets
Accuracy: 43.8
few-shot-image-classification-on-fc100-5-way-1ConstellationNets
Accuracy: 59.7
few-shot-image-classification-on-mini-2ConstellationNets
Accuracy: 64.89
few-shot-image-classification-on-mini-3ConstellationNets
Accuracy: 79.95

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp