HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Aggregated Residual Transformations for Deep Neural Networks

Saining Xie; Ross Girshick; Piotr Dollár; Zhuowen Tu; Kaiming He

Aggregated Residual Transformations for Deep Neural Networks

Abstract

We present a simple, highly modularized network architecture for image classification. Our network is constructed by repeating a building block that aggregates a set of transformations with the same topology. Our simple design results in a homogeneous, multi-branch architecture that has only a few hyper-parameters to set. This strategy exposes a new dimension, which we call "cardinality" (the size of the set of transformations), as an essential factor in addition to the dimensions of depth and width. On the ImageNet-1K dataset, we empirically show that even under the restricted condition of maintaining complexity, increasing cardinality is able to improve classification accuracy. Moreover, increasing cardinality is more effective than going deeper or wider when we increase the capacity. Our models, named ResNeXt, are the foundations of our entry to the ILSVRC 2016 classification task in which we secured 2nd place. We further investigate ResNeXt on an ImageNet-5K set and the COCO detection set, also showing better results than its ResNet counterpart. The code and models are publicly available online.

Code Repositories

TuSimple/resnet.mxnet
tf
Mentioned in GitHub
cjf8899/Pytorch_ResNeXt
pytorch
Mentioned in GitHub
Sakib1263/1DResNet-KERAS
tf
Mentioned in GitHub
facebookresearch/pycls
pytorch
Mentioned in GitHub
mlvccn/bmtc_transferattackvid
pytorch
Mentioned in GitHub
intsco/am-segmentation
pytorch
Mentioned in GitHub
hyunwoongko/resnext-parallel
tf
Mentioned in GitHub
hsd1503/resnet1d
pytorch
Mentioned in GitHub
mindspore-courses/MindSpore-classification
mindspore
Mentioned in GitHub
kobiso/CBAM-tensorflow-slim
tf
Mentioned in GitHub
D-X-Y/ResNeXt-DenseNet
pytorch
Mentioned in GitHub
hustic/TinyImageSet
pytorch
Mentioned in GitHub
facebookresearch/ResNeXt
Official
pytorch
Mentioned in GitHub
IMvision12/keras-vision-models
pytorch
Mentioned in GitHub
JianGoForIt/YellowFin_Pytorch
pytorch
Mentioned in GitHub
zhaoqyu/ResNeXt-MGE
pytorch
Mentioned in GitHub
osmr/imgclsmob
mxnet
Mentioned in GitHub
jiajunhua/facebookresearch-Detectron
caffe2
Mentioned in GitHub
kobiso/CBAM-tensorflow
tf
Mentioned in GitHub
Duplums/bhb10k-dl-benchmark
pytorch
Mentioned in GitHub
Mayurji/Image-Classification-PyTorch
pytorch
Mentioned in GitHub
Deci-AI/super-gradients
pytorch
Mentioned in GitHub
open-edge-platform/geti
pytorch
Mentioned in GitHub
developer0hye/SKNet-PyTorch
pytorch
Mentioned in GitHub
wwwuyijia/mindspore_models-ResNeXt50
mindspore
Mentioned in GitHub
prlz77/ResNeXt.pytorch
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
domain-generalization-on-vizwizResNeXt-101 32x16d
Accuracy - All Images: 51.7
Accuracy - Clean Images: 54.8
Accuracy - Corrupted Images: 48.1
image-classification-on-gashissdbResNeXt-50-32x4d
Accuracy: 98.59
F1-Score: 99.25
Precision: 99.94
image-classification-on-imagenetResNeXt-101 64x4
GFLOPs: 31.5
Number of params: 83.6M
Top 1 Accuracy: 80.9%
Top 5 Accuracy: 94.7

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp