HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

ResNeSt: Split-Attention Networks

ResNeSt: Split-Attention Networks

Abstract

It is well known that featuremap attention and multi-path representation are important for visual recognition. In this paper, we present a modularized architecture, which applies the channel-wise attention on different network branches to leverage their success in capturing cross-feature interactions and learning diverse representations. Our design results in a simple and unified computation block, which can be parameterized using only a few variables. Our model, named ResNeSt, outperforms EfficientNet in accuracy and latency trade-off on image classification. In addition, ResNeSt has achieved superior transfer learning results on several public benchmarks serving as the backbone, and has been adopted by the winning entries of COCO-LVIS challenge. The source code for complete system and pretrained models are publicly available.

Code Repositories

thepooons/melanoma-comp-2020
pytorch
Mentioned in GitHub
RobertHong1992/Resnest
pytorch
Mentioned in GitHub
ZJCV/ZCls
pytorch
Mentioned in GitHub
rwightman/pytorch-image-models
pytorch
Mentioned in GitHub
shellhue/detectron2-ResNeSt
pytorch
Mentioned in GitHub
mohitktanwr/Deep-Stem-ResNeSt-ISPRS
pytorch
Mentioned in GitHub
zhanghang1989/PyTorch-Encoding
pytorch
Mentioned in GitHub
ferna11i/detectron2_ResNeST
pytorch
Mentioned in GitHub
Burf/ResNeSt-Tensorflow2
tf
Mentioned in GitHub
YeongHyeon/ResNeSt-TF2
tf
Mentioned in GitHub
ChengWeiGu/ResNeSt-Pytorch
pytorch
Mentioned in GitHub
zhanghang1989/detectron2-ResNeSt
pytorch
Mentioned in GitHub
mohitktanwr/ResNeSt_Inverse
pytorch
Mentioned in GitHub
osmr/imgclsmob
mxnet
Mentioned in GitHub
zhanghang1989/ResNeSt
Official
pytorch
Mentioned in GitHub
Yuxiang1995/ICDAR2021_MFD
pytorch
Mentioned in GitHub
sailfish009/detectron2-ResNeSt
pytorch
Mentioned in GitHub
He-jerry/DSSNet
pytorch
Mentioned in GitHub
AnudeepKonda/MIMII_anamoly_detection
pytorch
Mentioned in GitHub
STomoya/ResNeSt
pytorch
Mentioned in GitHub
chongruo/detectron2-resnest
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-classification-on-imagenetResNeSt-50
GFLOPs: 5.39
Number of params: 27.5M
Top 1 Accuracy: 81.13%
image-classification-on-imagenetResNeSt-200
Number of params: 70M
Top 1 Accuracy: 83.9%
image-classification-on-imagenetResNeSt-50-fast
GFLOPs: 4.34
Number of params: 27.5M
Top 1 Accuracy: 80.64%
image-classification-on-imagenetResNeSt-101
Number of params: 48M
Top 1 Accuracy: 83.0%
image-classification-on-imagenetResNeSt-269
Number of params: 111M
Top 1 Accuracy: 84.5%
instance-segmentation-on-cocoResNeSt101
mask AP: 43%
instance-segmentation-on-cocoResNeSt-200 (multi-scale)
AP50: 70.2
AP75: 51.5
APL: 60.6
APM: 49.6
APS: 30.0
instance-segmentation-on-coco-minivalResNeSt-200 (multi-scale)
mask AP: 46.25
instance-segmentation-on-coco-minivalResNeSt-200-DCN (single-scale)
mask AP: 44.5
instance-segmentation-on-coco-minivalResNeSt-101 (single-scale)
mask AP: 41.56
instance-segmentation-on-coco-minivalResNeSt-200 (single-scale)
mask AP: 44.21
object-detection-on-cocoResNeSt-200 (multi-scale)
AP50: 72.0
AP75: 58.0
APL: 66.8
APM: 56.2
APS: 35.1
box mAP: 53.3
object-detection-on-coco-minivalResNeSt-200 (multi-scale)
AP50: 71.00
AP75: 57.07
APL: 66.29
APM: 56.36
APS: 36.80
box AP: 52.47
object-detection-on-coco-minivalResNeSt-200-DCN (single-scale)
AP50: 69.53
AP75: 55.40
APL: 65.83
APM: 54.66
APS: 32.67
box AP: 50.91
object-detection-on-coco-minivalResNeSt-200 (single-scale)
AP50: 68.78
AP75: 55.17
APL: 63.9
APM: 54.2
box AP: 50.54
panoptic-segmentation-on-coco-minivalPanopticFPN+ResNeSt(single-scale)
PQ: 47.9
PQst: 37.0
PQth: 55.1
semantic-segmentation-on-ade20kResNeSt-200
Validation mIoU: 48.36
semantic-segmentation-on-ade20kResNeSt-269
Validation mIoU: 47.60
semantic-segmentation-on-ade20kResNeSt-101
Validation mIoU: 46.91
semantic-segmentation-on-ade20k-valResNeSt-269
mIoU: 47.60
semantic-segmentation-on-ade20k-valResNeSt-200
mIoU: 48.36
semantic-segmentation-on-ade20k-valResNeSt-101
mIoU: 46.91
semantic-segmentation-on-cityscapesResNeSt200 (Mapillary)
Mean IoU (class): 83.3%
semantic-segmentation-on-cityscapes-valResNeSt-200
mIoU: 82.7
semantic-segmentation-on-dada-segResNeSt (ResNeSt-101)
mIoU: 19.99
semantic-segmentation-on-pascal-contextResNeSt-200
mIoU: 58.4
semantic-segmentation-on-pascal-contextResNeSt-269
mIoU: 58.9
semantic-segmentation-on-pascal-contextResNeSt-101
mIoU: 56.5

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp