Command Palette
Search for a command to run...

Abstract
It is well known that featuremap attention and multi-path representation are important for visual recognition. In this paper, we present a modularized architecture, which applies the channel-wise attention on different network branches to leverage their success in capturing cross-feature interactions and learning diverse representations. Our design results in a simple and unified computation block, which can be parameterized using only a few variables. Our model, named ResNeSt, outperforms EfficientNet in accuracy and latency trade-off on image classification. In addition, ResNeSt has achieved superior transfer learning results on several public benchmarks serving as the backbone, and has been adopted by the winning entries of COCO-LVIS challenge. The source code for complete system and pretrained models are publicly available.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| image-classification-on-imagenet | ResNeSt-50 | GFLOPs: 5.39 Number of params: 27.5M Top 1 Accuracy: 81.13% |
| image-classification-on-imagenet | ResNeSt-200 | Number of params: 70M Top 1 Accuracy: 83.9% |
| image-classification-on-imagenet | ResNeSt-50-fast | GFLOPs: 4.34 Number of params: 27.5M Top 1 Accuracy: 80.64% |
| image-classification-on-imagenet | ResNeSt-101 | Number of params: 48M Top 1 Accuracy: 83.0% |
| image-classification-on-imagenet | ResNeSt-269 | Number of params: 111M Top 1 Accuracy: 84.5% |
| instance-segmentation-on-coco | ResNeSt101 | mask AP: 43% |
| instance-segmentation-on-coco | ResNeSt-200 (multi-scale) | AP50: 70.2 AP75: 51.5 APL: 60.6 APM: 49.6 APS: 30.0 |
| instance-segmentation-on-coco-minival | ResNeSt-200 (multi-scale) | mask AP: 46.25 |
| instance-segmentation-on-coco-minival | ResNeSt-200-DCN (single-scale) | mask AP: 44.5 |
| instance-segmentation-on-coco-minival | ResNeSt-101 (single-scale) | mask AP: 41.56 |
| instance-segmentation-on-coco-minival | ResNeSt-200 (single-scale) | mask AP: 44.21 |
| object-detection-on-coco | ResNeSt-200 (multi-scale) | AP50: 72.0 AP75: 58.0 APL: 66.8 APM: 56.2 APS: 35.1 box mAP: 53.3 |
| object-detection-on-coco-minival | ResNeSt-200 (multi-scale) | AP50: 71.00 AP75: 57.07 APL: 66.29 APM: 56.36 APS: 36.80 box AP: 52.47 |
| object-detection-on-coco-minival | ResNeSt-200-DCN (single-scale) | AP50: 69.53 AP75: 55.40 APL: 65.83 APM: 54.66 APS: 32.67 box AP: 50.91 |
| object-detection-on-coco-minival | ResNeSt-200 (single-scale) | AP50: 68.78 AP75: 55.17 APL: 63.9 APM: 54.2 box AP: 50.54 |
| panoptic-segmentation-on-coco-minival | PanopticFPN+ResNeSt(single-scale) | PQ: 47.9 PQst: 37.0 PQth: 55.1 |
| semantic-segmentation-on-ade20k | ResNeSt-200 | Validation mIoU: 48.36 |
| semantic-segmentation-on-ade20k | ResNeSt-269 | Validation mIoU: 47.60 |
| semantic-segmentation-on-ade20k | ResNeSt-101 | Validation mIoU: 46.91 |
| semantic-segmentation-on-ade20k-val | ResNeSt-269 | mIoU: 47.60 |
| semantic-segmentation-on-ade20k-val | ResNeSt-200 | mIoU: 48.36 |
| semantic-segmentation-on-ade20k-val | ResNeSt-101 | mIoU: 46.91 |
| semantic-segmentation-on-cityscapes | ResNeSt200 (Mapillary) | Mean IoU (class): 83.3% |
| semantic-segmentation-on-cityscapes-val | ResNeSt-200 | mIoU: 82.7 |
| semantic-segmentation-on-dada-seg | ResNeSt (ResNeSt-101) | mIoU: 19.99 |
| semantic-segmentation-on-pascal-context | ResNeSt-200 | mIoU: 58.4 |
| semantic-segmentation-on-pascal-context | ResNeSt-269 | mIoU: 58.9 |
| semantic-segmentation-on-pascal-context | ResNeSt-101 | mIoU: 56.5 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.