HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Vision Eagle Attention: a new lens for advancing image classification

Mahmudul Hasan

Vision Eagle Attention: a new lens for advancing image classification

Abstract

In computer vision tasks, the ability to focus on relevant regions within an image is crucial for improving model performance, particularly when key features are small, subtle, or spatially dispersed. Convolutional neural networks (CNNs) typically treat all regions of an image equally, which can lead to inefficient feature extraction. To address this challenge, I have introduced Vision Eagle Attention, a novel attention mechanism that enhances visual feature extraction using convolutional spatial attention. The model applies convolution to capture local spatial features and generates an attention map that selectively emphasizes the most informative regions of the image. This attention mechanism enables the model to focus on discriminative features while suppressing irrelevant background information. I have integrated Vision Eagle Attention into a lightweight ResNet-18 architecture, demonstrating that this combination results in an efficient and powerful model. I have evaluated the performance of the proposed model on three widely used benchmark datasets: FashionMNIST, Intel Image Classification, and OracleMNIST, with a primary focus on image classification. Experimental results show that the proposed approach improves classification accuracy. Additionally, this method has the potential to be extended to other vision tasks, such as object detection, segmentation, and visual tracking, offering a computationally efficient solution for a wide range of vision-based applications. Code is available at: https://github.com/MahmudulHasan11085/Vision-Eagle-Attention.git

Benchmarks

BenchmarkMethodologyMetrics
image-classification-on-fashion-mnistResNet-18 + Vision Eagle Attention
Accuracy: 93.30
Percentage error: 6.70
image-classification-on-fashion-mnistResNet-18
Accuracy: 92.28
Percentage error: 7.72
image-classification-on-intel-imageResNet-18
Accuracy: 90.93
image-classification-on-intel-imageResNet-18 + Vision Eagle Attention
Accuracy: 92.43
image-classification-on-oracle-mnistResNet-18
Accuracy: 96.77
image-classification-on-oracle-mnistResNet-18 + Vision Eagle Attention
Accuracy: 97.20

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp