HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Variational Laws of Visual Attention for Dynamic Scenes

{Marco Gori Dario Zanca}

Variational Laws of Visual Attention for Dynamic Scenes

Abstract

Computational models of visual attention are at the crossroad of disciplines like cognitive science, computational neuroscience, and computer vision. This paper proposes a model of attentional scanpath that is based on the principle that there are foundational laws that drive the emergence of visual attention. We devise variational laws of the eye-movement that rely on a generalized view of the Least Action Principle in physics. The potential energy captures details as well as peripheral visual features, while the kinetic energy corresponds with the classic interpretation in analytic mechanics. In addition, the Lagrangian contains a brightness invariance term, which characterizes significantly the scanpath trajectories. We obtain differential equations of visual attention as the stationary point of the generalized action, and we propose an algorithm to estimate the model parameters. Finally, we report experimental results to validate the model in tasks of saliency detection.

Benchmarks

BenchmarkMethodologyMetrics
saliency-detection-on-cat2000EYMOL
AUC: 0.83
NSS: 1.78

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Variational Laws of Visual Attention for Dynamic Scenes | Papers | HyperAI