HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

What's in the Flow? Exploiting Temporal Motion Cues for Unsupervised Generic Event Boundary Detection

Gothe Sourabh Vasant ; Agarwal Vibhav ; Ghosh Sourav ; Vachhani Jayesh Rajkumar ; Kashyap Pranay ; Raja Barath Raj Kandur

What's in the Flow? Exploiting Temporal Motion Cues for Unsupervised
  Generic Event Boundary Detection

Abstract

Generic Event Boundary Detection (GEBD) task aims to recognize generic,taxonomy-free boundaries that segment a video into meaningful events. Currentmethods typically involve a neural model trained on a large volume of data,demanding substantial computational power and storage space. We explore twopivotal questions pertaining to GEBD: Can non-parametric algorithms outperformunsupervised neural methods? Does motion information alone suffice for highperformance? This inquiry drives us to algorithmically harness motion cues foridentifying generic event boundaries in videos. In this work, we proposeFlowGEBD, a non-parametric, unsupervised technique for GEBD. Our approachentails two algorithms utilizing optical flow: (i) Pixel Tracking and (ii) FlowNormalization. By conducting thorough experimentation on the challengingKinetics-GEBD and TAPOS datasets, our results establish FlowGEBD as the newstate-of-the-art (SOTA) among unsupervised methods. FlowGEBD exceeds the neuralmodels on the Kinetics-GEBD dataset by obtaining an F1@0.05 score of 0.713 withan absolute gain of 31.7% compared to the unsupervised baseline and achieves anaverage F1 score of 0.623 on the TAPOS validation dataset.

Benchmarks

BenchmarkMethodologyMetrics
generic-event-boundary-detection-on-kineticsFlowGEBD
F1 @ RelDis. 0.05: 0.713
generic-event-boundary-detection-on-taposFlowGEBD
F1 @ RelDis. 0.05: 0.375

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
What's in the Flow? Exploiting Temporal Motion Cues for Unsupervised Generic Event Boundary Detection | Papers | HyperAI