HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Cluster-based Video Summarization with Temporal Context Awareness

Hai-Dang Huynh-Lam; Ngoc-Phuong Ho-Thi; Minh-Triet Tran; Trung-Nghia Le

Cluster-based Video Summarization with Temporal Context Awareness

Abstract

In this paper, we present TAC-SUM, a novel and efficient training-free approach for video summarization that addresses the limitations of existing cluster-based models by incorporating temporal context. Our method partitions the input video into temporally consecutive segments with clustering information, enabling the injection of temporal awareness into the clustering process, setting it apart from prior cluster-based summarization methods. The resulting temporal-aware clusters are then utilized to compute the final summary, using simple rules for keyframe selection and frame importance scoring. Experimental results on the SumMe dataset demonstrate the effectiveness of our proposed approach, outperforming existing unsupervised methods and achieving comparable performance to state-of-the-art supervised summarization techniques. Our source code is available for reference at \url{https://github.com/hcmus-thesis-gulu/TAC-SUM}.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
unsupervised-video-summarization-on-summeTAC-SUM
F1-score: 54.48

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Cluster-based Video Summarization with Temporal Context Awareness | Papers | HyperAI