HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

When to Extract ReID Features: A Selective Approach for Improved Multiple Object Tracking

Emirhan Bayar Cemal Aker

When to Extract ReID Features: A Selective Approach for Improved Multiple Object Tracking

Abstract

Extracting and matching Re-Identification (ReID) features is used by many state-of-the-art (SOTA) Multiple Object Tracking (MOT) methods, particularly effective against frequent and long-term occlusions. While end-to-end object detection and tracking have been the main focus of recent research, they have yet to outperform traditional methods in benchmarks like MOT17 and MOT20. Thus, from an application standpoint, methods with separate detection and embedding remain the best option for accuracy, modularity, and ease of implementation, though they are impractical for edge devices due to the overhead involved. In this paper, we investigate a selective approach to minimize the overhead of feature extraction while preserving accuracy, modularity, and ease of implementation. This approach can be integrated into various SOTA methods. We demonstrate its effectiveness by applying it to StrongSORT and Deep OC-SORT. Experiments on MOT17, MOT20, and DanceTrack datasets show that our mechanism retains the advantages of feature extraction during occlusions while significantly reducing runtime. Additionally, it improves accuracy by preventing confusion in the feature-matching stage, particularly in cases of deformation and appearance similarity, which are common in DanceTrack. https://github.com/emirhanbayar/Fast-StrongSORT, https://github.com/emirhanbayar/Fast-Deep-OC-SORT

Code Repositories

emirhanbayar/fast-strongsort
Official
pytorch
Mentioned in GitHub
emirhanbayar/fast-deep-oc-sort
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
multi-object-tracking-on-dancetrackFast-StrongSORT
AssA: 38.8
HOTA: 55.9
IDF1: 54.6
multi-object-tracking-on-mot17Fast-StrongSORT
AssA: 62.3
HOTA: 62.7
IDF1: 77.5
multi-object-tracking-on-mot20-1Fast-StrongSORT
HOTA: 61.2
IDF1: 75.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp