Online multi-object tracking with efficient track drift and fragmentation handling

Jaeyong Ju, Daehun Kim, Bonhwa Ku, David K. Han, Hanseok Ko

Research output: Contribution to journalArticlepeer-review

15 Citations (Scopus)


This paper addresses the problem of multi-object tracking in complex scenes by a single, static, uncalibrated camera. Tracking-by-detection is a widely used approach for multi-object tracking. Challenges still remain in complex scenes, however, when this approach has to deal with occlusions, unreliable detections (e.g., inaccurate position/size, false positives, or false negatives), and sudden object motion/appearance changes, among other issues. To handle these problems, this paper presents a novel online multi-object tracking method, which can be fully applied to real-time applications. First, an object tracking process based on frame-by-frame association with a novel affinity model and an appearance update that does not rely on online learning is proposed to effectively and rapidly assign detections to tracks. Second, a two-stage drift handling method with novel track confidence is proposed to correct drifting tracks caused by the abrupt motion change of objects under occlusion and prolonged inaccurate detections. In addition, a fragmentation handling method based on a track-to-track association is proposed to solve the problem in which an object trajectory is broken into several tracks due to long-term occlusions. Based on experimental results derived from challenging public data sets, the proposed method delivers an impressive performance compared with other state-of-the-art methods. Furthermore, additional performance analysis demonstrates the effect and usefulness of each component of the proposed method.

Original languageEnglish
Pages (from-to)283-290
Number of pages8
JournalJournal of the Optical Society of America A: Optics and Image Science, and Vision
Issue number2
Publication statusPublished - 2017 Feb 1

Bibliographical note

Funding Information:
Brain Korea 21 Plus Project; Korea University (KU); Office of Naval Research Global (ONRG) (N62909-16-1-2185).

Publisher Copyright:
© 2017 Optical Society of America.

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Online multi-object tracking with efficient track drift and fragmentation handling'. Together they form a unique fingerprint.

Cite this