Robust fragments-based tracking using the integral histogram

Amit Adam, Ehud Rivlin, Ilan Shimshoni

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present a novel algorithm (which we call "Frag-Track")for tracking an object in a video sequence. The template object is represented by multiple image fragments or patches. The patches are arbitrary and are not based on an object model (in contrast with traditional use of model-based parts e.g. limbs and torso in human tracking). Every patch votes on the possible positions and scales of the object in the current frame, by comparing its histogram with the corresponding image patch histogram. We then minimize a robust statistic in order to combine the vote maps of the multiple patches. A key tool enabling the application of our algorithm to tracking is the integral histogram data structure [18]. Its use allows to extract histograms of multiple rectangular regions in the image in a very efficient manner. Our algorithm overcomes several difficulties which cannot be handled by traditional histogram-based algorithms [8, 6]. First, by robustly combining multiple patch votes, we are able to handle partial occlusions or pose change. Second, the geometric relations between the template patches allow us to take into account the spatial distribution of the pixel intensities - information which is lost in traditional histogram-based algorithms. Third, as noted by [18], tracking large targets has the same computational cost as tracking small targets. We present extensive experimental results on challenging sequences, which demonstrate the robust tracking achieved by our algorithm (even with the use of only gray-scale (non-color) information).

Original languageEnglish
Title of host publicationProceedings - 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006
Pages798-805
Number of pages8
DOIs
StatePublished - 2006
Event2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006 - New York, NY, United States
Duration: 17 Jun 200622 Jun 2006

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume1
ISSN (Print)1063-6919

Conference

Conference2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006
Country/TerritoryUnited States
CityNew York, NY
Period17/06/0622/06/06

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Robust fragments-based tracking using the integral histogram'. Together they form a unique fingerprint.

Cite this