Open Access

Model-Based Real-Time Head Tracking

EURASIP Journal on Advances in Signal Processing20022002:873945

DOI: 10.1155/S1110865702206034

Received: 31 August 2001

Published: 22 October 2002

Abstract

This paper treats real-time tracking of a human head using an analysis by synthesis approach. The work is based on the Structure from Motion (SfM) algorithm from Azarbayejani and Pentland (1995). We will analyze the convergence properties of the SfM algorithm for planar objects, and extend it to handle new points. The extended algorithm is then used for head tracking. The system tracks feature points in the image using a texture mapped three-dimensional model of the head. The texture is updated adaptively so that points in the ear region can be tracked when the user′s head is rotated far, allowing out-of-plane rotation of up to https://static-content.springer.com/image/art%3A10.1155%2FS1110865702206034/MediaObjects/13634_2001_Article_916_IEq1_HTML.gif without losing track. The covariance of the https://static-content.springer.com/image/art%3A10.1155%2FS1110865702206034/MediaObjects/13634_2001_Article_916_IEq2_HTML.gif - and the https://static-content.springer.com/image/art%3A10.1155%2FS1110865702206034/MediaObjects/13634_2001_Article_916_IEq3_HTML.gif -coordinates are estimated and forwarded to the Kalman filter, making the tracker robust to occlusion. The system automatically detects tracking failure and reinitializes the algorithm using information gathered in the original initialization process.

Keywords

face tracking modeling real-time EKF structure from motion planar objects analysis by synthesis

Authors’ Affiliations

(1)
Multimedia Technologies Department, Ericsson Research

Copyright

© Ström 2002