Zoom-Invariant Tracking Using Points and Lines in Affine Views - An Application of the Affine Multifocal Tensors

Abstract

This paper describes methods for tracking using point and line features in affine views to provide fundamental invariance to changes of focal length. It first demonstrates how an earlier method of transfer-based tracking using spatio-temporal matching of point features in a stereo active head is indeed zoom-invariant. In order to also make use of lines the paper then illustrates how the affine tri- and quadrifocal tensors may be applied to tracking with zoom in monocular and stereo systems respectively. The usefulness of the tensors is evident from their ability to transfer a fixation point in two uncalibrated images into novel views. Whereas the trifocal tensor is already familiar and in common use for matching and reconstruction we believe this to be the first practical application of a quadrifocal tensor. We develop expressions for affine tri- and quadrifocal tensors, and using novel affine specializations of existing projective algorithms we show how computation of the tensors is faster simpler and more stable. Experiments on real images are presented.