ML Anthology

Video to Reference Image Alignment in the Presence of Sparse Features and Appearance Change

David J. Hirvonen, Bogdan Matei, Richard P. Wildes, Steven C. Hsu
CVPR 2001 pp. II:366-373
doi:10.1109/CVPR.2001.990984 /cvpr/2001/hirvonen2001cvpr-video/

Abstract

A robust, multi-frame, progressive refinement framework for registering narrow field of view video to reference imagery is presented. A major strength of the approach is its effectiveness in the presence of dissimilar video and reference image appearance. Normalized oriented energy image pyramids are employed to enable alignment of images with global visual dissimilarities, yet local feature commonality. Local matching is then applied coarse-to-fine, along four dimensions: spatial frequency, local support, search range, and model order (a robust parametric model fit is used to reject outliers at each iteration). Globally optimal multi-frame alignment is obtained with respect to several constraints: frame-to-reference local matches, recovered frame-to-frame motion, and optional a priori estimates of sensor pose. The framework is described in detail and applied to two examples: aerial video to geographic reference image alignment (georegistration) and retinal slit lamp video to fundus image alignment.

CVPR Semantic Scholar

Cite

Text

Hirvonen et al. "Video to Reference Image Alignment in the Presence of Sparse Features and Appearance Change." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2001. doi:10.1109/CVPR.2001.990984

Markdown

[Hirvonen et al. "Video to Reference Image Alignment in the Presence of Sparse Features and Appearance Change." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2001.](https://mlanthology.org/cvpr/2001/hirvonen2001cvpr-video/) doi:10.1109/CVPR.2001.990984

BibTeX

@inproceedings{hirvonen2001cvpr-video,
  title     = {{Video to Reference Image Alignment in the Presence of Sparse Features and Appearance Change}},
  author    = {Hirvonen, David J. and Matei, Bogdan and Wildes, Richard P. and Hsu, Steven C.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2001},
  pages     = {II:366-373},
  doi       = {10.1109/CVPR.2001.990984},
  url       = {https://mlanthology.org/cvpr/2001/hirvonen2001cvpr-video/}
}