Background estimation under rapid gain change in thermal imagery

Hulya Yalcin, Robert Collins, Martial Hebert

Research output: Contribution to journalArticle

11 Scopus citations

Abstract

We consider detection of moving ground vehicles in airborne sequences recorded by a thermal sensor with automatic gain control, using an approach that integrates dense optic flow over time to maintain a model of background appearance and a foreground occlusion layer mask. However, the automatic gain control of the thermal sensor introduces rapid changes in intensity that makes this difficult. In this paper we show that an intensity-clipped affine model of sensor gain is sufficient to describe the behavior of our thermal sensor. We develop a method for gain estimation and compensation that uses sparse flow of corner features to compute the affine background scene motion that brings pairs of frames into alignment prior to estimating change in pixel brightness. Dense optic flow and background appearance modeling is then performed on these motion-compensated and brightness-compensated frames. Experimental results demonstrate that the resulting algorithm can segment ground vehicles from thermal airborne video while building a mosaic of the background layer, despite the presence of rapid gain changes.

Original languageEnglish (US)
Pages (from-to)148-161
Number of pages14
JournalComputer Vision and Image Understanding
Volume106
Issue number2-3
DOIs
StatePublished - May 1 2007

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition

Cite this