Particle filter for closed-loop detection and tracking from occluded airborne images

Takuma Nakamura, Stephen Haviland, Dmitry Bershadsky, Daniel Magree, Eric Johnson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper describes a novel vision-based target tracking and landing method that uses aerial images from an on-board camera. The proposed method explicitly deals with occlusions that often occur during these maneuvers. Normalized cross correlation (NCC) is used to locate an image patch in a reference image with a measure of certainty. The key insight is that over the course of the vehicle approach, there is a transition between the target being contained in the camera images, and camera images being contained in the target image. When a vehicle is at high altitude, the NCC of the target over an entire camera image is computed. When at low altitude, the reverse operation is performed: the NCC of the camera images is computed over the target image. Additionally, at both high and low altitude, we find interesting region using contour trees, and the NCC of the template with the region is calculated. This way, we can recognize a target even when it is only partly in view. A particle filter is used to fuse highly multi-modal measurements from the three techniques. Each particle chooses its update measurement using a roulette wheel selection with the size of the slice being proportional to the measurement's NCC and, therefore, converges to a location that has a greater NCC and numerous positive hits. The particle filter allows estimation of target position and velocity states, which are used to determine criteria for safe landing. We evaluate our system with an image-in-the-loop simulation and closed-loop flight tests with a quadrotor.

Original languageEnglish (US)
Title of host publication2017 International Conference on Unmanned Aircraft Systems, ICUAS 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages256-263
Number of pages8
ISBN (Electronic)9781509044948
DOIs
StatePublished - Jul 25 2017
Event2017 International Conference on Unmanned Aircraft Systems, ICUAS 2017 - Miami, United States
Duration: Jun 13 2017Jun 16 2017

Publication series

Name2017 International Conference on Unmanned Aircraft Systems, ICUAS 2017

Other

Other2017 International Conference on Unmanned Aircraft Systems, ICUAS 2017
CountryUnited States
CityMiami
Period6/13/176/16/17

All Science Journal Classification (ASJC) codes

  • Aerospace Engineering
  • Control and Optimization

Fingerprint Dive into the research topics of 'Particle filter for closed-loop detection and tracking from occluded airborne images'. Together they form a unique fingerprint.

Cite this