Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle

James A. Ross, Brian R. Geiger, Gregory L. Sinsley, Joseph Francis Horn, Lyle Norman Long, Albert F. Niessner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

A real-time computer vision algorithm for the identification and geolocation of ground targets was developed and implemented on the Penn State University / Applied Research Laboratory Unmanned Aerial Vehicle (PSU/ARL UAV) system. The geolocation data is filtered using a linear Kalman filter, which provides a smoothed estimate of target location and target velocity. The vision processing routine and estimator are coupled with an onboard path planning algorithm that optimizes the vehicle trajectory to maximize surveillance coverage of the targets. The vision processing and estimation routines were flight tested onboard a UAV system with a human pilot-in-the-loop. It was found that GPS latency had a significant effect on the geolocation error, and performance was significantly improved when using latency compensation. The combined target geolocation and path planning system was tested on the ground using a hardware-in-the-loop simulation, and resulted successful tracking and observation of a fixed target. Timing results showed that is is feasible to implement total system in real time.

Original languageEnglish (US)
Title of host publicationAIAA Guidance, Navigation and Control Conference and Exhibit
StatePublished - Dec 1 2008
EventAIAA Guidance, Navigation and Control Conference and Exhibit - Honolulu, HI, United States
Duration: Aug 18 2008Aug 21 2008

Publication series

NameAIAA Guidance, Navigation and Control Conference and Exhibit

Other

OtherAIAA Guidance, Navigation and Control Conference and Exhibit
CountryUnited States
CityHonolulu, HI
Period8/18/088/21/08

Fingerprint

Unmanned aerial vehicles (UAV)
Motion planning
Research laboratories
Processing
Kalman filters
Computer vision
Global positioning system
Trajectories
Hardware
Compensation and Redress

All Science Journal Classification (ASJC) codes

  • Aerospace Engineering
  • Control and Systems Engineering

Cite this

Ross, J. A., Geiger, B. R., Sinsley, G. L., Horn, J. F., Long, L. N., & Niessner, A. F. (2008). Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle. In AIAA Guidance, Navigation and Control Conference and Exhibit [2008-7448] (AIAA Guidance, Navigation and Control Conference and Exhibit).
Ross, James A. ; Geiger, Brian R. ; Sinsley, Gregory L. ; Horn, Joseph Francis ; Long, Lyle Norman ; Niessner, Albert F. / Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle. AIAA Guidance, Navigation and Control Conference and Exhibit. 2008. (AIAA Guidance, Navigation and Control Conference and Exhibit).
@inproceedings{b5956692df2b48508e55efca344b2088,
title = "Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle",
abstract = "A real-time computer vision algorithm for the identification and geolocation of ground targets was developed and implemented on the Penn State University / Applied Research Laboratory Unmanned Aerial Vehicle (PSU/ARL UAV) system. The geolocation data is filtered using a linear Kalman filter, which provides a smoothed estimate of target location and target velocity. The vision processing routine and estimator are coupled with an onboard path planning algorithm that optimizes the vehicle trajectory to maximize surveillance coverage of the targets. The vision processing and estimation routines were flight tested onboard a UAV system with a human pilot-in-the-loop. It was found that GPS latency had a significant effect on the geolocation error, and performance was significantly improved when using latency compensation. The combined target geolocation and path planning system was tested on the ground using a hardware-in-the-loop simulation, and resulted successful tracking and observation of a fixed target. Timing results showed that is is feasible to implement total system in real time.",
author = "Ross, {James A.} and Geiger, {Brian R.} and Sinsley, {Gregory L.} and Horn, {Joseph Francis} and Long, {Lyle Norman} and Niessner, {Albert F.}",
year = "2008",
month = "12",
day = "1",
language = "English (US)",
isbn = "9781563479458",
series = "AIAA Guidance, Navigation and Control Conference and Exhibit",
booktitle = "AIAA Guidance, Navigation and Control Conference and Exhibit",

}

Ross, JA, Geiger, BR, Sinsley, GL, Horn, JF, Long, LN & Niessner, AF 2008, Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle. in AIAA Guidance, Navigation and Control Conference and Exhibit., 2008-7448, AIAA Guidance, Navigation and Control Conference and Exhibit, AIAA Guidance, Navigation and Control Conference and Exhibit, Honolulu, HI, United States, 8/18/08.

Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle. / Ross, James A.; Geiger, Brian R.; Sinsley, Gregory L.; Horn, Joseph Francis; Long, Lyle Norman; Niessner, Albert F.

AIAA Guidance, Navigation and Control Conference and Exhibit. 2008. 2008-7448 (AIAA Guidance, Navigation and Control Conference and Exhibit).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle

AU - Ross, James A.

AU - Geiger, Brian R.

AU - Sinsley, Gregory L.

AU - Horn, Joseph Francis

AU - Long, Lyle Norman

AU - Niessner, Albert F.

PY - 2008/12/1

Y1 - 2008/12/1

N2 - A real-time computer vision algorithm for the identification and geolocation of ground targets was developed and implemented on the Penn State University / Applied Research Laboratory Unmanned Aerial Vehicle (PSU/ARL UAV) system. The geolocation data is filtered using a linear Kalman filter, which provides a smoothed estimate of target location and target velocity. The vision processing routine and estimator are coupled with an onboard path planning algorithm that optimizes the vehicle trajectory to maximize surveillance coverage of the targets. The vision processing and estimation routines were flight tested onboard a UAV system with a human pilot-in-the-loop. It was found that GPS latency had a significant effect on the geolocation error, and performance was significantly improved when using latency compensation. The combined target geolocation and path planning system was tested on the ground using a hardware-in-the-loop simulation, and resulted successful tracking and observation of a fixed target. Timing results showed that is is feasible to implement total system in real time.

AB - A real-time computer vision algorithm for the identification and geolocation of ground targets was developed and implemented on the Penn State University / Applied Research Laboratory Unmanned Aerial Vehicle (PSU/ARL UAV) system. The geolocation data is filtered using a linear Kalman filter, which provides a smoothed estimate of target location and target velocity. The vision processing routine and estimator are coupled with an onboard path planning algorithm that optimizes the vehicle trajectory to maximize surveillance coverage of the targets. The vision processing and estimation routines were flight tested onboard a UAV system with a human pilot-in-the-loop. It was found that GPS latency had a significant effect on the geolocation error, and performance was significantly improved when using latency compensation. The combined target geolocation and path planning system was tested on the ground using a hardware-in-the-loop simulation, and resulted successful tracking and observation of a fixed target. Timing results showed that is is feasible to implement total system in real time.

UR - http://www.scopus.com/inward/record.url?scp=78651061154&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78651061154&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:78651061154

SN - 9781563479458

T3 - AIAA Guidance, Navigation and Control Conference and Exhibit

BT - AIAA Guidance, Navigation and Control Conference and Exhibit

ER -

Ross JA, Geiger BR, Sinsley GL, Horn JF, Long LN, Niessner AF. Vision-based target geolocation and optimal surveillance on an Unmanned Aerial Vehicle. In AIAA Guidance, Navigation and Control Conference and Exhibit. 2008. 2008-7448. (AIAA Guidance, Navigation and Control Conference and Exhibit).