Relative motion estimation for vision-based formation flight using unscented kalman filter

Seung Min Oh, Eric Johnson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

33 Citations (Scopus)

Abstract

This paper describes a vision-based relative motion estimator in the formation flight of two unmanned aerial vehicles (UAVs). The navigation of a follower aircraft relative to a target (or leader) aircraft is performed by vision-only information from a single camera fixed to the follower aircraft. The images of the target aircraft projected on the videocamera plane of the follower aircraft are captured and processed into vision information. The vision information for the relative motion estimator in this work is composed of three target angles: an azimuth angle, an elevation angle, and a subtended angle. Using this vision information measurement, the follower aircraft estimates a target relative position, a target relative velocity, a target size, and target acceleration components in the framework of an unscented Kalman filter (UKF). The UKF is applied to the relative motion estimator due to the highly nonlinear characteristics of the problem at hand. In order to evaluate the performance of the vision-based navigation filter, vision information obtained through a real-time flight test is post-processed by the filter. The real-time vision information, obtained by a geometric active contour method on an onboard computer, is composed of three points of the target aircraft on the camera image plane of the follower aircraft. These target points are the center point, the left wingtip point, and the right wingtip point. The target center point on the image plane provides information about the azimuth and the elevation angles of the target in the camera frame, and the two wingtip points provide information about the subtended angle of the target, which ultimately provides the target size. The vision-based estimation results of the target-follower relative motion and target characteristics are compared to actual data that are independently obtained from the onboard integrated navigation systems of both aircraft during the flight test. Each integrated navigation system is composed of an inertial measurement unit (IMU), a global positioning system (GPS), and a magnetometer. Comparisons indicate that the vision-based estimation filter produces satisfactory estimation results and thus successfully overcomes the highly nonlinear system characteristics by the UKF framework.

Original languageEnglish (US)
Title of host publicationCollection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007
Pages5365-5381
Number of pages17
StatePublished - Dec 24 2007
EventAIAA Guidance, Navigation, and Control Conference 2007 - Hilton Head, SC, United States
Duration: Aug 20 2007Aug 23 2007

Publication series

NameCollection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007
Volume5

Other

OtherAIAA Guidance, Navigation, and Control Conference 2007
CountryUnited States
CityHilton Head, SC
Period8/20/078/23/07

Fingerprint

Motion estimation
Kalman filters
Aircraft
Cameras
Navigation systems
Navigation
Units of measurement
Magnetometers
Unmanned aerial vehicles (UAV)
Global positioning system
Nonlinear systems

All Science Journal Classification (ASJC) codes

  • Aerospace Engineering
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Oh, S. M., & Johnson, E. (2007). Relative motion estimation for vision-based formation flight using unscented kalman filter. In Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007 (pp. 5365-5381). (Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007; Vol. 5).
Oh, Seung Min ; Johnson, Eric. / Relative motion estimation for vision-based formation flight using unscented kalman filter. Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007. 2007. pp. 5365-5381 (Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007).
@inproceedings{b131fbe915e94ae98ae3125b347f2a28,
title = "Relative motion estimation for vision-based formation flight using unscented kalman filter",
abstract = "This paper describes a vision-based relative motion estimator in the formation flight of two unmanned aerial vehicles (UAVs). The navigation of a follower aircraft relative to a target (or leader) aircraft is performed by vision-only information from a single camera fixed to the follower aircraft. The images of the target aircraft projected on the videocamera plane of the follower aircraft are captured and processed into vision information. The vision information for the relative motion estimator in this work is composed of three target angles: an azimuth angle, an elevation angle, and a subtended angle. Using this vision information measurement, the follower aircraft estimates a target relative position, a target relative velocity, a target size, and target acceleration components in the framework of an unscented Kalman filter (UKF). The UKF is applied to the relative motion estimator due to the highly nonlinear characteristics of the problem at hand. In order to evaluate the performance of the vision-based navigation filter, vision information obtained through a real-time flight test is post-processed by the filter. The real-time vision information, obtained by a geometric active contour method on an onboard computer, is composed of three points of the target aircraft on the camera image plane of the follower aircraft. These target points are the center point, the left wingtip point, and the right wingtip point. The target center point on the image plane provides information about the azimuth and the elevation angles of the target in the camera frame, and the two wingtip points provide information about the subtended angle of the target, which ultimately provides the target size. The vision-based estimation results of the target-follower relative motion and target characteristics are compared to actual data that are independently obtained from the onboard integrated navigation systems of both aircraft during the flight test. Each integrated navigation system is composed of an inertial measurement unit (IMU), a global positioning system (GPS), and a magnetometer. Comparisons indicate that the vision-based estimation filter produces satisfactory estimation results and thus successfully overcomes the highly nonlinear system characteristics by the UKF framework.",
author = "Oh, {Seung Min} and Eric Johnson",
year = "2007",
month = "12",
day = "24",
language = "English (US)",
isbn = "1563479044",
series = "Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007",
pages = "5365--5381",
booktitle = "Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007",

}

Oh, SM & Johnson, E 2007, Relative motion estimation for vision-based formation flight using unscented kalman filter. in Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007. Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007, vol. 5, pp. 5365-5381, AIAA Guidance, Navigation, and Control Conference 2007, Hilton Head, SC, United States, 8/20/07.

Relative motion estimation for vision-based formation flight using unscented kalman filter. / Oh, Seung Min; Johnson, Eric.

Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007. 2007. p. 5365-5381 (Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007; Vol. 5).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Relative motion estimation for vision-based formation flight using unscented kalman filter

AU - Oh, Seung Min

AU - Johnson, Eric

PY - 2007/12/24

Y1 - 2007/12/24

N2 - This paper describes a vision-based relative motion estimator in the formation flight of two unmanned aerial vehicles (UAVs). The navigation of a follower aircraft relative to a target (or leader) aircraft is performed by vision-only information from a single camera fixed to the follower aircraft. The images of the target aircraft projected on the videocamera plane of the follower aircraft are captured and processed into vision information. The vision information for the relative motion estimator in this work is composed of three target angles: an azimuth angle, an elevation angle, and a subtended angle. Using this vision information measurement, the follower aircraft estimates a target relative position, a target relative velocity, a target size, and target acceleration components in the framework of an unscented Kalman filter (UKF). The UKF is applied to the relative motion estimator due to the highly nonlinear characteristics of the problem at hand. In order to evaluate the performance of the vision-based navigation filter, vision information obtained through a real-time flight test is post-processed by the filter. The real-time vision information, obtained by a geometric active contour method on an onboard computer, is composed of three points of the target aircraft on the camera image plane of the follower aircraft. These target points are the center point, the left wingtip point, and the right wingtip point. The target center point on the image plane provides information about the azimuth and the elevation angles of the target in the camera frame, and the two wingtip points provide information about the subtended angle of the target, which ultimately provides the target size. The vision-based estimation results of the target-follower relative motion and target characteristics are compared to actual data that are independently obtained from the onboard integrated navigation systems of both aircraft during the flight test. Each integrated navigation system is composed of an inertial measurement unit (IMU), a global positioning system (GPS), and a magnetometer. Comparisons indicate that the vision-based estimation filter produces satisfactory estimation results and thus successfully overcomes the highly nonlinear system characteristics by the UKF framework.

AB - This paper describes a vision-based relative motion estimator in the formation flight of two unmanned aerial vehicles (UAVs). The navigation of a follower aircraft relative to a target (or leader) aircraft is performed by vision-only information from a single camera fixed to the follower aircraft. The images of the target aircraft projected on the videocamera plane of the follower aircraft are captured and processed into vision information. The vision information for the relative motion estimator in this work is composed of three target angles: an azimuth angle, an elevation angle, and a subtended angle. Using this vision information measurement, the follower aircraft estimates a target relative position, a target relative velocity, a target size, and target acceleration components in the framework of an unscented Kalman filter (UKF). The UKF is applied to the relative motion estimator due to the highly nonlinear characteristics of the problem at hand. In order to evaluate the performance of the vision-based navigation filter, vision information obtained through a real-time flight test is post-processed by the filter. The real-time vision information, obtained by a geometric active contour method on an onboard computer, is composed of three points of the target aircraft on the camera image plane of the follower aircraft. These target points are the center point, the left wingtip point, and the right wingtip point. The target center point on the image plane provides information about the azimuth and the elevation angles of the target in the camera frame, and the two wingtip points provide information about the subtended angle of the target, which ultimately provides the target size. The vision-based estimation results of the target-follower relative motion and target characteristics are compared to actual data that are independently obtained from the onboard integrated navigation systems of both aircraft during the flight test. Each integrated navigation system is composed of an inertial measurement unit (IMU), a global positioning system (GPS), and a magnetometer. Comparisons indicate that the vision-based estimation filter produces satisfactory estimation results and thus successfully overcomes the highly nonlinear system characteristics by the UKF framework.

UR - http://www.scopus.com/inward/record.url?scp=37249059798&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37249059798&partnerID=8YFLogxK

M3 - Conference contribution

SN - 1563479044

SN - 9781563479045

T3 - Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007

SP - 5365

EP - 5381

BT - Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007

ER -

Oh SM, Johnson E. Relative motion estimation for vision-based formation flight using unscented kalman filter. In Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007. 2007. p. 5365-5381. (Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference 2007).