GPS-denied indoor and outdoor monocular vision aided navigation and control of unmanned aircraft

Girish Chowdhary, Eric Johnson, Daniel Magree, Allen Wu, Andy Shein

Research output: Contribution to journalArticle

92 Citations (Scopus)

Abstract

GPS-denied closed-loop autonomous control of unstable Unmanned Aerial Vehicles (UAVs) such as rotorcraft using information from a monocular camera has been an open problem. Most proposed Vision aided Inertial Navigation Systems (V-INSs) have been too computationally intensive or do not have sufficient integrity for closed-loop flight. We provide an affirmative answer to the question of whether V-INSs can be used to sustain prolonged real-world GPS-denied flight by presenting a V-INS that is validated through autonomous flight-tests over prolonged closed-loop dynamic operation in both indoor and outdoor GPS-denied environments with two rotorcraft unmanned aircraft systems (UASs). The architecture efficiently combines visual feature information from a monocular camera with measurements from inertial sensors. Inertial measurements are used to predict frame-to-frame transition of online selected feature locations, and the difference between predicted and observed feature locations is used to bind in real-time the inertial measurement unit drift, estimate its bias, and account for initial misalignment errors. A novel algorithm to manage a library of features online is presented that can add or remove features based on a measure of relative confidence in each feature location. The resulting V-INS is sufficiently efficient and reliable to enable real-time implementation on resource-constrained aerial vehicles. The presented algorithms are validated on multiple platforms in real-world conditions: through a 16-min flight test, including an autonomous landing, of a 66 kg rotorcraft UAV operating in an unconctrolled outdoor environment without using GPS and through a Micro-UAV operating in a cluttered, unmapped, and gusty indoor environment.

Original languageEnglish (US)
Pages (from-to)415-438
Number of pages24
JournalJournal of Field Robotics
Volume30
Issue number3
DOIs
StatePublished - May 1 2013

Fingerprint

Inertial navigation systems
Global positioning system
Navigation
Unmanned aerial vehicles (UAV)
Aircraft
Cameras
Units of measurement
Landing
Antennas
Sensors

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science Applications

Cite this

Chowdhary, Girish ; Johnson, Eric ; Magree, Daniel ; Wu, Allen ; Shein, Andy. / GPS-denied indoor and outdoor monocular vision aided navigation and control of unmanned aircraft. In: Journal of Field Robotics. 2013 ; Vol. 30, No. 3. pp. 415-438.
@article{93572c6b14884244b05a52601fac0ab8,
title = "GPS-denied indoor and outdoor monocular vision aided navigation and control of unmanned aircraft",
abstract = "GPS-denied closed-loop autonomous control of unstable Unmanned Aerial Vehicles (UAVs) such as rotorcraft using information from a monocular camera has been an open problem. Most proposed Vision aided Inertial Navigation Systems (V-INSs) have been too computationally intensive or do not have sufficient integrity for closed-loop flight. We provide an affirmative answer to the question of whether V-INSs can be used to sustain prolonged real-world GPS-denied flight by presenting a V-INS that is validated through autonomous flight-tests over prolonged closed-loop dynamic operation in both indoor and outdoor GPS-denied environments with two rotorcraft unmanned aircraft systems (UASs). The architecture efficiently combines visual feature information from a monocular camera with measurements from inertial sensors. Inertial measurements are used to predict frame-to-frame transition of online selected feature locations, and the difference between predicted and observed feature locations is used to bind in real-time the inertial measurement unit drift, estimate its bias, and account for initial misalignment errors. A novel algorithm to manage a library of features online is presented that can add or remove features based on a measure of relative confidence in each feature location. The resulting V-INS is sufficiently efficient and reliable to enable real-time implementation on resource-constrained aerial vehicles. The presented algorithms are validated on multiple platforms in real-world conditions: through a 16-min flight test, including an autonomous landing, of a 66 kg rotorcraft UAV operating in an unconctrolled outdoor environment without using GPS and through a Micro-UAV operating in a cluttered, unmapped, and gusty indoor environment.",
author = "Girish Chowdhary and Eric Johnson and Daniel Magree and Allen Wu and Andy Shein",
year = "2013",
month = "5",
day = "1",
doi = "10.1002/rob.21454",
language = "English (US)",
volume = "30",
pages = "415--438",
journal = "Journal of Field Robotics",
issn = "1556-4959",
publisher = "John Wiley and Sons Inc.",
number = "3",

}

GPS-denied indoor and outdoor monocular vision aided navigation and control of unmanned aircraft. / Chowdhary, Girish; Johnson, Eric; Magree, Daniel; Wu, Allen; Shein, Andy.

In: Journal of Field Robotics, Vol. 30, No. 3, 01.05.2013, p. 415-438.

Research output: Contribution to journalArticle

TY - JOUR

T1 - GPS-denied indoor and outdoor monocular vision aided navigation and control of unmanned aircraft

AU - Chowdhary, Girish

AU - Johnson, Eric

AU - Magree, Daniel

AU - Wu, Allen

AU - Shein, Andy

PY - 2013/5/1

Y1 - 2013/5/1

N2 - GPS-denied closed-loop autonomous control of unstable Unmanned Aerial Vehicles (UAVs) such as rotorcraft using information from a monocular camera has been an open problem. Most proposed Vision aided Inertial Navigation Systems (V-INSs) have been too computationally intensive or do not have sufficient integrity for closed-loop flight. We provide an affirmative answer to the question of whether V-INSs can be used to sustain prolonged real-world GPS-denied flight by presenting a V-INS that is validated through autonomous flight-tests over prolonged closed-loop dynamic operation in both indoor and outdoor GPS-denied environments with two rotorcraft unmanned aircraft systems (UASs). The architecture efficiently combines visual feature information from a monocular camera with measurements from inertial sensors. Inertial measurements are used to predict frame-to-frame transition of online selected feature locations, and the difference between predicted and observed feature locations is used to bind in real-time the inertial measurement unit drift, estimate its bias, and account for initial misalignment errors. A novel algorithm to manage a library of features online is presented that can add or remove features based on a measure of relative confidence in each feature location. The resulting V-INS is sufficiently efficient and reliable to enable real-time implementation on resource-constrained aerial vehicles. The presented algorithms are validated on multiple platforms in real-world conditions: through a 16-min flight test, including an autonomous landing, of a 66 kg rotorcraft UAV operating in an unconctrolled outdoor environment without using GPS and through a Micro-UAV operating in a cluttered, unmapped, and gusty indoor environment.

AB - GPS-denied closed-loop autonomous control of unstable Unmanned Aerial Vehicles (UAVs) such as rotorcraft using information from a monocular camera has been an open problem. Most proposed Vision aided Inertial Navigation Systems (V-INSs) have been too computationally intensive or do not have sufficient integrity for closed-loop flight. We provide an affirmative answer to the question of whether V-INSs can be used to sustain prolonged real-world GPS-denied flight by presenting a V-INS that is validated through autonomous flight-tests over prolonged closed-loop dynamic operation in both indoor and outdoor GPS-denied environments with two rotorcraft unmanned aircraft systems (UASs). The architecture efficiently combines visual feature information from a monocular camera with measurements from inertial sensors. Inertial measurements are used to predict frame-to-frame transition of online selected feature locations, and the difference between predicted and observed feature locations is used to bind in real-time the inertial measurement unit drift, estimate its bias, and account for initial misalignment errors. A novel algorithm to manage a library of features online is presented that can add or remove features based on a measure of relative confidence in each feature location. The resulting V-INS is sufficiently efficient and reliable to enable real-time implementation on resource-constrained aerial vehicles. The presented algorithms are validated on multiple platforms in real-world conditions: through a 16-min flight test, including an autonomous landing, of a 66 kg rotorcraft UAV operating in an unconctrolled outdoor environment without using GPS and through a Micro-UAV operating in a cluttered, unmapped, and gusty indoor environment.

UR - http://www.scopus.com/inward/record.url?scp=84875873152&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875873152&partnerID=8YFLogxK

U2 - 10.1002/rob.21454

DO - 10.1002/rob.21454

M3 - Article

AN - SCOPUS:84875873152

VL - 30

SP - 415

EP - 438

JO - Journal of Field Robotics

JF - Journal of Field Robotics

SN - 1556-4959

IS - 3

ER -