Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs)

Andrew D. O'Neill, Joshua C. Davidson, Tim J. Kane, Ram M. Narayanan, Nibir K. Dhar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

A fundamental problem in imaging remote sensing systems is that of scale and resolution. The ability to resolve an object at a distance requires a high resolution sensor, with pixels subtending a small portion of the total field-of-view (FOV) of the imaging system. Traditional approaches to addressing this challenge are fundamentally data limited. To this end, we implemented foveating data reduction models inspired by the bi-foveated vision of birds of prey. The development of such systems for multiple target detection and tracking for air-to-ground target acquisition is important for several defense applications. The relative merits and disadvantages of various optical imaging technologies as well as several image transformations, sampling schemes, and object tracking algorithms were explored. Variable focal lens controlled by pressure, external voltage, or microfluidics demonstrate potential for devices requiring high resolution within a specified range. The distortion, coma, and spherical aberrations that occur can be corrected through the use of adaptive optics and custom 3D printed lenses. In conjunction with the hardware aspects, algorithmic approaches were also considered. The use of dynamically generated, moving foveal regions was investigated for use in motion tracking and object detection algorithms. Through the use of imaging systems with exceptionally large fields of view and localized areas of high resolution, machine vision systems can be implemented with less computational and data overhead. The implementation of our system is suited to use in either unmanned aerial vehicle or autonomous vehicle applications.

Original languageEnglish (US)
Title of host publicationImage Sensing Technologies
Subtitle of host publicationMaterials, Devices, Systems, and Applications V
EditorsAchyut K. Dutta, Nibir K. Dhar
PublisherSPIE
ISBN (Electronic)9781510618237
DOIs
StatePublished - Jan 1 2018
EventImage Sensing Technologies: Materials, Devices, Systems, and Applications V 2018 - Orlando, United States
Duration: Apr 16 2018Apr 19 2018

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10656
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Other

OtherImage Sensing Technologies: Materials, Devices, Systems, and Applications V 2018
CountryUnited States
CityOrlando
Period4/16/184/19/18

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs)'. Together they form a unique fingerprint.

  • Cite this

    O'Neill, A. D., Davidson, J. C., Kane, T. J., Narayanan, R. M., & Dhar, N. K. (2018). Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs). In A. K. Dutta, & N. K. Dhar (Eds.), Image Sensing Technologies: Materials, Devices, Systems, and Applications V [1065610] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10656). SPIE. https://doi.org/10.1117/12.2305520