Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs)

Andrew D. O'Neill, Joshua C. Davidson, Tim J. Kane, Ram M. Narayanan, Nibir K. Dhar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

A fundamental problem in imaging remote sensing systems is that of scale and resolution. The ability to resolve an object at a distance requires a high resolution sensor, with pixels subtending a small portion of the total field-of-view (FOV) of the imaging system. Traditional approaches to addressing this challenge are fundamentally data limited. To this end, we implemented foveating data reduction models inspired by the bi-foveated vision of birds of prey. The development of such systems for multiple target detection and tracking for air-to-ground target acquisition is important for several defense applications. The relative merits and disadvantages of various optical imaging technologies as well as several image transformations, sampling schemes, and object tracking algorithms were explored. Variable focal lens controlled by pressure, external voltage, or microfluidics demonstrate potential for devices requiring high resolution within a specified range. The distortion, coma, and spherical aberrations that occur can be corrected through the use of adaptive optics and custom 3D printed lenses. In conjunction with the hardware aspects, algorithmic approaches were also considered. The use of dynamically generated, moving foveal regions was investigated for use in motion tracking and object detection algorithms. Through the use of imaging systems with exceptionally large fields of view and localized areas of high resolution, machine vision systems can be implemented with less computational and data overhead. The implementation of our system is suited to use in either unmanned aerial vehicle or autonomous vehicle applications.

Original languageEnglish (US)
Title of host publicationImage Sensing Technologies
Subtitle of host publicationMaterials, Devices, Systems, and Applications V
EditorsAchyut K. Dutta, Nibir K. Dhar
PublisherSPIE
ISBN (Electronic)9781510618237
DOIs
StatePublished - Jan 1 2018
EventImage Sensing Technologies: Materials, Devices, Systems, and Applications V 2018 - Orlando, United States
Duration: Apr 16 2018Apr 19 2018

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10656
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Other

OtherImage Sensing Technologies: Materials, Devices, Systems, and Applications V 2018
CountryUnited States
CityOrlando
Period4/16/184/19/18

Fingerprint

pilotless aircraft
Unmanned aerial vehicles (UAV)
Target tracking
Imaging System
Imaging systems
Lenses
High Resolution
Field of View
Imaging techniques
field of view
Lens
Adaptive optics
high resolution
Birds
Aberrations
lenses
Microfluidics
Computer vision
Image Transformation
target acquisition

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

O'Neill, A. D., Davidson, J. C., Kane, T. J., Narayanan, R. M., & Dhar, N. K. (2018). Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs). In A. K. Dutta, & N. K. Dhar (Eds.), Image Sensing Technologies: Materials, Devices, Systems, and Applications V [1065610] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10656). SPIE. https://doi.org/10.1117/12.2305520
O'Neill, Andrew D. ; Davidson, Joshua C. ; Kane, Tim J. ; Narayanan, Ram M. ; Dhar, Nibir K. / Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs). Image Sensing Technologies: Materials, Devices, Systems, and Applications V. editor / Achyut K. Dutta ; Nibir K. Dhar. SPIE, 2018. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{1f7aba67bd53433098fee5d3c04be499,
title = "Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs)",
abstract = "A fundamental problem in imaging remote sensing systems is that of scale and resolution. The ability to resolve an object at a distance requires a high resolution sensor, with pixels subtending a small portion of the total field-of-view (FOV) of the imaging system. Traditional approaches to addressing this challenge are fundamentally data limited. To this end, we implemented foveating data reduction models inspired by the bi-foveated vision of birds of prey. The development of such systems for multiple target detection and tracking for air-to-ground target acquisition is important for several defense applications. The relative merits and disadvantages of various optical imaging technologies as well as several image transformations, sampling schemes, and object tracking algorithms were explored. Variable focal lens controlled by pressure, external voltage, or microfluidics demonstrate potential for devices requiring high resolution within a specified range. The distortion, coma, and spherical aberrations that occur can be corrected through the use of adaptive optics and custom 3D printed lenses. In conjunction with the hardware aspects, algorithmic approaches were also considered. The use of dynamically generated, moving foveal regions was investigated for use in motion tracking and object detection algorithms. Through the use of imaging systems with exceptionally large fields of view and localized areas of high resolution, machine vision systems can be implemented with less computational and data overhead. The implementation of our system is suited to use in either unmanned aerial vehicle or autonomous vehicle applications.",
author = "O'Neill, {Andrew D.} and Davidson, {Joshua C.} and Kane, {Tim J.} and Narayanan, {Ram M.} and Dhar, {Nibir K.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1117/12.2305520",
language = "English (US)",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Dutta, {Achyut K.} and Dhar, {Nibir K.}",
booktitle = "Image Sensing Technologies",
address = "United States",

}

O'Neill, AD, Davidson, JC, Kane, TJ, Narayanan, RM & Dhar, NK 2018, Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs). in AK Dutta & NK Dhar (eds), Image Sensing Technologies: Materials, Devices, Systems, and Applications V., 1065610, Proceedings of SPIE - The International Society for Optical Engineering, vol. 10656, SPIE, Image Sensing Technologies: Materials, Devices, Systems, and Applications V 2018, Orlando, United States, 4/16/18. https://doi.org/10.1117/12.2305520

Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs). / O'Neill, Andrew D.; Davidson, Joshua C.; Kane, Tim J.; Narayanan, Ram M.; Dhar, Nibir K.

Image Sensing Technologies: Materials, Devices, Systems, and Applications V. ed. / Achyut K. Dutta; Nibir K. Dhar. SPIE, 2018. 1065610 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10656).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs)

AU - O'Neill, Andrew D.

AU - Davidson, Joshua C.

AU - Kane, Tim J.

AU - Narayanan, Ram M.

AU - Dhar, Nibir K.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - A fundamental problem in imaging remote sensing systems is that of scale and resolution. The ability to resolve an object at a distance requires a high resolution sensor, with pixels subtending a small portion of the total field-of-view (FOV) of the imaging system. Traditional approaches to addressing this challenge are fundamentally data limited. To this end, we implemented foveating data reduction models inspired by the bi-foveated vision of birds of prey. The development of such systems for multiple target detection and tracking for air-to-ground target acquisition is important for several defense applications. The relative merits and disadvantages of various optical imaging technologies as well as several image transformations, sampling schemes, and object tracking algorithms were explored. Variable focal lens controlled by pressure, external voltage, or microfluidics demonstrate potential for devices requiring high resolution within a specified range. The distortion, coma, and spherical aberrations that occur can be corrected through the use of adaptive optics and custom 3D printed lenses. In conjunction with the hardware aspects, algorithmic approaches were also considered. The use of dynamically generated, moving foveal regions was investigated for use in motion tracking and object detection algorithms. Through the use of imaging systems with exceptionally large fields of view and localized areas of high resolution, machine vision systems can be implemented with less computational and data overhead. The implementation of our system is suited to use in either unmanned aerial vehicle or autonomous vehicle applications.

AB - A fundamental problem in imaging remote sensing systems is that of scale and resolution. The ability to resolve an object at a distance requires a high resolution sensor, with pixels subtending a small portion of the total field-of-view (FOV) of the imaging system. Traditional approaches to addressing this challenge are fundamentally data limited. To this end, we implemented foveating data reduction models inspired by the bi-foveated vision of birds of prey. The development of such systems for multiple target detection and tracking for air-to-ground target acquisition is important for several defense applications. The relative merits and disadvantages of various optical imaging technologies as well as several image transformations, sampling schemes, and object tracking algorithms were explored. Variable focal lens controlled by pressure, external voltage, or microfluidics demonstrate potential for devices requiring high resolution within a specified range. The distortion, coma, and spherical aberrations that occur can be corrected through the use of adaptive optics and custom 3D printed lenses. In conjunction with the hardware aspects, algorithmic approaches were also considered. The use of dynamically generated, moving foveal regions was investigated for use in motion tracking and object detection algorithms. Through the use of imaging systems with exceptionally large fields of view and localized areas of high resolution, machine vision systems can be implemented with less computational and data overhead. The implementation of our system is suited to use in either unmanned aerial vehicle or autonomous vehicle applications.

UR - http://www.scopus.com/inward/record.url?scp=85050957628&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050957628&partnerID=8YFLogxK

U2 - 10.1117/12.2305520

DO - 10.1117/12.2305520

M3 - Conference contribution

AN - SCOPUS:85050957628

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Image Sensing Technologies

A2 - Dutta, Achyut K.

A2 - Dhar, Nibir K.

PB - SPIE

ER -

O'Neill AD, Davidson JC, Kane TJ, Narayanan RM, Dhar NK. Considerations in the development of a foveated imaging system for unmanned aerial vehicles (UAVs). In Dutta AK, Dhar NK, editors, Image Sensing Technologies: Materials, Devices, Systems, and Applications V. SPIE. 2018. 1065610. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.2305520