Cognitive cameras

Assistive vision systems

Kevin M. Irick, Peter A. Zientara, John Morgan Sampson, Vijaykrishnan Narayanan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As a benefactor of the proliferation of large scale integration, traditionally simple and unintelligent devices such as cameras have been transformed into key components of rich and engaging smart environments. By integrating machine perception algorithms, these cognitive cameras have the ability to perceive and understand their environments. A principal barrier to realizing the potential of cognitive cameras has been the absence of sufficient computing power within the device. This is especially true in wearable devices which are limited by both compute capability and energy. Hardware customization and specialization present effective solutions to the power and performance bottlenecks that have limited ubiquitous adoption. This work details the architecture, design, and evaluation of a cognitive camera system that employs custom hardware to meet both power and performance constraints. Furthermore we illustrate its use as an assistance system for the visually impaired.

Original languageEnglish (US)
Title of host publication2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages188
Number of pages1
ISBN (Electronic)9781467383202
DOIs
StatePublished - Nov 10 2015
EventInternational Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015 - Amsterdam, Netherlands
Duration: Oct 4 2015Oct 9 2015

Other

OtherInternational Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015
CountryNetherlands
CityAmsterdam
Period10/4/1510/9/15

Fingerprint

Cameras
Hardware
LSI circuits

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Computer Science Applications

Cite this

Irick, K. M., Zientara, P. A., Sampson, J. M., & Narayanan, V. (2015). Cognitive cameras: Assistive vision systems. In 2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015 (pp. 188). [7324560] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CASES.2015.7324560
Irick, Kevin M. ; Zientara, Peter A. ; Sampson, John Morgan ; Narayanan, Vijaykrishnan. / Cognitive cameras : Assistive vision systems. 2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 188
@inproceedings{9d94e006a7f34f51aa7fde525d705f5a,
title = "Cognitive cameras: Assistive vision systems",
abstract = "As a benefactor of the proliferation of large scale integration, traditionally simple and unintelligent devices such as cameras have been transformed into key components of rich and engaging smart environments. By integrating machine perception algorithms, these cognitive cameras have the ability to perceive and understand their environments. A principal barrier to realizing the potential of cognitive cameras has been the absence of sufficient computing power within the device. This is especially true in wearable devices which are limited by both compute capability and energy. Hardware customization and specialization present effective solutions to the power and performance bottlenecks that have limited ubiquitous adoption. This work details the architecture, design, and evaluation of a cognitive camera system that employs custom hardware to meet both power and performance constraints. Furthermore we illustrate its use as an assistance system for the visually impaired.",
author = "Irick, {Kevin M.} and Zientara, {Peter A.} and Sampson, {John Morgan} and Vijaykrishnan Narayanan",
year = "2015",
month = "11",
day = "10",
doi = "10.1109/CASES.2015.7324560",
language = "English (US)",
pages = "188",
booktitle = "2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Irick, KM, Zientara, PA, Sampson, JM & Narayanan, V 2015, Cognitive cameras: Assistive vision systems. in 2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015., 7324560, Institute of Electrical and Electronics Engineers Inc., pp. 188, International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015, Amsterdam, Netherlands, 10/4/15. https://doi.org/10.1109/CASES.2015.7324560

Cognitive cameras : Assistive vision systems. / Irick, Kevin M.; Zientara, Peter A.; Sampson, John Morgan; Narayanan, Vijaykrishnan.

2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 188 7324560.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Cognitive cameras

T2 - Assistive vision systems

AU - Irick, Kevin M.

AU - Zientara, Peter A.

AU - Sampson, John Morgan

AU - Narayanan, Vijaykrishnan

PY - 2015/11/10

Y1 - 2015/11/10

N2 - As a benefactor of the proliferation of large scale integration, traditionally simple and unintelligent devices such as cameras have been transformed into key components of rich and engaging smart environments. By integrating machine perception algorithms, these cognitive cameras have the ability to perceive and understand their environments. A principal barrier to realizing the potential of cognitive cameras has been the absence of sufficient computing power within the device. This is especially true in wearable devices which are limited by both compute capability and energy. Hardware customization and specialization present effective solutions to the power and performance bottlenecks that have limited ubiquitous adoption. This work details the architecture, design, and evaluation of a cognitive camera system that employs custom hardware to meet both power and performance constraints. Furthermore we illustrate its use as an assistance system for the visually impaired.

AB - As a benefactor of the proliferation of large scale integration, traditionally simple and unintelligent devices such as cameras have been transformed into key components of rich and engaging smart environments. By integrating machine perception algorithms, these cognitive cameras have the ability to perceive and understand their environments. A principal barrier to realizing the potential of cognitive cameras has been the absence of sufficient computing power within the device. This is especially true in wearable devices which are limited by both compute capability and energy. Hardware customization and specialization present effective solutions to the power and performance bottlenecks that have limited ubiquitous adoption. This work details the architecture, design, and evaluation of a cognitive camera system that employs custom hardware to meet both power and performance constraints. Furthermore we illustrate its use as an assistance system for the visually impaired.

UR - http://www.scopus.com/inward/record.url?scp=84962243632&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962243632&partnerID=8YFLogxK

U2 - 10.1109/CASES.2015.7324560

DO - 10.1109/CASES.2015.7324560

M3 - Conference contribution

SP - 188

BT - 2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Irick KM, Zientara PA, Sampson JM, Narayanan V. Cognitive cameras: Assistive vision systems. In 2015 International Conference on Compilers, Architecture and Synthesis for Embedded Systems, CASES 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 188. 7324560 https://doi.org/10.1109/CASES.2015.7324560