Emulating mammalian vision on reconfigurable hardware

Srinidhi Kestur, Mi Sun Park, Jagdish Sabarad, Dharav Dantara, Vijaykrishnan Narayanan, Yang Chen, Deepak Khosla

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Scopus citations

Abstract

A significant challenge in creating machines with artificial vision is designing systems which can process visual information as efficiently as the brain. To address this challenge, we identify key algorithms which model the process of attention and recognition in the visual cortex of mammals. This paper presents Cover - an FPGA framework for generating systems which can potentially emulate the visual cortex. We have designed accelerators for models of attention and recognition in the cortex and integrated them to realize an end-to-end attention-recognition system. Evaluation of our system on a Dinigroup multi-FPGA platform shows high performance and accuracy for attention and recognition systems and speedups over existing CPU, GPU and FPGA implementations. Results show that our end-to-end system which emulates the cortex can achieve near real-time speeds for high resolution images. This system can be applied to many artificial vision applications such as augmented virtual reality and autonomous vehicle navigation.

Original languageEnglish (US)
Title of host publicationProceedings of the 2012 IEEE 20th International Symposium on Field-Programmable Custom Computing Machines, FCCM 2012
Pages141-148
Number of pages8
DOIs
StatePublished - Aug 17 2012
Event20th IEEE International Symposium on Field-Programmable Custom Computing Machines, FCCM 2012 - Toronto, ON, Canada
Duration: Apr 29 2012May 1 2012

Publication series

NameProceedings of the 2012 IEEE 20th International Symposium on Field-Programmable Custom Computing Machines, FCCM 2012

Other

Other20th IEEE International Symposium on Field-Programmable Custom Computing Machines, FCCM 2012
CountryCanada
CityToronto, ON
Period4/29/125/1/12

All Science Journal Classification (ASJC) codes

  • Computer Science Applications

Fingerprint Dive into the research topics of 'Emulating mammalian vision on reconfigurable hardware'. Together they form a unique fingerprint.

Cite this