Trends and opportunities for sram based in-memory and near-memory computation

Srivatsa Srinivasa, Akshay Krishna Ramanathan, Jainaveen Sundaram, Dileep Kurian, Srinivasan Gopal, Nilesh Jain, Anuradha Srinivasan, Ravi Iyer, Vijaykrishnan Narayanan, Tanay Karnik

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Changes in application trends along with increasing number of connected devices have led to explosion in the amount of data being generated every single day. Computing systems need to efficiently process these huge amounts of data and generate results, classify objects, stream high quality videos and so on. In-Memory Computing and Near-Memory Computing have been emerged as the popular design choices to address the challenges in executing the above-mentioned tasks. Through In-Memory Computing, SRAM Banks can be repurposed as compute engines while performing Bulk Boolean operations. Near-Memory techniques have shown promise in improving the performance of Machine learning tasks. By carefully understanding the design we describe the opportunities towards amalgamating both these design techniques for obtaining further performance enhancement and achieving lower power budget while executing fundamental Machine Learning primitives. In this work, we take the example of Sparse Matrix Multiplication, and design an I-NMC accelerator which speeds up the index handling by 10x-60x and 10x-70x energy efficiency based on the workload dimensions as compared with non I-NMC solution occupying just 1% of the overall hardware area.

Original languageEnglish (US)
Title of host publicationProceedings of the 22nd International Symposium on Quality Electronic Design, ISQED 2021
PublisherIEEE Computer Society
Pages547-552
Number of pages6
ISBN (Electronic)9781728176413
DOIs
StatePublished - Apr 7 2021
Event22nd International Symposium on Quality Electronic Design, ISQED 2021 - Santa Clara, United States
Duration: Apr 7 2021Apr 9 2021

Publication series

NameProceedings - International Symposium on Quality Electronic Design, ISQED
Volume2021-April
ISSN (Print)1948-3287
ISSN (Electronic)1948-3295

Conference

Conference22nd International Symposium on Quality Electronic Design, ISQED 2021
Country/TerritoryUnited States
CitySanta Clara
Period4/7/214/9/21

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Electrical and Electronic Engineering
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Trends and opportunities for sram based in-memory and near-memory computation'. Together they form a unique fingerprint.

Cite this