Big data analytics concepts and management techniques

Tarek Elarabi, Bhanu Sharma, Karan Pahwa, Vishal Deep

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Emergence of big data sources at a rapid rate extends the necessity of old data organization due to the large volume, velocity, variety, value, and veracity of this data. Performing timely analysis on huge datasets is the central promise of big data analytics. The frameworks used to compose analytics jobs into a Directed Acyclic Graphs of small tasks, and then aggregate the intermediate results from the tasks to obtain the final result, does so with the help of a scheduler and a reliable storage layer that distributes the datasets on different machines. This paper presents the above two aspects, scheduling and storage, describe their key principles, and how these principles are realized in widely-deployed systems. The aim of this research project is to design a novel memory management for in-memory databases. Special designed hardware architectures can support the memory management of the host processor. This paper also explores how special designed hardware architectures can upkeep and fast-track data attainment, data straining and data investigation.

Original languageEnglish (US)
Title of host publicationProceedings of the International Conference on Inventive Computation Technologies, ICICT 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509012855
DOIs
StatePublished - Jul 2 2016
Event2016 International Conference on Inventive Computation Technologies, ICICT 2016 - Coimbatore, India
Duration: Aug 26 2016Aug 27 2016

Publication series

NameProceedings of the International Conference on Inventive Computation Technologies, ICICT 2016
Volume2

Other

Other2016 International Conference on Inventive Computation Technologies, ICICT 2016
CountryIndia
CityCoimbatore
Period8/26/168/27/16

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Health Informatics
  • Artificial Intelligence
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Big data analytics concepts and management techniques'. Together they form a unique fingerprint.

Cite this