Towards trusted services: Result verification schemes for MapReduce

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

Recent development in Internet-scale data applications and services, combined with the proliferation of cloud computing, has created a new computing model for data intensive computing best characterized by the MapReduce paradigm. The MapReduce computing paradigm, pioneered by Google in its Internet search application, is an architectural and programming model for efficiently processing massive amount of raw unstructured data. With the availability of the open source Hadoop tools, applications built based on the MapReduce computing model are rapidly growing. In this work, we focus on a unique security concern on the MapReduce architecture. Given the potential security risks from lazy or malicious servers involved in a MapReduce task, we design efficient and innovative mechanisms for detecting cheating services under the MapReduce environment based on watermark injection and random sampling methods. The new detection schemes are expected to significantly reduce the cost of verification overhead. Finally, extensive analytical and experimental evaluation confirms the effectiveness of our schemes in MapReduce result verification.

Original languageEnglish (US)
Title of host publicationProceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012
Pages41-48
Number of pages8
DOIs
StatePublished - 2012
Event12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012 - Ottawa, ON, Canada
Duration: May 13 2012May 16 2012

Publication series

NameProceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012

Other

Other12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012
Country/TerritoryCanada
CityOttawa, ON
Period5/13/125/16/12

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Towards trusted services: Result verification schemes for MapReduce'. Together they form a unique fingerprint.

Cite this