Detailed Information
Cited 0 time in 
Cited 0 time in 
Cited 0 time in
Metadata Downloads
Skew-Tolerant Key Distribution for Load Balancing in MapReduce
- Authors
- Son, Jihoon; Choi, Hyunsik; Chung, Yon Dohn
- Issue Date
- Feb-2012
- Publisher
- IEICE-INST ELECTRONICS INFORMATION COMMUNICATIONS ENG
- Keywords
- skew-tolerance; Map Reduce; load balance; key distribution
- Citation
- IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, v.E95D, no.2, pp.677 - 680
- Indexed
- SCOPUS
- Journal Title
- IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS
- Volume
- E95D
- Number
- 2
- Start Page
- 677
- End Page
- 680
- ISSN
- 1745-1361
- Abstract
- MapReduce is a parallel processing framework for large scale data. In the reduce phase. MapReduce employs the hash scheme in order to distribute data sharing the same key across cluster nodes. However, this approach is not robust for the skewed data distribution. In this paper, we propose a skew-tolerant key distribution method for MapReduce. The proposed method assigns keys to cluster nodes balancing their workloads. We implemented our proposed method on Hadoop. Through experiments, we evaluate the performance of the proposed method in comparison with the conventional method.
- Files in This Item
- There are no files associated with this item.
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
Related Researcher
- CHUNG, YON DOHN
- Department of Computer Science and Engineering