Skew-Tolerant Key Distribution for Load Balancing in MapReduce
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Son, Jihoon | - |
dc.contributor.author | Choi, Hyunsik | - |
dc.contributor.author | Chung, Yon Dohn | - |
dc.date.accessioned | 2021-09-06T10:33:38Z | - |
dc.date.available | 2021-09-06T10:33:38Z | - |
dc.date.created | 2021-06-19 | - |
dc.date.issued | 2012-02 | - |
dc.identifier.issn | 1745-1361 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/106161 | - |
dc.description.abstract | MapReduce is a parallel processing framework for large scale data. In the reduce phase. MapReduce employs the hash scheme in order to distribute data sharing the same key across cluster nodes. However, this approach is not robust for the skewed data distribution. In this paper, we propose a skew-tolerant key distribution method for MapReduce. The proposed method assigns keys to cluster nodes balancing their workloads. We implemented our proposed method on Hadoop. Through experiments, we evaluate the performance of the proposed method in comparison with the conventional method. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEICE-INST ELECTRONICS INFORMATION COMMUNICATIONS ENG | - |
dc.title | Skew-Tolerant Key Distribution for Load Balancing in MapReduce | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Chung, Yon Dohn | - |
dc.identifier.doi | 10.1587/transinf.E95.D.677 | - |
dc.identifier.scopusid | 2-s2.0-84856389487 | - |
dc.identifier.wosid | 000300471900044 | - |
dc.identifier.bibliographicCitation | IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, v.E95D, no.2, pp.677 - 680 | - |
dc.relation.isPartOf | IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS | - |
dc.citation.title | IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS | - |
dc.citation.volume | E95D | - |
dc.citation.number | 2 | - |
dc.citation.startPage | 677 | - |
dc.citation.endPage | 680 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Software Engineering | - |
dc.subject.keywordAuthor | skew-tolerance | - |
dc.subject.keywordAuthor | Map Reduce | - |
dc.subject.keywordAuthor | load balance | - |
dc.subject.keywordAuthor | key distribution | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.