Performance impact of JobTracker failure in Hadoop
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Young-Pil | - |
dc.contributor.author | Hong, Cheol-Ho | - |
dc.contributor.author | Yoo, Chuck | - |
dc.date.accessioned | 2021-09-04T16:11:05Z | - |
dc.date.available | 2021-09-04T16:11:05Z | - |
dc.date.created | 2021-06-18 | - |
dc.date.issued | 2015-05-10 | - |
dc.identifier.issn | 1074-5351 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/93568 | - |
dc.description.abstract | In this paper, we analyze the performance impact of JobTracker failure in Hadoop. A JobTracker failure is a serious problem that affects the overall job processing performance. We describe the cause of failure and the system behaviors because of failed job processing in the Hadoop. On the basis of the analysis, we build a job completion time model that reflects failure effects. Our model is based on a stochastic process with a node crash probability. With our model, we run simulation of performance impact with very credible failure data available from USENIX called computer failure data repository that have been collected for past 9years. The results show that the performance impact is very severe in that the job completion time increases about four times typically, and in a worst case, it increases up to 68 times. Copyright (c) 2014 John Wiley & Sons, Ltd. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | WILEY | - |
dc.title | Performance impact of JobTracker failure in Hadoop | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Yoo, Chuck | - |
dc.identifier.doi | 10.1002/dac.2759 | - |
dc.identifier.scopusid | 2-s2.0-84925345925 | - |
dc.identifier.wosid | 000351605500004 | - |
dc.identifier.bibliographicCitation | INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, v.28, no.7, pp.1265 - 1281 | - |
dc.relation.isPartOf | INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS | - |
dc.citation.title | INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS | - |
dc.citation.volume | 28 | - |
dc.citation.number | 7 | - |
dc.citation.startPage | 1265 | - |
dc.citation.endPage | 1281 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordAuthor | Hadoop | - |
dc.subject.keywordAuthor | large-scale data processing | - |
dc.subject.keywordAuthor | failure analysis | - |
dc.subject.keywordAuthor | JobTracker | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.