Log Analysis-Based Resource and Execution Time Improvement in HPC: A Case Study
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Yoon, JunWeon | - |
dc.contributor.author | Hong, TaeYoung | - |
dc.contributor.author | Park, ChanYeol | - |
dc.contributor.author | Noh, Seo-Young | - |
dc.contributor.author | Yu, HeonChang | - |
dc.date.accessioned | 2021-08-31T05:17:35Z | - |
dc.date.available | 2021-08-31T05:17:35Z | - |
dc.date.created | 2021-06-18 | - |
dc.date.issued | 2020-04 | - |
dc.identifier.issn | 2076-3417 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/56859 | - |
dc.description.abstract | High-performance computing (HPC) uses many distributed computing resources to solve large computational science problems through parallel computation. Such an approach can reduce overall job execution time and increase the capacity of solving large-scale and complex problems. In the supercomputer, the job scheduler, the HPC's flagship tool, is responsible for distributing and managing the resources of large systems. In this paper, we analyze the execution log of the job scheduler for a certain period of time and propose an optimization approach to reduce the idle time of jobs. In our experiment, it has been found that the main root cause of delayed job is highly related to resource waiting. The execution time of the entire job is affected and significantly delayed due to the increase in idle resources that must be ready when submitting the large-scale job. The backfilling algorithm can optimize the inefficiency of these idle resources and help to reduce the execution time of the job. Therefore, we propose the backfilling algorithm, which can be applied to the supercomputer. This experimental result shows that the overall execution time is reduced. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.subject | FAIRNESS | - |
dc.title | Log Analysis-Based Resource and Execution Time Improvement in HPC: A Case Study | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Yu, HeonChang | - |
dc.identifier.doi | 10.3390/app10072634 | - |
dc.identifier.scopusid | 2-s2.0-85083442047 | - |
dc.identifier.wosid | 000533356200433 | - |
dc.identifier.bibliographicCitation | APPLIED SCIENCES-BASEL, v.10, no.7 | - |
dc.relation.isPartOf | APPLIED SCIENCES-BASEL | - |
dc.citation.title | APPLIED SCIENCES-BASEL | - |
dc.citation.volume | 10 | - |
dc.citation.number | 7 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Chemistry | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Materials Science | - |
dc.relation.journalResearchArea | Physics | - |
dc.relation.journalWebOfScienceCategory | Chemistry, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Engineering, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Materials Science, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Physics, Applied | - |
dc.subject.keywordPlus | FAIRNESS | - |
dc.subject.keywordAuthor | HPC | - |
dc.subject.keywordAuthor | supercomputer | - |
dc.subject.keywordAuthor | parallel computing | - |
dc.subject.keywordAuthor | job scheduling | - |
dc.subject.keywordAuthor | backfilling | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.