Deep reinforcement learning with a critic-value-based branch tree for the inverse design of two-dimensional optical devices
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Hwang, Hyo-Seok | - |
dc.contributor.author | Lee, Minhyeok | - |
dc.contributor.author | Seok, Junhee | - |
dc.date.accessioned | 2022-11-18T17:40:52Z | - |
dc.date.available | 2022-11-18T17:40:52Z | - |
dc.date.created | 2022-11-17 | - |
dc.date.issued | 2022-09 | - |
dc.identifier.issn | 1568-4946 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/145782 | - |
dc.description.abstract | In optical engineering, designing a device or a system with the desired property is an important but challenging task. It is relatively straightforward to compute the physical properties of a given design; however, there is no general method for the reverse, i.e., designing with desired properties. To address this problem with a computational method, this paper proposes a deep reinforcement learning-based inverse design framework consisting of two methods: Inverse DEsign Agent (IDEA) and Critic-Value-based Branch Tree (CVBT) algorithm. IDEA is a deep reinforcement learning model based on the Advantage Actor-Critic (A2C) method using a deep learning simulator as a replacement for a real environment, significantly reducing training time compared to conventional methods. The CVBT algorithm suggests several design candidates using the critic values of IDEA, while conventional methods propose only one candidate. In this study, the proposed framework was applied to a two-dimensional optical device design problem. Experimental results with untrained target properties demonstrated that the proposed model, IDEA-CVBT, achieved state-of-the-art performance in terms of accuracy and stability. For instance, in a scenario with a binary type design, IDEA-CVBT exhibited an accuracy of 91.5%, while conventional deep reinforcement models showed 36.1% and 7.4% accuracies. Extensive analyses verified that IDEA-CVBT can be employed as an assistance system for engineers since IDEA-CVBT suggests several appropriate candidates that satisfy target properties. (C) 2022 Elsevier B.V. All rights reserved. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | ELSEVIER | - |
dc.subject | NEURAL-NETWORKS | - |
dc.subject | GO | - |
dc.subject | OPTIMIZATION | - |
dc.subject | ALGORITHM | - |
dc.subject | LEVEL | - |
dc.subject | GAME | - |
dc.title | Deep reinforcement learning with a critic-value-based branch tree for the inverse design of two-dimensional optical devices | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Seok, Junhee | - |
dc.identifier.doi | 10.1016/j.asoc.2022.109386 | - |
dc.identifier.scopusid | 2-s2.0-85135719408 | - |
dc.identifier.wosid | 000861101400002 | - |
dc.identifier.bibliographicCitation | APPLIED SOFT COMPUTING, v.127 | - |
dc.relation.isPartOf | APPLIED SOFT COMPUTING | - |
dc.citation.title | APPLIED SOFT COMPUTING | - |
dc.citation.volume | 127 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Interdisciplinary Applications | - |
dc.subject.keywordPlus | NEURAL-NETWORKS | - |
dc.subject.keywordPlus | GO | - |
dc.subject.keywordPlus | OPTIMIZATION | - |
dc.subject.keywordPlus | ALGORITHM | - |
dc.subject.keywordPlus | LEVEL | - |
dc.subject.keywordPlus | GAME | - |
dc.subject.keywordAuthor | Deep learning | - |
dc.subject.keywordAuthor | Deep reinforcement learning | - |
dc.subject.keywordAuthor | Multitask reinforcement learning | - |
dc.subject.keywordAuthor | Device design automation | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.