Tunnel ventilation controller design using an RLS-based natural actor-critic algorithm
- Authors
- Chu, Baeksuk; Park, Jooyoung; Hong, Daehie
- Issue Date
- 12월-2010
- Publisher
- KOREAN SOC PRECISION ENG
- Keywords
- Tunnel ventilation control; Reinforcement learning (RL); Actor-critic architecture; Natural gradient; Recursive least-squares (RLS)
- Citation
- INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, v.11, no.6, pp.829 - 838
- Indexed
- SCOPUS
KCI
- Journal Title
- INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING
- Volume
- 11
- Number
- 6
- Start Page
- 829
- End Page
- 838
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/115143
- DOI
- 10.1007/s12541-010-0100-6
- ISSN
- 2234-7593
- Abstract
- Tunnel ventilation systems provide drivers with a comfortable and safe driving environment by generating sufficient airflow and by diluting the concentration of noxious contaminants below an acceptable level. For that purpose, tunnel ventilation systems contain mechanical equipment such as jet-fans, blowers and dust collectors. These machines consume large amount of energy, therefore, it is necessary to have an efficient operating algorithm for tunnel ventilation in terms of energy savings and safe driving. In this paper, a new reinforcement learning (RL) method is applied as the control algorithm. In the process of formulating the reward of the tunnel ventilation system, which is a performance index to be maximized in the RL methodology, the following two objectives are of great interest: maintaining an adequate level of pollutants and minimizing power consumption. The RL control algorithm adopted in this research is based on an actor-critic architecture and natural gradient method. Due to its ability to achieve the truly steepest direction of gradients, the natural gradient method can be a promising route to improving the efficacy of the actor module. Also, the recursive least-squares (RLS) method is employed to the critic module in order to improve the efficiency by which data is used. Using actual data collected from an existing tunnel ventilation system, extensive simulation studies were performed. It was confirmed that the suggested algorithm achieved the desired control goals and, when compared to previously developed RL-based control algorithms, improved the performance considerably.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Science and Technology > Department of Electro-Mechanical Systems Engineering > 1. Journal Articles
- College of Engineering > Department of Mechanical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.