Oliveira, Pedro M. and Palma, Jonathan M. and Nepomuceno, Erivelton G. and Lacerda, Márcio J. (2023) Reinforcement learning for control design of uncertain polytopic systems. Information Sciences, 625. pp. 417-429. ISSN 0020-0255
Download (1MB)
|
Abstract
This work is concerned with the design of state-feedback, and static output-feedback controllers for uncertain discrete-time systems. The reinforcement learning (RL) method is employed and the controller to be designed is considered as an agent changing the behavior of the plant, which is the environment. A State-Action-Reward-State-Action (SARSA) algorithm is developed to achieve this goal. This is an open problem, as this offline design through the usage of RL is an approach not so well explored in the literature. The gain matrices are used directly as design variables in the SARSA algorithm, and a time-varying incremental step is employed. The method uses a grid in the uncertain parameters to place the poles of the closed-loop system in a disk on the complex plane. In addition, a stability test based on the Lyapunov theory is performed to provide a hard stability certificate for the closed-loop system. Numerical experiments from the literature are used to illustrate the efficacy of the method, through the use of benchmark examples and exhaustive testing.
Item Type: | Article |
---|---|
Keywords: | Reinforcement learning; SARSA; Robust state-feedback; Static output-feedback; Polytopic uncertainty; Pole placement; |
Academic Unit: | Faculty of Science and Engineering > Electronic Engineering Faculty of Science and Engineering > Research Institutes > Hamilton Institute |
Item ID: | 18797 |
Identification Number: | https://doi.org/10.1016/j.ins.2023.01.042 |
Depositing User: | Erivelton Nepomuceno |
Date Deposited: | 22 Aug 2024 12:54 |
Journal or Publication Title: | Information Sciences |
Publisher: | Elsevier |
Refereed: | Yes |
URI: | |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only(login required)
Item control page |
Downloads
Downloads per month over past year