Oliveira, Pedro M. and Palma, Jonathan M. and Nepomuceno, Erivelton G. and Lacerda, Márcio J. (2023) Reinforcement learning for control design of uncertain polytopic systems. Information Sciences, 625. pp. 417-429. ISSN 0020-0255

Download (1MB)

Abstract

This work is concerned with the design of state-feedback, and static output-feedback controllers for uncertain discrete-time systems. The reinforcement learning (RL) method is employed and the controller to be designed is considered as an agent changing the behavior of the plant, which is the environment. A State-Action-Reward-State-Action (SARSA) algorithm is developed to achieve this goal. This is an open problem, as this offline design through the usage of RL is an approach not so well explored in the literature. The gain matrices are used directly as design variables in the SARSA algorithm, and a time-varying incremental step is employed. The method uses a grid in the uncertain parameters to place the poles of the closed-loop system in a disk on the complex plane. In addition, a stability test based on the Lyapunov theory is performed to provide a hard stability certificate for the closed-loop system. Numerical experiments from the literature are used to illustrate the efficacy of the method, through the use of benchmark examples and exhaustive testing.

Item Type:	Article
Keywords:	Reinforcement learning; SARSA; Robust state-feedback; Static output-feedback; Polytopic uncertainty; Pole placement;
Academic Unit:	Faculty of Science and Engineering > Electronic Engineering Faculty of Science and Engineering > Research Institutes > Hamilton Institute
Item ID:	18797
Identification Number:	https://doi.org/10.1016/j.ins.2023.01.042
Depositing User:	Erivelton Nepomuceno
Date Deposited:	22 Aug 2024 12:54
Journal or Publication Title:	Information Sciences
Publisher:	Elsevier
Refereed:	Yes
URI:	Publisher
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads