MURAL - Maynooth University Research Archive Library



    Optimal energy allocation for linear control with packet loss under energy harvesting constraints


    Knorn, Steffi and Dey, Subhrakanti (2017) Optimal energy allocation for linear control with packet loss under energy harvesting constraints. Automatica, 77. pp. 259-267. ISSN 0005-1098

    [img]
    Preview
    Download (173kB) | Preview


    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...



    Add this article to your Mendeley library


    Abstract

    This paper studies a closed loop linear control system over a lossy communication link. A sensor computes a state estimate of the observed discrete-time system and sends it (in the form of packetized transmission) to the controller in the receiver block over a randomly time-varying (fading) packet dropping link. The receiver sends an ACK/NACK packet to the transmitter over an acknowledgement channel which might also be prone to packet loss. It is assumed that the energy used in packet transmission depletes a battery of limited capacity at the sensor, but is also replenished by an energy harvester which has access to a source of everlasting but random harvested energy. Under an assumption of finite-state Markov chain models of the energy harvesting and the fading channel gain processes, the objective is to design an optimal energy allocation policy at the transmitter and an optimal control policy at the receiver so that an average infinite horizon linear quadratic Gaussian (LQG) control cost is minimized. It is shown that in the case of perfect channel feedback a separation principle holds, the optimal LQG controller is linear and the optimal energy allocation policy at the transmitter can be obtained via solving the Bellman dynamic programming equation. A Q-learning algorithm is used to approximate the optimal energy allocation policy in case the system parameters are unknown. Numerical simulation examples show that the dynamic programming based policies outperform various simple heuristic policies, especially at higher battery capacities.

    Item Type: Article
    Additional Information: This is the preprint version of the published article, which is available at Steffi Knorn, Subhrakanti Dey, Optimal energy allocation for linear control with packet loss under energy harvesting constraints, Automatica, Volume 77, 2017, Pages 259-267, ISSN 0005-1098, https://doi.org/10.1016/j.automatica.2016.11.036.
    Keywords: Kalman filtering (KF); Energy harvesting; Imperfect acknowledgements;
    Academic Unit: Faculty of Science and Engineering > Electronic Engineering
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 11461
    Identification Number: https://doi.org/10.1016/j.automatica.2016.11.036
    Depositing User: Subhrakanti Dey
    Date Deposited: 24 Oct 2019 12:50
    Journal or Publication Title: Automatica
    Publisher: Elsevier
    Refereed: Yes
    URI:

      Repository Staff Only(login required)

      View Item Item control page

      Downloads

      Downloads per month over past year