MURAL - Maynooth University Research Archive Library



    A Constrained MDP Approach to Dynamic Quantizer Design for HMM State Estimation


    Ghasemi, Nader and Dey, Subhrakanti (2009) A Constrained MDP Approach to Dynamic Quantizer Design for HMM State Estimation. IEEE Transactions on Signal Processing, 57 (3). pp. 1203-1209. ISSN 1053-587X

    [thumbnail of a constrained.pdf]
    Preview
    Text
    a constrained.pdf

    Download (563kB) | Preview

    Abstract

    This paper is concerned with dynamic quantizer design for state estimation of hidden Markov models (HMM) using multiple sensors under a sum power constraint at the sensor transmitters. The sensor nodes communicate with a fusion center over temporally correlated flat fading channels modelled by finite state Markov chains. Motivated by energy limitations in sensor nodes, we develop optimal quantizers by minimizing the long term average of the mean square estimation error with a constraint on the long term average of total transmission power across the sensors. Instead of introducing a cost function as a weighted sum of our two objectives, we propose a constrained Markov decision formulation as an average cost problem and employ a linear programming technique to obtain the optimal policy for the constrained problem. Our experimental results assert that the constrained approach is quite efficient in terms of computational complexity and memory requirements for our average cost problem and leads to the same optimal deterministic policies and optimal cost as the unconstrained approach under an irreducibility assumption on the underlying Markov chain and some mild regularity assumptions on the sensor measurement noise processes. We illustrate via numerical studies the performance results for the dynamic quantization scheme. We also study the effect of varying degrees of channel and measurement noise on the performance of the proposed scheme.
    Item Type: Article
    Keywords: Hidden Markov models; linear programming; Markov decision process; power control; state estimation;
    Academic Unit: Faculty of Science and Engineering > Electronic Engineering
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 14423
    Identification Number: 10.1109/TSP.2008.2010381
    Depositing User: Subhrakanti Dey
    Date Deposited: 11 May 2021 14:42
    Journal or Publication Title: IEEE Transactions on Signal Processing
    Publisher: Institute of Electrical and Electronics Engineers
    Refereed: Yes
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/14423
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads