MURAL - Maynooth University Research Archive Library



    Optimal Coding Predicts Attentional Modulation of Activity in Neural Systems


    Jaramillo, Santiago and Pearlmutter, Barak A. (2007) Optimal Coding Predicts Attentional Modulation of Activity in Neural Systems. Neural Computation, 19 (5). pp. 1295-1312. ISSN 0899-7667

    [thumbnail of neco.2007.19.5.pdf] PDF
    neco.2007.19.5.pdf
    Available under License Creative Commons Attribution Non-commercial.

    Download (209kB)
    Official URL: http://www.mitpressjournals.org/doi/pdf/10.1162/ne...

    Abstract

    Neuronal activity in response to a fixed stimulus has been shown to change as a function of attentional state, implying that the neural code also changes with attention. We propose an information-theoretic account of such modulation: that the nervous system adapts to optimally encode sensory stimuli while taking into account the changing relevance of different features. We show using computer simulation that such modulation emerges in a coding system informed about the uneven relevance of the input features. We present a simple feedforward model that learns a covert attention mechanism, given input patterns and coding fidelity requirements. After optimization, the system gains the ability to reorganize its computational resources (and coding strategy) depending on the incoming attentional signal, without the need of multiplicative interaction or explicit gating mechanisms between units. The modulation of activity for different attentional states matches that observed in a variety of selective attention experiments. This model predicts that the shape of the attentional modulation function can be strongly stimulus dependent. The general principle presented here accounts for attentional modulation of neural activity without relying on special-purpose architectural mechanisms dedicated to attention. This principle applies to different attentional goals, and its implications are relevant for all modalities in which attentional phenomena are observed.
    Item Type: Article
    Keywords: Neural systems; Optimal code; Sensory signals; Autoassociative network; Fidelity requirements; Modulatory phenomena.
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 1307
    Identification Number: 10.1162/neco.2007.19.5.1295
    Depositing User: Barak Pearlmutter
    Date Deposited: 25 Mar 2009 15:04
    Journal or Publication Title: Neural Computation
    Publisher: MIT Press
    Refereed: Yes
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/1307
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads