MURAL - Maynooth University Research Archive Library

    Introduction to the Special Issue on Cross-modal and Multimodal Natural Language Processing

    Lecorvé, Gwénolé and Kelleher, John D. (2022) Introduction to the Special Issue on Cross-modal and Multimodal Natural Language Processing. Traitement Automatique des Langues, 63 (2). pp. 7-13.

    Download (153kB) | Preview
    Official URL:

    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...

    Add this article to your Mendeley library


    Since our communication is multimodal in terms of our ability to express ourselves via different channels and our perception of the world, the automatic production and analysis of natural language content requires the integration of these multiple modalities in order to rival human performance. However, multimodal, or cross-modal, Natural Language Processing (NLP) has long been in the minority, perhaps because it is more complex. In the wake of recent advances in artificial intelligence, which are bringing multimodality to the fore, this special issue aims to highlight, through three articles on a variety of subjects, the questions that remain, particularly with regard to data requirements, understanding the links between modalities, and the need for convergence in terms of representation and modelling.

    Item Type: Article
    Keywords: Natural Language Processing, Machine Learning
    Academic Unit: Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 17364
    Depositing User: John Kelleher
    Date Deposited: 27 Jun 2023 10:55
    Journal or Publication Title: Traitement Automatique des Langues
    Publisher: Association pour le Traitement Automatique des Langues
    Refereed: Yes
    Funders: Science Foundation Ireland ADAPT Research Centre (Grant Number: 13/RC/2106_P2)
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only(login required)

    View Item Item control page


    Downloads per month over past year

    Origin of downloads