MURAL - Maynooth University Research Archive Library



    Introduction to the Special Issue on Cross-modal and Multimodal Natural Language Processing


    Lecorvé, Gwénolé and Kelleher, John D. (2022) Introduction to the Special Issue on Cross-modal and Multimodal Natural Language Processing. Traitement Automatique des Langues, 63 (2). pp. 7-13.

    [thumbnail of sO3jFt-TAL_63_2_0.pdf]
    Preview
    Text
    sO3jFt-TAL_63_2_0.pdf

    Download (153kB) | Preview
    Official URL: https://www.atala.org/content/tal_63_2_0

    Abstract

    Since our communication is multimodal in terms of our ability to express ourselves via different channels and our perception of the world, the automatic production and analysis of natural language content requires the integration of these multiple modalities in order to rival human performance. However, multimodal, or cross-modal, Natural Language Processing (NLP) has long been in the minority, perhaps because it is more complex. In the wake of recent advances in artificial intelligence, which are bringing multimodality to the fore, this special issue aims to highlight, through three articles on a variety of subjects, the questions that remain, particularly with regard to data requirements, understanding the links between modalities, and the need for convergence in terms of representation and modelling.
    Item Type: Article
    Keywords: Natural Language Processing, Machine Learning
    Academic Unit: Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 17364
    Depositing User: John Kelleher
    Date Deposited: 27 Jun 2023 10:55
    Journal or Publication Title: Traitement Automatique des Langues
    Publisher: Association pour le Traitement Automatique des Langues
    Refereed: Yes
    Funders: Science Foundation Ireland ADAPT Research Centre (Grant Number: 13/RC/2106_P2)
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/17364
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads