Lecorvé, Gwénolé and Kelleher, John D. (2022) Introduction to the Special Issue on Cross-modal and Multimodal Natural Language Processing. Traitement Automatique des Langues, 63 (2). pp. 7-13.

Preview

Download (153kB) | Preview

Abstract

Since our communication is multimodal in terms of our ability to express ourselves via different channels and our perception of the world, the automatic production and analysis of natural language content requires the integration of these multiple modalities in order to rival human performance. However, multimodal, or cross-modal, Natural Language Processing (NLP) has long been in the minority, perhaps because it is more complex. In the wake of recent advances in artificial intelligence, which are bringing multimodality to the fore, this special issue aims to highlight, through three articles on a variety of subjects, the questions that remain, particularly with regard to data requirements, understanding the links between modalities, and the need for convergence in terms of representation and modelling.

Item Type:	Article
Keywords:	Natural Language Processing, Machine Learning
Academic Unit:	Faculty of Science and Engineering > Research Institutes > Hamilton Institute
Item ID:	17364
Depositing User:	John Kelleher
Date Deposited:	27 Jun 2023 10:55
Journal or Publication Title:	Traitement Automatique des Langues
Publisher:	Association pour le Traitement Automatique des Langues
Refereed:	Yes
Funders:	Science Foundation Ireland ADAPT Research Centre (Grant Number: 13/RC/2106_P2)
URI:	Organisation
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads