Torre, Ilaria and Carrigan, Emma and Domijan, Katarina and McDonnell, Rachel and Harte, Naomi (2021) The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task. ACM Transactions on Computer-Human Interaction, 28 (6). pp. 1-38. ISSN 1073-0516

Preview

Download (8MB) | Preview

Abstract

Emotional expressivity is essential for human interactions, informing both perception and decision-making. Here, we examine whether creating an audio-visual emotional channel mismatch influences decision-making in a cooperative task with a virtual character. We created a virtual character that was either congruent in its emotional expression (smiling in the face and voice) or incongruent (smiling in only one channel). People (N = 98) evaluated the character in terms of valence and arousal in an online study; then, visitors in a museum played the “lunar survival task” with the character over three experiments (N = 597, 78, 101, respectively). Exploratory results suggest that multi-modal expressions are perceived, and reacted upon, differently than unimodal expressions, supporting previous theories of audio-visual integration.

Item Type:	Article
Additional Information:	Cite as: Torre, I., Carrigan, E., Domijan, K., McDonnell, R. & Harte, N. 2021, "The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task", ACM transactions on computer-human interaction, vol. 28, no. 6, pp. 1-38.
Keywords:	artificial agent; Computer and Information Sciences; Computer Sciences;
Academic Unit:	Faculty of Science and Engineering > Mathematics and Statistics Faculty of Science and Engineering > Research Institutes > Hamilton Institute
Item ID:	17906
Identification Number:	https://doi.org/10.1145/3469232
Depositing User:	Katarina Domijan
Date Deposited:	30 Nov 2023 14:36
Journal or Publication Title:	ACM Transactions on Computer-Human Interaction
Publisher:	Association for Computing Machinery
Refereed:	Yes
URI:	Publisher
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads