MURAL - Maynooth University Research Archive Library



    The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task


    Torre, Ilaria, Carrigan, Emma, Domijan, Katarina, McDonnell, Rachel and Harte, Naomi (2021) The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task. ACM Transactions on Computer-Human Interaction, 28 (6). pp. 1-38. ISSN 1073-0516

    [thumbnail of KatarinaDomijanSmiles2021.pdf]
    Preview
    Text
    KatarinaDomijanSmiles2021.pdf

    Download (8MB) | Preview

    Abstract

    Emotional expressivity is essential for human interactions, informing both perception and decision-making. Here, we examine whether creating an audio-visual emotional channel mismatch influences decision-making in a cooperative task with a virtual character. We created a virtual character that was either congruent in its emotional expression (smiling in the face and voice) or incongruent (smiling in only one channel). People (N = 98) evaluated the character in terms of valence and arousal in an online study; then, visitors in a museum played the “lunar survival task” with the character over three experiments (N = 597, 78, 101, respectively). Exploratory results suggest that multi-modal expressions are perceived, and reacted upon, differently than unimodal expressions, supporting previous theories of audio-visual integration.
    Item Type: Article
    Additional Information: Cite as: Torre, I., Carrigan, E., Domijan, K., McDonnell, R. & Harte, N. 2021, "The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task", ACM transactions on computer-human interaction, vol. 28, no. 6, pp. 1-38.
    Keywords: artificial agent; Computer and Information Sciences; Computer Sciences;
    Academic Unit: Faculty of Science and Engineering > Mathematics and Statistics
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Item ID: 17906
    Identification Number: 10.1145/3469232
    Depositing User: Katarina Domijan
    Date Deposited: 30 Nov 2023 14:36
    Journal or Publication Title: ACM Transactions on Computer-Human Interaction
    Publisher: Association for Computing Machinery
    Refereed: Yes
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/17906
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads