MURAL - Maynooth University Research Archive Library



    The Cyborg Philharmonic: Synchronizing interactive musical performances between humans and machines


    Chakraborty, Sutirtha, Dutta, Sourav and Timoney, Joseph (2021) The Cyborg Philharmonic: Synchronizing interactive musical performances between humans and machines. Humanities and Social Sciences Communications, 8 (1). ISSN 2662-9992

    [thumbnail of JosephTimoneyCyborg2021.pdf]
    Preview
    Text
    JosephTimoneyCyborg2021.pdf

    Download (1MB) | Preview

    Abstract

    Music offers a uniquely abstract way for the expression of human emotions and moods, wherein melodic harmony is achieved through a succinct blend of pitch, rhythm, tempo, texture, and other sonic qualities. The emerging field of “Robotic Musicianship” focuses on developing machine intelligence, in terms of algorithms and cognitive models, to capture the underlying principles of musical perception, composition, and performance. The capability of new-generation robots to manifest music in a human-like artistically expressive manner lies at the intersection of engineering, computers, music, and psychology; promising to offer new forms of creativity, sharing, and interpreting musical impulses. This manuscript explores how real-time collaborations between humans and machines might be achieved by the integration of technological and mathematical models from Synchronization and Learning, with precise configuration for the seamless generation of melody in tandem, towards the vision of human–robot symphonic orchestra. To explicitly capture the key ingredients of a good symphony—synchronization and anticipation—this work discusses a possible approach based on the joint strategy of: (i) Mapping— wherein mathematical models for oscillator coupling like Kuramoto could be used for establishing and maintaining synchronization, and (ii) Modelling—employing modern deep learning predictive models like Neural Network architectures to anticipate (or predict) future state changes in the sequence of music generation and pre-empt transitions in the coupled oscillator sequence. It is hoped that this discussion will foster new insights and research for better “real-time synchronized human computer collaborative interfaces and interactions”
    Item Type: Article
    Additional Information: Cite as: Chakraborty, S., Dutta, S. & Timoney, J. 2021, "The Cyborg Philharmonic: Synchronizing interactive musical performances between humans and machines", Humanities & social sciences communications, vol. 8, no. 1, pp. 1-9.
    Keywords: Mathematical models; Music;
    Academic Unit: Assisting Living & Learning,ALL institute
    Faculty of Science and Engineering > Computer Science
    Item ID: 17503
    Identification Number: 10.1057/s41599-021-00751-8
    Depositing User: Joseph Timoney
    Date Deposited: 07 Sep 2023 08:18
    Journal or Publication Title: Humanities and Social Sciences Communications
    Publisher: Palgrave Macmillan
    Refereed: Yes
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/17503
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads