Collaborative Music Performances with Humanoid Robots and Humans

Meng Cheng Lau*, John Anderson, Jacky Baltes, Christian Melendez Gallegos, Mario Mendez Diaz, Borui Li

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, there has been a growing interest in entertainment robotics, with researchers exploring the creation of robots capable of performing a wide range of tasks, such as magic, art drawing, dancing, and music. This paper highlights our research in creating a musical band with humanoid robots and human musicians, with the goal of achieving natural synchronization and collaboration in musical performances. We selected two of our humanoid robots namely Polaris, a mid-sized humanoid robot, serving as the drummer, and Oscar, a Robotis-OP3 humanoid robot, serving as the keyboardist. The technical implementation included key elements like visual servoing, human-robot interaction, and ROS, which facilitated seamless communication and coordination between our humanoid robots and human musicians. The successful collaboration of our robots with human musicians can be visually and audibly appreciated through the following YouTube link: https://youtu.be/pFOyt1KKCfY.

Original languageEnglish
Title of host publicationRobot Intelligence Technology and Applications 8 - Results from the 11th International Conference on Robot Intelligence Technology and Applications
EditorsAnwar P.P. Abdul Majeed, Eng Hwa Yap, Pengcheng Liu, Xiaowei Huang, Anh Nguyen, Wei Chen, Ue-Hwan Kim
PublisherSpringer Science and Business Media Deutschland GmbH
Pages165-175
Number of pages11
ISBN (Print)9783031706837
DOIs
Publication statusPublished - 2024
Event11th International Conference on Robot Intelligence Technology and Applications, RiTA 2023 - Taicang, China
Duration: 2023 Dec 62023 Dec 8

Publication series

NameLecture Notes in Networks and Systems
Volume1132 LNNS
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389

Conference

Conference11th International Conference on Robot Intelligence Technology and Applications, RiTA 2023
Country/TerritoryChina
CityTaicang
Period2023/12/062023/12/08

Keywords

  • Human-Robot Interaction
  • Robot Musician
  • Synchronization
  • Visual Servoing

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Collaborative Music Performances with Humanoid Robots and Humans'. Together they form a unique fingerprint.

Cite this