“关注人工智能的未来,融合设计与科技”
联系我们: yanyansun@mail.tsinghua.edu.cn

Design of Wearable digital Enhancement for Traditional Musical Instruments

This work introduces a wearable electronic music controller, which enables the performer to play the musical instrument shakuhachi and control electronic music at the same time alone.

In interactive electronic music, there is a form of performance that a performer plays a musical instrument on the spot, and the sound is transferred to computer music software through real-time recording, and then the composer operates music software, deforms the sound into electronic music. So the audience will hear the superposition of musical instrument sound and electronic music, which brings a richer auditory experience than simple music instrument performance. 

However, the cooperation of performers and composers has certain restrictions on the improvisation of performers. and it is difficult for one person to practice. Using wearable devices to capture body movements and thus control electronic music is a better idea. 

Electronic musical instruments produce sound after processing and transforming sound materials by computers or electronic devices. This kind of sound can not be directly related to the way performers operate musical instruments, so the audience can be confused about how the sound is produced, not knowing which action triggers which sound. Several researchers have found that it is effective to use visual feedback to help audiences establish this mental mapping between control input and sound output. Therefore, this work uses wearable lighting to visualize and enhance the gestures and the rhythm of electronic music. 

This work suggested that using a wearable device to collect finger movements can make control over electronic music while playing a musical instrument normally, and visualize finger movements through light, so as to help the audience understand the generation of electronic music and enhance the stage effect. 

We choose the Chinese traditional musical instrument shakuhachi to perform with a sensor-enhanced glove. The shakuhachi, is a bamboo-made musical instrument with a desolate and vast sound that brings a unique mysterious, cool, and ethereal feeling. It has the Oriental Zen temperament, which is completely different from the modern sci-fi feelings brought by electronic music. The combination of the two is a collision between tradition and modernity. 

In addition, during the performance of the shakuhachi, the performer stands or sits, and his body basically remains still, which is a very ”quiet” state. We hope that through the visual feedback of the wearable device, to add a kind of dynamic to the ”quiet” state to combine dynamic and static. 

Related Works

  • 联系我们

    • yanansun@mail.tsinghua.edu.cn
      清华大学美术学院B466
      +86 010 62798891
© 2024 数据与智能创新设计研究所