“关注人工智能的未来,融合设计与科技”
           
联系我们: qiong-wu@mail.tsinghua.edu.cn

传统乐器的可穿戴数字增强设计

一款可穿戴电子音乐控制器,使表演者能够同时独奏尺八乐器并控制电子音乐。

In interactive electronic music, there is a form of performance that a performer plays a musical instrument on the spot, and the sound is transferred to computer music software through real-time recording, and then the composer operates music software, deforms the sound into electronic music. So the audience will hear the superposition of musical instrument sound and electronic music, which brings a richer auditory experience than simple music instrument performance. 

However, the cooperation of performers and composers has certain restrictions on the improvisation of performers. and it is difficult for one person to practice. Using wearable devices to capture body movements and thus control electronic music is a better idea. 

Electronic musical instruments produce sound after processing and transforming sound materials by computers or electronic devices. This kind of sound can not be directly related to the way performers operate musical instruments, so the audience can be confused about how the sound is produced, not knowing which action triggers which sound. Several researchers have found that it is effective to use visual feedback to help audiences establish this mental mapping between control input and sound output. Therefore, this work uses wearable lighting to visualize and enhance the gestures and the rhythm of electronic music. 

This work suggested that using a wearable device to collect finger movements can make control over electronic music while playing a musical instrument normally, and visualize finger movements through light, so as to help the audience understand the generation of electronic music and enhance the stage effect. 

We choose the Chinese traditional musical instrument shakuhachi to perform with a sensor-enhanced glove. The shakuhachi, is a bamboo-made musical instrument with a desolate and vast sound that brings a unique mysterious, cool, and ethereal feeling. It has the Oriental Zen temperament, which is completely different from the modern sci-fi feelings brought by electronic music. The combination of the two is a collision between tradition and modernity. 

In addition, during the performance of the shakuhachi, the performer stands or sits, and his body basically remains still, which is a very ”quiet” state. We hope that through the visual feedback of the wearable device, to add a kind of dynamic to the ”quiet” state to combine dynamic and static. 

Time
2020-2021
Type
Author
姜嘉琪

Related Works

  • 联系我们

    • qiong-wu@mail.tsinghua.edu.cn
      清华大学美术学院B466
      +86 010 62798891
© 2025 数据与智能创新设计研究所