SIGGRAPH 26

To Perform/ To Live: Decolonizing of Digital Music Instruments and Feminism with Human-AI Co-Created Embodied Experience of Daily Objects

S. Zhang1,2, S. Lin1, T. Liu1,3, M. Fan1,4, R. Masu5,1

  1. 1The Hong Kong University of Science and Technology (Guangzhou)
  2. 2University of Trento
  3. 3University of Amsterdam
  4. 4The Hong Kong University of Science and Technology
  5. 5Conservatory of Trento

ACM SIGGRAPH 2026 (SIGGRAPH '26), 2026

To Perform/ To Live: Decolonizing of Digital Music Instruments and Feminism with Human-AI Co-Created Embodied Experience of Daily Objects

Abstract

This paper proposes a decolonial approach to interactive music performance grounded in Chinese everyday life. Responding to critiques that dominant interaction models and evaluation norms often reflect Western legacies, we design locally situated digital musical instruments (DMIs) that treat domestic routines as primary interface logic. Our embodied performance system, To Perform/To Live, repurposes familiar objects used in Chinese women’s daily lives: an abacus, a vegetable washing basin, a soup pot, a fan, and a massage hammer. Across three stages, performers transform counting, soup-making, and restoration gestures into musical control through tempo, pressure, repetition, and pause, rendering gendered labor audible without romanticizing it. After each performance, we extend the work through human–AI co-creation: recorded audio is analyzed to generate a terrain-like surface, 3D printed as a tactile disk that encodes the performance for touch and re-performance. We contribute a China-situated decolonial DMI strategy, a feminist sonic practice of performable labor, and the E2E framework linking embodied knowledge to AI-enabled material extensions.

co-creationembodied-interaction

BibTeX

@article{Zhang2026ToPerformToLive,
  author    = {Zhang, Shumeng and Lin, Shiqi and Liu, Tiancheng and Fan, Mingming and Masu, Raul},
  title     = {To Perform/ To Live: Decolonizing of Digital Music Instruments and Feminism with Human-AI Co-Created Embodied Experience of Daily Objects},
  journal   = {Proceedings of the ACM on Computer Graphics and Interactive Techniques},
  year      = {2026},
  volume    = {9},
  number    = {3},
  articleno = {45},
  numpages  = {12},
  publisher = {Association for Computing Machinery},
  doi       = {10.1145/3816078}
}