This presentation discusses composing works for audio-visual live performance based on the author’s physical theatre works, created in collaboration with a choreographer and visual artist Bettina Hoffmann.

Throughout collaborations called People in the Dunes Project between 2018 and 2020, the objective was exploring methodologies for composition, focusing on body movements as a media for not only sound conveyance and embodiment of music (cf. instrumentalists) but also visual art. Therefore, it addresses the question of what is the expressional possibilities with live aural and visual components through human physical representation and their interactions.

For designing interactive relations between sound and physical movements, two different methods were employed: in People in the Dunes I boundary microphones and a Kinect device were used for livesound capturing and motion tracking. On the other hand, in People in the Dunes II synthesised sound and fixed-media sound materials were applied to be controlled and modified by physical gestures, tracked by variety of iPhone sensors, that have been equipped originally. These technical comparisons also examine different usage of physical movements as well as possibilities of theatrical representations.