This presentation/demo is based on my final doctoral project that explores computer game technology’s artistic potential, particularly through the adaptation of the hand gesture of the Sabetan Technique of Indonesia Wayang Kulit to create performative strategies for Interactive Audiovisual Composition. Through this presentation, I will demonstrate how I acquired the gestural information processed through a machine learning model to control the spatialization and synthesis parameters, including the locomotion and behaviour of visual objects in the virtual environment.