Artwork title : Somatic Continuum

Somatic Continuum is an interactive audiovisual installation in which the participant's face, hands, and bodily presence become the instrument. Using 468 facial landmarks tracked in real time, Leap Motion hand gesture recognition, and a generative harmonic audio engine constrained to D minor, the interactive instalation translates facial changes such as closing your eyes or moving your mouth, hand movement, and proximity into a continuously responsive field of sound and image. The installation melds face meshes through thousands of particle lines, kaleidoscopic visual modes, and multi-layered particle systems that blur, duplicate and mirror eachother in different ways.

The piece is deliberately incomplete without a human presence. When someone steps in, they become a composer and visual artist in real time. The audience gets to shape original music through the way they move, the expressions they make, the distance they keep. No musical training is required; the harmonic constraint ensures that every gesture produces something coherent and beautiful. Participants can capture what they create through built-in photo and video recording, leaving with a unique art piece that did not exist before they arrived. No two people produce the same work. No single person produces the same work twice. The installation has been developed across 356+ versions and will be exhibited in Boston, USA in June and in Quito, Ecuador in August. 

You can see a demonstration of it here: https://drive.google.com/drive/folders/1dNEBjEfsQBY9SEowypCW957QcFErhOnm?usp=share_link

In the google drive link you can also try a version of the installation. (It says on the page the different viewing modes, which is recomended to try out. Depending on the mode the hands can move and shape the images and sound in different ways so it is recommended to experiment) This version is not as complex, layered or intricate as the real system that would be shown but it gives you a basic idea of how the interactivity works and how the piece generally looks and sounds.