Kinecthesis: The Journey to Ithaca

Kinecthesis is an interactive audiovisual installation producing dynamic text and sound, exploring the synergy between human and machine. The title derives from the Kinect motion sensor and the concepts of Thesis (theme) and Ecthesis (exposition), highlighting the connection between the body, language, and public presence.

Centering on C.P. Cavafy’s poem "Ithaca," the project employs the cut-up method via Generative Art algorithms in a Processing environment. The machine deconstructs the original text—categorizing it grammatically through Artificial Intelligence—and reconstructs it in real-time. By introducing elements of randomness, the system offers a unique, emergent poem with every interaction.

The installation operates via a Kinect sensor that detects visitors at a distance of 40–80 cm, transforming their presence into a digital silhouette of white dots within a shifting Perlin Noise Flow Field. When the figure’s outline touches the floating words, their sonification is triggered through text-to-speech, causing the words to gradually fade away. The system automatically resets if no motion is detected for more than five seconds or once all words have vanished from the screen.

The soundscape comprises four layers: the "oceanic" substrate of Ithaca, the glitch sounds of mechanical searching, the melodic "locking" of a cello, and the vocal rendering of words "unlocked" by the visitor's movement. In Kinecthesis, reading evolves from a passive act into a physical process, emphasizing the importance of the journey over the destination.