Look!
Look! is an experimental project exploring altered sensory perception, built around the speculative idea: What if your senses had different functions?
What if you could hear with your eyes?
Written in JavaScript using MediaPipe,
the program uses facial landmark detection
to map eye pupil movement and translate it into real-time sound, offering users a new way to "listen" visually.
Process
Experiments with the MediaPipe in TouchDesignerPupil tracking using Media Pipe. Code was written in JavaScript in p5.jsPupil tracking path