When the world is your instrument: Mogees

Mogees is, according to the website, "an interactive gestural-based surface for realtime audio mosaicing". The video demonstration is thrilling:

Mogees - Gesture recognition with contact-microphones from bruno zamborlin on Vimeo.

More text from the website:

In the video we show how it is possible to perform gesture recognition just with contact microphones. Through gesture recognition techniques we detect different kind of fingers-touch and associate them with different sounds. In the video we used two different audio synthesis techniques:

- physic modelling, which consists in generating the sound by simulating physical laws;
- concatenative synthesis (audio mosaicing), in which the sound of the contact microphone is associated with its closest frame present in a sound database.

The system can recognise both fingers-touches and objects that emits a sound, such as the coin shown in the video.

I don't understand this, or what's happening in the video: is the microphone simply massively amplifying the almost inaudible sounds your fingers make while tapping and riffing on objects? But I think it's amazing, would go nuts to get my hands on the technology, and wish one of the "objects" in the video had been a living thing.

[via Kottke]

No comments: