EmoSynth

Sonification of facial expressions

1 July 2017

Skills

  • Data Sonification

During a Music technology hackaton (a 6 hour programming contest) I developed with two friends a Pure Data program for sonifying emotions through facial expressions. For this purpose we used Affectiva., a facial recognition API driven by Machine Learning. For more information please watch the video. And don’t forget turning on english subtitles. You can get the code here.

We got 1st place and won an Arturia MiniBrute Analog Synthesizer


by:
Santiago Rentería

http://renterialab.com
Computer scientist and audio engineer working at the intersection of machine listening and acoustic ecology.
Interests: sound art, media archaeology and process philosophy.