Sonification of facial expressions

1 July 2017


  • Data Sonification

During a Music technology hackaton (a 6 hour programming contest) I developed with two friends a Pure Data program for sonifying emotions through facial expressions. For this purpose we used Affectiva., a facial recognition API driven by Machine Learning. For more information please watch the video. And don’t forget turning on english subtitles. You can get the code here.

We got 1st place and won an Arturia MiniBrute Analog Synthesizer

Santiago Rentería

Computer scientist and audio engineer working at the intersection of machine listening and acoustic ecology.
Interests: sound art, media archaeology and process philosophy.