The Colour of Music is a project put together to try and capture the extraordinary perception of those with synesthesia. It comprises of a multi-input system which incorporates both score following and audio analysis in order to obtain data from the music. This information is then used to control visualisations designed to emulate what those synesthesia may experience - seeing colours and textures triggered by the tonal and musical qualities of sounds around them.
I was brought on to develop two visualisation programs for the performance. These utilised the information provided by the audio analysis and score following systems to control custom Open GL based graphics.
The Colour of Music system was used in a live performance (Colour Music) by the internationally acclaimed Northern Sinfonia at the AIC2013 conference in Newcastle, UK.