As part of Tone Deaf 14 , a projection show was performed by Decomposing Pianos at the Isabel Bader. For this performance, custom code was developed to map the wooden panels behind the main stage. Each panel became a window in which to stitch together scenes and visual effects or carousel imagery throughout the venue. This code went on to become a versatile tool to present custom algorithms as audio responsive visualizations as is briefly documented here.
This live code performance took place at the Screening Room as a visual 3D mixer for clips of spoken word on the meaning of music, as collected by my friend and colleague Chris Trimmer. 3D space is navigated using three.js pointer lock controls. Audio is emitted using webAudio panner nodes, each surrounded by a large flat disk. Sound emanating from within the disk is not audible outside the disk. A strong prevalent drone exists throughout the scene, originating from the top of a central tower. Each disk is mixed based on the position of the user. Other audio effects are also employed, such as a low pass filter when below the randomly meshed floor.