Assisted Visual interpretation of audio (avia)

After amplitude values are extracted from an audio file at a specified sample rate, these values can be plotted on a graph against time. This then acts as a base structure for a visual composition.

Featured works


Process video created by Emily Jerison.

Every work starts with a favorite song

An mp3 file is placed as an input for a proprietary program, created by Boston University graduate Ryan King.

Amplitude values are given for a pre-specified sample rate, of say, 5 seconds. The output is a table with time values(x) corresponding with amplitude values(y). The values are mapped out on a graph template, giving a scatter-plot of the audio (the structure).

While the audio is present, a design is sketched onto the scatterplot. Colors, textures, shapes, etc. are all chosen while listening to the audio. The choice of line color is decided and applied as the first layer of spray-paint.

Spray-paint is used to provide a thin, even coating that allows for more variety in texture than other mediums. More than one of these layers may be applied, however, fewer layers decrease the likelihood of running into complications.

The sketch is then mapped out carefully onto the painted canvas with masking tape. The background color is then applied followed by removal of tape, revealing the finished piece. Any rough edges are removed by going back into the piece with acrylic paint. For shows and galleries, a miniature speaker is placed behind the canvas to initialize a synesthetic reaction, completing the process.