RMCAD Student Explores Synesthesia Through Virtual Reality

The term “synesthesia” refers to a sensation produced in one modality when a stimulus is applied to another modality. This phenomenon can manifest itself in multiple ways, such as hearing a certain sound that induces the visualization of a certain color.

The concept inspired 3D Animation student Zipporah De Long to create an artwork titled “Synesthesia in VR.” Using Tilt Brush, a room-scale 3D painting virtual reality application, De Long created a video that takes the viewer through a virtual space filled with designs that react to the sound of music.

“This idea really excited me because I am a very musical person, and I have been experimenting with a lot of audio [in my work],” she said.

Areas of the “room” include imagery that matches the change in pace of the music. Her goal was to create a work that mixed moments of loud and soft, intense and calm.

“I wanted to get really experimental with the program and see how different moods of songs could affect the movements of the different brushes in Tilt Brush,” she said.

View “Synesthesia in VR” here:

Learn more about RMCAD’s Animation program.