Music Instruction in a Virtual/Augmented Reality Environment (CAVE2™ and HoloLens)

August 10th, 2016

Categories: Multimedia, Sound Art, VR, VR Art, Audio Research, Augmented Reality, Mixed Reality

HoloLens Interface
HoloLens Interface

About

EVL summer intern, Shreyas Mohan from Metea Valley High School, Aurora, IL presents the results of his efforts towards developing a robust music instruction application for use in virtual and augmented reality environments - the CAVE2 and Microsoft HoloLens systems.

EVL Cyber-Commons, 2068 ERF
Wednesday, August 10, 2016, 1:00 PM

Shreyas developed an application for the CAVE2 and Microsoft HoloLens to investigate whether these technologies could be used effectively to teach music to a novice. Both applications taught the user ‘Mary Had a Little Lamb’ on the viola, graphically representing the correct bow direction, tempo, fingering, and sheet music. Additional application features included adjustable tempo and metronome functionality. Combining graphical visual cues while seeing the physical instrument in a mixed reality environment proved to be a powerful method for independent music instruction.