Haptic Midi is
a system that allows three non-musicians to collaboratively create
music. Any genre of music is possible, but the current implementation
allows the users to create jazz compositions. The interactive music
engine is built upon Microsoft’s DirectMusic SDK. The system
consists of three stations: solo, rhythm, and accompaniment. At
the solo station the interaction device is the haptic lens. With
this device the user is able to play three instruments that always
produce a note in the proper chord; he/she can also make gestures
on the device that will play musical embellishments (motifs). At
the rhythm station the interaction device is a glove containing
three bend sensors. The rhythm composition consists of three layers
of percussion instruments: cymbals, drums, and fill-ins (ie cowbells,
tambourines, SFX). The user can build new rhythms in the jazz composition
by
inputting and layering beats with these instruments via the
glove.
The user can change his/her choice of percussion instruments
by stepping on a footpad. Lastly, the accompaniment station consists
of three footpads. Here the user can control the tempo of the composition,
and the band or set of instruments available to all the performers,
by tapping and stepping on the pads.
This system is still in its
beginning stages. Future work will evaluate which types of interaction
devices the users prefer and what types of movements are more
natural for them. We also plan to make the solo interaction much
more complex
and extend the compositional options of the three users. We would
also like to explore other applications for this interactive
music technology in the realms of entertainment and music education.
click on the thumbnail below for a larger view (JPG: 640 x 480)
|
photo of a Gesture Pendant prototype
| 
]
[
