university of southern california viterbi school of engineering
music computation and cognition lab/group
home :: research :: education :: events :: people :: publications
musa.rt :: esp :: mimi :: mir :: dip :: music•film•emotion



     



expression synthesis project
intro :: press :: demos :: publications

... more photos  

The Expression Synthesis Project (ESP) explores the use of a driving interface for expression synthesis, also known as performance rendering. ESP aims to provide a compelling metaphor for expressive performance so as to make high-level expressive decisions accessible to non-experts.

In ESP, the user drives a car on a virtual road that represents the music with its twists and turns; and makes decisions on how to traverse each part of the road. The driver's decisions affect in real-time the rendering of the piece. The pedals and wheel provide a tactile interface for controlling the car dynamics and musical expression, while the display portrays a first person view of the road and dashboard from the driver's seat.

This game-like interface allows non-experts to create expressive renderings of existing music without having to master an instrument, and allows expert musicians to experiment with expressive choice without having to first master the notes of the piece. The prototype system has been tested and refined in numerous demonstrations.

principal investigator: prof. elaine chew
faculty collaborator: prof. alex françois
graduate student: jie liu (phd candidate, 2003-2007)
undergraduate: aaron yang (ugrp, 2002-2003)


This material is based upon work supported by the National Science Foundation under Grant No. 0347988. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.


updated December 5, 2007.