Jun Yin, Ankur Dhanik, David Hsu, and Ye Wang. 2004. The creation of a music-driven digital violinist. In Proceedings of the 12th annual ACM international conference on Multimedia (MULTIMEDIA '04). ACM, New York, NY, USA, 476-479. DOI=10.1145/1027527.1027642 http://doi.acm.org/10.1145/1027527.1027642 This paper describes an initial attempt on a music-driven digital violinist (MDV) system, which automatically generates animation of a violinist based on violin music. MDV first analyzes the input audio signal and transcribes it into music notes. Next it uses the notes to synthesize the animated video of a violinist. Tests on the prototype system show that it achieves adequate visual realism and near real-time performance.

Read more at http://dl.acm.org/citation.cfm?id=1027642