"David A. Shamma, Bryan Pardo, and Kristian J. Hammond. 2005. MusicStory: a personalized music video creator. In Proceedings of the 13th annual ACM international conference on Multimedia (MULTIMEDIA '05). ACM, New York, NY, USA, 563-566. DOI=10.1145/1101149.1101278 http://doi.acm.org/10.1145/1101149.1101278" In this paper, we describe MusicStory, a system that automatically creates videos to accompany music with lyrics. MusicStory uses common search engines, photo-sharing websites, and simple analysis of the dynamics and tempo of the music to create personalized photo-narratives. Video pacing and content is based on the content of the song and structure of the image repositories selected. The image associations MusicStory presents amplify the emotional experience by externalizing the imagery in song lyrics with the content found within a social network. The resulting work juxtaposes the meanings inherent in the social network with those in the song.

Read more at http://dl.acm.org/citation.cfm?id=1101278