Chaotic Music Generation System Using Music Conductor Gesture
Shuai Chen, Yoichiro Maeda, and Yasutake Takahashi
Department of Human and Artificial Intelligent Systems, Graduate School of Engineering, University of Fukui, 3-9-1 Bunkyo, Fukui 910-8507, Japan
In research on interactive music generation, we propose a music generation method in which the computer generates music under the recognition of a humanmusic conductor’s gestures. In this research, generated music is tuned by parameters of a network of chaotic elements which are determined by the recognized gesture in real time. The music conductor’s hand motions are detected by Microsoft Kinect in this system. Music theories are embedded in the algorithm and, as a result, generated music is richer. Furthermore, we constructed the music generation system and performed experiments for generating music composed by human beings.
-  A. Mulder and S. Fels, “Sound Sculpting: Manipulating Sound through Virtual Sculpting,” Western Computer Graphics Symposium, pp. 15-23, 1998.
-  H. S. Ip, H. Young, and C. C. Tang, “Body-Brush: A Bodydriven Interface for Visual Aesthetics,” ACM Int. Conf. onMultimedia 2002, pp. 664-665, 2002.
-  H. S. Ip, C. K. Law, and B. Kwong, “Cyber Composer: Hand Gesture-Driven Intelligent Music Composition and Generation,” Proc. of the 11th Int. Multimedia Modeling Conf. (MMM ’05), Vol.1550, pp. 5502-5505, 2005.
-  M. Yamamoto and Y. Maeda, “Interactive Kansei System for Sound Generation Based on Network of Chaotic Elements,” Proc. of the 4th Int. Symposium on Human and Artificial Intelligence Systems: From Control to Autonomy (HART 2004), pp. 315-320, 2004.
-  K. Kaneko, “Partition complexity in a network of chaotic elements,” J. of Physics A, pp. 2107-2119, 1991.
-  B. Benward and M. Saker, “Music: In Theory and Practice,” p. 213, 2008.
-  A. Blatter, “Revisiting music theory: a guide to the practice,” p. 28, 2007.